Nov 22 07:48:23 user nova-compute[74348]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74348) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74348) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74348) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 22 07:48:23 user nova-compute[74348]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:48:23 user nova-compute[74348]: INFO nova.virt.driver [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 22 07:48:23 user nova-compute[74348]: INFO nova.compute.provider_config [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] Acquiring lock "singleton_lock" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] Acquired lock "singleton_lock" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] Releasing lock "singleton_lock" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] Full set of CONF: {{(pid=74348) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] ******************************************************************************** {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] Configuration options gathered from: {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] ================================================================================ {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] allow_resize_to_same_host      = True {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] arq_binding_timeout            = 300 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] backdoor_port                  = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] backdoor_socket                = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] block_device_allocate_retries  = 300 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] block_device_allocate_retries_interval = 5 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cert                           = self.pem {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] compute_monitors               = [] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] config_dir                     = [] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] config_drive_format            = iso9660 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] config_source                  = [] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] console_host                   = user {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] control_exchange               = nova {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cpu_allocation_ratio           = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] daemon                         = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] debug                          = True {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] default_access_ip_network_name = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] default_availability_zone      = nova {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] default_ephemeral_format       = ext4 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] default_green_pool_size        = 1000 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] default_schedule_zone          = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] disk_allocation_ratio          = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] enable_new_services            = True {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] enabled_apis                   = ['osapi_compute'] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] enabled_ssl_apis               = [] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] flat_injected                  = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] force_config_drive             = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] force_raw_images               = True {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] graceful_shutdown_timeout      = 5 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] heal_instance_info_cache_interval = 60 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] host                           = user {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] instance_build_timeout         = 0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] instance_delete_interval       = 300 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] instance_format                = [instance: %(uuid)s]  {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] instance_name_template         = instance-%08x {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] instance_usage_audit           = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] instance_usage_audit_period    = month {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] internal_service_availability_zone = internal {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] key                            = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] live_migration_retry_count     = 30 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] log_config_append              = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] log_dir                        = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] log_file                       = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] log_options                    = True {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] log_rotate_interval            = 1 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] log_rotate_interval_type       = days {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] log_rotation_type              = none {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] long_rpc_timeout               = 1800 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] max_concurrent_builds          = 10 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] max_concurrent_live_migrations = 1 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] max_concurrent_snapshots       = 5 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] max_local_block_devices        = 3 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] max_logfile_count              = 30 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] max_logfile_size_mb            = 200 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] maximum_instance_delete_attempts = 5 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] metadata_listen                = 0.0.0.0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] metadata_listen_port           = 8775 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] metadata_workers               = 3 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] migrate_max_retries            = -1 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] mkisofs_cmd                    = genisoimage {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] my_ip                          = 10.0.0.210 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] network_allocate_retries       = 0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] osapi_compute_listen_port      = 8774 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] osapi_compute_unique_server_name_scope =  {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] osapi_compute_workers          = 3 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] password_length                = 12 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] periodic_enable                = True {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] periodic_fuzzy_delay           = 60 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] pointer_model                  = ps2mouse {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] preallocate_images             = none {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] publish_errors                 = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] pybasedir                      = /opt/stack/nova {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] ram_allocation_ratio           = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] rate_limit_burst               = 0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] rate_limit_except_level        = CRITICAL {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] rate_limit_interval            = 0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] reboot_timeout                 = 0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] reclaim_instance_interval      = 0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] record                         = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] reimage_timeout_per_gb         = 60 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] report_interval                = 120 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] rescue_timeout                 = 0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] reserved_host_cpus             = 0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] reserved_host_disk_mb          = 0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] reserved_host_memory_mb        = 512 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] reserved_huge_pages            = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] resize_confirm_window          = 0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] resize_fs_using_block_device   = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] resume_guests_state_on_host_boot = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] rpc_response_timeout           = 60 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] run_external_periodic_tasks    = True {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] running_deleted_instance_action = reap {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] running_deleted_instance_poll_interval = 1800 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] running_deleted_instance_timeout = 0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] scheduler_instance_sync_interval = 120 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] service_down_time              = 720 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] servicegroup_driver            = db {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] shelved_offload_time           = 0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] shelved_poll_interval          = 3600 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] shutdown_timeout               = 0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] source_is_ipv6                 = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] ssl_only                       = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] state_path                     = /opt/stack/data/nova {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] sync_power_state_interval      = 600 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] sync_power_state_pool_size     = 1000 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] syslog_log_facility            = LOG_USER {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] tempdir                        = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] timeout_nbd                    = 10 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] transport_url                  = **** {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] update_resources_interval      = 0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] use_cow_images                 = True {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] use_eventlog                   = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] use_journal                    = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] use_json                       = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] use_rootwrap_daemon            = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] use_stderr                     = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] use_syslog                     = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vcpu_pin_set                   = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vif_plugging_is_fatal          = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vif_plugging_timeout           = 0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] virt_mkfs                      = [] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] volume_usage_poll_interval     = 0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] watch_log_file                 = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] web                            = /usr/share/spice-html5 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_concurrency.disable_process_locking = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] api.auth_strategy              = keystone {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] api.compute_link_prefix        = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] api.dhcp_domain                = novalocal {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] api.enable_instance_password   = True {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] api.glance_link_prefix         = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] api.instance_list_per_project_cells = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] api.list_records_by_skipping_down_cells = True {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] api.local_metadata_per_cell    = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] api.max_limit                  = 1000 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] api.metadata_cache_expiration  = 15 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] api.neutron_default_tenant_id  = default {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] api.use_forwarded_for          = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] api.use_neutron_default_nets   = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] api.vendordata_dynamic_targets = [] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] api.vendordata_jsonfile_path   = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cache.backend                  = dogpile.cache.memcached {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cache.backend_argument         = **** {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cache.config_prefix            = cache.oslo {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cache.dead_timeout             = 60.0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cache.debug_cache_backend      = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cache.enable_retry_client      = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cache.enable_socket_keepalive  = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cache.enabled                  = True {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cache.expiration_time          = 600 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cache.hashclient_retry_attempts = 2 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cache.memcache_dead_retry      = 300 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cache.memcache_password        =  {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cache.memcache_pool_maxsize    = 10 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cache.memcache_sasl_enabled    = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cache.memcache_username        =  {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cache.proxies                  = [] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cache.retry_attempts           = 2 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cache.retry_delay              = 0.0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cache.socket_keepalive_count   = 1 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cache.socket_keepalive_idle    = 1 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cache.socket_keepalive_interval = 1 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cache.tls_allowed_ciphers      = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cache.tls_cafile               = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cache.tls_certfile             = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cache.tls_enabled              = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cache.tls_keyfile              = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cinder.auth_section            = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cinder.auth_type               = password {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cinder.cafile                  = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cinder.certfile                = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cinder.collect_timing          = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cinder.cross_az_attach         = True {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cinder.debug                   = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cinder.endpoint_template       = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cinder.http_retries            = 3 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cinder.insecure                = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cinder.keyfile                 = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cinder.os_region_name          = RegionOne {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cinder.split_loggers           = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cinder.timeout                 = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] compute.cpu_dedicated_set      = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] compute.cpu_shared_set         = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] compute.image_type_exclude_list = [] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] compute.max_concurrent_disk_ops = 0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] compute.max_disk_devices_to_attach = -1 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] compute.resource_provider_association_refresh = 300 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] compute.shutdown_retry_interval = 10 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] conductor.workers              = 3 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] console.allowed_origins        = [] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] console.ssl_ciphers            = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] console.ssl_minimum_version    = default {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] consoleauth.token_ttl          = 600 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cyborg.cafile                  = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cyborg.certfile                = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cyborg.collect_timing          = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cyborg.connect_retries         = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cyborg.connect_retry_delay     = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cyborg.endpoint_override       = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cyborg.insecure                = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cyborg.keyfile                 = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cyborg.max_version             = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cyborg.min_version             = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cyborg.region_name             = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cyborg.service_name            = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cyborg.service_type            = accelerator {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cyborg.split_loggers           = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cyborg.status_code_retries     = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cyborg.status_code_retry_delay = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cyborg.timeout                 = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] cyborg.version                 = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] database.backend               = sqlalchemy {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] database.connection            = **** {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] database.connection_debug      = 0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] database.connection_parameters =  {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] database.connection_recycle_time = 3600 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] database.connection_trace      = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] database.db_inc_retry_interval = True {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] database.db_max_retries        = 20 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] database.db_max_retry_interval = 10 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] database.db_retry_interval     = 1 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] database.max_overflow          = 50 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] database.max_pool_size         = 5 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] database.max_retries           = 10 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] database.mysql_wsrep_sync_wait = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] database.pool_timeout          = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] database.retry_interval        = 10 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] database.slave_connection      = **** {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] database.sqlite_synchronous    = True {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] api_database.backend           = sqlalchemy {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] api_database.connection        = **** {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] api_database.connection_debug  = 0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] api_database.connection_parameters =  {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] api_database.connection_recycle_time = 3600 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] api_database.connection_trace  = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] api_database.db_inc_retry_interval = True {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] api_database.db_max_retries    = 20 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] api_database.db_max_retry_interval = 10 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] api_database.db_retry_interval = 1 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] api_database.max_overflow      = 50 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] api_database.max_pool_size     = 5 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] api_database.max_retries       = 10 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] api_database.pool_timeout      = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] api_database.retry_interval    = 10 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] api_database.slave_connection  = **** {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] api_database.sqlite_synchronous = True {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] devices.enabled_mdev_types     = [] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] ephemeral_storage_encryption.enabled = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] glance.api_servers             = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] glance.cafile                  = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] glance.certfile                = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] glance.collect_timing          = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] glance.connect_retries         = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] glance.connect_retry_delay     = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] glance.debug                   = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] glance.default_trusted_certificate_ids = [] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] glance.enable_certificate_validation = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] glance.enable_rbd_download     = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] glance.endpoint_override       = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] glance.insecure                = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] glance.keyfile                 = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] glance.max_version             = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] glance.min_version             = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] glance.num_retries             = 3 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] glance.rbd_ceph_conf           =  {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] glance.rbd_connect_timeout     = 5 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] glance.rbd_pool                =  {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] glance.rbd_user                =  {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] glance.region_name             = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] glance.service_name            = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] glance.service_type            = image {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] glance.split_loggers           = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] glance.status_code_retries     = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] glance.status_code_retry_delay = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] glance.timeout                 = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] glance.verify_glance_signatures = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] glance.version                 = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] guestfs.debug                  = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] hyperv.config_drive_cdrom      = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] hyperv.config_drive_inject_password = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] hyperv.enable_instance_metrics_collection = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] hyperv.enable_remotefx         = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] hyperv.instances_path_share    =  {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] hyperv.iscsi_initiator_list    = [] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] hyperv.limit_cpu_features      = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] hyperv.power_state_check_timeframe = 60 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] hyperv.use_multipath_io        = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] hyperv.volume_attach_retry_count = 10 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] hyperv.vswitch_name            = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] mks.enabled                    = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] image_cache.manager_interval   = 2400 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] image_cache.precache_concurrency = 1 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] image_cache.remove_unused_base_images = True {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] image_cache.subdirectory_name  = _base {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] ironic.api_max_retries         = 60 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] ironic.api_retry_interval      = 2 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] ironic.auth_section            = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] ironic.auth_type               = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] ironic.cafile                  = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] ironic.certfile                = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] ironic.collect_timing          = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] ironic.conductor_group         = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] ironic.connect_retries         = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] ironic.connect_retry_delay     = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] ironic.endpoint_override       = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] ironic.insecure                = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] ironic.keyfile                 = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] ironic.max_version             = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] ironic.min_version             = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] ironic.peer_list               = [] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] ironic.region_name             = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] ironic.serial_console_state_timeout = 10 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] ironic.service_name            = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] ironic.service_type            = baremetal {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] ironic.split_loggers           = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] ironic.status_code_retries     = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] ironic.status_code_retry_delay = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] ironic.timeout                 = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] ironic.version                 = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] key_manager.fixed_key          = **** {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] barbican.barbican_api_version  = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] barbican.barbican_endpoint     = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] barbican.barbican_endpoint_type = public {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] barbican.barbican_region_name  = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] barbican.cafile                = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] barbican.certfile              = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] barbican.collect_timing        = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] barbican.insecure              = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] barbican.keyfile               = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] barbican.number_of_retries     = 60 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] barbican.retry_delay           = 1 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] barbican.send_service_user_token = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] barbican.split_loggers         = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] barbican.timeout               = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] barbican.verify_ssl            = True {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] barbican.verify_ssl_path       = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] barbican_service_user.auth_section = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] barbican_service_user.auth_type = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] barbican_service_user.cafile   = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] barbican_service_user.certfile = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] barbican_service_user.collect_timing = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] barbican_service_user.insecure = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] barbican_service_user.keyfile  = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] barbican_service_user.split_loggers = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] barbican_service_user.timeout  = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vault.approle_role_id          = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vault.approle_secret_id        = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vault.cafile                   = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vault.certfile                 = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vault.collect_timing           = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vault.insecure                 = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vault.keyfile                  = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vault.kv_mountpoint            = secret {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vault.kv_path                  = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vault.kv_version               = 2 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vault.namespace                = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vault.root_token_id            = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vault.split_loggers            = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vault.ssl_ca_crt_file          = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vault.timeout                  = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vault.use_ssl                  = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] keystone.auth_section          = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] keystone.auth_type             = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] keystone.cafile                = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] keystone.certfile              = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] keystone.collect_timing        = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] keystone.connect_retries       = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] keystone.connect_retry_delay   = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] keystone.endpoint_override     = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] keystone.insecure              = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] keystone.keyfile               = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] keystone.max_version           = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] keystone.min_version           = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] keystone.region_name           = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] keystone.service_name          = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] keystone.service_type          = identity {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] keystone.split_loggers         = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] keystone.status_code_retries   = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] keystone.status_code_retry_delay = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] keystone.timeout               = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] keystone.version               = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.connection_uri         =  {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.cpu_mode               = custom {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: WARNING oslo_config.cfg [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.cpu_power_governor_high = performance {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.cpu_power_governor_low = powersave {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.cpu_power_management   = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:23 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.device_detach_attempts = 8 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.device_detach_timeout  = 20 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.disk_cachemodes        = [] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.disk_prefix            = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.enabled_perf_events    = [] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.file_backed_memory     = 0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.gid_maps               = [] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.hw_disk_discard        = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.hw_machine_type        = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.images_rbd_glance_store_name =  {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.images_rbd_pool        = rbd {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.images_type            = default {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.images_volume_group    = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.inject_key             = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.inject_partition       = -2 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.inject_password        = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.iscsi_iface            = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.iser_use_multipath     = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.live_migration_bandwidth = 0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.live_migration_downtime = 500 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.live_migration_inbound_addr = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.live_migration_permit_post_copy = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.live_migration_scheme  = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.live_migration_timeout_action = abort {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.live_migration_tunnelled = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: WARNING oslo_config.cfg [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 22 07:48:24 user nova-compute[74348]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 22 07:48:24 user nova-compute[74348]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 22 07:48:24 user nova-compute[74348]: and ``live_migration_inbound_addr`` respectively.
Nov 22 07:48:24 user nova-compute[74348]: ).  Its value may be silently ignored in the future.
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.live_migration_with_native_tls = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.max_queues             = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.nfs_mount_options      = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.num_memory_encrypted_guests = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.num_pcie_ports         = 0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.pmem_namespaces        = [] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.quobyte_client_cfg     = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.rbd_secret_uuid        = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.rbd_user               = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.remote_filesystem_transport = ssh {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.rescue_image_id        = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.rescue_kernel_id       = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.rescue_ramdisk_id      = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.rx_queue_size          = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.smbfs_mount_options    =  {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.snapshot_compression   = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.snapshot_image_format  = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.sparse_logical_volumes = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.swtpm_enabled          = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.swtpm_group            = tss {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.swtpm_user             = tss {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.sysinfo_serial         = unique {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.tb_cache_size          = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.tx_queue_size          = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.uid_maps               = [] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.use_virtio_for_bridges = True {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.virt_type              = kvm {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.volume_clear           = zero {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.volume_clear_size      = 0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.volume_use_multipath   = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.vzstorage_cache_path   = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.vzstorage_mount_user   = stack {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] neutron.auth_section           = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] neutron.auth_type              = password {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] neutron.cafile                 = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] neutron.certfile               = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] neutron.collect_timing         = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] neutron.connect_retries        = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] neutron.connect_retry_delay    = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] neutron.default_floating_pool  = public {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] neutron.endpoint_override      = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] neutron.extension_sync_interval = 600 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] neutron.http_retries           = 3 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] neutron.insecure               = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] neutron.keyfile                = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] neutron.max_version            = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] neutron.min_version            = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] neutron.ovs_bridge             = br-int {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] neutron.physnets               = [] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] neutron.region_name            = RegionOne {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] neutron.service_metadata_proxy = True {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] neutron.service_name           = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] neutron.service_type           = network {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] neutron.split_loggers          = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] neutron.status_code_retries    = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] neutron.status_code_retry_delay = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] neutron.timeout                = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] neutron.version                = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] notifications.bdms_in_notifications = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] notifications.default_level    = INFO {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] notifications.notification_format = unversioned {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] notifications.notify_on_state_change = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] pci.alias                      = [] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] pci.device_spec                = [] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] pci.report_in_placement        = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] placement.auth_section         = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] placement.auth_type            = password {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] placement.cafile               = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] placement.certfile             = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] placement.collect_timing       = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] placement.connect_retries      = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] placement.connect_retry_delay  = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] placement.default_domain_id    = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] placement.default_domain_name  = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] placement.domain_id            = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] placement.domain_name          = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] placement.endpoint_override    = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] placement.insecure             = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] placement.keyfile              = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] placement.max_version          = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] placement.min_version          = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] placement.password             = **** {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] placement.project_domain_id    = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] placement.project_domain_name  = Default {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] placement.project_id           = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] placement.project_name         = service {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] placement.region_name          = RegionOne {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] placement.service_name         = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] placement.service_type         = placement {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] placement.split_loggers        = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] placement.status_code_retries  = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] placement.status_code_retry_delay = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] placement.system_scope         = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] placement.timeout              = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] placement.trust_id             = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] placement.user_domain_id       = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] placement.user_domain_name     = Default {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] placement.user_id              = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] placement.username             = placement {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] placement.version              = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] quota.cores                    = 20 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] quota.count_usage_from_placement = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] quota.injected_file_content_bytes = 10240 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] quota.injected_file_path_length = 255 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] quota.injected_files           = 5 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] quota.instances                = 10 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] quota.key_pairs                = 100 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] quota.metadata_items           = 128 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] quota.ram                      = 51200 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] quota.recheck_quota            = True {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] quota.server_group_members     = 10 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] quota.server_groups            = 10 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] rdp.enabled                    = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] scheduler.image_metadata_prefilter = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] scheduler.max_attempts         = 3 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] scheduler.max_placement_results = 1000 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] scheduler.query_placement_for_image_type_support = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] scheduler.workers              = 3 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] filter_scheduler.host_subset_size = 1 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] filter_scheduler.isolated_hosts = [] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] filter_scheduler.isolated_images = [] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] filter_scheduler.pci_in_placement = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] filter_scheduler.track_instance_changes = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] metrics.required               = True {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] metrics.weight_multiplier      = 1.0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] metrics.weight_setting         = [] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] serial_console.enabled         = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] serial_console.port_range      = 10000:20000 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] serial_console.serialproxy_port = 6083 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] service_user.auth_section      = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] service_user.auth_type         = password {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] service_user.cafile            = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] service_user.certfile          = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] service_user.collect_timing    = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] service_user.insecure          = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] service_user.keyfile           = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] service_user.send_service_user_token = True {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] service_user.split_loggers     = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] service_user.timeout           = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] spice.agent_enabled            = True {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] spice.enabled                  = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] spice.html5proxy_port          = 6082 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] spice.image_compression        = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] spice.jpeg_compression         = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] spice.playback_compression     = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] spice.server_listen            = 127.0.0.1 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] spice.streaming_mode           = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] spice.zlib_compression         = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] upgrade_levels.baseapi         = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] upgrade_levels.compute         = auto {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] upgrade_levels.conductor       = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] upgrade_levels.scheduler       = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vendordata_dynamic_auth.auth_section = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vendordata_dynamic_auth.auth_type = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vendordata_dynamic_auth.cafile = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vendordata_dynamic_auth.certfile = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vendordata_dynamic_auth.insecure = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vendordata_dynamic_auth.keyfile = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vendordata_dynamic_auth.timeout = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vmware.api_retry_count         = 10 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vmware.ca_file                 = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vmware.cache_prefix            = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vmware.cluster_name            = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vmware.connection_pool_size    = 10 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vmware.console_delay_seconds   = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vmware.datastore_regex         = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vmware.host_ip                 = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vmware.host_password           = **** {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vmware.host_port               = 443 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vmware.host_username           = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vmware.insecure                = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vmware.integration_bridge      = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vmware.maximum_objects         = 100 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vmware.pbm_default_policy      = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vmware.pbm_enabled             = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vmware.pbm_wsdl_location       = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vmware.serial_port_proxy_uri   = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vmware.serial_port_service_uri = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vmware.task_poll_interval      = 0.5 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vmware.use_linked_clone        = True {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vmware.vnc_keymap              = en-us {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vmware.vnc_port                = 5900 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vmware.vnc_port_total          = 10000 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vnc.auth_schemes               = ['none'] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vnc.enabled                    = True {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vnc.novncproxy_port            = 6080 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vnc.server_listen              = 0.0.0.0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vnc.vencrypt_ca_certs          = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vnc.vencrypt_client_cert       = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vnc.vencrypt_client_key        = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] workarounds.disable_rootwrap   = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] workarounds.enable_numa_live_migration = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] workarounds.libvirt_disable_apic = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] wsgi.client_socket_timeout     = 900 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] wsgi.default_pool_size         = 1000 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] wsgi.keep_alive                = True {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] wsgi.max_header_line           = 16384 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] wsgi.ssl_ca_file               = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] wsgi.ssl_cert_file             = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] wsgi.ssl_key_file              = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] wsgi.tcp_keepidle              = 600 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] zvm.ca_file                    = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] zvm.cloud_connector_url        = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] zvm.reachable_timeout          = 300 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_policy.enforce_new_defaults = True {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_policy.enforce_scope      = True {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_policy.policy_default_rule = default {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_policy.policy_file        = policy.yaml {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] profiler.connection_string     = messaging:// {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] profiler.enabled               = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] profiler.es_doc_type           = notification {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] profiler.es_scroll_size        = 10000 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] profiler.es_scroll_time        = 2m {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] profiler.filter_error_trace    = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] profiler.hmac_keys             = **** {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] profiler.sentinel_service_name = mymaster {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] profiler.socket_timeout        = 0.1 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] profiler.trace_requests        = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] profiler.trace_sqlalchemy      = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] profiler_jaeger.process_tags   = {} {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] profiler_jaeger.service_name_prefix = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] profiler_otlp.service_name_prefix = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] remote_debug.host              = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] remote_debug.port              = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_messaging_rabbit.ssl      = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_messaging_notifications.retry = -1 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_messaging_notifications.transport_url = **** {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_limit.auth_section        = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_limit.auth_type           = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_limit.cafile              = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_limit.certfile            = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_limit.collect_timing      = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_limit.connect_retries     = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_limit.connect_retry_delay = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_limit.endpoint_id         = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_limit.endpoint_override   = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_limit.insecure            = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_limit.keyfile             = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_limit.max_version         = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_limit.min_version         = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_limit.region_name         = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_limit.service_name        = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_limit.service_type        = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_limit.split_loggers       = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_limit.status_code_retries = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_limit.status_code_retry_delay = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_limit.timeout             = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_limit.valid_interfaces    = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_limit.version             = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_reports.file_event_handler = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] oslo_reports.log_dir           = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vif_plug_ovs_privileged.group  = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] vif_plug_ovs_privileged.user   = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] os_vif_linux_bridge.flat_interface = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] os_vif_ovs.isolate_vif         = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] os_vif_ovs.per_port_bridge     = False {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] os_brick.lock_path             = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] privsep_osbrick.capabilities   = [21] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] privsep_osbrick.group          = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] privsep_osbrick.helper_command = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] privsep_osbrick.user           = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] nova_sys_admin.group           = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] nova_sys_admin.helper_command  = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] nova_sys_admin.user            = None {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG oslo_service.service [None req-10c700d9-27e7-404a-b2c9-075d2f943a6e None None] ******************************************************************************** {{(pid=74348) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 22 07:48:24 user nova-compute[74348]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 22 07:48:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Connecting to libvirt: qemu:///system {{(pid=74348) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f2255232560> {{(pid=74348) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 22 07:48:24 user nova-compute[74348]: libvirt:  error : internal error: could not initialize domain event timer
Nov 22 07:48:24 user nova-compute[74348]: WARNING nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 22 07:48:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f2255232560> {{(pid=74348) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Starting native event thread {{(pid=74348) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Starting green dispatch thread {{(pid=74348) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 22 07:48:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Starting connection event dispatch thread {{(pid=74348) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 22 07:48:24 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Connection event '1' reason 'None'
Nov 22 07:48:24 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 22 07:48:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.mount [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Initialising _HostMountState generation 0 {{(pid=74348) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 22 07:48:31 user nova-compute[74348]: INFO nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Libvirt host capabilities <capabilities>
Nov 22 07:48:31 user nova-compute[74348]:   <host>
Nov 22 07:48:31 user nova-compute[74348]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 22 07:48:31 user nova-compute[74348]:     <cpu>
Nov 22 07:48:31 user nova-compute[74348]:       <arch>x86_64</arch>
Nov 22 07:48:31 user nova-compute[74348]:       <model>IvyBridge-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <vendor>Intel</vendor>
Nov 22 07:48:31 user nova-compute[74348]:       <microcode version='1070'/>
Nov 22 07:48:31 user nova-compute[74348]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 22 07:48:31 user nova-compute[74348]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature name='ss'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature name='vmx'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature name='pcid'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature name='osxsave'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature name='hypervisor'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature name='arat'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature name='tsc_adjust'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature name='md-clear'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature name='stibp'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature name='arch-capabilities'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature name='ssbd'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature name='invtsc'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature name='rsba'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature name='skip-l1dfl-vmentry'/>
Nov 22 07:48:31 user nova-compute[74348]:       <pages unit='KiB' size='4'/>
Nov 22 07:48:31 user nova-compute[74348]:       <pages unit='KiB' size='2048'/>
Nov 22 07:48:31 user nova-compute[74348]:     </cpu>
Nov 22 07:48:31 user nova-compute[74348]:     <power_management>
Nov 22 07:48:31 user nova-compute[74348]:       <suspend_mem/>
Nov 22 07:48:31 user nova-compute[74348]:       <suspend_disk/>
Nov 22 07:48:31 user nova-compute[74348]:       <suspend_hybrid/>
Nov 22 07:48:31 user nova-compute[74348]:     </power_management>
Nov 22 07:48:31 user nova-compute[74348]:     <iommu support='no'/>
Nov 22 07:48:31 user nova-compute[74348]:     <migration_features>
Nov 22 07:48:31 user nova-compute[74348]:       <live/>
Nov 22 07:48:31 user nova-compute[74348]:       <uri_transports>
Nov 22 07:48:31 user nova-compute[74348]:         <uri_transport>tcp</uri_transport>
Nov 22 07:48:31 user nova-compute[74348]:         <uri_transport>rdma</uri_transport>
Nov 22 07:48:31 user nova-compute[74348]:       </uri_transports>
Nov 22 07:48:31 user nova-compute[74348]:     </migration_features>
Nov 22 07:48:31 user nova-compute[74348]:     <topology>
Nov 22 07:48:31 user nova-compute[74348]:       <cells num='2'>
Nov 22 07:48:31 user nova-compute[74348]:         <cell id='0'>
Nov 22 07:48:31 user nova-compute[74348]:           <memory unit='KiB'>8189224</memory>
Nov 22 07:48:31 user nova-compute[74348]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 22 07:48:31 user nova-compute[74348]:           <pages unit='KiB' size='2048'>0</pages>
Nov 22 07:48:31 user nova-compute[74348]:           <distances>
Nov 22 07:48:31 user nova-compute[74348]:             <sibling id='0' value='10'/>
Nov 22 07:48:31 user nova-compute[74348]:             <sibling id='1' value='20'/>
Nov 22 07:48:31 user nova-compute[74348]:           </distances>
Nov 22 07:48:31 user nova-compute[74348]:           <cpus num='6'>
Nov 22 07:48:31 user nova-compute[74348]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 22 07:48:31 user nova-compute[74348]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 22 07:48:31 user nova-compute[74348]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 22 07:48:31 user nova-compute[74348]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 22 07:48:31 user nova-compute[74348]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 22 07:48:31 user nova-compute[74348]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 22 07:48:31 user nova-compute[74348]:           </cpus>
Nov 22 07:48:31 user nova-compute[74348]:         </cell>
Nov 22 07:48:31 user nova-compute[74348]:         <cell id='1'>
Nov 22 07:48:31 user nova-compute[74348]:           <memory unit='KiB'>8206460</memory>
Nov 22 07:48:31 user nova-compute[74348]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 22 07:48:31 user nova-compute[74348]:           <pages unit='KiB' size='2048'>0</pages>
Nov 22 07:48:31 user nova-compute[74348]:           <distances>
Nov 22 07:48:31 user nova-compute[74348]:             <sibling id='0' value='20'/>
Nov 22 07:48:31 user nova-compute[74348]:             <sibling id='1' value='10'/>
Nov 22 07:48:31 user nova-compute[74348]:           </distances>
Nov 22 07:48:31 user nova-compute[74348]:           <cpus num='6'>
Nov 22 07:48:31 user nova-compute[74348]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 22 07:48:31 user nova-compute[74348]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 22 07:48:31 user nova-compute[74348]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 22 07:48:31 user nova-compute[74348]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 22 07:48:31 user nova-compute[74348]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 22 07:48:31 user nova-compute[74348]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 22 07:48:31 user nova-compute[74348]:           </cpus>
Nov 22 07:48:31 user nova-compute[74348]:         </cell>
Nov 22 07:48:31 user nova-compute[74348]:       </cells>
Nov 22 07:48:31 user nova-compute[74348]:     </topology>
Nov 22 07:48:31 user nova-compute[74348]:     <cache>
Nov 22 07:48:31 user nova-compute[74348]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 22 07:48:31 user nova-compute[74348]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 22 07:48:31 user nova-compute[74348]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 22 07:48:31 user nova-compute[74348]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 22 07:48:31 user nova-compute[74348]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 22 07:48:31 user nova-compute[74348]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 22 07:48:31 user nova-compute[74348]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 22 07:48:31 user nova-compute[74348]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 22 07:48:31 user nova-compute[74348]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 22 07:48:31 user nova-compute[74348]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 22 07:48:31 user nova-compute[74348]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 22 07:48:31 user nova-compute[74348]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 22 07:48:31 user nova-compute[74348]:     </cache>
Nov 22 07:48:31 user nova-compute[74348]:     <secmodel>
Nov 22 07:48:31 user nova-compute[74348]:       <model>apparmor</model>
Nov 22 07:48:31 user nova-compute[74348]:       <doi>0</doi>
Nov 22 07:48:31 user nova-compute[74348]:     </secmodel>
Nov 22 07:48:31 user nova-compute[74348]:     <secmodel>
Nov 22 07:48:31 user nova-compute[74348]:       <model>dac</model>
Nov 22 07:48:31 user nova-compute[74348]:       <doi>0</doi>
Nov 22 07:48:31 user nova-compute[74348]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 22 07:48:31 user nova-compute[74348]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 22 07:48:31 user nova-compute[74348]:     </secmodel>
Nov 22 07:48:31 user nova-compute[74348]:   </host>
Nov 22 07:48:31 user nova-compute[74348]:   <guest>
Nov 22 07:48:31 user nova-compute[74348]:     <os_type>hvm</os_type>
Nov 22 07:48:31 user nova-compute[74348]:     <arch name='alpha'>
Nov 22 07:48:31 user nova-compute[74348]:       <wordsize>64</wordsize>
Nov 22 07:48:31 user nova-compute[74348]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='4'>clipper</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <domain type='qemu'/>
Nov 22 07:48:31 user nova-compute[74348]:     </arch>
Nov 22 07:48:31 user nova-compute[74348]:     <features>
Nov 22 07:48:31 user nova-compute[74348]:       <cpuselection/>
Nov 22 07:48:31 user nova-compute[74348]:       <deviceboot/>
Nov 22 07:48:31 user nova-compute[74348]:       <disksnapshot default='on' toggle='no'/>
Nov 22 07:48:31 user nova-compute[74348]:     </features>
Nov 22 07:48:31 user nova-compute[74348]:   </guest>
Nov 22 07:48:31 user nova-compute[74348]:   <guest>
Nov 22 07:48:31 user nova-compute[74348]:     <os_type>hvm</os_type>
Nov 22 07:48:31 user nova-compute[74348]:     <arch name='armv6l'>
Nov 22 07:48:31 user nova-compute[74348]:       <wordsize>32</wordsize>
Nov 22 07:48:31 user nova-compute[74348]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>integratorcp</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>borzoi</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>spitz</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2'>nuri</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2'>musca-b1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>versatileab</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>kzm</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2'>musca-a</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2'>smdkc210</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>sx1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>z2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>tosa</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='4'>sabrelite</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>realview-eb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>n810</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>n800</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>versatilepb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>terrier</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>mainstone</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='4'>midway</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>musicpal</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>microbit</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>cubieboard</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>verdex</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>netduino2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='4'>raspi2b</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>cheetah</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='4'>highbank</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>akita</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>connex</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>collie</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>raspi0</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <domain type='qemu'/>
Nov 22 07:48:31 user nova-compute[74348]:     </arch>
Nov 22 07:48:31 user nova-compute[74348]:     <features>
Nov 22 07:48:31 user nova-compute[74348]:       <cpuselection/>
Nov 22 07:48:31 user nova-compute[74348]:       <deviceboot/>
Nov 22 07:48:31 user nova-compute[74348]:       <disksnapshot default='on' toggle='no'/>
Nov 22 07:48:31 user nova-compute[74348]:     </features>
Nov 22 07:48:31 user nova-compute[74348]:   </guest>
Nov 22 07:48:31 user nova-compute[74348]:   <guest>
Nov 22 07:48:31 user nova-compute[74348]:     <os_type>hvm</os_type>
Nov 22 07:48:31 user nova-compute[74348]:     <arch name='armv7l'>
Nov 22 07:48:31 user nova-compute[74348]:       <wordsize>32</wordsize>
Nov 22 07:48:31 user nova-compute[74348]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>integratorcp</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>borzoi</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>spitz</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2'>nuri</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2'>musca-b1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>versatileab</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>kzm</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2'>musca-a</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2'>smdkc210</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>sx1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>z2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>tosa</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='4'>sabrelite</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>realview-eb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>n810</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>n800</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>versatilepb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>terrier</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>mainstone</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='4'>midway</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>musicpal</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>microbit</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>cubieboard</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>verdex</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>netduino2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='4'>raspi2b</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>cheetah</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='4'>highbank</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>akita</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>connex</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>collie</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>raspi0</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <domain type='qemu'/>
Nov 22 07:48:31 user nova-compute[74348]:     </arch>
Nov 22 07:48:31 user nova-compute[74348]:     <features>
Nov 22 07:48:31 user nova-compute[74348]:       <cpuselection/>
Nov 22 07:48:31 user nova-compute[74348]:       <deviceboot/>
Nov 22 07:48:31 user nova-compute[74348]:       <disksnapshot default='on' toggle='no'/>
Nov 22 07:48:31 user nova-compute[74348]:     </features>
Nov 22 07:48:31 user nova-compute[74348]:   </guest>
Nov 22 07:48:31 user nova-compute[74348]:   <guest>
Nov 22 07:48:31 user nova-compute[74348]:     <os_type>hvm</os_type>
Nov 22 07:48:31 user nova-compute[74348]:     <arch name='aarch64'>
Nov 22 07:48:31 user nova-compute[74348]:       <wordsize>64</wordsize>
Nov 22 07:48:31 user nova-compute[74348]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>integratorcp</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>borzoi</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>spitz</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2'>nuri</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2'>musca-b1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>versatileab</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>kzm</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2'>musca-a</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2'>smdkc210</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>sx1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>z2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>tosa</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='4'>sabrelite</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>realview-eb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>n810</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>n800</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>versatilepb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>terrier</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>mainstone</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='4'>midway</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>musicpal</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>microbit</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>cubieboard</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>verdex</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>netduino2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='4'>raspi3b</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='4'>raspi2b</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>cheetah</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='4'>highbank</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>akita</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>connex</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>collie</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>raspi0</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <domain type='qemu'/>
Nov 22 07:48:31 user nova-compute[74348]:     </arch>
Nov 22 07:48:31 user nova-compute[74348]:     <features>
Nov 22 07:48:31 user nova-compute[74348]:       <acpi default='on' toggle='yes'/>
Nov 22 07:48:31 user nova-compute[74348]:       <cpuselection/>
Nov 22 07:48:31 user nova-compute[74348]:       <deviceboot/>
Nov 22 07:48:31 user nova-compute[74348]:       <disksnapshot default='on' toggle='no'/>
Nov 22 07:48:31 user nova-compute[74348]:     </features>
Nov 22 07:48:31 user nova-compute[74348]:   </guest>
Nov 22 07:48:31 user nova-compute[74348]:   <guest>
Nov 22 07:48:31 user nova-compute[74348]:     <os_type>hvm</os_type>
Nov 22 07:48:31 user nova-compute[74348]:     <arch name='cris'>
Nov 22 07:48:31 user nova-compute[74348]:       <wordsize>32</wordsize>
Nov 22 07:48:31 user nova-compute[74348]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <domain type='qemu'/>
Nov 22 07:48:31 user nova-compute[74348]:     </arch>
Nov 22 07:48:31 user nova-compute[74348]:     <features>
Nov 22 07:48:31 user nova-compute[74348]:       <cpuselection/>
Nov 22 07:48:31 user nova-compute[74348]:       <deviceboot/>
Nov 22 07:48:31 user nova-compute[74348]:       <disksnapshot default='on' toggle='no'/>
Nov 22 07:48:31 user nova-compute[74348]:     </features>
Nov 22 07:48:31 user nova-compute[74348]:   </guest>
Nov 22 07:48:31 user nova-compute[74348]:   <guest>
Nov 22 07:48:31 user nova-compute[74348]:     <os_type>hvm</os_type>
Nov 22 07:48:31 user nova-compute[74348]:     <arch name='i686'>
Nov 22 07:48:31 user nova-compute[74348]:       <wordsize>32</wordsize>
Nov 22 07:48:31 user nova-compute[74348]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>x-remote</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>isapc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>microvm</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <domain type='qemu'/>
Nov 22 07:48:31 user nova-compute[74348]:       <domain type='kvm'/>
Nov 22 07:48:31 user nova-compute[74348]:     </arch>
Nov 22 07:48:31 user nova-compute[74348]:     <features>
Nov 22 07:48:31 user nova-compute[74348]:       <pae/>
Nov 22 07:48:31 user nova-compute[74348]:       <nonpae/>
Nov 22 07:48:31 user nova-compute[74348]:       <acpi default='on' toggle='yes'/>
Nov 22 07:48:31 user nova-compute[74348]:       <apic default='on' toggle='no'/>
Nov 22 07:48:31 user nova-compute[74348]:       <cpuselection/>
Nov 22 07:48:31 user nova-compute[74348]:       <deviceboot/>
Nov 22 07:48:31 user nova-compute[74348]:       <disksnapshot default='on' toggle='no'/>
Nov 22 07:48:31 user nova-compute[74348]:     </features>
Nov 22 07:48:31 user nova-compute[74348]:   </guest>
Nov 22 07:48:31 user nova-compute[74348]:   <guest>
Nov 22 07:48:31 user nova-compute[74348]:     <os_type>hvm</os_type>
Nov 22 07:48:31 user nova-compute[74348]:     <arch name='m68k'>
Nov 22 07:48:31 user nova-compute[74348]:       <wordsize>32</wordsize>
Nov 22 07:48:31 user nova-compute[74348]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>an5206</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>q800</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>next-cube</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <domain type='qemu'/>
Nov 22 07:48:31 user nova-compute[74348]:     </arch>
Nov 22 07:48:31 user nova-compute[74348]:     <features>
Nov 22 07:48:31 user nova-compute[74348]:       <cpuselection/>
Nov 22 07:48:31 user nova-compute[74348]:       <deviceboot/>
Nov 22 07:48:31 user nova-compute[74348]:       <disksnapshot default='on' toggle='no'/>
Nov 22 07:48:31 user nova-compute[74348]:     </features>
Nov 22 07:48:31 user nova-compute[74348]:   </guest>
Nov 22 07:48:31 user nova-compute[74348]:   <guest>
Nov 22 07:48:31 user nova-compute[74348]:     <os_type>hvm</os_type>
Nov 22 07:48:31 user nova-compute[74348]:     <arch name='microblaze'>
Nov 22 07:48:31 user nova-compute[74348]:       <wordsize>32</wordsize>
Nov 22 07:48:31 user nova-compute[74348]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <domain type='qemu'/>
Nov 22 07:48:31 user nova-compute[74348]:     </arch>
Nov 22 07:48:31 user nova-compute[74348]:     <features>
Nov 22 07:48:31 user nova-compute[74348]:       <cpuselection/>
Nov 22 07:48:31 user nova-compute[74348]:       <deviceboot/>
Nov 22 07:48:31 user nova-compute[74348]:       <disksnapshot default='on' toggle='no'/>
Nov 22 07:48:31 user nova-compute[74348]:     </features>
Nov 22 07:48:31 user nova-compute[74348]:   </guest>
Nov 22 07:48:31 user nova-compute[74348]:   <guest>
Nov 22 07:48:31 user nova-compute[74348]:     <os_type>hvm</os_type>
Nov 22 07:48:31 user nova-compute[74348]:     <arch name='microblazeel'>
Nov 22 07:48:31 user nova-compute[74348]:       <wordsize>32</wordsize>
Nov 22 07:48:31 user nova-compute[74348]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <domain type='qemu'/>
Nov 22 07:48:31 user nova-compute[74348]:     </arch>
Nov 22 07:48:31 user nova-compute[74348]:     <features>
Nov 22 07:48:31 user nova-compute[74348]:       <cpuselection/>
Nov 22 07:48:31 user nova-compute[74348]:       <deviceboot/>
Nov 22 07:48:31 user nova-compute[74348]:       <disksnapshot default='on' toggle='no'/>
Nov 22 07:48:31 user nova-compute[74348]:     </features>
Nov 22 07:48:31 user nova-compute[74348]:   </guest>
Nov 22 07:48:31 user nova-compute[74348]:   <guest>
Nov 22 07:48:31 user nova-compute[74348]:     <os_type>hvm</os_type>
Nov 22 07:48:31 user nova-compute[74348]:     <arch name='mips'>
Nov 22 07:48:31 user nova-compute[74348]:       <wordsize>32</wordsize>
Nov 22 07:48:31 user nova-compute[74348]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='16'>malta</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>mipssim</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <domain type='qemu'/>
Nov 22 07:48:31 user nova-compute[74348]:     </arch>
Nov 22 07:48:31 user nova-compute[74348]:     <features>
Nov 22 07:48:31 user nova-compute[74348]:       <cpuselection/>
Nov 22 07:48:31 user nova-compute[74348]:       <deviceboot/>
Nov 22 07:48:31 user nova-compute[74348]:       <disksnapshot default='on' toggle='no'/>
Nov 22 07:48:31 user nova-compute[74348]:     </features>
Nov 22 07:48:31 user nova-compute[74348]:   </guest>
Nov 22 07:48:31 user nova-compute[74348]:   <guest>
Nov 22 07:48:31 user nova-compute[74348]:     <os_type>hvm</os_type>
Nov 22 07:48:31 user nova-compute[74348]:     <arch name='mipsel'>
Nov 22 07:48:31 user nova-compute[74348]:       <wordsize>32</wordsize>
Nov 22 07:48:31 user nova-compute[74348]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='16'>malta</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>mipssim</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <domain type='qemu'/>
Nov 22 07:48:31 user nova-compute[74348]:     </arch>
Nov 22 07:48:31 user nova-compute[74348]:     <features>
Nov 22 07:48:31 user nova-compute[74348]:       <cpuselection/>
Nov 22 07:48:31 user nova-compute[74348]:       <deviceboot/>
Nov 22 07:48:31 user nova-compute[74348]:       <disksnapshot default='on' toggle='no'/>
Nov 22 07:48:31 user nova-compute[74348]:     </features>
Nov 22 07:48:31 user nova-compute[74348]:   </guest>
Nov 22 07:48:31 user nova-compute[74348]:   <guest>
Nov 22 07:48:31 user nova-compute[74348]:     <os_type>hvm</os_type>
Nov 22 07:48:31 user nova-compute[74348]:     <arch name='mips64'>
Nov 22 07:48:31 user nova-compute[74348]:       <wordsize>64</wordsize>
Nov 22 07:48:31 user nova-compute[74348]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='16'>malta</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>mipssim</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>pica61</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>magnum</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <domain type='qemu'/>
Nov 22 07:48:31 user nova-compute[74348]:     </arch>
Nov 22 07:48:31 user nova-compute[74348]:     <features>
Nov 22 07:48:31 user nova-compute[74348]:       <cpuselection/>
Nov 22 07:48:31 user nova-compute[74348]:       <deviceboot/>
Nov 22 07:48:31 user nova-compute[74348]:       <disksnapshot default='on' toggle='no'/>
Nov 22 07:48:31 user nova-compute[74348]:     </features>
Nov 22 07:48:31 user nova-compute[74348]:   </guest>
Nov 22 07:48:31 user nova-compute[74348]:   <guest>
Nov 22 07:48:31 user nova-compute[74348]:     <os_type>hvm</os_type>
Nov 22 07:48:31 user nova-compute[74348]:     <arch name='mips64el'>
Nov 22 07:48:31 user nova-compute[74348]:       <wordsize>64</wordsize>
Nov 22 07:48:31 user nova-compute[74348]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='16'>malta</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>mipssim</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>pica61</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>magnum</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='16'>boston</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <domain type='qemu'/>
Nov 22 07:48:31 user nova-compute[74348]:     </arch>
Nov 22 07:48:31 user nova-compute[74348]:     <features>
Nov 22 07:48:31 user nova-compute[74348]:       <cpuselection/>
Nov 22 07:48:31 user nova-compute[74348]:       <deviceboot/>
Nov 22 07:48:31 user nova-compute[74348]:       <disksnapshot default='on' toggle='no'/>
Nov 22 07:48:31 user nova-compute[74348]:     </features>
Nov 22 07:48:31 user nova-compute[74348]:   </guest>
Nov 22 07:48:31 user nova-compute[74348]:   <guest>
Nov 22 07:48:31 user nova-compute[74348]:     <os_type>hvm</os_type>
Nov 22 07:48:31 user nova-compute[74348]:     <arch name='ppc'>
Nov 22 07:48:31 user nova-compute[74348]:       <wordsize>32</wordsize>
Nov 22 07:48:31 user nova-compute[74348]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>g3beige</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>mac99</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='32'>ppce500</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>pegasos2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>sam460ex</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>bamboo</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>40p</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>ref405ep</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>taihu</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <domain type='qemu'/>
Nov 22 07:48:31 user nova-compute[74348]:     </arch>
Nov 22 07:48:31 user nova-compute[74348]:     <features>
Nov 22 07:48:31 user nova-compute[74348]:       <cpuselection/>
Nov 22 07:48:31 user nova-compute[74348]:       <deviceboot/>
Nov 22 07:48:31 user nova-compute[74348]:       <disksnapshot default='on' toggle='no'/>
Nov 22 07:48:31 user nova-compute[74348]:     </features>
Nov 22 07:48:31 user nova-compute[74348]:   </guest>
Nov 22 07:48:31 user nova-compute[74348]:   <guest>
Nov 22 07:48:31 user nova-compute[74348]:     <os_type>hvm</os_type>
Nov 22 07:48:31 user nova-compute[74348]:     <arch name='ppc64'>
Nov 22 07:48:31 user nova-compute[74348]:       <wordsize>64</wordsize>
Nov 22 07:48:31 user nova-compute[74348]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2048'>powernv9</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>taihu</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2048'>powernv10</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='32'>ppce500</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>40p</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>pegasos2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>bamboo</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>g3beige</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>mac99</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>sam460ex</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>ref405ep</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2048'>powernv8</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <domain type='qemu'/>
Nov 22 07:48:31 user nova-compute[74348]:     </arch>
Nov 22 07:48:31 user nova-compute[74348]:     <features>
Nov 22 07:48:31 user nova-compute[74348]:       <cpuselection/>
Nov 22 07:48:31 user nova-compute[74348]:       <deviceboot/>
Nov 22 07:48:31 user nova-compute[74348]:       <disksnapshot default='on' toggle='no'/>
Nov 22 07:48:31 user nova-compute[74348]:     </features>
Nov 22 07:48:31 user nova-compute[74348]:   </guest>
Nov 22 07:48:31 user nova-compute[74348]:   <guest>
Nov 22 07:48:31 user nova-compute[74348]:     <os_type>hvm</os_type>
Nov 22 07:48:31 user nova-compute[74348]:     <arch name='ppc64le'>
Nov 22 07:48:31 user nova-compute[74348]:       <wordsize>64</wordsize>
Nov 22 07:48:31 user nova-compute[74348]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2048'>powernv9</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>taihu</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2048'>powernv10</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='32'>ppce500</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>40p</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>pegasos2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>bamboo</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>g3beige</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>mac99</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>sam460ex</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>ref405ep</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2048'>powernv8</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <domain type='qemu'/>
Nov 22 07:48:31 user nova-compute[74348]:     </arch>
Nov 22 07:48:31 user nova-compute[74348]:     <features>
Nov 22 07:48:31 user nova-compute[74348]:       <cpuselection/>
Nov 22 07:48:31 user nova-compute[74348]:       <deviceboot/>
Nov 22 07:48:31 user nova-compute[74348]:       <disksnapshot default='on' toggle='no'/>
Nov 22 07:48:31 user nova-compute[74348]:     </features>
Nov 22 07:48:31 user nova-compute[74348]:   </guest>
Nov 22 07:48:31 user nova-compute[74348]:   <guest>
Nov 22 07:48:31 user nova-compute[74348]:     <os_type>hvm</os_type>
Nov 22 07:48:31 user nova-compute[74348]:     <arch name='riscv32'>
Nov 22 07:48:31 user nova-compute[74348]:       <wordsize>32</wordsize>
Nov 22 07:48:31 user nova-compute[74348]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='8'>spike</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>opentitan</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='5'>sifive_u</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>sifive_e</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='8'>virt</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <domain type='qemu'/>
Nov 22 07:48:31 user nova-compute[74348]:     </arch>
Nov 22 07:48:31 user nova-compute[74348]:     <features>
Nov 22 07:48:31 user nova-compute[74348]:       <cpuselection/>
Nov 22 07:48:31 user nova-compute[74348]:       <deviceboot/>
Nov 22 07:48:31 user nova-compute[74348]:       <disksnapshot default='on' toggle='no'/>
Nov 22 07:48:31 user nova-compute[74348]:     </features>
Nov 22 07:48:31 user nova-compute[74348]:   </guest>
Nov 22 07:48:31 user nova-compute[74348]:   <guest>
Nov 22 07:48:31 user nova-compute[74348]:     <os_type>hvm</os_type>
Nov 22 07:48:31 user nova-compute[74348]:     <arch name='riscv64'>
Nov 22 07:48:31 user nova-compute[74348]:       <wordsize>64</wordsize>
Nov 22 07:48:31 user nova-compute[74348]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='8'>spike</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='5'>sifive_u</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>shakti_c</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>sifive_e</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='8'>virt</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <domain type='qemu'/>
Nov 22 07:48:31 user nova-compute[74348]:     </arch>
Nov 22 07:48:31 user nova-compute[74348]:     <features>
Nov 22 07:48:31 user nova-compute[74348]:       <cpuselection/>
Nov 22 07:48:31 user nova-compute[74348]:       <deviceboot/>
Nov 22 07:48:31 user nova-compute[74348]:       <disksnapshot default='on' toggle='no'/>
Nov 22 07:48:31 user nova-compute[74348]:     </features>
Nov 22 07:48:31 user nova-compute[74348]:   </guest>
Nov 22 07:48:31 user nova-compute[74348]:   <guest>
Nov 22 07:48:31 user nova-compute[74348]:     <os_type>hvm</os_type>
Nov 22 07:48:31 user nova-compute[74348]:     <arch name='s390x'>
Nov 22 07:48:31 user nova-compute[74348]:       <wordsize>64</wordsize>
Nov 22 07:48:31 user nova-compute[74348]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <domain type='qemu'/>
Nov 22 07:48:31 user nova-compute[74348]:     </arch>
Nov 22 07:48:31 user nova-compute[74348]:     <features>
Nov 22 07:48:31 user nova-compute[74348]:       <cpuselection/>
Nov 22 07:48:31 user nova-compute[74348]:       <deviceboot/>
Nov 22 07:48:31 user nova-compute[74348]:       <disksnapshot default='on' toggle='no'/>
Nov 22 07:48:31 user nova-compute[74348]:     </features>
Nov 22 07:48:31 user nova-compute[74348]:   </guest>
Nov 22 07:48:31 user nova-compute[74348]:   <guest>
Nov 22 07:48:31 user nova-compute[74348]:     <os_type>hvm</os_type>
Nov 22 07:48:31 user nova-compute[74348]:     <arch name='sh4'>
Nov 22 07:48:31 user nova-compute[74348]:       <wordsize>32</wordsize>
Nov 22 07:48:31 user nova-compute[74348]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>shix</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>r2d</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <domain type='qemu'/>
Nov 22 07:48:31 user nova-compute[74348]:     </arch>
Nov 22 07:48:31 user nova-compute[74348]:     <features>
Nov 22 07:48:31 user nova-compute[74348]:       <cpuselection/>
Nov 22 07:48:31 user nova-compute[74348]:       <deviceboot/>
Nov 22 07:48:31 user nova-compute[74348]:       <disksnapshot default='on' toggle='no'/>
Nov 22 07:48:31 user nova-compute[74348]:     </features>
Nov 22 07:48:31 user nova-compute[74348]:   </guest>
Nov 22 07:48:31 user nova-compute[74348]:   <guest>
Nov 22 07:48:31 user nova-compute[74348]:     <os_type>hvm</os_type>
Nov 22 07:48:31 user nova-compute[74348]:     <arch name='sh4eb'>
Nov 22 07:48:31 user nova-compute[74348]:       <wordsize>64</wordsize>
Nov 22 07:48:31 user nova-compute[74348]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>shix</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>r2d</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <domain type='qemu'/>
Nov 22 07:48:31 user nova-compute[74348]:     </arch>
Nov 22 07:48:31 user nova-compute[74348]:     <features>
Nov 22 07:48:31 user nova-compute[74348]:       <cpuselection/>
Nov 22 07:48:31 user nova-compute[74348]:       <deviceboot/>
Nov 22 07:48:31 user nova-compute[74348]:       <disksnapshot default='on' toggle='no'/>
Nov 22 07:48:31 user nova-compute[74348]:     </features>
Nov 22 07:48:31 user nova-compute[74348]:   </guest>
Nov 22 07:48:31 user nova-compute[74348]:   <guest>
Nov 22 07:48:31 user nova-compute[74348]:     <os_type>hvm</os_type>
Nov 22 07:48:31 user nova-compute[74348]:     <arch name='sparc'>
Nov 22 07:48:31 user nova-compute[74348]:       <wordsize>32</wordsize>
Nov 22 07:48:31 user nova-compute[74348]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>SS-5</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='4'>SS-20</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>LX</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>SS-4</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='4'>SS-10</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>Voyager</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <domain type='qemu'/>
Nov 22 07:48:31 user nova-compute[74348]:     </arch>
Nov 22 07:48:31 user nova-compute[74348]:     <features>
Nov 22 07:48:31 user nova-compute[74348]:       <cpuselection/>
Nov 22 07:48:31 user nova-compute[74348]:       <deviceboot/>
Nov 22 07:48:31 user nova-compute[74348]:       <disksnapshot default='on' toggle='no'/>
Nov 22 07:48:31 user nova-compute[74348]:     </features>
Nov 22 07:48:31 user nova-compute[74348]:   </guest>
Nov 22 07:48:31 user nova-compute[74348]:   <guest>
Nov 22 07:48:31 user nova-compute[74348]:     <os_type>hvm</os_type>
Nov 22 07:48:31 user nova-compute[74348]:     <arch name='sparc64'>
Nov 22 07:48:31 user nova-compute[74348]:       <wordsize>64</wordsize>
Nov 22 07:48:31 user nova-compute[74348]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>sun4u</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>niagara</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>sun4v</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <domain type='qemu'/>
Nov 22 07:48:31 user nova-compute[74348]:     </arch>
Nov 22 07:48:31 user nova-compute[74348]:     <features>
Nov 22 07:48:31 user nova-compute[74348]:       <cpuselection/>
Nov 22 07:48:31 user nova-compute[74348]:       <deviceboot/>
Nov 22 07:48:31 user nova-compute[74348]:       <disksnapshot default='on' toggle='no'/>
Nov 22 07:48:31 user nova-compute[74348]:     </features>
Nov 22 07:48:31 user nova-compute[74348]:   </guest>
Nov 22 07:48:31 user nova-compute[74348]:   <guest>
Nov 22 07:48:31 user nova-compute[74348]:     <os_type>hvm</os_type>
Nov 22 07:48:31 user nova-compute[74348]:     <arch name='x86_64'>
Nov 22 07:48:31 user nova-compute[74348]:       <wordsize>64</wordsize>
Nov 22 07:48:31 user nova-compute[74348]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>x-remote</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='1'>isapc</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>microvm</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <domain type='qemu'/>
Nov 22 07:48:31 user nova-compute[74348]:       <domain type='kvm'/>
Nov 22 07:48:31 user nova-compute[74348]:     </arch>
Nov 22 07:48:31 user nova-compute[74348]:     <features>
Nov 22 07:48:31 user nova-compute[74348]:       <acpi default='on' toggle='yes'/>
Nov 22 07:48:31 user nova-compute[74348]:       <apic default='on' toggle='no'/>
Nov 22 07:48:31 user nova-compute[74348]:       <cpuselection/>
Nov 22 07:48:31 user nova-compute[74348]:       <deviceboot/>
Nov 22 07:48:31 user nova-compute[74348]:       <disksnapshot default='on' toggle='no'/>
Nov 22 07:48:31 user nova-compute[74348]:     </features>
Nov 22 07:48:31 user nova-compute[74348]:   </guest>
Nov 22 07:48:31 user nova-compute[74348]:   <guest>
Nov 22 07:48:31 user nova-compute[74348]:     <os_type>hvm</os_type>
Nov 22 07:48:31 user nova-compute[74348]:     <arch name='xtensa'>
Nov 22 07:48:31 user nova-compute[74348]:       <wordsize>32</wordsize>
Nov 22 07:48:31 user nova-compute[74348]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='4'>sim</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='32'>kc705</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='32'>ml605</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='32'>virt</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='32'>lx200</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='32'>lx60</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <domain type='qemu'/>
Nov 22 07:48:31 user nova-compute[74348]:     </arch>
Nov 22 07:48:31 user nova-compute[74348]:     <features>
Nov 22 07:48:31 user nova-compute[74348]:       <cpuselection/>
Nov 22 07:48:31 user nova-compute[74348]:       <deviceboot/>
Nov 22 07:48:31 user nova-compute[74348]:       <disksnapshot default='on' toggle='no'/>
Nov 22 07:48:31 user nova-compute[74348]:     </features>
Nov 22 07:48:31 user nova-compute[74348]:   </guest>
Nov 22 07:48:31 user nova-compute[74348]:   <guest>
Nov 22 07:48:31 user nova-compute[74348]:     <os_type>hvm</os_type>
Nov 22 07:48:31 user nova-compute[74348]:     <arch name='xtensaeb'>
Nov 22 07:48:31 user nova-compute[74348]:       <wordsize>32</wordsize>
Nov 22 07:48:31 user nova-compute[74348]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='4'>sim</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='32'>kc705</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='32'>ml605</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='32'>virt</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='32'>lx200</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='32'>lx60</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 22 07:48:31 user nova-compute[74348]:       <domain type='qemu'/>
Nov 22 07:48:31 user nova-compute[74348]:     </arch>
Nov 22 07:48:31 user nova-compute[74348]:     <features>
Nov 22 07:48:31 user nova-compute[74348]:       <cpuselection/>
Nov 22 07:48:31 user nova-compute[74348]:       <deviceboot/>
Nov 22 07:48:31 user nova-compute[74348]:       <disksnapshot default='on' toggle='no'/>
Nov 22 07:48:31 user nova-compute[74348]:     </features>
Nov 22 07:48:31 user nova-compute[74348]:   </guest>
Nov 22 07:48:31 user nova-compute[74348]: </capabilities>
Nov 22 07:48:31 user nova-compute[74348]: 
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74348) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74348) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74348) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74348) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74348) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74348) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74348) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74348) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74348) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74348) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74348) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu', 'pc', 'ubuntu-q35'} {{(pid=74348) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 22 07:48:31 user nova-compute[74348]: <domainCapabilities>
Nov 22 07:48:31 user nova-compute[74348]:   <path>/usr/bin/qemu-system-i386</path>
Nov 22 07:48:31 user nova-compute[74348]:   <domain>kvm</domain>
Nov 22 07:48:31 user nova-compute[74348]:   <machine>pc-q35-6.2</machine>
Nov 22 07:48:31 user nova-compute[74348]:   <arch>i686</arch>
Nov 22 07:48:31 user nova-compute[74348]:   <vcpu max='288'/>
Nov 22 07:48:31 user nova-compute[74348]:   <iothreads supported='yes'/>
Nov 22 07:48:31 user nova-compute[74348]:   <os supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:     <enum name='firmware'/>
Nov 22 07:48:31 user nova-compute[74348]:     <loader supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 22 07:48:31 user nova-compute[74348]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 22 07:48:31 user nova-compute[74348]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 22 07:48:31 user nova-compute[74348]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 22 07:48:31 user nova-compute[74348]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='type'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>rom</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>pflash</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='readonly'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>yes</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>no</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='secure'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>no</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </loader>
Nov 22 07:48:31 user nova-compute[74348]:   </os>
Nov 22 07:48:31 user nova-compute[74348]:   <cpu>
Nov 22 07:48:31 user nova-compute[74348]:     <mode name='host-passthrough' supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='hostPassthroughMigratable'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>off</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </mode>
Nov 22 07:48:31 user nova-compute[74348]:     <mode name='maximum' supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='maximumMigratable'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>on</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>off</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </mode>
Nov 22 07:48:31 user nova-compute[74348]:     <mode name='host-model' supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <vendor>Intel</vendor>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='ss'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='vmx'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='pcid'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='hypervisor'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='arat'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='tsc_adjust'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='umip'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='md-clear'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='stibp'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='arch-capabilities'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='ssbd'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='ibpb'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='ibrs'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='amd-stibp'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='amd-ssbd'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='disable' name='erms'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='disable' name='xsaveopt'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='disable' name='lm'/>
Nov 22 07:48:31 user nova-compute[74348]:     </mode>
Nov 22 07:48:31 user nova-compute[74348]:     <mode name='custom' supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>qemu64</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>qemu32</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>phenom</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>pentium3</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>pentium2</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>pentium</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>n270</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>kvm64</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>kvm32</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>coreduo</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>core2duo</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>athlon</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Westmere-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Westmere</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Snowridge</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Server</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Client</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>SandyBridge</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Penryn</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Opteron_G5</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Opteron_G4</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Opteron_G3</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Opteron_G2</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Opteron_G1</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Nehalem-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Nehalem</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>IvyBridge</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Icelake-Server</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Haswell-noTSX</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Haswell-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Haswell</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>EPYC-Rome</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>EPYC-Milan</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>EPYC-IBPB</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>EPYC</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Dhyana</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Cooperlake</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Conroe</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Cascadelake-Server</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Broadwell-noTSX</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Broadwell-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Broadwell</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>486</model>
Nov 22 07:48:31 user nova-compute[74348]:     </mode>
Nov 22 07:48:31 user nova-compute[74348]:   </cpu>
Nov 22 07:48:31 user nova-compute[74348]:   <memoryBacking supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:     <enum name='sourceType'>
Nov 22 07:48:31 user nova-compute[74348]:       <value>file</value>
Nov 22 07:48:31 user nova-compute[74348]:       <value>anonymous</value>
Nov 22 07:48:31 user nova-compute[74348]:       <value>memfd</value>
Nov 22 07:48:31 user nova-compute[74348]:     </enum>
Nov 22 07:48:31 user nova-compute[74348]:   </memoryBacking>
Nov 22 07:48:31 user nova-compute[74348]:   <devices>
Nov 22 07:48:31 user nova-compute[74348]:     <disk supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='diskDevice'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>disk</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>cdrom</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>floppy</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>lun</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='bus'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>fdc</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>scsi</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>usb</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>sata</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='model'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio-transitional</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio-non-transitional</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </disk>
Nov 22 07:48:31 user nova-compute[74348]:     <graphics supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='type'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>sdl</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>vnc</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>spice</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>egl-headless</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </graphics>
Nov 22 07:48:31 user nova-compute[74348]:     <video supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='modelType'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>vga</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>cirrus</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>vmvga</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>qxl</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>none</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>bochs</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>ramfb</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </video>
Nov 22 07:48:31 user nova-compute[74348]:     <hostdev supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='mode'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>subsystem</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='startupPolicy'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>default</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>mandatory</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>requisite</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>optional</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='subsysType'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>usb</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>pci</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>scsi</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='capsType'/>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='pciBackend'/>
Nov 22 07:48:31 user nova-compute[74348]:     </hostdev>
Nov 22 07:48:31 user nova-compute[74348]:     <rng supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='model'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio-transitional</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio-non-transitional</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='backendModel'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>random</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>egd</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>builtin</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </rng>
Nov 22 07:48:31 user nova-compute[74348]:     <filesystem supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='driverType'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>path</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>handle</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtiofs</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </filesystem>
Nov 22 07:48:31 user nova-compute[74348]:     <tpm supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='model'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>tpm-tis</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>tpm-crb</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='backendModel'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>passthrough</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>emulator</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </tpm>
Nov 22 07:48:31 user nova-compute[74348]:   </devices>
Nov 22 07:48:31 user nova-compute[74348]:   <features>
Nov 22 07:48:31 user nova-compute[74348]:     <gic supported='no'/>
Nov 22 07:48:31 user nova-compute[74348]:     <vmcoreinfo supported='yes'/>
Nov 22 07:48:31 user nova-compute[74348]:     <genid supported='yes'/>
Nov 22 07:48:31 user nova-compute[74348]:     <backingStoreInput supported='yes'/>
Nov 22 07:48:31 user nova-compute[74348]:     <backup supported='yes'/>
Nov 22 07:48:31 user nova-compute[74348]:     <sev supported='no'/>
Nov 22 07:48:31 user nova-compute[74348]:   </features>
Nov 22 07:48:31 user nova-compute[74348]: </domainCapabilities>
Nov 22 07:48:31 user nova-compute[74348]:  {{(pid=74348) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 22 07:48:31 user nova-compute[74348]: <domainCapabilities>
Nov 22 07:48:31 user nova-compute[74348]:   <path>/usr/bin/qemu-system-i386</path>
Nov 22 07:48:31 user nova-compute[74348]:   <domain>kvm</domain>
Nov 22 07:48:31 user nova-compute[74348]:   <machine>pc-i440fx-jammy</machine>
Nov 22 07:48:31 user nova-compute[74348]:   <arch>i686</arch>
Nov 22 07:48:31 user nova-compute[74348]:   <vcpu max='255'/>
Nov 22 07:48:31 user nova-compute[74348]:   <iothreads supported='yes'/>
Nov 22 07:48:31 user nova-compute[74348]:   <os supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:     <enum name='firmware'/>
Nov 22 07:48:31 user nova-compute[74348]:     <loader supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 22 07:48:31 user nova-compute[74348]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 22 07:48:31 user nova-compute[74348]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 22 07:48:31 user nova-compute[74348]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 22 07:48:31 user nova-compute[74348]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='type'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>rom</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>pflash</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='readonly'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>yes</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>no</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='secure'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>no</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </loader>
Nov 22 07:48:31 user nova-compute[74348]:   </os>
Nov 22 07:48:31 user nova-compute[74348]:   <cpu>
Nov 22 07:48:31 user nova-compute[74348]:     <mode name='host-passthrough' supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='hostPassthroughMigratable'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>off</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </mode>
Nov 22 07:48:31 user nova-compute[74348]:     <mode name='maximum' supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='maximumMigratable'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>on</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>off</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </mode>
Nov 22 07:48:31 user nova-compute[74348]:     <mode name='host-model' supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <vendor>Intel</vendor>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='ss'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='vmx'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='pcid'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='hypervisor'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='arat'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='tsc_adjust'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='umip'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='md-clear'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='stibp'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='arch-capabilities'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='ssbd'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='ibpb'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='ibrs'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='amd-stibp'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='amd-ssbd'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='disable' name='erms'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='disable' name='xsaveopt'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='disable' name='lm'/>
Nov 22 07:48:31 user nova-compute[74348]:     </mode>
Nov 22 07:48:31 user nova-compute[74348]:     <mode name='custom' supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>qemu64</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>qemu32</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>phenom</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>pentium3</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>pentium2</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>pentium</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>n270</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>kvm64</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>kvm32</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>coreduo</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>core2duo</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>athlon</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Westmere-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Westmere</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Snowridge</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Server</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Client</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>SandyBridge</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Penryn</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Opteron_G5</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Opteron_G4</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Opteron_G3</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Opteron_G2</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Opteron_G1</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Nehalem-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Nehalem</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>IvyBridge</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Icelake-Server</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Haswell-noTSX</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Haswell-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Haswell</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>EPYC-Rome</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>EPYC-Milan</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>EPYC-IBPB</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>EPYC</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Dhyana</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Cooperlake</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Conroe</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Cascadelake-Server</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Broadwell-noTSX</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Broadwell-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Broadwell</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>486</model>
Nov 22 07:48:31 user nova-compute[74348]:     </mode>
Nov 22 07:48:31 user nova-compute[74348]:   </cpu>
Nov 22 07:48:31 user nova-compute[74348]:   <memoryBacking supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:     <enum name='sourceType'>
Nov 22 07:48:31 user nova-compute[74348]:       <value>file</value>
Nov 22 07:48:31 user nova-compute[74348]:       <value>anonymous</value>
Nov 22 07:48:31 user nova-compute[74348]:       <value>memfd</value>
Nov 22 07:48:31 user nova-compute[74348]:     </enum>
Nov 22 07:48:31 user nova-compute[74348]:   </memoryBacking>
Nov 22 07:48:31 user nova-compute[74348]:   <devices>
Nov 22 07:48:31 user nova-compute[74348]:     <disk supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='diskDevice'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>disk</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>cdrom</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>floppy</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>lun</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='bus'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>ide</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>fdc</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>scsi</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>usb</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>sata</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='model'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio-transitional</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio-non-transitional</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </disk>
Nov 22 07:48:31 user nova-compute[74348]:     <graphics supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='type'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>sdl</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>vnc</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>spice</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>egl-headless</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </graphics>
Nov 22 07:48:31 user nova-compute[74348]:     <video supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='modelType'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>vga</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>cirrus</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>vmvga</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>qxl</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>none</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>bochs</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>ramfb</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </video>
Nov 22 07:48:31 user nova-compute[74348]:     <hostdev supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='mode'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>subsystem</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='startupPolicy'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>default</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>mandatory</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>requisite</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>optional</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='subsysType'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>usb</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>pci</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>scsi</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='capsType'/>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='pciBackend'/>
Nov 22 07:48:31 user nova-compute[74348]:     </hostdev>
Nov 22 07:48:31 user nova-compute[74348]:     <rng supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='model'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio-transitional</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio-non-transitional</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='backendModel'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>random</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>egd</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>builtin</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </rng>
Nov 22 07:48:31 user nova-compute[74348]:     <filesystem supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='driverType'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>path</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>handle</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtiofs</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </filesystem>
Nov 22 07:48:31 user nova-compute[74348]:     <tpm supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='model'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>tpm-tis</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>tpm-crb</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='backendModel'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>passthrough</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>emulator</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </tpm>
Nov 22 07:48:31 user nova-compute[74348]:   </devices>
Nov 22 07:48:31 user nova-compute[74348]:   <features>
Nov 22 07:48:31 user nova-compute[74348]:     <gic supported='no'/>
Nov 22 07:48:31 user nova-compute[74348]:     <vmcoreinfo supported='yes'/>
Nov 22 07:48:31 user nova-compute[74348]:     <genid supported='yes'/>
Nov 22 07:48:31 user nova-compute[74348]:     <backingStoreInput supported='yes'/>
Nov 22 07:48:31 user nova-compute[74348]:     <backup supported='yes'/>
Nov 22 07:48:31 user nova-compute[74348]:     <sev supported='no'/>
Nov 22 07:48:31 user nova-compute[74348]:   </features>
Nov 22 07:48:31 user nova-compute[74348]: </domainCapabilities>
Nov 22 07:48:31 user nova-compute[74348]:  {{(pid=74348) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 22 07:48:31 user nova-compute[74348]: <domainCapabilities>
Nov 22 07:48:31 user nova-compute[74348]:   <path>/usr/bin/qemu-system-i386</path>
Nov 22 07:48:31 user nova-compute[74348]:   <domain>kvm</domain>
Nov 22 07:48:31 user nova-compute[74348]:   <machine>pc-i440fx-6.2</machine>
Nov 22 07:48:31 user nova-compute[74348]:   <arch>i686</arch>
Nov 22 07:48:31 user nova-compute[74348]:   <vcpu max='255'/>
Nov 22 07:48:31 user nova-compute[74348]:   <iothreads supported='yes'/>
Nov 22 07:48:31 user nova-compute[74348]:   <os supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:     <enum name='firmware'/>
Nov 22 07:48:31 user nova-compute[74348]:     <loader supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 22 07:48:31 user nova-compute[74348]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 22 07:48:31 user nova-compute[74348]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 22 07:48:31 user nova-compute[74348]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 22 07:48:31 user nova-compute[74348]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='type'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>rom</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>pflash</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='readonly'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>yes</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>no</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='secure'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>no</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </loader>
Nov 22 07:48:31 user nova-compute[74348]:   </os>
Nov 22 07:48:31 user nova-compute[74348]:   <cpu>
Nov 22 07:48:31 user nova-compute[74348]:     <mode name='host-passthrough' supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='hostPassthroughMigratable'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>off</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </mode>
Nov 22 07:48:31 user nova-compute[74348]:     <mode name='maximum' supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='maximumMigratable'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>on</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>off</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </mode>
Nov 22 07:48:31 user nova-compute[74348]:     <mode name='host-model' supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <vendor>Intel</vendor>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='ss'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='vmx'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='pcid'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='hypervisor'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='arat'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='tsc_adjust'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='umip'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='md-clear'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='stibp'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='arch-capabilities'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='ssbd'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='ibpb'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='ibrs'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='amd-stibp'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='amd-ssbd'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='disable' name='erms'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='disable' name='xsaveopt'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='disable' name='lm'/>
Nov 22 07:48:31 user nova-compute[74348]:     </mode>
Nov 22 07:48:31 user nova-compute[74348]:     <mode name='custom' supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>qemu64</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>qemu32</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>phenom</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>pentium3</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>pentium2</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>pentium</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>n270</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>kvm64</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>kvm32</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>coreduo</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>core2duo</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>athlon</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Westmere-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Westmere</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Snowridge</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Server</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Client</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>SandyBridge</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Penryn</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Opteron_G5</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Opteron_G4</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Opteron_G3</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Opteron_G2</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Opteron_G1</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Nehalem-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Nehalem</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>IvyBridge</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Icelake-Server</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Haswell-noTSX</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Haswell-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Haswell</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>EPYC-Rome</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>EPYC-Milan</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>EPYC-IBPB</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>EPYC</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Dhyana</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Cooperlake</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Conroe</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Cascadelake-Server</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Broadwell-noTSX</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Broadwell-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Broadwell</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>486</model>
Nov 22 07:48:31 user nova-compute[74348]:     </mode>
Nov 22 07:48:31 user nova-compute[74348]:   </cpu>
Nov 22 07:48:31 user nova-compute[74348]:   <memoryBacking supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:     <enum name='sourceType'>
Nov 22 07:48:31 user nova-compute[74348]:       <value>file</value>
Nov 22 07:48:31 user nova-compute[74348]:       <value>anonymous</value>
Nov 22 07:48:31 user nova-compute[74348]:       <value>memfd</value>
Nov 22 07:48:31 user nova-compute[74348]:     </enum>
Nov 22 07:48:31 user nova-compute[74348]:   </memoryBacking>
Nov 22 07:48:31 user nova-compute[74348]:   <devices>
Nov 22 07:48:31 user nova-compute[74348]:     <disk supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='diskDevice'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>disk</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>cdrom</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>floppy</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>lun</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='bus'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>ide</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>fdc</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>scsi</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>usb</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>sata</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='model'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio-transitional</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio-non-transitional</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </disk>
Nov 22 07:48:31 user nova-compute[74348]:     <graphics supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='type'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>sdl</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>vnc</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>spice</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>egl-headless</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </graphics>
Nov 22 07:48:31 user nova-compute[74348]:     <video supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='modelType'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>vga</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>cirrus</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>vmvga</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>qxl</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>none</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>bochs</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>ramfb</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </video>
Nov 22 07:48:31 user nova-compute[74348]:     <hostdev supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='mode'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>subsystem</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='startupPolicy'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>default</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>mandatory</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>requisite</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>optional</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='subsysType'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>usb</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>pci</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>scsi</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='capsType'/>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='pciBackend'/>
Nov 22 07:48:31 user nova-compute[74348]:     </hostdev>
Nov 22 07:48:31 user nova-compute[74348]:     <rng supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='model'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio-transitional</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio-non-transitional</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='backendModel'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>random</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>egd</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>builtin</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </rng>
Nov 22 07:48:31 user nova-compute[74348]:     <filesystem supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='driverType'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>path</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>handle</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtiofs</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </filesystem>
Nov 22 07:48:31 user nova-compute[74348]:     <tpm supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='model'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>tpm-tis</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>tpm-crb</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='backendModel'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>passthrough</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>emulator</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </tpm>
Nov 22 07:48:31 user nova-compute[74348]:   </devices>
Nov 22 07:48:31 user nova-compute[74348]:   <features>
Nov 22 07:48:31 user nova-compute[74348]:     <gic supported='no'/>
Nov 22 07:48:31 user nova-compute[74348]:     <vmcoreinfo supported='yes'/>
Nov 22 07:48:31 user nova-compute[74348]:     <genid supported='yes'/>
Nov 22 07:48:31 user nova-compute[74348]:     <backingStoreInput supported='yes'/>
Nov 22 07:48:31 user nova-compute[74348]:     <backup supported='yes'/>
Nov 22 07:48:31 user nova-compute[74348]:     <sev supported='no'/>
Nov 22 07:48:31 user nova-compute[74348]:   </features>
Nov 22 07:48:31 user nova-compute[74348]: </domainCapabilities>
Nov 22 07:48:31 user nova-compute[74348]:  {{(pid=74348) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 22 07:48:31 user nova-compute[74348]: <domainCapabilities>
Nov 22 07:48:31 user nova-compute[74348]:   <path>/usr/bin/qemu-system-i386</path>
Nov 22 07:48:31 user nova-compute[74348]:   <domain>kvm</domain>
Nov 22 07:48:31 user nova-compute[74348]:   <machine>pc-q35-jammy</machine>
Nov 22 07:48:31 user nova-compute[74348]:   <arch>i686</arch>
Nov 22 07:48:31 user nova-compute[74348]:   <vcpu max='288'/>
Nov 22 07:48:31 user nova-compute[74348]:   <iothreads supported='yes'/>
Nov 22 07:48:31 user nova-compute[74348]:   <os supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:     <enum name='firmware'/>
Nov 22 07:48:31 user nova-compute[74348]:     <loader supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 22 07:48:31 user nova-compute[74348]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 22 07:48:31 user nova-compute[74348]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 22 07:48:31 user nova-compute[74348]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 22 07:48:31 user nova-compute[74348]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='type'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>rom</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>pflash</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='readonly'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>yes</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>no</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='secure'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>no</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </loader>
Nov 22 07:48:31 user nova-compute[74348]:   </os>
Nov 22 07:48:31 user nova-compute[74348]:   <cpu>
Nov 22 07:48:31 user nova-compute[74348]:     <mode name='host-passthrough' supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='hostPassthroughMigratable'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>off</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </mode>
Nov 22 07:48:31 user nova-compute[74348]:     <mode name='maximum' supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='maximumMigratable'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>on</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>off</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </mode>
Nov 22 07:48:31 user nova-compute[74348]:     <mode name='host-model' supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <vendor>Intel</vendor>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='ss'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='vmx'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='pcid'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='hypervisor'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='arat'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='tsc_adjust'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='umip'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='md-clear'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='stibp'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='arch-capabilities'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='ssbd'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='ibpb'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='ibrs'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='amd-stibp'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='amd-ssbd'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='disable' name='erms'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='disable' name='xsaveopt'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='disable' name='lm'/>
Nov 22 07:48:31 user nova-compute[74348]:     </mode>
Nov 22 07:48:31 user nova-compute[74348]:     <mode name='custom' supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>qemu64</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>qemu32</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>phenom</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>pentium3</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>pentium2</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>pentium</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>n270</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>kvm64</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>kvm32</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>coreduo</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>core2duo</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>athlon</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Westmere-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Westmere</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Snowridge</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Server</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Client</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>SandyBridge</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Penryn</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Opteron_G5</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Opteron_G4</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Opteron_G3</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Opteron_G2</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Opteron_G1</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Nehalem-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Nehalem</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>IvyBridge</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Icelake-Server</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Haswell-noTSX</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Haswell-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Haswell</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>EPYC-Rome</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>EPYC-Milan</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>EPYC-IBPB</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>EPYC</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Dhyana</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Cooperlake</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Conroe</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Cascadelake-Server</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Broadwell-noTSX</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Broadwell-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Broadwell</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>486</model>
Nov 22 07:48:31 user nova-compute[74348]:     </mode>
Nov 22 07:48:31 user nova-compute[74348]:   </cpu>
Nov 22 07:48:31 user nova-compute[74348]:   <memoryBacking supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:     <enum name='sourceType'>
Nov 22 07:48:31 user nova-compute[74348]:       <value>file</value>
Nov 22 07:48:31 user nova-compute[74348]:       <value>anonymous</value>
Nov 22 07:48:31 user nova-compute[74348]:       <value>memfd</value>
Nov 22 07:48:31 user nova-compute[74348]:     </enum>
Nov 22 07:48:31 user nova-compute[74348]:   </memoryBacking>
Nov 22 07:48:31 user nova-compute[74348]:   <devices>
Nov 22 07:48:31 user nova-compute[74348]:     <disk supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='diskDevice'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>disk</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>cdrom</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>floppy</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>lun</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='bus'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>fdc</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>scsi</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>usb</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>sata</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='model'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio-transitional</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio-non-transitional</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </disk>
Nov 22 07:48:31 user nova-compute[74348]:     <graphics supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='type'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>sdl</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>vnc</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>spice</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>egl-headless</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </graphics>
Nov 22 07:48:31 user nova-compute[74348]:     <video supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='modelType'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>vga</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>cirrus</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>vmvga</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>qxl</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>none</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>bochs</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>ramfb</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </video>
Nov 22 07:48:31 user nova-compute[74348]:     <hostdev supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='mode'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>subsystem</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='startupPolicy'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>default</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>mandatory</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>requisite</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>optional</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='subsysType'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>usb</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>pci</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>scsi</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='capsType'/>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='pciBackend'/>
Nov 22 07:48:31 user nova-compute[74348]:     </hostdev>
Nov 22 07:48:31 user nova-compute[74348]:     <rng supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='model'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio-transitional</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio-non-transitional</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='backendModel'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>random</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>egd</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>builtin</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </rng>
Nov 22 07:48:31 user nova-compute[74348]:     <filesystem supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='driverType'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>path</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>handle</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtiofs</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </filesystem>
Nov 22 07:48:31 user nova-compute[74348]:     <tpm supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='model'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>tpm-tis</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>tpm-crb</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='backendModel'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>passthrough</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>emulator</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </tpm>
Nov 22 07:48:31 user nova-compute[74348]:   </devices>
Nov 22 07:48:31 user nova-compute[74348]:   <features>
Nov 22 07:48:31 user nova-compute[74348]:     <gic supported='no'/>
Nov 22 07:48:31 user nova-compute[74348]:     <vmcoreinfo supported='yes'/>
Nov 22 07:48:31 user nova-compute[74348]:     <genid supported='yes'/>
Nov 22 07:48:31 user nova-compute[74348]:     <backingStoreInput supported='yes'/>
Nov 22 07:48:31 user nova-compute[74348]:     <backup supported='yes'/>
Nov 22 07:48:31 user nova-compute[74348]:     <sev supported='no'/>
Nov 22 07:48:31 user nova-compute[74348]:   </features>
Nov 22 07:48:31 user nova-compute[74348]: </domainCapabilities>
Nov 22 07:48:31 user nova-compute[74348]:  {{(pid=74348) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74348) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74348) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74348) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74348) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74348) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74348) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74348) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74348) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74348) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74348) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74348) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74348) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74348) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74348) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74348) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74348) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74348) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=74348) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74348) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74348) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74348) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=74348) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74348) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74348) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74348) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74348) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74348) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74348) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74348) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74348) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74348) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74348) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74348) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74348) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74348) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74348) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74348) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74348) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu', 'pc', 'ubuntu-q35'} {{(pid=74348) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 22 07:48:31 user nova-compute[74348]: <domainCapabilities>
Nov 22 07:48:31 user nova-compute[74348]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 22 07:48:31 user nova-compute[74348]:   <domain>kvm</domain>
Nov 22 07:48:31 user nova-compute[74348]:   <machine>pc-q35-6.2</machine>
Nov 22 07:48:31 user nova-compute[74348]:   <arch>x86_64</arch>
Nov 22 07:48:31 user nova-compute[74348]:   <vcpu max='288'/>
Nov 22 07:48:31 user nova-compute[74348]:   <iothreads supported='yes'/>
Nov 22 07:48:31 user nova-compute[74348]:   <os supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:     <enum name='firmware'>
Nov 22 07:48:31 user nova-compute[74348]:       <value>efi</value>
Nov 22 07:48:31 user nova-compute[74348]:     </enum>
Nov 22 07:48:31 user nova-compute[74348]:     <loader supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 22 07:48:31 user nova-compute[74348]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 22 07:48:31 user nova-compute[74348]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='type'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>rom</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>pflash</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='readonly'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>yes</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>no</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='secure'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>yes</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>no</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </loader>
Nov 22 07:48:31 user nova-compute[74348]:   </os>
Nov 22 07:48:31 user nova-compute[74348]:   <cpu>
Nov 22 07:48:31 user nova-compute[74348]:     <mode name='host-passthrough' supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='hostPassthroughMigratable'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>on</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>off</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </mode>
Nov 22 07:48:31 user nova-compute[74348]:     <mode name='maximum' supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='maximumMigratable'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>on</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>off</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </mode>
Nov 22 07:48:31 user nova-compute[74348]:     <mode name='host-model' supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <vendor>Intel</vendor>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='ss'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='vmx'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='pcid'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='hypervisor'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='arat'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='tsc_adjust'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='umip'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='md-clear'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='stibp'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='arch-capabilities'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='ssbd'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='invtsc'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='ibpb'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='ibrs'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='amd-stibp'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='amd-ssbd'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='rsba'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='pschange-mc-no'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='disable' name='erms'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='disable' name='xsaveopt'/>
Nov 22 07:48:31 user nova-compute[74348]:     </mode>
Nov 22 07:48:31 user nova-compute[74348]:     <mode name='custom' supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>qemu64</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>qemu32</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>phenom</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>pentium3</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>pentium2</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>pentium</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>n270</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>kvm64</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>kvm32</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>coreduo</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>core2duo</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>athlon</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>Westmere-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>Westmere</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Snowridge</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Server</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Client</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>SandyBridge</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>Penryn</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Opteron_G5</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Opteron_G4</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Opteron_G3</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Opteron_G2</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>Opteron_G1</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>Nehalem</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>IvyBridge</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Icelake-Server</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Haswell-noTSX</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Haswell-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Haswell</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>EPYC-Rome</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>EPYC-Milan</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>EPYC-IBPB</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>EPYC</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Dhyana</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Cooperlake</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>Conroe</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Cascadelake-Server</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Broadwell-noTSX</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Broadwell-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Broadwell</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>486</model>
Nov 22 07:48:31 user nova-compute[74348]:     </mode>
Nov 22 07:48:31 user nova-compute[74348]:   </cpu>
Nov 22 07:48:31 user nova-compute[74348]:   <memoryBacking supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:     <enum name='sourceType'>
Nov 22 07:48:31 user nova-compute[74348]:       <value>file</value>
Nov 22 07:48:31 user nova-compute[74348]:       <value>anonymous</value>
Nov 22 07:48:31 user nova-compute[74348]:       <value>memfd</value>
Nov 22 07:48:31 user nova-compute[74348]:     </enum>
Nov 22 07:48:31 user nova-compute[74348]:   </memoryBacking>
Nov 22 07:48:31 user nova-compute[74348]:   <devices>
Nov 22 07:48:31 user nova-compute[74348]:     <disk supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='diskDevice'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>disk</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>cdrom</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>floppy</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>lun</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='bus'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>fdc</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>scsi</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>usb</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>sata</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='model'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio-transitional</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio-non-transitional</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </disk>
Nov 22 07:48:31 user nova-compute[74348]:     <graphics supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='type'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>sdl</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>vnc</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>spice</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>egl-headless</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </graphics>
Nov 22 07:48:31 user nova-compute[74348]:     <video supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='modelType'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>vga</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>cirrus</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>vmvga</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>qxl</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>none</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>bochs</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>ramfb</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </video>
Nov 22 07:48:31 user nova-compute[74348]:     <hostdev supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='mode'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>subsystem</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='startupPolicy'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>default</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>mandatory</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>requisite</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>optional</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='subsysType'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>usb</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>pci</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>scsi</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='capsType'/>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='pciBackend'/>
Nov 22 07:48:31 user nova-compute[74348]:     </hostdev>
Nov 22 07:48:31 user nova-compute[74348]:     <rng supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='model'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio-transitional</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio-non-transitional</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='backendModel'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>random</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>egd</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>builtin</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </rng>
Nov 22 07:48:31 user nova-compute[74348]:     <filesystem supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='driverType'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>path</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>handle</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtiofs</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </filesystem>
Nov 22 07:48:31 user nova-compute[74348]:     <tpm supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='model'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>tpm-tis</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>tpm-crb</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='backendModel'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>passthrough</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>emulator</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </tpm>
Nov 22 07:48:31 user nova-compute[74348]:   </devices>
Nov 22 07:48:31 user nova-compute[74348]:   <features>
Nov 22 07:48:31 user nova-compute[74348]:     <gic supported='no'/>
Nov 22 07:48:31 user nova-compute[74348]:     <vmcoreinfo supported='yes'/>
Nov 22 07:48:31 user nova-compute[74348]:     <genid supported='yes'/>
Nov 22 07:48:31 user nova-compute[74348]:     <backingStoreInput supported='yes'/>
Nov 22 07:48:31 user nova-compute[74348]:     <backup supported='yes'/>
Nov 22 07:48:31 user nova-compute[74348]:     <sev supported='no'/>
Nov 22 07:48:31 user nova-compute[74348]:   </features>
Nov 22 07:48:31 user nova-compute[74348]: </domainCapabilities>
Nov 22 07:48:31 user nova-compute[74348]:  {{(pid=74348) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 22 07:48:31 user nova-compute[74348]: <domainCapabilities>
Nov 22 07:48:31 user nova-compute[74348]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 22 07:48:31 user nova-compute[74348]:   <domain>kvm</domain>
Nov 22 07:48:31 user nova-compute[74348]:   <machine>pc-i440fx-jammy</machine>
Nov 22 07:48:31 user nova-compute[74348]:   <arch>x86_64</arch>
Nov 22 07:48:31 user nova-compute[74348]:   <vcpu max='255'/>
Nov 22 07:48:31 user nova-compute[74348]:   <iothreads supported='yes'/>
Nov 22 07:48:31 user nova-compute[74348]:   <os supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:     <enum name='firmware'>
Nov 22 07:48:31 user nova-compute[74348]:       <value>efi</value>
Nov 22 07:48:31 user nova-compute[74348]:     </enum>
Nov 22 07:48:31 user nova-compute[74348]:     <loader supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='type'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>rom</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>pflash</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='readonly'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>yes</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>no</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='secure'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>no</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </loader>
Nov 22 07:48:31 user nova-compute[74348]:   </os>
Nov 22 07:48:31 user nova-compute[74348]:   <cpu>
Nov 22 07:48:31 user nova-compute[74348]:     <mode name='host-passthrough' supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='hostPassthroughMigratable'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>on</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>off</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </mode>
Nov 22 07:48:31 user nova-compute[74348]:     <mode name='maximum' supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='maximumMigratable'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>on</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>off</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </mode>
Nov 22 07:48:31 user nova-compute[74348]:     <mode name='host-model' supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <vendor>Intel</vendor>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='ss'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='vmx'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='pcid'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='hypervisor'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='arat'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='tsc_adjust'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='umip'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='md-clear'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='stibp'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='arch-capabilities'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='ssbd'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='invtsc'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='ibpb'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='ibrs'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='amd-stibp'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='amd-ssbd'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='rsba'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='pschange-mc-no'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='disable' name='erms'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='disable' name='xsaveopt'/>
Nov 22 07:48:31 user nova-compute[74348]:     </mode>
Nov 22 07:48:31 user nova-compute[74348]:     <mode name='custom' supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>qemu64</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>qemu32</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>phenom</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>pentium3</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>pentium2</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>pentium</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>n270</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>kvm64</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>kvm32</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>coreduo</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>core2duo</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>athlon</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>Westmere-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>Westmere</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Snowridge</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Server</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Client</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>SandyBridge</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>Penryn</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Opteron_G5</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Opteron_G4</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Opteron_G3</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Opteron_G2</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>Opteron_G1</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>Nehalem</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>IvyBridge</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Icelake-Server</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Haswell-noTSX</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Haswell-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Haswell</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>EPYC-Rome</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>EPYC-Milan</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>EPYC-IBPB</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>EPYC</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Dhyana</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Cooperlake</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>Conroe</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Cascadelake-Server</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Broadwell-noTSX</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Broadwell-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Broadwell</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>486</model>
Nov 22 07:48:31 user nova-compute[74348]:     </mode>
Nov 22 07:48:31 user nova-compute[74348]:   </cpu>
Nov 22 07:48:31 user nova-compute[74348]:   <memoryBacking supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:     <enum name='sourceType'>
Nov 22 07:48:31 user nova-compute[74348]:       <value>file</value>
Nov 22 07:48:31 user nova-compute[74348]:       <value>anonymous</value>
Nov 22 07:48:31 user nova-compute[74348]:       <value>memfd</value>
Nov 22 07:48:31 user nova-compute[74348]:     </enum>
Nov 22 07:48:31 user nova-compute[74348]:   </memoryBacking>
Nov 22 07:48:31 user nova-compute[74348]:   <devices>
Nov 22 07:48:31 user nova-compute[74348]:     <disk supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='diskDevice'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>disk</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>cdrom</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>floppy</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>lun</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='bus'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>ide</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>fdc</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>scsi</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>usb</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>sata</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='model'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio-transitional</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio-non-transitional</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </disk>
Nov 22 07:48:31 user nova-compute[74348]:     <graphics supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='type'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>sdl</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>vnc</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>spice</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>egl-headless</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </graphics>
Nov 22 07:48:31 user nova-compute[74348]:     <video supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='modelType'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>vga</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>cirrus</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>vmvga</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>qxl</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>none</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>bochs</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>ramfb</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </video>
Nov 22 07:48:31 user nova-compute[74348]:     <hostdev supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='mode'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>subsystem</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='startupPolicy'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>default</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>mandatory</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>requisite</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>optional</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='subsysType'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>usb</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>pci</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>scsi</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='capsType'/>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='pciBackend'/>
Nov 22 07:48:31 user nova-compute[74348]:     </hostdev>
Nov 22 07:48:31 user nova-compute[74348]:     <rng supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='model'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio-transitional</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio-non-transitional</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='backendModel'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>random</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>egd</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>builtin</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </rng>
Nov 22 07:48:31 user nova-compute[74348]:     <filesystem supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='driverType'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>path</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>handle</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtiofs</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </filesystem>
Nov 22 07:48:31 user nova-compute[74348]:     <tpm supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='model'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>tpm-tis</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>tpm-crb</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='backendModel'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>passthrough</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>emulator</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </tpm>
Nov 22 07:48:31 user nova-compute[74348]:   </devices>
Nov 22 07:48:31 user nova-compute[74348]:   <features>
Nov 22 07:48:31 user nova-compute[74348]:     <gic supported='no'/>
Nov 22 07:48:31 user nova-compute[74348]:     <vmcoreinfo supported='yes'/>
Nov 22 07:48:31 user nova-compute[74348]:     <genid supported='yes'/>
Nov 22 07:48:31 user nova-compute[74348]:     <backingStoreInput supported='yes'/>
Nov 22 07:48:31 user nova-compute[74348]:     <backup supported='yes'/>
Nov 22 07:48:31 user nova-compute[74348]:     <sev supported='no'/>
Nov 22 07:48:31 user nova-compute[74348]:   </features>
Nov 22 07:48:31 user nova-compute[74348]: </domainCapabilities>
Nov 22 07:48:31 user nova-compute[74348]:  {{(pid=74348) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 22 07:48:31 user nova-compute[74348]: <domainCapabilities>
Nov 22 07:48:31 user nova-compute[74348]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 22 07:48:31 user nova-compute[74348]:   <domain>kvm</domain>
Nov 22 07:48:31 user nova-compute[74348]:   <machine>pc-i440fx-6.2</machine>
Nov 22 07:48:31 user nova-compute[74348]:   <arch>x86_64</arch>
Nov 22 07:48:31 user nova-compute[74348]:   <vcpu max='255'/>
Nov 22 07:48:31 user nova-compute[74348]:   <iothreads supported='yes'/>
Nov 22 07:48:31 user nova-compute[74348]:   <os supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:     <enum name='firmware'>
Nov 22 07:48:31 user nova-compute[74348]:       <value>efi</value>
Nov 22 07:48:31 user nova-compute[74348]:     </enum>
Nov 22 07:48:31 user nova-compute[74348]:     <loader supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='type'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>rom</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>pflash</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='readonly'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>yes</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>no</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='secure'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>no</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </loader>
Nov 22 07:48:31 user nova-compute[74348]:   </os>
Nov 22 07:48:31 user nova-compute[74348]:   <cpu>
Nov 22 07:48:31 user nova-compute[74348]:     <mode name='host-passthrough' supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='hostPassthroughMigratable'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>on</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>off</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </mode>
Nov 22 07:48:31 user nova-compute[74348]:     <mode name='maximum' supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='maximumMigratable'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>on</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>off</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </mode>
Nov 22 07:48:31 user nova-compute[74348]:     <mode name='host-model' supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <vendor>Intel</vendor>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='ss'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='vmx'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='pcid'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='hypervisor'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='arat'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='tsc_adjust'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='umip'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='md-clear'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='stibp'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='arch-capabilities'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='ssbd'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='invtsc'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='ibpb'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='ibrs'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='amd-stibp'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='amd-ssbd'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='rsba'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='pschange-mc-no'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='disable' name='erms'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='disable' name='xsaveopt'/>
Nov 22 07:48:31 user nova-compute[74348]:     </mode>
Nov 22 07:48:31 user nova-compute[74348]:     <mode name='custom' supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>qemu64</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>qemu32</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>phenom</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>pentium3</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>pentium2</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>pentium</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>n270</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>kvm64</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>kvm32</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>coreduo</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>core2duo</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>athlon</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>Westmere-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>Westmere</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Snowridge</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Server</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Client</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>SandyBridge</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>Penryn</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Opteron_G5</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Opteron_G4</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Opteron_G3</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Opteron_G2</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>Opteron_G1</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>Nehalem</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>IvyBridge</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Icelake-Server</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Haswell-noTSX</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Haswell-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Haswell</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>EPYC-Rome</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>EPYC-Milan</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>EPYC-IBPB</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>EPYC</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Dhyana</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Cooperlake</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>Conroe</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Cascadelake-Server</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Broadwell-noTSX</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Broadwell-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Broadwell</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>486</model>
Nov 22 07:48:31 user nova-compute[74348]:     </mode>
Nov 22 07:48:31 user nova-compute[74348]:   </cpu>
Nov 22 07:48:31 user nova-compute[74348]:   <memoryBacking supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:     <enum name='sourceType'>
Nov 22 07:48:31 user nova-compute[74348]:       <value>file</value>
Nov 22 07:48:31 user nova-compute[74348]:       <value>anonymous</value>
Nov 22 07:48:31 user nova-compute[74348]:       <value>memfd</value>
Nov 22 07:48:31 user nova-compute[74348]:     </enum>
Nov 22 07:48:31 user nova-compute[74348]:   </memoryBacking>
Nov 22 07:48:31 user nova-compute[74348]:   <devices>
Nov 22 07:48:31 user nova-compute[74348]:     <disk supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='diskDevice'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>disk</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>cdrom</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>floppy</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>lun</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='bus'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>ide</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>fdc</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>scsi</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>usb</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>sata</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='model'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio-transitional</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio-non-transitional</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </disk>
Nov 22 07:48:31 user nova-compute[74348]:     <graphics supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='type'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>sdl</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>vnc</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>spice</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>egl-headless</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </graphics>
Nov 22 07:48:31 user nova-compute[74348]:     <video supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='modelType'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>vga</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>cirrus</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>vmvga</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>qxl</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>none</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>bochs</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>ramfb</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </video>
Nov 22 07:48:31 user nova-compute[74348]:     <hostdev supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='mode'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>subsystem</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='startupPolicy'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>default</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>mandatory</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>requisite</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>optional</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='subsysType'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>usb</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>pci</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>scsi</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='capsType'/>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='pciBackend'/>
Nov 22 07:48:31 user nova-compute[74348]:     </hostdev>
Nov 22 07:48:31 user nova-compute[74348]:     <rng supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='model'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio-transitional</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio-non-transitional</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='backendModel'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>random</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>egd</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>builtin</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </rng>
Nov 22 07:48:31 user nova-compute[74348]:     <filesystem supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='driverType'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>path</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>handle</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtiofs</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </filesystem>
Nov 22 07:48:31 user nova-compute[74348]:     <tpm supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='model'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>tpm-tis</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>tpm-crb</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='backendModel'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>passthrough</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>emulator</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </tpm>
Nov 22 07:48:31 user nova-compute[74348]:   </devices>
Nov 22 07:48:31 user nova-compute[74348]:   <features>
Nov 22 07:48:31 user nova-compute[74348]:     <gic supported='no'/>
Nov 22 07:48:31 user nova-compute[74348]:     <vmcoreinfo supported='yes'/>
Nov 22 07:48:31 user nova-compute[74348]:     <genid supported='yes'/>
Nov 22 07:48:31 user nova-compute[74348]:     <backingStoreInput supported='yes'/>
Nov 22 07:48:31 user nova-compute[74348]:     <backup supported='yes'/>
Nov 22 07:48:31 user nova-compute[74348]:     <sev supported='no'/>
Nov 22 07:48:31 user nova-compute[74348]:   </features>
Nov 22 07:48:31 user nova-compute[74348]: </domainCapabilities>
Nov 22 07:48:31 user nova-compute[74348]:  {{(pid=74348) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 22 07:48:31 user nova-compute[74348]: <domainCapabilities>
Nov 22 07:48:31 user nova-compute[74348]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 22 07:48:31 user nova-compute[74348]:   <domain>kvm</domain>
Nov 22 07:48:31 user nova-compute[74348]:   <machine>pc-q35-jammy</machine>
Nov 22 07:48:31 user nova-compute[74348]:   <arch>x86_64</arch>
Nov 22 07:48:31 user nova-compute[74348]:   <vcpu max='288'/>
Nov 22 07:48:31 user nova-compute[74348]:   <iothreads supported='yes'/>
Nov 22 07:48:31 user nova-compute[74348]:   <os supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:     <enum name='firmware'>
Nov 22 07:48:31 user nova-compute[74348]:       <value>efi</value>
Nov 22 07:48:31 user nova-compute[74348]:     </enum>
Nov 22 07:48:31 user nova-compute[74348]:     <loader supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 22 07:48:31 user nova-compute[74348]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 22 07:48:31 user nova-compute[74348]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='type'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>rom</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>pflash</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='readonly'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>yes</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>no</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='secure'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>yes</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>no</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </loader>
Nov 22 07:48:31 user nova-compute[74348]:   </os>
Nov 22 07:48:31 user nova-compute[74348]:   <cpu>
Nov 22 07:48:31 user nova-compute[74348]:     <mode name='host-passthrough' supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='hostPassthroughMigratable'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>on</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>off</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </mode>
Nov 22 07:48:31 user nova-compute[74348]:     <mode name='maximum' supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='maximumMigratable'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>on</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>off</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </mode>
Nov 22 07:48:31 user nova-compute[74348]:     <mode name='host-model' supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <vendor>Intel</vendor>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='ss'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='vmx'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='pcid'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='hypervisor'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='arat'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='tsc_adjust'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='umip'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='md-clear'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='stibp'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='arch-capabilities'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='ssbd'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='invtsc'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='ibpb'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='ibrs'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='amd-stibp'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='amd-ssbd'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='rsba'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='require' name='pschange-mc-no'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='disable' name='erms'/>
Nov 22 07:48:31 user nova-compute[74348]:       <feature policy='disable' name='xsaveopt'/>
Nov 22 07:48:31 user nova-compute[74348]:     </mode>
Nov 22 07:48:31 user nova-compute[74348]:     <mode name='custom' supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>qemu64</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>qemu32</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>phenom</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>pentium3</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>pentium2</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>pentium</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>n270</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>kvm64</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>kvm32</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>coreduo</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>core2duo</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>athlon</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>Westmere-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>Westmere</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Snowridge</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Server</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Skylake-Client</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>SandyBridge</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>Penryn</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Opteron_G5</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Opteron_G4</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Opteron_G3</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Opteron_G2</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>Opteron_G1</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>Nehalem</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>IvyBridge</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Icelake-Server</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Haswell-noTSX</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Haswell-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Haswell</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>EPYC-Rome</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>EPYC-Milan</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>EPYC-IBPB</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>EPYC</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Dhyana</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Cooperlake</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>Conroe</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Cascadelake-Server</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Broadwell-noTSX</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Broadwell-IBRS</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='no'>Broadwell</model>
Nov 22 07:48:31 user nova-compute[74348]:       <model usable='yes'>486</model>
Nov 22 07:48:31 user nova-compute[74348]:     </mode>
Nov 22 07:48:31 user nova-compute[74348]:   </cpu>
Nov 22 07:48:31 user nova-compute[74348]:   <memoryBacking supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:     <enum name='sourceType'>
Nov 22 07:48:31 user nova-compute[74348]:       <value>file</value>
Nov 22 07:48:31 user nova-compute[74348]:       <value>anonymous</value>
Nov 22 07:48:31 user nova-compute[74348]:       <value>memfd</value>
Nov 22 07:48:31 user nova-compute[74348]:     </enum>
Nov 22 07:48:31 user nova-compute[74348]:   </memoryBacking>
Nov 22 07:48:31 user nova-compute[74348]:   <devices>
Nov 22 07:48:31 user nova-compute[74348]:     <disk supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='diskDevice'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>disk</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>cdrom</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>floppy</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>lun</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='bus'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>fdc</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>scsi</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>usb</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>sata</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='model'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio-transitional</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio-non-transitional</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </disk>
Nov 22 07:48:31 user nova-compute[74348]:     <graphics supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='type'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>sdl</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>vnc</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>spice</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>egl-headless</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </graphics>
Nov 22 07:48:31 user nova-compute[74348]:     <video supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='modelType'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>vga</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>cirrus</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>vmvga</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>qxl</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>none</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>bochs</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>ramfb</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </video>
Nov 22 07:48:31 user nova-compute[74348]:     <hostdev supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='mode'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>subsystem</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='startupPolicy'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>default</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>mandatory</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>requisite</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>optional</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='subsysType'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>usb</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>pci</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>scsi</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='capsType'/>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='pciBackend'/>
Nov 22 07:48:31 user nova-compute[74348]:     </hostdev>
Nov 22 07:48:31 user nova-compute[74348]:     <rng supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='model'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio-transitional</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtio-non-transitional</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='backendModel'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>random</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>egd</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>builtin</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </rng>
Nov 22 07:48:31 user nova-compute[74348]:     <filesystem supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='driverType'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>path</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>handle</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>virtiofs</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </filesystem>
Nov 22 07:48:31 user nova-compute[74348]:     <tpm supported='yes'>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='model'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>tpm-tis</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>tpm-crb</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:       <enum name='backendModel'>
Nov 22 07:48:31 user nova-compute[74348]:         <value>passthrough</value>
Nov 22 07:48:31 user nova-compute[74348]:         <value>emulator</value>
Nov 22 07:48:31 user nova-compute[74348]:       </enum>
Nov 22 07:48:31 user nova-compute[74348]:     </tpm>
Nov 22 07:48:31 user nova-compute[74348]:   </devices>
Nov 22 07:48:31 user nova-compute[74348]:   <features>
Nov 22 07:48:31 user nova-compute[74348]:     <gic supported='no'/>
Nov 22 07:48:31 user nova-compute[74348]:     <vmcoreinfo supported='yes'/>
Nov 22 07:48:31 user nova-compute[74348]:     <genid supported='yes'/>
Nov 22 07:48:31 user nova-compute[74348]:     <backingStoreInput supported='yes'/>
Nov 22 07:48:31 user nova-compute[74348]:     <backup supported='yes'/>
Nov 22 07:48:31 user nova-compute[74348]:     <sev supported='no'/>
Nov 22 07:48:31 user nova-compute[74348]:   </features>
Nov 22 07:48:31 user nova-compute[74348]: </domainCapabilities>
Nov 22 07:48:31 user nova-compute[74348]:  {{(pid=74348) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74348) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74348) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74348) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74348) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Checking secure boot support for host arch (x86_64) {{(pid=74348) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 22 07:48:31 user nova-compute[74348]: INFO nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Secure Boot support detected
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] cpu compare xml: <cpu match="exact">
Nov 22 07:48:31 user nova-compute[74348]:   <model>Nehalem</model>
Nov 22 07:48:31 user nova-compute[74348]: </cpu>
Nov 22 07:48:31 user nova-compute[74348]:  {{(pid=74348) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 22 07:48:31 user nova-compute[74348]: INFO nova.virt.node [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Generated node identity 52690f6a-773f-4e8d-be85-d278b6522975
Nov 22 07:48:31 user nova-compute[74348]: INFO nova.virt.node [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Wrote node identity 52690f6a-773f-4e8d-be85-d278b6522975 to /opt/stack/data/nova/compute_id
Nov 22 07:48:31 user nova-compute[74348]: WARNING nova.compute.manager [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Compute nodes ['52690f6a-773f-4e8d-be85-d278b6522975'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 22 07:48:31 user nova-compute[74348]: INFO nova.compute.manager [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 22 07:48:31 user nova-compute[74348]: WARNING nova.compute.manager [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 22 07:48:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 07:48:31 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:48:31 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Hypervisor/Node resource view: name=user free_ram=10971MB free_disk=25.983051300048828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:48:31 user nova-compute[74348]: WARNING nova.compute.resource_tracker [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] No compute node record for user:52690f6a-773f-4e8d-be85-d278b6522975: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 52690f6a-773f-4e8d-be85-d278b6522975 could not be found.
Nov 22 07:48:31 user nova-compute[74348]: INFO nova.compute.resource_tracker [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Compute node record created for user:user with uuid: 52690f6a-773f-4e8d-be85-d278b6522975
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 07:48:31 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 07:48:32 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] [req-e3d9db2f-23c8-448a-9fc7-32c9bf4c64bf] Created resource provider record via placement API for resource provider with UUID 52690f6a-773f-4e8d-be85-d278b6522975 and name user.
Nov 22 07:48:32 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74348) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 22 07:48:32 user nova-compute[74348]: INFO nova.virt.libvirt.host [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] kernel doesn't support AMD SEV
Nov 22 07:48:32 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Updating inventory in ProviderTree for provider 52690f6a-773f-4e8d-be85-d278b6522975 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 22 07:48:32 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 07:48:32 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Libvirt baseline CPU <cpu>
Nov 22 07:48:32 user nova-compute[74348]:   <arch>x86_64</arch>
Nov 22 07:48:32 user nova-compute[74348]:   <model>Nehalem</model>
Nov 22 07:48:32 user nova-compute[74348]:   <vendor>Intel</vendor>
Nov 22 07:48:32 user nova-compute[74348]:   <topology sockets="6" cores="1" threads="1"/>
Nov 22 07:48:32 user nova-compute[74348]: </cpu>
Nov 22 07:48:32 user nova-compute[74348]:  {{(pid=74348) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 22 07:48:32 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Updated inventory for provider 52690f6a-773f-4e8d-be85-d278b6522975 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 22 07:48:32 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Updating resource provider 52690f6a-773f-4e8d-be85-d278b6522975 generation from 0 to 1 during operation: update_inventory {{(pid=74348) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 22 07:48:32 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Updating inventory in ProviderTree for provider 52690f6a-773f-4e8d-be85-d278b6522975 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 22 07:48:32 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Updating resource provider 52690f6a-773f-4e8d-be85-d278b6522975 generation from 1 to 2 during operation: update_traits {{(pid=74348) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 22 07:48:32 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 07:48:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.597s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:48:32 user nova-compute[74348]: DEBUG nova.service [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Creating RPC server for service compute {{(pid=74348) start /opt/stack/nova/nova/service.py:182}}
Nov 22 07:48:32 user nova-compute[74348]: DEBUG nova.service [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] Join ServiceGroup membership for this service compute {{(pid=74348) start /opt/stack/nova/nova/service.py:199}}
Nov 22 07:48:32 user nova-compute[74348]: DEBUG nova.servicegroup.drivers.db [None req-7aa72fa5-f56f-49e6-a0f9-7d0a0edb75e1 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74348) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 22 07:49:16 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._sync_power_states {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:49:16 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:49:23 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:49:23 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:49:23 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 07:49:23 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Rebuilding the list of instances to heal {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 07:49:23 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Didn't find any instances for network info cache update. {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 07:49:23 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:49:23 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:49:23 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:49:23 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:49:23 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:49:23 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:49:23 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 07:49:23 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:49:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:49:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:49:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:49:23 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 07:49:23 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:49:23 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:49:23 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=10349MB free_disk=25.886768341064453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 07:49:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:49:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:49:23 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 07:49:23 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 07:49:23 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:49:23 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:49:23 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 07:49:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:50:23 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:50:23 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:50:23 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 07:50:23 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Rebuilding the list of instances to heal {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 07:50:23 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Didn't find any instances for network info cache update. {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 07:50:23 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:50:23 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:50:23 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:50:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:50:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:50:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:50:24 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 07:50:24 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:50:24 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:50:24 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=10329MB free_disk=25.951786041259766GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 07:50:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:50:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:50:24 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 07:50:24 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 07:50:24 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:50:24 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:50:24 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 07:50:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.098s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:50:24 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:50:24 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:50:24 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:50:24 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 07:50:25 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:50:25 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:51:23 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:51:23 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 07:51:23 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Rebuilding the list of instances to heal {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 07:51:23 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Didn't find any instances for network info cache update. {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 07:51:23 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:51:25 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:51:25 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:51:25 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:51:25 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:51:25 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 07:51:25 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:51:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:51:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:51:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:51:25 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 07:51:25 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:51:25 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:51:25 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=10313MB free_disk=25.70355224609375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 07:51:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:51:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:51:25 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 07:51:25 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 07:51:25 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:51:25 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:51:25 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 07:51:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.107s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:51:26 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:51:27 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:52:24 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:52:24 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 07:52:24 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Rebuilding the list of instances to heal {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 07:52:24 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Didn't find any instances for network info cache update. {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 07:52:24 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:52:25 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:52:26 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:52:26 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:52:26 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:52:27 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:52:27 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 07:52:27 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:52:27 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:52:27 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:52:27 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:52:27 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 07:52:27 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:52:27 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:52:27 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=9671MB free_disk=25.724239349365234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 07:52:27 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:52:27 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:52:27 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 07:52:27 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 07:52:28 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:52:28 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:52:28 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 07:52:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.189s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:52:29 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:52:29 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:52:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Acquiring lock "059bde4a-c5c9-45ab-9b4a-c969c74a6083" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:52:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Lock "059bde4a-c5c9-45ab-9b4a-c969c74a6083" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:52:34 user nova-compute[74348]: DEBUG nova.compute.manager [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 07:52:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:52:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:52:34 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 07:52:34 user nova-compute[74348]: INFO nova.compute.claims [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Claim successful on node user
Nov 22 07:52:34 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:52:34 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:52:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.427s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:52:34 user nova-compute[74348]: DEBUG nova.compute.manager [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 07:52:35 user nova-compute[74348]: DEBUG nova.compute.manager [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 07:52:35 user nova-compute[74348]: DEBUG nova.network.neutron [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 07:52:35 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 07:52:35 user nova-compute[74348]: DEBUG nova.compute.manager [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 07:52:35 user nova-compute[74348]: DEBUG nova.compute.manager [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 07:52:35 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 07:52:35 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Creating image(s)
Nov 22 07:52:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Acquiring lock "/opt/stack/data/nova/instances/059bde4a-c5c9-45ab-9b4a-c969c74a6083/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:52:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Lock "/opt/stack/data/nova/instances/059bde4a-c5c9-45ab-9b4a-c969c74a6083/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:52:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Lock "/opt/stack/data/nova/instances/059bde4a-c5c9-45ab-9b4a-c969c74a6083/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:52:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Acquiring lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:52:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:52:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "522f5959-4874-4c61-888d-6fb1cc4d72e6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:52:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "522f5959-4874-4c61-888d-6fb1cc4d72e6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:52:35 user nova-compute[74348]: DEBUG nova.compute.manager [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 07:52:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:52:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:52:35 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 07:52:35 user nova-compute[74348]: INFO nova.compute.claims [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Claim successful on node user
Nov 22 07:52:35 user nova-compute[74348]: DEBUG nova.policy [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d2925596cad453baed756b931a54586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee2e6be4a484d32bac3fda2043aa23d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 07:52:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263.part --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:52:36 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:52:36 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:52:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263.part --force-share --output=json" returned: 0 in 0.185s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:52:36 user nova-compute[74348]: DEBUG nova.virt.images [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] 7abe07a9-4f70-41a1-a0fc-c06f9c8dd109 was qcow2, converting to raw {{(pid=74348) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 22 07:52:36 user nova-compute[74348]: DEBUG nova.privsep.utils [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74348) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 07:52:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263.part /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263.converted {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:52:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.962s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:52:36 user nova-compute[74348]: DEBUG nova.compute.manager [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 07:52:36 user nova-compute[74348]: DEBUG nova.compute.manager [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 07:52:36 user nova-compute[74348]: DEBUG nova.network.neutron [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 07:52:36 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 07:52:36 user nova-compute[74348]: DEBUG nova.compute.manager [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 07:52:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263.part /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263.converted" returned: 0 in 0.324s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:52:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263.converted --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:52:36 user nova-compute[74348]: DEBUG nova.compute.manager [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 07:52:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 07:52:36 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Creating image(s)
Nov 22 07:52:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "/opt/stack/data/nova/instances/522f5959-4874-4c61-888d-6fb1cc4d72e6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:52:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "/opt/stack/data/nova/instances/522f5959-4874-4c61-888d-6fb1cc4d72e6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:52:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "/opt/stack/data/nova/instances/522f5959-4874-4c61-888d-6fb1cc4d72e6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:52:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:52:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:52:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.773s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:52:37 user nova-compute[74348]: INFO oslo.privsep.daemon [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp4l1rqvsj/privsep.sock']
Nov 22 07:52:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.070s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:52:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:52:37 user sudo[83588]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp4l1rqvsj/privsep.sock
Nov 22 07:52:37 user sudo[83588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 22 07:52:37 user nova-compute[74348]: DEBUG nova.policy [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f8eca17e3a564220b3b07af4eddadaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569146bb9b04838ad8044260da6ad58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 07:52:38 user nova-compute[74348]: DEBUG nova.network.neutron [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Successfully created port: 06aa6370-ccfd-4a76-86ca-7bbfad795beb {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 07:52:38 user sudo[83588]: pam_unix(sudo:session): session closed for user root
Nov 22 07:52:38 user nova-compute[74348]: INFO oslo.privsep.daemon [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Spawned new privsep daemon via rootwrap
Nov 22 07:52:38 user nova-compute[74348]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 22 07:52:38 user nova-compute[74348]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 22 07:52:38 user nova-compute[74348]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 22 07:52:38 user nova-compute[74348]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83592
Nov 22 07:52:38 user nova-compute[74348]: WARNING oslo_privsep.priv_context [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] privsep daemon already running
Nov 22 07:52:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:52:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:52:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.169s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:52:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:52:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:52:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:52:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.178s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:52:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Acquiring lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:52:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.204s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:52:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/522f5959-4874-4c61-888d-6fb1cc4d72e6/disk 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:52:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/522f5959-4874-4c61-888d-6fb1cc4d72e6/disk 1073741824" returned: 0 in 0.157s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:52:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.365s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:52:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:52:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.361s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:52:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:52:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.192s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:52:39 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Checking if we can resize image /opt/stack/data/nova/instances/522f5959-4874-4c61-888d-6fb1cc4d72e6/disk. size=1073741824 {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 07:52:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/522f5959-4874-4c61-888d-6fb1cc4d72e6/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:52:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.218s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:52:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/059bde4a-c5c9-45ab-9b4a-c969c74a6083/disk 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:52:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/059bde4a-c5c9-45ab-9b4a-c969c74a6083/disk 1073741824" returned: 0 in 0.055s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:52:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:52:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:52:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/522f5959-4874-4c61-888d-6fb1cc4d72e6/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:52:39 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Cannot resize image /opt/stack/data/nova/instances/522f5959-4874-4c61-888d-6fb1cc4d72e6/disk to a smaller size. {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 07:52:39 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 07:52:39 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Ensure instance console log exists: /opt/stack/data/nova/instances/522f5959-4874-4c61-888d-6fb1cc4d72e6/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 07:52:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:52:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:52:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:52:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.170s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:52:39 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Checking if we can resize image /opt/stack/data/nova/instances/059bde4a-c5c9-45ab-9b4a-c969c74a6083/disk. size=1073741824 {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 07:52:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059bde4a-c5c9-45ab-9b4a-c969c74a6083/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:52:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059bde4a-c5c9-45ab-9b4a-c969c74a6083/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:52:39 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Cannot resize image /opt/stack/data/nova/instances/059bde4a-c5c9-45ab-9b4a-c969c74a6083/disk to a smaller size. {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 07:52:39 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 07:52:39 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Ensure instance console log exists: /opt/stack/data/nova/instances/059bde4a-c5c9-45ab-9b4a-c969c74a6083/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 07:52:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:52:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:52:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:52:39 user nova-compute[74348]: DEBUG nova.network.neutron [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Successfully created port: 72ea4eea-6e08-44b2-9274-0f849d534f05 {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 07:52:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Acquiring lock "bcedb385-b72a-49c2-b363-cf6da5804b60" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:52:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lock "bcedb385-b72a-49c2-b363-cf6da5804b60" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:52:40 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 07:52:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:52:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:52:40 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 07:52:40 user nova-compute[74348]: INFO nova.compute.claims [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Claim successful on node user
Nov 22 07:52:41 user nova-compute[74348]: DEBUG nova.network.neutron [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Successfully updated port: 06aa6370-ccfd-4a76-86ca-7bbfad795beb {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 07:52:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Acquiring lock "refresh_cache-059bde4a-c5c9-45ab-9b4a-c969c74a6083" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:52:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Acquired lock "refresh_cache-059bde4a-c5c9-45ab-9b4a-c969c74a6083" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:52:41 user nova-compute[74348]: DEBUG nova.network.neutron [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 07:52:41 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:52:41 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:52:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.593s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:52:41 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 07:52:41 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 07:52:41 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 07:52:41 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 07:52:41 user nova-compute[74348]: DEBUG nova.network.neutron [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 07:52:41 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 07:52:41 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 07:52:41 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 07:52:41 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Creating image(s)
Nov 22 07:52:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Acquiring lock "/opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:52:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lock "/opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:52:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lock "/opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:52:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:52:41 user nova-compute[74348]: DEBUG nova.policy [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7feabb30a9c14a209ad4fc962ef29481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52a21c1ef18473aa64c139de7b920ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 07:52:41 user nova-compute[74348]: DEBUG nova.compute.manager [req-e06a5412-6362-495f-8c42-9a86a029a4d3 req-f252f2d0-a6f3-4bf0-96df-5c540e273d50 service nova] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Received event network-changed-06aa6370-ccfd-4a76-86ca-7bbfad795beb {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:52:41 user nova-compute[74348]: DEBUG nova.compute.manager [req-e06a5412-6362-495f-8c42-9a86a029a4d3 req-f252f2d0-a6f3-4bf0-96df-5c540e273d50 service nova] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Refreshing instance network info cache due to event network-changed-06aa6370-ccfd-4a76-86ca-7bbfad795beb. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:52:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e06a5412-6362-495f-8c42-9a86a029a4d3 req-f252f2d0-a6f3-4bf0-96df-5c540e273d50 service nova] Acquiring lock "refresh_cache-059bde4a-c5c9-45ab-9b4a-c969c74a6083" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:52:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.186s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:52:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Acquiring lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:52:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:52:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.165s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk 1073741824" returned: 0 in 0.044s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.174s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk. size=1073741824 {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Cannot resize image /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk to a smaller size. {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Ensure instance console log exists: /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG nova.network.neutron [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Updating instance_info_cache with network_info: [{"id": "06aa6370-ccfd-4a76-86ca-7bbfad795beb", "address": "fa:16:3e:0d:49:2d", "network": {"id": "7f692ef6-9a86-4aba-a055-8877d70394ba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1993883418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee2e6be4a484d32bac3fda2043aa23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06aa6370-cc", "ovs_interfaceid": "06aa6370-ccfd-4a76-86ca-7bbfad795beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Releasing lock "refresh_cache-059bde4a-c5c9-45ab-9b4a-c969c74a6083" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG nova.compute.manager [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Instance network_info: |[{"id": "06aa6370-ccfd-4a76-86ca-7bbfad795beb", "address": "fa:16:3e:0d:49:2d", "network": {"id": "7f692ef6-9a86-4aba-a055-8877d70394ba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1993883418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee2e6be4a484d32bac3fda2043aa23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06aa6370-cc", "ovs_interfaceid": "06aa6370-ccfd-4a76-86ca-7bbfad795beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e06a5412-6362-495f-8c42-9a86a029a4d3 req-f252f2d0-a6f3-4bf0-96df-5c540e273d50 service nova] Acquired lock "refresh_cache-059bde4a-c5c9-45ab-9b4a-c969c74a6083" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG nova.network.neutron [req-e06a5412-6362-495f-8c42-9a86a029a4d3 req-f252f2d0-a6f3-4bf0-96df-5c540e273d50 service nova] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Refreshing network info cache for port 06aa6370-ccfd-4a76-86ca-7bbfad795beb {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Start _get_guest_xml network_info=[{"id": "06aa6370-ccfd-4a76-86ca-7bbfad795beb", "address": "fa:16:3e:0d:49:2d", "network": {"id": "7f692ef6-9a86-4aba-a055-8877d70394ba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1993883418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee2e6be4a484d32bac3fda2043aa23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06aa6370-cc", "ovs_interfaceid": "06aa6370-ccfd-4a76-86ca-7bbfad795beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 07:52:42 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:52:42 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:52:42 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG nova.privsep.utils [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74348) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:52:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1797427382',display_name='tempest-ServersNegativeTestJSON-server-1797427382',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1797427382',id=1,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dee2e6be4a484d32bac3fda2043aa23d',ramdisk_id='',reservation_id='r-bj5rcocz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1255640261',owner_user_name='tempest-ServersNegativeTestJSON-1255640261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:52:35Z,user_data=None,user_id='8d2925596cad453baed756b931a54586',uuid=059bde4a-c5c9-45ab-9b4a-c969c74a6083,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06aa6370-ccfd-4a76-86ca-7bbfad795beb", "address": "fa:16:3e:0d:49:2d", "network": {"id": "7f692ef6-9a86-4aba-a055-8877d70394ba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1993883418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee2e6be4a484d32bac3fda2043aa23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06aa6370-cc", "ovs_interfaceid": "06aa6370-ccfd-4a76-86ca-7bbfad795beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Converting VIF {"id": "06aa6370-ccfd-4a76-86ca-7bbfad795beb", "address": "fa:16:3e:0d:49:2d", "network": {"id": "7f692ef6-9a86-4aba-a055-8877d70394ba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1993883418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee2e6be4a484d32bac3fda2043aa23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06aa6370-cc", "ovs_interfaceid": "06aa6370-ccfd-4a76-86ca-7bbfad795beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:49:2d,bridge_name='br-int',has_traffic_filtering=True,id=06aa6370-ccfd-4a76-86ca-7bbfad795beb,network=Network(7f692ef6-9a86-4aba-a055-8877d70394ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06aa6370-cc') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG nova.objects.instance [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Lazy-loading 'pci_devices' on Instance uuid 059bde4a-c5c9-45ab-9b4a-c969c74a6083 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] End _get_guest_xml xml=<domain type="kvm">
Nov 22 07:52:42 user nova-compute[74348]:   <uuid>059bde4a-c5c9-45ab-9b4a-c969c74a6083</uuid>
Nov 22 07:52:42 user nova-compute[74348]:   <name>instance-00000001</name>
Nov 22 07:52:42 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 07:52:42 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 07:52:42 user nova-compute[74348]:   <metadata>
Nov 22 07:52:42 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 07:52:42 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 07:52:42 user nova-compute[74348]:       <nova:name>tempest-ServersNegativeTestJSON-server-1797427382</nova:name>
Nov 22 07:52:42 user nova-compute[74348]:       <nova:creationTime>2023-11-22 07:52:42</nova:creationTime>
Nov 22 07:52:42 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 07:52:42 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 07:52:42 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 07:52:42 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 07:52:42 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 07:52:42 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 07:52:42 user nova-compute[74348]:       </nova:flavor>
Nov 22 07:52:42 user nova-compute[74348]:       <nova:owner>
Nov 22 07:52:42 user nova-compute[74348]:         <nova:user uuid="8d2925596cad453baed756b931a54586">tempest-ServersNegativeTestJSON-1255640261-project-member</nova:user>
Nov 22 07:52:42 user nova-compute[74348]:         <nova:project uuid="dee2e6be4a484d32bac3fda2043aa23d">tempest-ServersNegativeTestJSON-1255640261</nova:project>
Nov 22 07:52:42 user nova-compute[74348]:       </nova:owner>
Nov 22 07:52:42 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 07:52:42 user nova-compute[74348]:       <nova:ports>
Nov 22 07:52:42 user nova-compute[74348]:         <nova:port uuid="06aa6370-ccfd-4a76-86ca-7bbfad795beb">
Nov 22 07:52:42 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 22 07:52:42 user nova-compute[74348]:         </nova:port>
Nov 22 07:52:42 user nova-compute[74348]:       </nova:ports>
Nov 22 07:52:42 user nova-compute[74348]:     </nova:instance>
Nov 22 07:52:42 user nova-compute[74348]:   </metadata>
Nov 22 07:52:42 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 07:52:42 user nova-compute[74348]:     <system>
Nov 22 07:52:42 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 07:52:42 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 07:52:42 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 07:52:42 user nova-compute[74348]:       <entry name="serial">059bde4a-c5c9-45ab-9b4a-c969c74a6083</entry>
Nov 22 07:52:42 user nova-compute[74348]:       <entry name="uuid">059bde4a-c5c9-45ab-9b4a-c969c74a6083</entry>
Nov 22 07:52:42 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 07:52:42 user nova-compute[74348]:     </system>
Nov 22 07:52:42 user nova-compute[74348]:   </sysinfo>
Nov 22 07:52:42 user nova-compute[74348]:   <os>
Nov 22 07:52:42 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 07:52:42 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 07:52:42 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 07:52:42 user nova-compute[74348]:   </os>
Nov 22 07:52:42 user nova-compute[74348]:   <features>
Nov 22 07:52:42 user nova-compute[74348]:     <acpi/>
Nov 22 07:52:42 user nova-compute[74348]:     <apic/>
Nov 22 07:52:42 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 07:52:42 user nova-compute[74348]:   </features>
Nov 22 07:52:42 user nova-compute[74348]:   <clock offset="utc">
Nov 22 07:52:42 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 07:52:42 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 07:52:42 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 07:52:42 user nova-compute[74348]:   </clock>
Nov 22 07:52:42 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 07:52:42 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 07:52:42 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 07:52:42 user nova-compute[74348]:   </cpu>
Nov 22 07:52:42 user nova-compute[74348]:   <devices>
Nov 22 07:52:42 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 07:52:42 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 07:52:42 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/059bde4a-c5c9-45ab-9b4a-c969c74a6083/disk"/>
Nov 22 07:52:42 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 07:52:42 user nova-compute[74348]:     </disk>
Nov 22 07:52:42 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 07:52:42 user nova-compute[74348]:       <mac address="fa:16:3e:0d:49:2d"/>
Nov 22 07:52:42 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:52:42 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 07:52:42 user nova-compute[74348]:       <target dev="tap06aa6370-cc"/>
Nov 22 07:52:42 user nova-compute[74348]:     </interface>
Nov 22 07:52:42 user nova-compute[74348]:     <serial type="pty">
Nov 22 07:52:42 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/059bde4a-c5c9-45ab-9b4a-c969c74a6083/console.log" append="off"/>
Nov 22 07:52:42 user nova-compute[74348]:     </serial>
Nov 22 07:52:42 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 07:52:42 user nova-compute[74348]:     <video>
Nov 22 07:52:42 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:52:42 user nova-compute[74348]:     </video>
Nov 22 07:52:42 user nova-compute[74348]:     <rng model="virtio">
Nov 22 07:52:42 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 07:52:42 user nova-compute[74348]:     </rng>
Nov 22 07:52:42 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 07:52:42 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 07:52:42 user nova-compute[74348]:       <stats period="10"/>
Nov 22 07:52:42 user nova-compute[74348]:     </memballoon>
Nov 22 07:52:42 user nova-compute[74348]:   </devices>
Nov 22 07:52:42 user nova-compute[74348]: </domain>
Nov 22 07:52:42 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:52:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1797427382',display_name='tempest-ServersNegativeTestJSON-server-1797427382',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1797427382',id=1,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dee2e6be4a484d32bac3fda2043aa23d',ramdisk_id='',reservation_id='r-bj5rcocz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1255640261',owner_user_name='tempest-ServersNegativeTestJSON-1255640261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:52:35Z,user_data=None,user_id='8d2925596cad453baed756b931a54586',uuid=059bde4a-c5c9-45ab-9b4a-c969c74a6083,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06aa6370-ccfd-4a76-86ca-7bbfad795beb", "address": "fa:16:3e:0d:49:2d", "network": {"id": "7f692ef6-9a86-4aba-a055-8877d70394ba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1993883418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee2e6be4a484d32bac3fda2043aa23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06aa6370-cc", "ovs_interfaceid": "06aa6370-ccfd-4a76-86ca-7bbfad795beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Converting VIF {"id": "06aa6370-ccfd-4a76-86ca-7bbfad795beb", "address": "fa:16:3e:0d:49:2d", "network": {"id": "7f692ef6-9a86-4aba-a055-8877d70394ba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1993883418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee2e6be4a484d32bac3fda2043aa23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06aa6370-cc", "ovs_interfaceid": "06aa6370-ccfd-4a76-86ca-7bbfad795beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:49:2d,bridge_name='br-int',has_traffic_filtering=True,id=06aa6370-ccfd-4a76-86ca-7bbfad795beb,network=Network(7f692ef6-9a86-4aba-a055-8877d70394ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06aa6370-cc') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG os_vif [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:49:2d,bridge_name='br-int',has_traffic_filtering=True,id=06aa6370-ccfd-4a76-86ca-7bbfad795beb,network=Network(7f692ef6-9a86-4aba-a055-8877d70394ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06aa6370-cc') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Created schema index Interface.name {{(pid=74348) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Created schema index Port.name {{(pid=74348) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Created schema index Bridge.name {{(pid=74348) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Acquiring lock "e36789b1-45e6-40f7-ba97-8962cb116a39" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lock "e36789b1-45e6-40f7-ba97-8962cb116a39" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [POLLOUT] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:43 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 07:52:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:52:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 07:52:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f0ffc97d-f01b-5c1c-aa37-93569ae1b3cc', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:52:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:52:43 user nova-compute[74348]: INFO oslo.privsep.daemon [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpj356930v/privsep.sock']
Nov 22 07:52:43 user sudo[83734]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpj356930v/privsep.sock
Nov 22 07:52:43 user sudo[83734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 22 07:52:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:52:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:52:43 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 07:52:43 user nova-compute[74348]: INFO nova.compute.claims [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Claim successful on node user
Nov 22 07:52:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquiring lock "5f3bbae3-babf-44d2-96da-c459fb77d9c7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:52:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "5f3bbae3-babf-44d2-96da-c459fb77d9c7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:52:43 user nova-compute[74348]: DEBUG nova.compute.manager [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 07:52:43 user nova-compute[74348]: DEBUG nova.network.neutron [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Successfully updated port: 72ea4eea-6e08-44b2-9274-0f849d534f05 {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 07:52:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "refresh_cache-522f5959-4874-4c61-888d-6fb1cc4d72e6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:52:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquired lock "refresh_cache-522f5959-4874-4c61-888d-6fb1cc4d72e6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:52:43 user nova-compute[74348]: DEBUG nova.network.neutron [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 07:52:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:52:43 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:52:43 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:52:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.418s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:52:43 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 07:52:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.218s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:52:43 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 07:52:43 user nova-compute[74348]: INFO nova.compute.claims [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Claim successful on node user
Nov 22 07:52:43 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Successfully created port: 07295502-d217-400f-8b56-9ff1ccd600cf {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 07:52:43 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 07:52:43 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 07:52:43 user nova-compute[74348]: DEBUG nova.network.neutron [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 07:52:43 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 07:52:43 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 07:52:43 user nova-compute[74348]: DEBUG nova.compute.manager [req-18595321-b56c-45ff-a50a-88a0fc0cac92 req-a7e4f2c7-003f-453c-9997-50002a88fa3a service nova] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Received event network-changed-72ea4eea-6e08-44b2-9274-0f849d534f05 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:52:43 user nova-compute[74348]: DEBUG nova.compute.manager [req-18595321-b56c-45ff-a50a-88a0fc0cac92 req-a7e4f2c7-003f-453c-9997-50002a88fa3a service nova] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Refreshing instance network info cache due to event network-changed-72ea4eea-6e08-44b2-9274-0f849d534f05. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:52:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-18595321-b56c-45ff-a50a-88a0fc0cac92 req-a7e4f2c7-003f-453c-9997-50002a88fa3a service nova] Acquiring lock "refresh_cache-522f5959-4874-4c61-888d-6fb1cc4d72e6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:52:43 user nova-compute[74348]: DEBUG nova.policy [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a3b62e16105c4210bfc24e71c09ede28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaa9566ba2842d49f843dbddc59854d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 07:52:43 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 07:52:43 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 07:52:43 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Creating image(s)
Nov 22 07:52:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Acquiring lock "/opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:52:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lock "/opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:52:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lock "/opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:52:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:52:44 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:52:44 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:52:44 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:52:44 user nova-compute[74348]: DEBUG nova.compute.manager [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 07:52:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.180s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:52:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Acquiring lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:52:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:52:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:52:44 user nova-compute[74348]: DEBUG nova.compute.manager [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 07:52:44 user nova-compute[74348]: DEBUG nova.network.neutron [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 07:52:44 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 07:52:44 user nova-compute[74348]: DEBUG nova.compute.manager [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 07:52:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.204s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:52:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:52:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk 1073741824" returned: 0 in 0.060s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:52:44 user nova-compute[74348]: DEBUG nova.compute.manager [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 07:52:44 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 07:52:44 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Creating image(s)
Nov 22 07:52:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquiring lock "/opt/stack/data/nova/instances/5f3bbae3-babf-44d2-96da-c459fb77d9c7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:52:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "/opt/stack/data/nova/instances/5f3bbae3-babf-44d2-96da-c459fb77d9c7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:52:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "/opt/stack/data/nova/instances/5f3bbae3-babf-44d2-96da-c459fb77d9c7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:52:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:52:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:52:44 user nova-compute[74348]: DEBUG nova.policy [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2e8ce0d767724228bfd6cf3a4afad00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444367658c0241d0b5b377a73fedb52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 07:52:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:52:44 user sudo[83734]: pam_unix(sudo:session): session closed for user root
Nov 22 07:52:44 user nova-compute[74348]: INFO oslo.privsep.daemon [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Spawned new privsep daemon via rootwrap
Nov 22 07:52:44 user nova-compute[74348]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 22 07:52:44 user nova-compute[74348]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 22 07:52:44 user nova-compute[74348]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 22 07:52:44 user nova-compute[74348]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83743
Nov 22 07:52:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.190s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:52:44 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk. size=1073741824 {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 07:52:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:52:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.194s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:52:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquiring lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:52:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:52:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:52:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:52:44 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Cannot resize image /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk to a smaller size. {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 07:52:44 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 07:52:44 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Ensure instance console log exists: /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 07:52:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:52:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:52:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:52:44 user nova-compute[74348]: DEBUG nova.network.neutron [req-e06a5412-6362-495f-8c42-9a86a029a4d3 req-f252f2d0-a6f3-4bf0-96df-5c540e273d50 service nova] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Updated VIF entry in instance network info cache for port 06aa6370-ccfd-4a76-86ca-7bbfad795beb. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 07:52:44 user nova-compute[74348]: DEBUG nova.network.neutron [req-e06a5412-6362-495f-8c42-9a86a029a4d3 req-f252f2d0-a6f3-4bf0-96df-5c540e273d50 service nova] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Updating instance_info_cache with network_info: [{"id": "06aa6370-ccfd-4a76-86ca-7bbfad795beb", "address": "fa:16:3e:0d:49:2d", "network": {"id": "7f692ef6-9a86-4aba-a055-8877d70394ba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1993883418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee2e6be4a484d32bac3fda2043aa23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06aa6370-cc", "ovs_interfaceid": "06aa6370-ccfd-4a76-86ca-7bbfad795beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:52:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e06a5412-6362-495f-8c42-9a86a029a4d3 req-f252f2d0-a6f3-4bf0-96df-5c540e273d50 service nova] Releasing lock "refresh_cache-059bde4a-c5c9-45ab-9b4a-c969c74a6083" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:52:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.197s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:52:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/5f3bbae3-babf-44d2-96da-c459fb77d9c7/disk 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:52:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/5f3bbae3-babf-44d2-96da-c459fb77d9c7/disk 1073741824" returned: 0 in 0.065s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:52:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:52:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG nova.network.neutron [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Updating instance_info_cache with network_info: [{"id": "72ea4eea-6e08-44b2-9274-0f849d534f05", "address": "fa:16:3e:1e:82:7c", "network": {"id": "5c50496a-0882-415b-8115-ddf7b65516a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-531638472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f569146bb9b04838ad8044260da6ad58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72ea4eea-6e", "ovs_interfaceid": "72ea4eea-6e08-44b2-9274-0f849d534f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Releasing lock "refresh_cache-522f5959-4874-4c61-888d-6fb1cc4d72e6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG nova.compute.manager [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Instance network_info: |[{"id": "72ea4eea-6e08-44b2-9274-0f849d534f05", "address": "fa:16:3e:1e:82:7c", "network": {"id": "5c50496a-0882-415b-8115-ddf7b65516a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-531638472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f569146bb9b04838ad8044260da6ad58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72ea4eea-6e", "ovs_interfaceid": "72ea4eea-6e08-44b2-9274-0f849d534f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-18595321-b56c-45ff-a50a-88a0fc0cac92 req-a7e4f2c7-003f-453c-9997-50002a88fa3a service nova] Acquired lock "refresh_cache-522f5959-4874-4c61-888d-6fb1cc4d72e6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG nova.network.neutron [req-18595321-b56c-45ff-a50a-88a0fc0cac92 req-a7e4f2c7-003f-453c-9997-50002a88fa3a service nova] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Refreshing network info cache for port 72ea4eea-6e08-44b2-9274-0f849d534f05 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Start _get_guest_xml network_info=[{"id": "72ea4eea-6e08-44b2-9274-0f849d534f05", "address": "fa:16:3e:1e:82:7c", "network": {"id": "5c50496a-0882-415b-8115-ddf7b65516a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-531638472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f569146bb9b04838ad8044260da6ad58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72ea4eea-6e", "ovs_interfaceid": "72ea4eea-6e08-44b2-9274-0f849d534f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 07:52:45 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:52:45 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:52:45 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:52:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1983625057',display_name='tempest-AttachVolumeNegativeTest-server-1983625057',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1983625057',id=2,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUEUSzbhctY9QxlGiT7YnV5JvIkRFZox5OS7b+KfaYmQXTXFpWhe/1XseZC4+mBl1JkBrsltqpkgU7fseXZPlbodnE7rHw58wKDjvvRxRJ5zkvyLCGi1M8DnDfwOYoRog==',key_name='tempest-keypair-1590408668',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f569146bb9b04838ad8044260da6ad58',ramdisk_id='',reservation_id='r-od43lihf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1606364171',owner_user_name='tempest-AttachVolumeNegativeTest-1606364171-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:52:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8eca17e3a564220b3b07af4eddadaca',uuid=522f5959-4874-4c61-888d-6fb1cc4d72e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72ea4eea-6e08-44b2-9274-0f849d534f05", "address": "fa:16:3e:1e:82:7c", "network": {"id": "5c50496a-0882-415b-8115-ddf7b65516a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-531638472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f569146bb9b04838ad8044260da6ad58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72ea4eea-6e", "ovs_interfaceid": "72ea4eea-6e08-44b2-9274-0f849d534f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Converting VIF {"id": "72ea4eea-6e08-44b2-9274-0f849d534f05", "address": "fa:16:3e:1e:82:7c", "network": {"id": "5c50496a-0882-415b-8115-ddf7b65516a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-531638472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f569146bb9b04838ad8044260da6ad58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72ea4eea-6e", "ovs_interfaceid": "72ea4eea-6e08-44b2-9274-0f849d534f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:82:7c,bridge_name='br-int',has_traffic_filtering=True,id=72ea4eea-6e08-44b2-9274-0f849d534f05,network=Network(5c50496a-0882-415b-8115-ddf7b65516a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72ea4eea-6e') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG nova.objects.instance [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lazy-loading 'pci_devices' on Instance uuid 522f5959-4874-4c61-888d-6fb1cc4d72e6 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.192s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5f3bbae3-babf-44d2-96da-c459fb77d9c7/disk. size=1073741824 {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3bbae3-babf-44d2-96da-c459fb77d9c7/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] End _get_guest_xml xml=<domain type="kvm">
Nov 22 07:52:45 user nova-compute[74348]:   <uuid>522f5959-4874-4c61-888d-6fb1cc4d72e6</uuid>
Nov 22 07:52:45 user nova-compute[74348]:   <name>instance-00000002</name>
Nov 22 07:52:45 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 07:52:45 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 07:52:45 user nova-compute[74348]:   <metadata>
Nov 22 07:52:45 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 07:52:45 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 07:52:45 user nova-compute[74348]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1983625057</nova:name>
Nov 22 07:52:45 user nova-compute[74348]:       <nova:creationTime>2023-11-22 07:52:45</nova:creationTime>
Nov 22 07:52:45 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 07:52:45 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 07:52:45 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 07:52:45 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 07:52:45 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 07:52:45 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 07:52:45 user nova-compute[74348]:       </nova:flavor>
Nov 22 07:52:45 user nova-compute[74348]:       <nova:owner>
Nov 22 07:52:45 user nova-compute[74348]:         <nova:user uuid="f8eca17e3a564220b3b07af4eddadaca">tempest-AttachVolumeNegativeTest-1606364171-project-member</nova:user>
Nov 22 07:52:45 user nova-compute[74348]:         <nova:project uuid="f569146bb9b04838ad8044260da6ad58">tempest-AttachVolumeNegativeTest-1606364171</nova:project>
Nov 22 07:52:45 user nova-compute[74348]:       </nova:owner>
Nov 22 07:52:45 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 07:52:45 user nova-compute[74348]:       <nova:ports>
Nov 22 07:52:45 user nova-compute[74348]:         <nova:port uuid="72ea4eea-6e08-44b2-9274-0f849d534f05">
Nov 22 07:52:45 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 22 07:52:45 user nova-compute[74348]:         </nova:port>
Nov 22 07:52:45 user nova-compute[74348]:       </nova:ports>
Nov 22 07:52:45 user nova-compute[74348]:     </nova:instance>
Nov 22 07:52:45 user nova-compute[74348]:   </metadata>
Nov 22 07:52:45 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 07:52:45 user nova-compute[74348]:     <system>
Nov 22 07:52:45 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 07:52:45 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 07:52:45 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 07:52:45 user nova-compute[74348]:       <entry name="serial">522f5959-4874-4c61-888d-6fb1cc4d72e6</entry>
Nov 22 07:52:45 user nova-compute[74348]:       <entry name="uuid">522f5959-4874-4c61-888d-6fb1cc4d72e6</entry>
Nov 22 07:52:45 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 07:52:45 user nova-compute[74348]:     </system>
Nov 22 07:52:45 user nova-compute[74348]:   </sysinfo>
Nov 22 07:52:45 user nova-compute[74348]:   <os>
Nov 22 07:52:45 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 07:52:45 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 07:52:45 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 07:52:45 user nova-compute[74348]:   </os>
Nov 22 07:52:45 user nova-compute[74348]:   <features>
Nov 22 07:52:45 user nova-compute[74348]:     <acpi/>
Nov 22 07:52:45 user nova-compute[74348]:     <apic/>
Nov 22 07:52:45 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 07:52:45 user nova-compute[74348]:   </features>
Nov 22 07:52:45 user nova-compute[74348]:   <clock offset="utc">
Nov 22 07:52:45 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 07:52:45 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 07:52:45 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 07:52:45 user nova-compute[74348]:   </clock>
Nov 22 07:52:45 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 07:52:45 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 07:52:45 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 07:52:45 user nova-compute[74348]:   </cpu>
Nov 22 07:52:45 user nova-compute[74348]:   <devices>
Nov 22 07:52:45 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 07:52:45 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 07:52:45 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/522f5959-4874-4c61-888d-6fb1cc4d72e6/disk"/>
Nov 22 07:52:45 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 07:52:45 user nova-compute[74348]:     </disk>
Nov 22 07:52:45 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 07:52:45 user nova-compute[74348]:       <mac address="fa:16:3e:1e:82:7c"/>
Nov 22 07:52:45 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:52:45 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 07:52:45 user nova-compute[74348]:       <target dev="tap72ea4eea-6e"/>
Nov 22 07:52:45 user nova-compute[74348]:     </interface>
Nov 22 07:52:45 user nova-compute[74348]:     <serial type="pty">
Nov 22 07:52:45 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/522f5959-4874-4c61-888d-6fb1cc4d72e6/console.log" append="off"/>
Nov 22 07:52:45 user nova-compute[74348]:     </serial>
Nov 22 07:52:45 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 07:52:45 user nova-compute[74348]:     <video>
Nov 22 07:52:45 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:52:45 user nova-compute[74348]:     </video>
Nov 22 07:52:45 user nova-compute[74348]:     <rng model="virtio">
Nov 22 07:52:45 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 07:52:45 user nova-compute[74348]:     </rng>
Nov 22 07:52:45 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 07:52:45 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 07:52:45 user nova-compute[74348]:       <stats period="10"/>
Nov 22 07:52:45 user nova-compute[74348]:     </memballoon>
Nov 22 07:52:45 user nova-compute[74348]:   </devices>
Nov 22 07:52:45 user nova-compute[74348]: </domain>
Nov 22 07:52:45 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:52:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1983625057',display_name='tempest-AttachVolumeNegativeTest-server-1983625057',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1983625057',id=2,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUEUSzbhctY9QxlGiT7YnV5JvIkRFZox5OS7b+KfaYmQXTXFpWhe/1XseZC4+mBl1JkBrsltqpkgU7fseXZPlbodnE7rHw58wKDjvvRxRJ5zkvyLCGi1M8DnDfwOYoRog==',key_name='tempest-keypair-1590408668',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f569146bb9b04838ad8044260da6ad58',ramdisk_id='',reservation_id='r-od43lihf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1606364171',owner_user_name='tempest-AttachVolumeNegativeTest-1606364171-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:52:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8eca17e3a564220b3b07af4eddadaca',uuid=522f5959-4874-4c61-888d-6fb1cc4d72e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72ea4eea-6e08-44b2-9274-0f849d534f05", "address": "fa:16:3e:1e:82:7c", "network": {"id": "5c50496a-0882-415b-8115-ddf7b65516a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-531638472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f569146bb9b04838ad8044260da6ad58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72ea4eea-6e", "ovs_interfaceid": "72ea4eea-6e08-44b2-9274-0f849d534f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Converting VIF {"id": "72ea4eea-6e08-44b2-9274-0f849d534f05", "address": "fa:16:3e:1e:82:7c", "network": {"id": "5c50496a-0882-415b-8115-ddf7b65516a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-531638472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f569146bb9b04838ad8044260da6ad58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72ea4eea-6e", "ovs_interfaceid": "72ea4eea-6e08-44b2-9274-0f849d534f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:82:7c,bridge_name='br-int',has_traffic_filtering=True,id=72ea4eea-6e08-44b2-9274-0f849d534f05,network=Network(5c50496a-0882-415b-8115-ddf7b65516a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72ea4eea-6e') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG os_vif [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:82:7c,bridge_name='br-int',has_traffic_filtering=True,id=72ea4eea-6e08-44b2-9274-0f849d534f05,network=Network(5c50496a-0882-415b-8115-ddf7b65516a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72ea4eea-6e') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap06aa6370-cc, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap06aa6370-cc, col_values=(('qos', UUID('27d7ce62-e503-4fcf-a684-cae293b19664')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap06aa6370-cc, col_values=(('external_ids', {'iface-id': '06aa6370-ccfd-4a76-86ca-7bbfad795beb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:49:2d', 'vm-uuid': '059bde4a-c5c9-45ab-9b4a-c969c74a6083'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:45 user nova-compute[74348]: INFO os_vif [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:49:2d,bridge_name='br-int',has_traffic_filtering=True,id=06aa6370-ccfd-4a76-86ca-7bbfad795beb,network=Network(7f692ef6-9a86-4aba-a055-8877d70394ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06aa6370-cc')
Nov 22 07:52:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7ea1063d-f79a-5f5c-a50d-a8133be130c4', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72ea4eea-6e, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap72ea4eea-6e, col_values=(('qos', UUID('e1d445c5-8939-4620-848e-c95dca0a1db6')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap72ea4eea-6e, col_values=(('external_ids', {'iface-id': '72ea4eea-6e08-44b2-9274-0f849d534f05', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:82:7c', 'vm-uuid': '522f5959-4874-4c61-888d-6fb1cc4d72e6'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:45 user nova-compute[74348]: INFO os_vif [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:82:7c,bridge_name='br-int',has_traffic_filtering=True,id=72ea4eea-6e08-44b2-9274-0f849d534f05,network=Network(5c50496a-0882-415b-8115-ddf7b65516a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72ea4eea-6e')
Nov 22 07:52:45 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] No VIF found with MAC fa:16:3e:0d:49:2d, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] No VIF found with MAC fa:16:3e:1e:82:7c, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3bbae3-babf-44d2-96da-c459fb77d9c7/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Cannot resize image /opt/stack/data/nova/instances/5f3bbae3-babf-44d2-96da-c459fb77d9c7/disk to a smaller size. {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Ensure instance console log exists: /opt/stack/data/nova/instances/5f3bbae3-babf-44d2-96da-c459fb77d9c7/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.004s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Successfully updated port: 07295502-d217-400f-8b56-9ff1ccd600cf {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Acquiring lock "refresh_cache-bcedb385-b72a-49c2-b363-cf6da5804b60" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Acquired lock "refresh_cache-bcedb385-b72a-49c2-b363-cf6da5804b60" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:52:45 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 07:52:46 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 07:52:46 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Successfully created port: 618bd526-892d-4dfb-8ba6-f65e83e3f467 {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 07:52:46 user nova-compute[74348]: DEBUG nova.compute.manager [req-80f80330-79b5-4ab6-8b40-ef047eb3dd4d req-a8c2bcbb-48ed-45a1-8d48-abfc5396ae2d service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Received event network-changed-07295502-d217-400f-8b56-9ff1ccd600cf {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:52:46 user nova-compute[74348]: DEBUG nova.compute.manager [req-80f80330-79b5-4ab6-8b40-ef047eb3dd4d req-a8c2bcbb-48ed-45a1-8d48-abfc5396ae2d service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Refreshing instance network info cache due to event network-changed-07295502-d217-400f-8b56-9ff1ccd600cf. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:52:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-80f80330-79b5-4ab6-8b40-ef047eb3dd4d req-a8c2bcbb-48ed-45a1-8d48-abfc5396ae2d service nova] Acquiring lock "refresh_cache-bcedb385-b72a-49c2-b363-cf6da5804b60" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:52:46 user nova-compute[74348]: DEBUG nova.network.neutron [req-18595321-b56c-45ff-a50a-88a0fc0cac92 req-a7e4f2c7-003f-453c-9997-50002a88fa3a service nova] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Updated VIF entry in instance network info cache for port 72ea4eea-6e08-44b2-9274-0f849d534f05. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 07:52:46 user nova-compute[74348]: DEBUG nova.network.neutron [req-18595321-b56c-45ff-a50a-88a0fc0cac92 req-a7e4f2c7-003f-453c-9997-50002a88fa3a service nova] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Updating instance_info_cache with network_info: [{"id": "72ea4eea-6e08-44b2-9274-0f849d534f05", "address": "fa:16:3e:1e:82:7c", "network": {"id": "5c50496a-0882-415b-8115-ddf7b65516a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-531638472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f569146bb9b04838ad8044260da6ad58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72ea4eea-6e", "ovs_interfaceid": "72ea4eea-6e08-44b2-9274-0f849d534f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:52:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-18595321-b56c-45ff-a50a-88a0fc0cac92 req-a7e4f2c7-003f-453c-9997-50002a88fa3a service nova] Releasing lock "refresh_cache-522f5959-4874-4c61-888d-6fb1cc4d72e6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:52:46 user nova-compute[74348]: DEBUG nova.network.neutron [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Successfully created port: 094232d9-8ec1-401f-8908-2a698a5385bb {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 07:52:46 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Updating instance_info_cache with network_info: [{"id": "07295502-d217-400f-8b56-9ff1ccd600cf", "address": "fa:16:3e:50:0c:08", "network": {"id": "fd2e1dc2-9099-48b4-b56d-bc5d09c892fe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1689843295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52a21c1ef18473aa64c139de7b920ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07295502-d2", "ovs_interfaceid": "07295502-d217-400f-8b56-9ff1ccd600cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Releasing lock "refresh_cache-bcedb385-b72a-49c2-b363-cf6da5804b60" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Instance network_info: |[{"id": "07295502-d217-400f-8b56-9ff1ccd600cf", "address": "fa:16:3e:50:0c:08", "network": {"id": "fd2e1dc2-9099-48b4-b56d-bc5d09c892fe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1689843295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52a21c1ef18473aa64c139de7b920ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07295502-d2", "ovs_interfaceid": "07295502-d217-400f-8b56-9ff1ccd600cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-80f80330-79b5-4ab6-8b40-ef047eb3dd4d req-a8c2bcbb-48ed-45a1-8d48-abfc5396ae2d service nova] Acquired lock "refresh_cache-bcedb385-b72a-49c2-b363-cf6da5804b60" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG nova.network.neutron [req-80f80330-79b5-4ab6-8b40-ef047eb3dd4d req-a8c2bcbb-48ed-45a1-8d48-abfc5396ae2d service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Refreshing network info cache for port 07295502-d217-400f-8b56-9ff1ccd600cf {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Start _get_guest_xml network_info=[{"id": "07295502-d217-400f-8b56-9ff1ccd600cf", "address": "fa:16:3e:50:0c:08", "network": {"id": "fd2e1dc2-9099-48b4-b56d-bc5d09c892fe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1689843295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52a21c1ef18473aa64c139de7b920ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07295502-d2", "ovs_interfaceid": "07295502-d217-400f-8b56-9ff1ccd600cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 07:52:47 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:52:47 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:52:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:52:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1265518421',display_name='tempest-ServerStableDeviceRescueTest-server-1265518421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1265518421',id=3,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnGejlUCbU+TZ721uJZEGmLnTNVCBBM879Xewcu8isegoAWEt+xTskGWpM7X241rS86tQTNpoTmY80QMBL/L0CKb2yd4AKlvcL5MuFfyK4GKM1PMiVB7vqffS9ETA8vQg==',key_name='tempest-keypair-1916933864',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f52a21c1ef18473aa64c139de7b920ab',ramdisk_id='',reservation_id='r-hqpjdyae',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1621342321',owner_user_name='tempest-ServerStableDeviceRescueTest-1621342321-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:52:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7feabb30a9c14a209ad4fc962ef29481',uuid=bcedb385-b72a-49c2-b363-cf6da5804b60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07295502-d217-400f-8b56-9ff1ccd600cf", "address": "fa:16:3e:50:0c:08", "network": {"id": "fd2e1dc2-9099-48b4-b56d-bc5d09c892fe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1689843295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52a21c1ef18473aa64c139de7b920ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07295502-d2", "ovs_interfaceid": "07295502-d217-400f-8b56-9ff1ccd600cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Converting VIF {"id": "07295502-d217-400f-8b56-9ff1ccd600cf", "address": "fa:16:3e:50:0c:08", "network": {"id": "fd2e1dc2-9099-48b4-b56d-bc5d09c892fe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1689843295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52a21c1ef18473aa64c139de7b920ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07295502-d2", "ovs_interfaceid": "07295502-d217-400f-8b56-9ff1ccd600cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:0c:08,bridge_name='br-int',has_traffic_filtering=True,id=07295502-d217-400f-8b56-9ff1ccd600cf,network=Network(fd2e1dc2-9099-48b4-b56d-bc5d09c892fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07295502-d2') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG nova.objects.instance [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lazy-loading 'pci_devices' on Instance uuid bcedb385-b72a-49c2-b363-cf6da5804b60 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] End _get_guest_xml xml=<domain type="kvm">
Nov 22 07:52:47 user nova-compute[74348]:   <uuid>bcedb385-b72a-49c2-b363-cf6da5804b60</uuid>
Nov 22 07:52:47 user nova-compute[74348]:   <name>instance-00000003</name>
Nov 22 07:52:47 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 07:52:47 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 07:52:47 user nova-compute[74348]:   <metadata>
Nov 22 07:52:47 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 07:52:47 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 07:52:47 user nova-compute[74348]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1265518421</nova:name>
Nov 22 07:52:47 user nova-compute[74348]:       <nova:creationTime>2023-11-22 07:52:47</nova:creationTime>
Nov 22 07:52:47 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 07:52:47 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 07:52:47 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 07:52:47 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 07:52:47 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 07:52:47 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 07:52:47 user nova-compute[74348]:       </nova:flavor>
Nov 22 07:52:47 user nova-compute[74348]:       <nova:owner>
Nov 22 07:52:47 user nova-compute[74348]:         <nova:user uuid="7feabb30a9c14a209ad4fc962ef29481">tempest-ServerStableDeviceRescueTest-1621342321-project-member</nova:user>
Nov 22 07:52:47 user nova-compute[74348]:         <nova:project uuid="f52a21c1ef18473aa64c139de7b920ab">tempest-ServerStableDeviceRescueTest-1621342321</nova:project>
Nov 22 07:52:47 user nova-compute[74348]:       </nova:owner>
Nov 22 07:52:47 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 07:52:47 user nova-compute[74348]:       <nova:ports>
Nov 22 07:52:47 user nova-compute[74348]:         <nova:port uuid="07295502-d217-400f-8b56-9ff1ccd600cf">
Nov 22 07:52:47 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 22 07:52:47 user nova-compute[74348]:         </nova:port>
Nov 22 07:52:47 user nova-compute[74348]:       </nova:ports>
Nov 22 07:52:47 user nova-compute[74348]:     </nova:instance>
Nov 22 07:52:47 user nova-compute[74348]:   </metadata>
Nov 22 07:52:47 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 07:52:47 user nova-compute[74348]:     <system>
Nov 22 07:52:47 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 07:52:47 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 07:52:47 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 07:52:47 user nova-compute[74348]:       <entry name="serial">bcedb385-b72a-49c2-b363-cf6da5804b60</entry>
Nov 22 07:52:47 user nova-compute[74348]:       <entry name="uuid">bcedb385-b72a-49c2-b363-cf6da5804b60</entry>
Nov 22 07:52:47 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 07:52:47 user nova-compute[74348]:     </system>
Nov 22 07:52:47 user nova-compute[74348]:   </sysinfo>
Nov 22 07:52:47 user nova-compute[74348]:   <os>
Nov 22 07:52:47 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 07:52:47 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 07:52:47 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 07:52:47 user nova-compute[74348]:   </os>
Nov 22 07:52:47 user nova-compute[74348]:   <features>
Nov 22 07:52:47 user nova-compute[74348]:     <acpi/>
Nov 22 07:52:47 user nova-compute[74348]:     <apic/>
Nov 22 07:52:47 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 07:52:47 user nova-compute[74348]:   </features>
Nov 22 07:52:47 user nova-compute[74348]:   <clock offset="utc">
Nov 22 07:52:47 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 07:52:47 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 07:52:47 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 07:52:47 user nova-compute[74348]:   </clock>
Nov 22 07:52:47 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 07:52:47 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 07:52:47 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 07:52:47 user nova-compute[74348]:   </cpu>
Nov 22 07:52:47 user nova-compute[74348]:   <devices>
Nov 22 07:52:47 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 07:52:47 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 07:52:47 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk"/>
Nov 22 07:52:47 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 07:52:47 user nova-compute[74348]:     </disk>
Nov 22 07:52:47 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 07:52:47 user nova-compute[74348]:       <mac address="fa:16:3e:50:0c:08"/>
Nov 22 07:52:47 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:52:47 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 07:52:47 user nova-compute[74348]:       <target dev="tap07295502-d2"/>
Nov 22 07:52:47 user nova-compute[74348]:     </interface>
Nov 22 07:52:47 user nova-compute[74348]:     <serial type="pty">
Nov 22 07:52:47 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/console.log" append="off"/>
Nov 22 07:52:47 user nova-compute[74348]:     </serial>
Nov 22 07:52:47 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 07:52:47 user nova-compute[74348]:     <video>
Nov 22 07:52:47 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:52:47 user nova-compute[74348]:     </video>
Nov 22 07:52:47 user nova-compute[74348]:     <rng model="virtio">
Nov 22 07:52:47 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 07:52:47 user nova-compute[74348]:     </rng>
Nov 22 07:52:47 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 07:52:47 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 07:52:47 user nova-compute[74348]:       <stats period="10"/>
Nov 22 07:52:47 user nova-compute[74348]:     </memballoon>
Nov 22 07:52:47 user nova-compute[74348]:   </devices>
Nov 22 07:52:47 user nova-compute[74348]: </domain>
Nov 22 07:52:47 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:52:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1265518421',display_name='tempest-ServerStableDeviceRescueTest-server-1265518421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1265518421',id=3,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnGejlUCbU+TZ721uJZEGmLnTNVCBBM879Xewcu8isegoAWEt+xTskGWpM7X241rS86tQTNpoTmY80QMBL/L0CKb2yd4AKlvcL5MuFfyK4GKM1PMiVB7vqffS9ETA8vQg==',key_name='tempest-keypair-1916933864',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f52a21c1ef18473aa64c139de7b920ab',ramdisk_id='',reservation_id='r-hqpjdyae',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1621342321',owner_user_name='tempest-ServerStableDeviceRescueTest-1621342321-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:52:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7feabb30a9c14a209ad4fc962ef29481',uuid=bcedb385-b72a-49c2-b363-cf6da5804b60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07295502-d217-400f-8b56-9ff1ccd600cf", "address": "fa:16:3e:50:0c:08", "network": {"id": "fd2e1dc2-9099-48b4-b56d-bc5d09c892fe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1689843295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52a21c1ef18473aa64c139de7b920ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07295502-d2", "ovs_interfaceid": "07295502-d217-400f-8b56-9ff1ccd600cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Converting VIF {"id": "07295502-d217-400f-8b56-9ff1ccd600cf", "address": "fa:16:3e:50:0c:08", "network": {"id": "fd2e1dc2-9099-48b4-b56d-bc5d09c892fe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1689843295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52a21c1ef18473aa64c139de7b920ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07295502-d2", "ovs_interfaceid": "07295502-d217-400f-8b56-9ff1ccd600cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:0c:08,bridge_name='br-int',has_traffic_filtering=True,id=07295502-d217-400f-8b56-9ff1ccd600cf,network=Network(fd2e1dc2-9099-48b4-b56d-bc5d09c892fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07295502-d2') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG os_vif [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:0c:08,bridge_name='br-int',has_traffic_filtering=True,id=07295502-d217-400f-8b56-9ff1ccd600cf,network=Network(fd2e1dc2-9099-48b4-b56d-bc5d09c892fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07295502-d2') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2238c748-b985-5684-8716-f94854e3eeed', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap07295502-d2, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap07295502-d2, col_values=(('qos', UUID('0ff8e10b-5dd7-4458-a7c4-aa8255219e10')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap07295502-d2, col_values=(('external_ids', {'iface-id': '07295502-d217-400f-8b56-9ff1ccd600cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:0c:08', 'vm-uuid': 'bcedb385-b72a-49c2-b363-cf6da5804b60'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:47 user nova-compute[74348]: INFO os_vif [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:0c:08,bridge_name='br-int',has_traffic_filtering=True,id=07295502-d217-400f-8b56-9ff1ccd600cf,network=Network(fd2e1dc2-9099-48b4-b56d-bc5d09c892fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07295502-d2')
Nov 22 07:52:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] No VIF found with MAC fa:16:3e:50:0c:08, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:48 user nova-compute[74348]: DEBUG nova.network.neutron [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Successfully updated port: 094232d9-8ec1-401f-8908-2a698a5385bb {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 07:52:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquiring lock "refresh_cache-5f3bbae3-babf-44d2-96da-c459fb77d9c7" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:52:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquired lock "refresh_cache-5f3bbae3-babf-44d2-96da-c459fb77d9c7" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:52:48 user nova-compute[74348]: DEBUG nova.network.neutron [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 07:52:48 user nova-compute[74348]: DEBUG nova.network.neutron [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 07:52:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:48 user nova-compute[74348]: DEBUG nova.compute.manager [req-3fd3b5f0-fd51-46e4-86b9-8f2ef40abef1 req-d920263e-0dca-48ef-937b-e4553a88a8b4 service nova] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Received event network-changed-094232d9-8ec1-401f-8908-2a698a5385bb {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:52:48 user nova-compute[74348]: DEBUG nova.compute.manager [req-3fd3b5f0-fd51-46e4-86b9-8f2ef40abef1 req-d920263e-0dca-48ef-937b-e4553a88a8b4 service nova] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Refreshing instance network info cache due to event network-changed-094232d9-8ec1-401f-8908-2a698a5385bb. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:52:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3fd3b5f0-fd51-46e4-86b9-8f2ef40abef1 req-d920263e-0dca-48ef-937b-e4553a88a8b4 service nova] Acquiring lock "refresh_cache-5f3bbae3-babf-44d2-96da-c459fb77d9c7" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:52:48 user nova-compute[74348]: DEBUG nova.network.neutron [req-80f80330-79b5-4ab6-8b40-ef047eb3dd4d req-a8c2bcbb-48ed-45a1-8d48-abfc5396ae2d service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Updated VIF entry in instance network info cache for port 07295502-d217-400f-8b56-9ff1ccd600cf. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 07:52:48 user nova-compute[74348]: DEBUG nova.network.neutron [req-80f80330-79b5-4ab6-8b40-ef047eb3dd4d req-a8c2bcbb-48ed-45a1-8d48-abfc5396ae2d service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Updating instance_info_cache with network_info: [{"id": "07295502-d217-400f-8b56-9ff1ccd600cf", "address": "fa:16:3e:50:0c:08", "network": {"id": "fd2e1dc2-9099-48b4-b56d-bc5d09c892fe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1689843295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52a21c1ef18473aa64c139de7b920ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07295502-d2", "ovs_interfaceid": "07295502-d217-400f-8b56-9ff1ccd600cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:52:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-80f80330-79b5-4ab6-8b40-ef047eb3dd4d req-a8c2bcbb-48ed-45a1-8d48-abfc5396ae2d service nova] Releasing lock "refresh_cache-bcedb385-b72a-49c2-b363-cf6da5804b60" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:52:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:48 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Successfully updated port: 618bd526-892d-4dfb-8ba6-f65e83e3f467 {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 07:52:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Acquiring lock "refresh_cache-e36789b1-45e6-40f7-ba97-8962cb116a39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:52:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Acquired lock "refresh_cache-e36789b1-45e6-40f7-ba97-8962cb116a39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:52:48 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 07:52:48 user nova-compute[74348]: DEBUG nova.compute.manager [req-2606867a-2c67-4459-9f18-a2bb19025ed6 req-26f90bb2-5c38-4eb5-b52d-1aa0ff011714 service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Received event network-changed-618bd526-892d-4dfb-8ba6-f65e83e3f467 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:52:48 user nova-compute[74348]: DEBUG nova.compute.manager [req-2606867a-2c67-4459-9f18-a2bb19025ed6 req-26f90bb2-5c38-4eb5-b52d-1aa0ff011714 service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Refreshing instance network info cache due to event network-changed-618bd526-892d-4dfb-8ba6-f65e83e3f467. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:52:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2606867a-2c67-4459-9f18-a2bb19025ed6 req-26f90bb2-5c38-4eb5-b52d-1aa0ff011714 service nova] Acquiring lock "refresh_cache-e36789b1-45e6-40f7-ba97-8962cb116a39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:52:48 user nova-compute[74348]: DEBUG nova.network.neutron [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Updating instance_info_cache with network_info: [{"id": "094232d9-8ec1-401f-8908-2a698a5385bb", "address": "fa:16:3e:db:2f:02", "network": {"id": "4ef640bb-4a2f-4f98-8b01-b5df87fcb35a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1216437312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444367658c0241d0b5b377a73fedb52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap094232d9-8e", "ovs_interfaceid": "094232d9-8ec1-401f-8908-2a698a5385bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:52:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Releasing lock "refresh_cache-5f3bbae3-babf-44d2-96da-c459fb77d9c7" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:52:48 user nova-compute[74348]: DEBUG nova.compute.manager [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Instance network_info: |[{"id": "094232d9-8ec1-401f-8908-2a698a5385bb", "address": "fa:16:3e:db:2f:02", "network": {"id": "4ef640bb-4a2f-4f98-8b01-b5df87fcb35a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1216437312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444367658c0241d0b5b377a73fedb52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap094232d9-8e", "ovs_interfaceid": "094232d9-8ec1-401f-8908-2a698a5385bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 07:52:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3fd3b5f0-fd51-46e4-86b9-8f2ef40abef1 req-d920263e-0dca-48ef-937b-e4553a88a8b4 service nova] Acquired lock "refresh_cache-5f3bbae3-babf-44d2-96da-c459fb77d9c7" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:52:48 user nova-compute[74348]: DEBUG nova.network.neutron [req-3fd3b5f0-fd51-46e4-86b9-8f2ef40abef1 req-d920263e-0dca-48ef-937b-e4553a88a8b4 service nova] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Refreshing network info cache for port 094232d9-8ec1-401f-8908-2a698a5385bb {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:52:48 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Start _get_guest_xml network_info=[{"id": "094232d9-8ec1-401f-8908-2a698a5385bb", "address": "fa:16:3e:db:2f:02", "network": {"id": "4ef640bb-4a2f-4f98-8b01-b5df87fcb35a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1216437312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444367658c0241d0b5b377a73fedb52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap094232d9-8e", "ovs_interfaceid": "094232d9-8ec1-401f-8908-2a698a5385bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 07:52:49 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:52:49 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1450258036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1450258036',id=5,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1mtconRFrvBaGaD9CZoZHOYetItLhh+X0u+WBLx8FOzUxBxl1z1yZwHXr7/IGky0lzZ93nU+B2OiX2u0QzHbm4aEnwCi0/69yJ8ttWXpalWyUQuVbL5dlCSEydwFRPsA==',key_name='tempest-keypair-784392895',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='444367658c0241d0b5b377a73fedb52b',ramdisk_id='',reservation_id='r-7t8ojxyu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1610098589',owner_user_name='tempest-AttachVolumeShelveTestJSON-1610098589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:52:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e8ce0d767724228bfd6cf3a4afad00d',uuid=5f3bbae3-babf-44d2-96da-c459fb77d9c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "094232d9-8ec1-401f-8908-2a698a5385bb", "address": "fa:16:3e:db:2f:02", "network": {"id": "4ef640bb-4a2f-4f98-8b01-b5df87fcb35a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1216437312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444367658c0241d0b5b377a73fedb52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap094232d9-8e", "ovs_interfaceid": "094232d9-8ec1-401f-8908-2a698a5385bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Converting VIF {"id": "094232d9-8ec1-401f-8908-2a698a5385bb", "address": "fa:16:3e:db:2f:02", "network": {"id": "4ef640bb-4a2f-4f98-8b01-b5df87fcb35a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1216437312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444367658c0241d0b5b377a73fedb52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap094232d9-8e", "ovs_interfaceid": "094232d9-8ec1-401f-8908-2a698a5385bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:2f:02,bridge_name='br-int',has_traffic_filtering=True,id=094232d9-8ec1-401f-8908-2a698a5385bb,network=Network(4ef640bb-4a2f-4f98-8b01-b5df87fcb35a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap094232d9-8e') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.objects.instance [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lazy-loading 'pci_devices' on Instance uuid 5f3bbae3-babf-44d2-96da-c459fb77d9c7 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] End _get_guest_xml xml=<domain type="kvm">
Nov 22 07:52:49 user nova-compute[74348]:   <uuid>5f3bbae3-babf-44d2-96da-c459fb77d9c7</uuid>
Nov 22 07:52:49 user nova-compute[74348]:   <name>instance-00000005</name>
Nov 22 07:52:49 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 07:52:49 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 07:52:49 user nova-compute[74348]:   <metadata>
Nov 22 07:52:49 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 07:52:49 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 07:52:49 user nova-compute[74348]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1450258036</nova:name>
Nov 22 07:52:49 user nova-compute[74348]:       <nova:creationTime>2023-11-22 07:52:49</nova:creationTime>
Nov 22 07:52:49 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 07:52:49 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 07:52:49 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 07:52:49 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 07:52:49 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 07:52:49 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 07:52:49 user nova-compute[74348]:       </nova:flavor>
Nov 22 07:52:49 user nova-compute[74348]:       <nova:owner>
Nov 22 07:52:49 user nova-compute[74348]:         <nova:user uuid="2e8ce0d767724228bfd6cf3a4afad00d">tempest-AttachVolumeShelveTestJSON-1610098589-project-member</nova:user>
Nov 22 07:52:49 user nova-compute[74348]:         <nova:project uuid="444367658c0241d0b5b377a73fedb52b">tempest-AttachVolumeShelveTestJSON-1610098589</nova:project>
Nov 22 07:52:49 user nova-compute[74348]:       </nova:owner>
Nov 22 07:52:49 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 07:52:49 user nova-compute[74348]:       <nova:ports>
Nov 22 07:52:49 user nova-compute[74348]:         <nova:port uuid="094232d9-8ec1-401f-8908-2a698a5385bb">
Nov 22 07:52:49 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 22 07:52:49 user nova-compute[74348]:         </nova:port>
Nov 22 07:52:49 user nova-compute[74348]:       </nova:ports>
Nov 22 07:52:49 user nova-compute[74348]:     </nova:instance>
Nov 22 07:52:49 user nova-compute[74348]:   </metadata>
Nov 22 07:52:49 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 07:52:49 user nova-compute[74348]:     <system>
Nov 22 07:52:49 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 07:52:49 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 07:52:49 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 07:52:49 user nova-compute[74348]:       <entry name="serial">5f3bbae3-babf-44d2-96da-c459fb77d9c7</entry>
Nov 22 07:52:49 user nova-compute[74348]:       <entry name="uuid">5f3bbae3-babf-44d2-96da-c459fb77d9c7</entry>
Nov 22 07:52:49 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 07:52:49 user nova-compute[74348]:     </system>
Nov 22 07:52:49 user nova-compute[74348]:   </sysinfo>
Nov 22 07:52:49 user nova-compute[74348]:   <os>
Nov 22 07:52:49 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 07:52:49 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 07:52:49 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 07:52:49 user nova-compute[74348]:   </os>
Nov 22 07:52:49 user nova-compute[74348]:   <features>
Nov 22 07:52:49 user nova-compute[74348]:     <acpi/>
Nov 22 07:52:49 user nova-compute[74348]:     <apic/>
Nov 22 07:52:49 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 07:52:49 user nova-compute[74348]:   </features>
Nov 22 07:52:49 user nova-compute[74348]:   <clock offset="utc">
Nov 22 07:52:49 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 07:52:49 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 07:52:49 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 07:52:49 user nova-compute[74348]:   </clock>
Nov 22 07:52:49 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 07:52:49 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 07:52:49 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 07:52:49 user nova-compute[74348]:   </cpu>
Nov 22 07:52:49 user nova-compute[74348]:   <devices>
Nov 22 07:52:49 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 07:52:49 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 07:52:49 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/5f3bbae3-babf-44d2-96da-c459fb77d9c7/disk"/>
Nov 22 07:52:49 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 07:52:49 user nova-compute[74348]:     </disk>
Nov 22 07:52:49 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 07:52:49 user nova-compute[74348]:       <mac address="fa:16:3e:db:2f:02"/>
Nov 22 07:52:49 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:52:49 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 07:52:49 user nova-compute[74348]:       <target dev="tap094232d9-8e"/>
Nov 22 07:52:49 user nova-compute[74348]:     </interface>
Nov 22 07:52:49 user nova-compute[74348]:     <serial type="pty">
Nov 22 07:52:49 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/5f3bbae3-babf-44d2-96da-c459fb77d9c7/console.log" append="off"/>
Nov 22 07:52:49 user nova-compute[74348]:     </serial>
Nov 22 07:52:49 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 07:52:49 user nova-compute[74348]:     <video>
Nov 22 07:52:49 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:52:49 user nova-compute[74348]:     </video>
Nov 22 07:52:49 user nova-compute[74348]:     <rng model="virtio">
Nov 22 07:52:49 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 07:52:49 user nova-compute[74348]:     </rng>
Nov 22 07:52:49 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 07:52:49 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 07:52:49 user nova-compute[74348]:       <stats period="10"/>
Nov 22 07:52:49 user nova-compute[74348]:     </memballoon>
Nov 22 07:52:49 user nova-compute[74348]:   </devices>
Nov 22 07:52:49 user nova-compute[74348]: </domain>
Nov 22 07:52:49 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1450258036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1450258036',id=5,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1mtconRFrvBaGaD9CZoZHOYetItLhh+X0u+WBLx8FOzUxBxl1z1yZwHXr7/IGky0lzZ93nU+B2OiX2u0QzHbm4aEnwCi0/69yJ8ttWXpalWyUQuVbL5dlCSEydwFRPsA==',key_name='tempest-keypair-784392895',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='444367658c0241d0b5b377a73fedb52b',ramdisk_id='',reservation_id='r-7t8ojxyu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1610098589',owner_user_name='tempest-AttachVolumeShelveTestJSON-1610098589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:52:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e8ce0d767724228bfd6cf3a4afad00d',uuid=5f3bbae3-babf-44d2-96da-c459fb77d9c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "094232d9-8ec1-401f-8908-2a698a5385bb", "address": "fa:16:3e:db:2f:02", "network": {"id": "4ef640bb-4a2f-4f98-8b01-b5df87fcb35a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1216437312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444367658c0241d0b5b377a73fedb52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap094232d9-8e", "ovs_interfaceid": "094232d9-8ec1-401f-8908-2a698a5385bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Converting VIF {"id": "094232d9-8ec1-401f-8908-2a698a5385bb", "address": "fa:16:3e:db:2f:02", "network": {"id": "4ef640bb-4a2f-4f98-8b01-b5df87fcb35a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1216437312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444367658c0241d0b5b377a73fedb52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap094232d9-8e", "ovs_interfaceid": "094232d9-8ec1-401f-8908-2a698a5385bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:2f:02,bridge_name='br-int',has_traffic_filtering=True,id=094232d9-8ec1-401f-8908-2a698a5385bb,network=Network(4ef640bb-4a2f-4f98-8b01-b5df87fcb35a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap094232d9-8e') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG os_vif [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:2f:02,bridge_name='br-int',has_traffic_filtering=True,id=094232d9-8ec1-401f-8908-2a698a5385bb,network=Network(4ef640bb-4a2f-4f98-8b01-b5df87fcb35a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap094232d9-8e') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '97a3bd30-7f97-5aa1-aecb-80ea76b9cfa5', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap094232d9-8e, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap094232d9-8e, col_values=(('qos', UUID('88b511a4-f697-4e8b-b16e-48dda1c2eade')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap094232d9-8e, col_values=(('external_ids', {'iface-id': '094232d9-8ec1-401f-8908-2a698a5385bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:2f:02', 'vm-uuid': '5f3bbae3-babf-44d2-96da-c459fb77d9c7'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:52:49 user nova-compute[74348]: INFO os_vif [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:2f:02,bridge_name='br-int',has_traffic_filtering=True,id=094232d9-8ec1-401f-8908-2a698a5385bb,network=Network(4ef640bb-4a2f-4f98-8b01-b5df87fcb35a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap094232d9-8e')
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] No VIF found with MAC fa:16:3e:db:2f:02, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.network.neutron [req-3fd3b5f0-fd51-46e4-86b9-8f2ef40abef1 req-d920263e-0dca-48ef-937b-e4553a88a8b4 service nova] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Updated VIF entry in instance network info cache for port 094232d9-8ec1-401f-8908-2a698a5385bb. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.network.neutron [req-3fd3b5f0-fd51-46e4-86b9-8f2ef40abef1 req-d920263e-0dca-48ef-937b-e4553a88a8b4 service nova] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Updating instance_info_cache with network_info: [{"id": "094232d9-8ec1-401f-8908-2a698a5385bb", "address": "fa:16:3e:db:2f:02", "network": {"id": "4ef640bb-4a2f-4f98-8b01-b5df87fcb35a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1216437312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444367658c0241d0b5b377a73fedb52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap094232d9-8e", "ovs_interfaceid": "094232d9-8ec1-401f-8908-2a698a5385bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3fd3b5f0-fd51-46e4-86b9-8f2ef40abef1 req-d920263e-0dca-48ef-937b-e4553a88a8b4 service nova] Releasing lock "refresh_cache-5f3bbae3-babf-44d2-96da-c459fb77d9c7" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Updating instance_info_cache with network_info: [{"id": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "address": "fa:16:3e:a7:50:2a", "network": {"id": "8a783b63-dae2-41eb-a00a-5cf8e94a5412", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872095489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beaa9566ba2842d49f843dbddc59854d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap618bd526-89", "ovs_interfaceid": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Releasing lock "refresh_cache-e36789b1-45e6-40f7-ba97-8962cb116a39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Instance network_info: |[{"id": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "address": "fa:16:3e:a7:50:2a", "network": {"id": "8a783b63-dae2-41eb-a00a-5cf8e94a5412", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872095489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beaa9566ba2842d49f843dbddc59854d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap618bd526-89", "ovs_interfaceid": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2606867a-2c67-4459-9f18-a2bb19025ed6 req-26f90bb2-5c38-4eb5-b52d-1aa0ff011714 service nova] Acquired lock "refresh_cache-e36789b1-45e6-40f7-ba97-8962cb116a39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.network.neutron [req-2606867a-2c67-4459-9f18-a2bb19025ed6 req-26f90bb2-5c38-4eb5-b52d-1aa0ff011714 service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Refreshing network info cache for port 618bd526-892d-4dfb-8ba6-f65e83e3f467 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Start _get_guest_xml network_info=[{"id": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "address": "fa:16:3e:a7:50:2a", "network": {"id": "8a783b63-dae2-41eb-a00a-5cf8e94a5412", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872095489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beaa9566ba2842d49f843dbddc59854d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap618bd526-89", "ovs_interfaceid": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 07:52:49 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:52:49 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2131516711',display_name='tempest-ServerActionsTestOtherB-server-2131516711',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2131516711',id=4,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNk1MOJm11bQ93eU1QYv8ji0a1vxy2ayCOX/9R0SEaykivxTwmzY2ykLPWhT+1BMkwgumhcTt15jzBxURGp9c6w0OYjMGs9IXzcm5BaMYRSciSb/BXxgpEqQZEDxBbmLrQ==',key_name='tempest-keypair-1880925410',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='beaa9566ba2842d49f843dbddc59854d',ramdisk_id='',reservation_id='r-0nqnkret',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-849589705',owner_user_name='tempest-ServerActionsTestOtherB-849589705-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:52:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3b62e16105c4210bfc24e71c09ede28',uuid=e36789b1-45e6-40f7-ba97-8962cb116a39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "address": "fa:16:3e:a7:50:2a", "network": {"id": "8a783b63-dae2-41eb-a00a-5cf8e94a5412", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872095489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beaa9566ba2842d49f843dbddc59854d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap618bd526-89", "ovs_interfaceid": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Converting VIF {"id": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "address": "fa:16:3e:a7:50:2a", "network": {"id": "8a783b63-dae2-41eb-a00a-5cf8e94a5412", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872095489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beaa9566ba2842d49f843dbddc59854d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap618bd526-89", "ovs_interfaceid": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:50:2a,bridge_name='br-int',has_traffic_filtering=True,id=618bd526-892d-4dfb-8ba6-f65e83e3f467,network=Network(8a783b63-dae2-41eb-a00a-5cf8e94a5412),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap618bd526-89') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.objects.instance [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lazy-loading 'pci_devices' on Instance uuid e36789b1-45e6-40f7-ba97-8962cb116a39 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] End _get_guest_xml xml=<domain type="kvm">
Nov 22 07:52:49 user nova-compute[74348]:   <uuid>e36789b1-45e6-40f7-ba97-8962cb116a39</uuid>
Nov 22 07:52:49 user nova-compute[74348]:   <name>instance-00000004</name>
Nov 22 07:52:49 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 07:52:49 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 07:52:49 user nova-compute[74348]:   <metadata>
Nov 22 07:52:49 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 07:52:49 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 07:52:49 user nova-compute[74348]:       <nova:name>tempest-ServerActionsTestOtherB-server-2131516711</nova:name>
Nov 22 07:52:49 user nova-compute[74348]:       <nova:creationTime>2023-11-22 07:52:49</nova:creationTime>
Nov 22 07:52:49 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 07:52:49 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 07:52:49 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 07:52:49 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 07:52:49 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 07:52:49 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 07:52:49 user nova-compute[74348]:       </nova:flavor>
Nov 22 07:52:49 user nova-compute[74348]:       <nova:owner>
Nov 22 07:52:49 user nova-compute[74348]:         <nova:user uuid="a3b62e16105c4210bfc24e71c09ede28">tempest-ServerActionsTestOtherB-849589705-project-member</nova:user>
Nov 22 07:52:49 user nova-compute[74348]:         <nova:project uuid="beaa9566ba2842d49f843dbddc59854d">tempest-ServerActionsTestOtherB-849589705</nova:project>
Nov 22 07:52:49 user nova-compute[74348]:       </nova:owner>
Nov 22 07:52:49 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 07:52:49 user nova-compute[74348]:       <nova:ports>
Nov 22 07:52:49 user nova-compute[74348]:         <nova:port uuid="618bd526-892d-4dfb-8ba6-f65e83e3f467">
Nov 22 07:52:49 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 22 07:52:49 user nova-compute[74348]:         </nova:port>
Nov 22 07:52:49 user nova-compute[74348]:       </nova:ports>
Nov 22 07:52:49 user nova-compute[74348]:     </nova:instance>
Nov 22 07:52:49 user nova-compute[74348]:   </metadata>
Nov 22 07:52:49 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 07:52:49 user nova-compute[74348]:     <system>
Nov 22 07:52:49 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 07:52:49 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 07:52:49 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 07:52:49 user nova-compute[74348]:       <entry name="serial">e36789b1-45e6-40f7-ba97-8962cb116a39</entry>
Nov 22 07:52:49 user nova-compute[74348]:       <entry name="uuid">e36789b1-45e6-40f7-ba97-8962cb116a39</entry>
Nov 22 07:52:49 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 07:52:49 user nova-compute[74348]:     </system>
Nov 22 07:52:49 user nova-compute[74348]:   </sysinfo>
Nov 22 07:52:49 user nova-compute[74348]:   <os>
Nov 22 07:52:49 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 07:52:49 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 07:52:49 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 07:52:49 user nova-compute[74348]:   </os>
Nov 22 07:52:49 user nova-compute[74348]:   <features>
Nov 22 07:52:49 user nova-compute[74348]:     <acpi/>
Nov 22 07:52:49 user nova-compute[74348]:     <apic/>
Nov 22 07:52:49 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 07:52:49 user nova-compute[74348]:   </features>
Nov 22 07:52:49 user nova-compute[74348]:   <clock offset="utc">
Nov 22 07:52:49 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 07:52:49 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 07:52:49 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 07:52:49 user nova-compute[74348]:   </clock>
Nov 22 07:52:49 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 07:52:49 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 07:52:49 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 07:52:49 user nova-compute[74348]:   </cpu>
Nov 22 07:52:49 user nova-compute[74348]:   <devices>
Nov 22 07:52:49 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 07:52:49 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 07:52:49 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk"/>
Nov 22 07:52:49 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 07:52:49 user nova-compute[74348]:     </disk>
Nov 22 07:52:49 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 07:52:49 user nova-compute[74348]:       <mac address="fa:16:3e:a7:50:2a"/>
Nov 22 07:52:49 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:52:49 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 07:52:49 user nova-compute[74348]:       <target dev="tap618bd526-89"/>
Nov 22 07:52:49 user nova-compute[74348]:     </interface>
Nov 22 07:52:49 user nova-compute[74348]:     <serial type="pty">
Nov 22 07:52:49 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/console.log" append="off"/>
Nov 22 07:52:49 user nova-compute[74348]:     </serial>
Nov 22 07:52:49 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 07:52:49 user nova-compute[74348]:     <video>
Nov 22 07:52:49 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:52:49 user nova-compute[74348]:     </video>
Nov 22 07:52:49 user nova-compute[74348]:     <rng model="virtio">
Nov 22 07:52:49 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 07:52:49 user nova-compute[74348]:     </rng>
Nov 22 07:52:49 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 07:52:49 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 07:52:49 user nova-compute[74348]:       <stats period="10"/>
Nov 22 07:52:49 user nova-compute[74348]:     </memballoon>
Nov 22 07:52:49 user nova-compute[74348]:   </devices>
Nov 22 07:52:49 user nova-compute[74348]: </domain>
Nov 22 07:52:49 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2131516711',display_name='tempest-ServerActionsTestOtherB-server-2131516711',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2131516711',id=4,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNk1MOJm11bQ93eU1QYv8ji0a1vxy2ayCOX/9R0SEaykivxTwmzY2ykLPWhT+1BMkwgumhcTt15jzBxURGp9c6w0OYjMGs9IXzcm5BaMYRSciSb/BXxgpEqQZEDxBbmLrQ==',key_name='tempest-keypair-1880925410',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='beaa9566ba2842d49f843dbddc59854d',ramdisk_id='',reservation_id='r-0nqnkret',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-849589705',owner_user_name='tempest-ServerActionsTestOtherB-849589705-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:52:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3b62e16105c4210bfc24e71c09ede28',uuid=e36789b1-45e6-40f7-ba97-8962cb116a39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "address": "fa:16:3e:a7:50:2a", "network": {"id": "8a783b63-dae2-41eb-a00a-5cf8e94a5412", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872095489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beaa9566ba2842d49f843dbddc59854d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap618bd526-89", "ovs_interfaceid": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Converting VIF {"id": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "address": "fa:16:3e:a7:50:2a", "network": {"id": "8a783b63-dae2-41eb-a00a-5cf8e94a5412", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872095489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beaa9566ba2842d49f843dbddc59854d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap618bd526-89", "ovs_interfaceid": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:50:2a,bridge_name='br-int',has_traffic_filtering=True,id=618bd526-892d-4dfb-8ba6-f65e83e3f467,network=Network(8a783b63-dae2-41eb-a00a-5cf8e94a5412),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap618bd526-89') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG os_vif [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:50:2a,bridge_name='br-int',has_traffic_filtering=True,id=618bd526-892d-4dfb-8ba6-f65e83e3f467,network=Network(8a783b63-dae2-41eb-a00a-5cf8e94a5412),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap618bd526-89') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3dbd3f92-55f5-5042-88ab-15741eaa68d0', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap618bd526-89, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap618bd526-89, col_values=(('qos', UUID('8a8736b9-d067-4ac0-a42a-c21890c95775')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap618bd526-89, col_values=(('external_ids', {'iface-id': '618bd526-892d-4dfb-8ba6-f65e83e3f467', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:50:2a', 'vm-uuid': 'e36789b1-45e6-40f7-ba97-8962cb116a39'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:52:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:49 user nova-compute[74348]: INFO os_vif [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:50:2a,bridge_name='br-int',has_traffic_filtering=True,id=618bd526-892d-4dfb-8ba6-f65e83e3f467,network=Network(8a783b63-dae2-41eb-a00a-5cf8e94a5412),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap618bd526-89')
Nov 22 07:52:50 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:52:50 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] No VIF found with MAC fa:16:3e:a7:50:2a, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 07:52:50 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:50 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:50 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:50 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:50 user nova-compute[74348]: DEBUG nova.network.neutron [req-2606867a-2c67-4459-9f18-a2bb19025ed6 req-26f90bb2-5c38-4eb5-b52d-1aa0ff011714 service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Updated VIF entry in instance network info cache for port 618bd526-892d-4dfb-8ba6-f65e83e3f467. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 07:52:50 user nova-compute[74348]: DEBUG nova.network.neutron [req-2606867a-2c67-4459-9f18-a2bb19025ed6 req-26f90bb2-5c38-4eb5-b52d-1aa0ff011714 service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Updating instance_info_cache with network_info: [{"id": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "address": "fa:16:3e:a7:50:2a", "network": {"id": "8a783b63-dae2-41eb-a00a-5cf8e94a5412", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872095489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beaa9566ba2842d49f843dbddc59854d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap618bd526-89", "ovs_interfaceid": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:52:50 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2606867a-2c67-4459-9f18-a2bb19025ed6 req-26f90bb2-5c38-4eb5-b52d-1aa0ff011714 service nova] Releasing lock "refresh_cache-e36789b1-45e6-40f7-ba97-8962cb116a39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:52:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:52 user nova-compute[74348]: DEBUG nova.compute.manager [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 07:52:52 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 07:52:52 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Instance spawned successfully.
Nov 22 07:52:52 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 07:52:52 user nova-compute[74348]: DEBUG nova.compute.manager [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 07:52:52 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 07:52:52 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:52:52 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:52:52 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:52:52 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:52:52 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:52:52 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:52:52 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Instance spawned successfully.
Nov 22 07:52:52 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 07:52:52 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:52:52 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:52:52 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:52:52 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:52:52 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:52:52 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:52:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:53 user nova-compute[74348]: INFO nova.compute.manager [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Took 16.09 seconds to spawn the instance on the hypervisor.
Nov 22 07:52:53 user nova-compute[74348]: DEBUG nova.compute.manager [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 07:52:53 user nova-compute[74348]: INFO nova.compute.manager [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Took 17.85 seconds to spawn the instance on the hypervisor.
Nov 22 07:52:53 user nova-compute[74348]: DEBUG nova.compute.manager [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 07:52:53 user nova-compute[74348]: INFO nova.compute.manager [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Took 17.64 seconds to build instance.
Nov 22 07:52:53 user nova-compute[74348]: INFO nova.compute.manager [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Took 18.99 seconds to build instance.
Nov 22 07:52:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2d71c674-3fbd-47ed-9396-caa4a5ad05e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "522f5959-4874-4c61-888d-6fb1cc4d72e6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.793s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:52:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e363bd5f-0491-49c5-a5e7-bb2678b72330 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Lock "059bde4a-c5c9-45ab-9b4a-c969c74a6083" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.304s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:52:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:55 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:55 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:55 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:55 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:55 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 07:52:55 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 07:52:55 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Instance spawned successfully.
Nov 22 07:52:55 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 07:52:55 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:52:55 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:52:55 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:52:55 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:52:55 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:52:55 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:52:55 user nova-compute[74348]: INFO nova.compute.manager [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Took 14.03 seconds to spawn the instance on the hypervisor.
Nov 22 07:52:55 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 07:52:55 user nova-compute[74348]: INFO nova.compute.manager [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Took 15.24 seconds to build instance.
Nov 22 07:52:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ecccac8e-fefa-4c00-98b9-e3fdeda2d7b6 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lock "bcedb385-b72a-49c2-b363-cf6da5804b60" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.497s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:52:56 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 07:52:56 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 07:52:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:56 user nova-compute[74348]: DEBUG nova.compute.manager [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 07:52:56 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 07:52:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:56 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Instance spawned successfully.
Nov 22 07:52:56 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 07:52:56 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Instance spawned successfully.
Nov 22 07:52:56 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 07:52:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:56 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:52:56 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:52:56 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:52:56 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:52:56 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:52:56 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:52:56 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:52:56 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:52:56 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:52:56 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:52:56 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:52:56 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:52:56 user nova-compute[74348]: INFO nova.compute.manager [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Took 12.37 seconds to spawn the instance on the hypervisor.
Nov 22 07:52:56 user nova-compute[74348]: DEBUG nova.compute.manager [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 07:52:56 user nova-compute[74348]: INFO nova.compute.manager [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Took 12.90 seconds to spawn the instance on the hypervisor.
Nov 22 07:52:56 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 07:52:56 user nova-compute[74348]: INFO nova.compute.manager [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Took 13.61 seconds to build instance.
Nov 22 07:52:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b8d033be-b714-403a-a31f-a387b70708fa tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "5f3bbae3-babf-44d2-96da-c459fb77d9c7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.758s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:52:57 user nova-compute[74348]: INFO nova.compute.manager [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Took 13.89 seconds to build instance.
Nov 22 07:52:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ca09238b-074b-4b4d-a40b-d021d158a8b7 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lock "e36789b1-45e6-40f7-ba97-8962cb116a39" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.066s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:52:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Acquiring lock "da6aa6c0-2b77-49a5-9942-d6596ac4bd3f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:52:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Lock "da6aa6c0-2b77-49a5-9942-d6596ac4bd3f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:52:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:58 user nova-compute[74348]: DEBUG nova.compute.manager [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 07:52:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:52:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:52:58 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 07:52:58 user nova-compute[74348]: INFO nova.compute.claims [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Claim successful on node user
Nov 22 07:52:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:52:58 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:52:58 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:52:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.597s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:52:58 user nova-compute[74348]: DEBUG nova.compute.manager [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 07:52:58 user nova-compute[74348]: DEBUG nova.compute.manager [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 07:52:58 user nova-compute[74348]: DEBUG nova.network.neutron [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 07:52:58 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 22 07:52:58 user nova-compute[74348]: DEBUG nova.compute.manager [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 07:52:59 user nova-compute[74348]: DEBUG nova.policy [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7a4ce1cfe834401b8447059330f357fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebae3234a914be89750e24861ca1166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 07:52:59 user nova-compute[74348]: DEBUG nova.compute.manager [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 07:52:59 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 07:52:59 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Creating image(s)
Nov 22 07:52:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Acquiring lock "/opt/stack/data/nova/instances/da6aa6c0-2b77-49a5-9942-d6596ac4bd3f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:52:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Lock "/opt/stack/data/nova/instances/da6aa6c0-2b77-49a5-9942-d6596ac4bd3f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:52:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Lock "/opt/stack/data/nova/instances/da6aa6c0-2b77-49a5-9942-d6596ac4bd3f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:52:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Acquiring lock "c0a0ab07e0255008917ccfe2a84fa5c48f3999af" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:52:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Lock "c0a0ab07e0255008917ccfe2a84fa5c48f3999af" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c0a0ab07e0255008917ccfe2a84fa5c48f3999af.part --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:00 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:00 user nova-compute[74348]: DEBUG nova.network.neutron [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Successfully created port: c870c926-d416-4c0c-8fcc-873ce1c3b14e {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 07:53:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c0a0ab07e0255008917ccfe2a84fa5c48f3999af.part --force-share --output=json" returned: 0 in 0.313s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:00 user nova-compute[74348]: DEBUG nova.virt.images [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] 1be7b361-9f4d-4af0-958c-ab6c87e0a8b5 was qcow2, converting to raw {{(pid=74348) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 22 07:53:00 user nova-compute[74348]: DEBUG nova.privsep.utils [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74348) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 07:53:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c0a0ab07e0255008917ccfe2a84fa5c48f3999af.part /opt/stack/data/nova/instances/_base/c0a0ab07e0255008917ccfe2a84fa5c48f3999af.converted {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:00 user nova-compute[74348]: DEBUG nova.compute.manager [req-9aa5ba6e-3d0f-45bd-86de-bb88ea824d7a req-052398a0-e709-44dc-8c61-9848c3c6a021 service nova] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Received event network-vif-plugged-72ea4eea-6e08-44b2-9274-0f849d534f05 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:53:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9aa5ba6e-3d0f-45bd-86de-bb88ea824d7a req-052398a0-e709-44dc-8c61-9848c3c6a021 service nova] Acquiring lock "522f5959-4874-4c61-888d-6fb1cc4d72e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9aa5ba6e-3d0f-45bd-86de-bb88ea824d7a req-052398a0-e709-44dc-8c61-9848c3c6a021 service nova] Lock "522f5959-4874-4c61-888d-6fb1cc4d72e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9aa5ba6e-3d0f-45bd-86de-bb88ea824d7a req-052398a0-e709-44dc-8c61-9848c3c6a021 service nova] Lock "522f5959-4874-4c61-888d-6fb1cc4d72e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:00 user nova-compute[74348]: DEBUG nova.compute.manager [req-9aa5ba6e-3d0f-45bd-86de-bb88ea824d7a req-052398a0-e709-44dc-8c61-9848c3c6a021 service nova] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] No waiting events found dispatching network-vif-plugged-72ea4eea-6e08-44b2-9274-0f849d534f05 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:53:00 user nova-compute[74348]: WARNING nova.compute.manager [req-9aa5ba6e-3d0f-45bd-86de-bb88ea824d7a req-052398a0-e709-44dc-8c61-9848c3c6a021 service nova] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Received unexpected event network-vif-plugged-72ea4eea-6e08-44b2-9274-0f849d534f05 for instance with vm_state active and task_state None.
Nov 22 07:53:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c0a0ab07e0255008917ccfe2a84fa5c48f3999af.part /opt/stack/data/nova/instances/_base/c0a0ab07e0255008917ccfe2a84fa5c48f3999af.converted" returned: 0 in 0.434s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c0a0ab07e0255008917ccfe2a84fa5c48f3999af.converted --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c0a0ab07e0255008917ccfe2a84fa5c48f3999af.converted --force-share --output=json" returned: 0 in 0.286s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Lock "c0a0ab07e0255008917ccfe2a84fa5c48f3999af" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.944s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c0a0ab07e0255008917ccfe2a84fa5c48f3999af --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c0a0ab07e0255008917ccfe2a84fa5c48f3999af --force-share --output=json" returned: 0 in 0.532s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Acquiring lock "c0a0ab07e0255008917ccfe2a84fa5c48f3999af" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Lock "c0a0ab07e0255008917ccfe2a84fa5c48f3999af" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c0a0ab07e0255008917ccfe2a84fa5c48f3999af --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c0a0ab07e0255008917ccfe2a84fa5c48f3999af --force-share --output=json" returned: 0 in 0.309s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c0a0ab07e0255008917ccfe2a84fa5c48f3999af,backing_fmt=raw /opt/stack/data/nova/instances/da6aa6c0-2b77-49a5-9942-d6596ac4bd3f/disk 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c0a0ab07e0255008917ccfe2a84fa5c48f3999af,backing_fmt=raw /opt/stack/data/nova/instances/da6aa6c0-2b77-49a5-9942-d6596ac4bd3f/disk 1073741824" returned: 0 in 0.089s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Lock "c0a0ab07e0255008917ccfe2a84fa5c48f3999af" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.409s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c0a0ab07e0255008917ccfe2a84fa5c48f3999af --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:02 user nova-compute[74348]: DEBUG nova.network.neutron [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Successfully updated port: c870c926-d416-4c0c-8fcc-873ce1c3b14e {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 07:53:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Acquiring lock "refresh_cache-da6aa6c0-2b77-49a5-9942-d6596ac4bd3f" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:53:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Acquired lock "refresh_cache-da6aa6c0-2b77-49a5-9942-d6596ac4bd3f" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:53:02 user nova-compute[74348]: DEBUG nova.network.neutron [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 07:53:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:02 user nova-compute[74348]: DEBUG nova.network.neutron [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 07:53:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c0a0ab07e0255008917ccfe2a84fa5c48f3999af --force-share --output=json" returned: 0 in 0.459s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:02 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Checking if we can resize image /opt/stack/data/nova/instances/da6aa6c0-2b77-49a5-9942-d6596ac4bd3f/disk. size=1073741824 {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 07:53:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6aa6c0-2b77-49a5-9942-d6596ac4bd3f/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:02 user nova-compute[74348]: DEBUG nova.compute.manager [req-84349805-d51d-4de0-9baf-bc67f764b24c req-d0c85baf-c7d3-4d1b-addb-453e2ac85ffa service nova] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Received event network-vif-plugged-72ea4eea-6e08-44b2-9274-0f849d534f05 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:53:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-84349805-d51d-4de0-9baf-bc67f764b24c req-d0c85baf-c7d3-4d1b-addb-453e2ac85ffa service nova] Acquiring lock "522f5959-4874-4c61-888d-6fb1cc4d72e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-84349805-d51d-4de0-9baf-bc67f764b24c req-d0c85baf-c7d3-4d1b-addb-453e2ac85ffa service nova] Lock "522f5959-4874-4c61-888d-6fb1cc4d72e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-84349805-d51d-4de0-9baf-bc67f764b24c req-d0c85baf-c7d3-4d1b-addb-453e2ac85ffa service nova] Lock "522f5959-4874-4c61-888d-6fb1cc4d72e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:02 user nova-compute[74348]: DEBUG nova.compute.manager [req-84349805-d51d-4de0-9baf-bc67f764b24c req-d0c85baf-c7d3-4d1b-addb-453e2ac85ffa service nova] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] No waiting events found dispatching network-vif-plugged-72ea4eea-6e08-44b2-9274-0f849d534f05 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:53:02 user nova-compute[74348]: WARNING nova.compute.manager [req-84349805-d51d-4de0-9baf-bc67f764b24c req-d0c85baf-c7d3-4d1b-addb-453e2ac85ffa service nova] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Received unexpected event network-vif-plugged-72ea4eea-6e08-44b2-9274-0f849d534f05 for instance with vm_state active and task_state None.
Nov 22 07:53:02 user nova-compute[74348]: DEBUG nova.compute.manager [req-84349805-d51d-4de0-9baf-bc67f764b24c req-d0c85baf-c7d3-4d1b-addb-453e2ac85ffa service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Received event network-vif-plugged-618bd526-892d-4dfb-8ba6-f65e83e3f467 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:53:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-84349805-d51d-4de0-9baf-bc67f764b24c req-d0c85baf-c7d3-4d1b-addb-453e2ac85ffa service nova] Acquiring lock "e36789b1-45e6-40f7-ba97-8962cb116a39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-84349805-d51d-4de0-9baf-bc67f764b24c req-d0c85baf-c7d3-4d1b-addb-453e2ac85ffa service nova] Lock "e36789b1-45e6-40f7-ba97-8962cb116a39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-84349805-d51d-4de0-9baf-bc67f764b24c req-d0c85baf-c7d3-4d1b-addb-453e2ac85ffa service nova] Lock "e36789b1-45e6-40f7-ba97-8962cb116a39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:02 user nova-compute[74348]: DEBUG nova.compute.manager [req-84349805-d51d-4de0-9baf-bc67f764b24c req-d0c85baf-c7d3-4d1b-addb-453e2ac85ffa service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] No waiting events found dispatching network-vif-plugged-618bd526-892d-4dfb-8ba6-f65e83e3f467 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:53:02 user nova-compute[74348]: WARNING nova.compute.manager [req-84349805-d51d-4de0-9baf-bc67f764b24c req-d0c85baf-c7d3-4d1b-addb-453e2ac85ffa service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Received unexpected event network-vif-plugged-618bd526-892d-4dfb-8ba6-f65e83e3f467 for instance with vm_state active and task_state None.
Nov 22 07:53:02 user nova-compute[74348]: DEBUG nova.compute.manager [req-84349805-d51d-4de0-9baf-bc67f764b24c req-d0c85baf-c7d3-4d1b-addb-453e2ac85ffa service nova] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Received event network-changed-c870c926-d416-4c0c-8fcc-873ce1c3b14e {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:53:02 user nova-compute[74348]: DEBUG nova.compute.manager [req-84349805-d51d-4de0-9baf-bc67f764b24c req-d0c85baf-c7d3-4d1b-addb-453e2ac85ffa service nova] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Refreshing instance network info cache due to event network-changed-c870c926-d416-4c0c-8fcc-873ce1c3b14e. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:53:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-84349805-d51d-4de0-9baf-bc67f764b24c req-d0c85baf-c7d3-4d1b-addb-453e2ac85ffa service nova] Acquiring lock "refresh_cache-da6aa6c0-2b77-49a5-9942-d6596ac4bd3f" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:53:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6aa6c0-2b77-49a5-9942-d6596ac4bd3f/disk --force-share --output=json" returned: 0 in 0.411s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:02 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Cannot resize image /opt/stack/data/nova/instances/da6aa6c0-2b77-49a5-9942-d6596ac4bd3f/disk to a smaller size. {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 07:53:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 07:53:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Ensure instance console log exists: /opt/stack/data/nova/instances/da6aa6c0-2b77-49a5-9942-d6596ac4bd3f/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 07:53:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG nova.network.neutron [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Updating instance_info_cache with network_info: [{"id": "c870c926-d416-4c0c-8fcc-873ce1c3b14e", "address": "fa:16:3e:06:64:68", "network": {"id": "e3c8d160-d362-47c0-9373-7b90d08587d1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1245990371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ebae3234a914be89750e24861ca1166", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc870c926-d4", "ovs_interfaceid": "c870c926-d416-4c0c-8fcc-873ce1c3b14e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Releasing lock "refresh_cache-da6aa6c0-2b77-49a5-9942-d6596ac4bd3f" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG nova.compute.manager [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Instance network_info: |[{"id": "c870c926-d416-4c0c-8fcc-873ce1c3b14e", "address": "fa:16:3e:06:64:68", "network": {"id": "e3c8d160-d362-47c0-9373-7b90d08587d1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1245990371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ebae3234a914be89750e24861ca1166", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc870c926-d4", "ovs_interfaceid": "c870c926-d416-4c0c-8fcc-873ce1c3b14e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-84349805-d51d-4de0-9baf-bc67f764b24c req-d0c85baf-c7d3-4d1b-addb-453e2ac85ffa service nova] Acquired lock "refresh_cache-da6aa6c0-2b77-49a5-9942-d6596ac4bd3f" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG nova.network.neutron [req-84349805-d51d-4de0-9baf-bc67f764b24c req-d0c85baf-c7d3-4d1b-addb-453e2ac85ffa service nova] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Refreshing network info cache for port c870c926-d416-4c0c-8fcc-873ce1c3b14e {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Start _get_guest_xml network_info=[{"id": "c870c926-d416-4c0c-8fcc-873ce1c3b14e", "address": "fa:16:3e:06:64:68", "network": {"id": "e3c8d160-d362-47c0-9373-7b90d08587d1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1245990371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ebae3234a914be89750e24861ca1166", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc870c926-d4", "ovs_interfaceid": "c870c926-d416-4c0c-8fcc-873ce1c3b14e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:52:48Z,direct_url=<?>,disk_format='qcow2',id=1be7b361-9f4d-4af0-958c-ab6c87e0a8b5,min_disk=0,min_ram=0,name='',owner='7bb6a578282e49789aeeae66f01b93e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:52:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/sda', 'encryption_format': None, 'disk_bus': 'scsi', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '1be7b361-9f4d-4af0-958c-ab6c87e0a8b5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 07:53:03 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:53:03 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:53:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:52:48Z,direct_url=<?>,disk_format='qcow2',id=1be7b361-9f4d-4af0-958c-ab6c87e0a8b5,min_disk=0,min_ram=0,name='',owner='7bb6a578282e49789aeeae66f01b93e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:52:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:52:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1123505270',display_name='tempest-AttachSCSIVolumeTestJSON-server-1123505270',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1123505270',id=6,image_ref='1be7b361-9f4d-4af0-958c-ab6c87e0a8b5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtih7HZpvV+FMcBBM8F22aAkTErmhOyjqz9PaNsThpRcocRH2o3aFn4nQVw2aESc0yTlKXAOt60y02JARrEp+w+xh/OUBybCM6VugB3NIx5yH1cGOrE05w6tw5kqwYV5g==',key_name='tempest-keypair-1731144104',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ebae3234a914be89750e24861ca1166',ramdisk_id='',reservation_id='r-h8izt0dx',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1be7b361-9f4d-4af0-958c-ab6c87e0a8b5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1796317290',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1796317290-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:52:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a4ce1cfe834401b8447059330f357fa',uuid=da6aa6c0-2b77-49a5-9942-d6596ac4bd3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c870c926-d416-4c0c-8fcc-873ce1c3b14e", "address": "fa:16:3e:06:64:68", "network": {"id": "e3c8d160-d362-47c0-9373-7b90d08587d1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1245990371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ebae3234a914be89750e24861ca1166", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc870c926-d4", "ovs_interfaceid": "c870c926-d416-4c0c-8fcc-873ce1c3b14e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Converting VIF {"id": "c870c926-d416-4c0c-8fcc-873ce1c3b14e", "address": "fa:16:3e:06:64:68", "network": {"id": "e3c8d160-d362-47c0-9373-7b90d08587d1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1245990371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ebae3234a914be89750e24861ca1166", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc870c926-d4", "ovs_interfaceid": "c870c926-d416-4c0c-8fcc-873ce1c3b14e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:64:68,bridge_name='br-int',has_traffic_filtering=True,id=c870c926-d416-4c0c-8fcc-873ce1c3b14e,network=Network(e3c8d160-d362-47c0-9373-7b90d08587d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc870c926-d4') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG nova.objects.instance [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Lazy-loading 'pci_devices' on Instance uuid da6aa6c0-2b77-49a5-9942-d6596ac4bd3f {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] End _get_guest_xml xml=<domain type="kvm">
Nov 22 07:53:03 user nova-compute[74348]:   <uuid>da6aa6c0-2b77-49a5-9942-d6596ac4bd3f</uuid>
Nov 22 07:53:03 user nova-compute[74348]:   <name>instance-00000006</name>
Nov 22 07:53:03 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 07:53:03 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 07:53:03 user nova-compute[74348]:   <metadata>
Nov 22 07:53:03 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 07:53:03 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 07:53:03 user nova-compute[74348]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1123505270</nova:name>
Nov 22 07:53:03 user nova-compute[74348]:       <nova:creationTime>2023-11-22 07:53:03</nova:creationTime>
Nov 22 07:53:03 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 07:53:03 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 07:53:03 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 07:53:03 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 07:53:03 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 07:53:03 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 07:53:03 user nova-compute[74348]:       </nova:flavor>
Nov 22 07:53:03 user nova-compute[74348]:       <nova:owner>
Nov 22 07:53:03 user nova-compute[74348]:         <nova:user uuid="7a4ce1cfe834401b8447059330f357fa">tempest-AttachSCSIVolumeTestJSON-1796317290-project-member</nova:user>
Nov 22 07:53:03 user nova-compute[74348]:         <nova:project uuid="9ebae3234a914be89750e24861ca1166">tempest-AttachSCSIVolumeTestJSON-1796317290</nova:project>
Nov 22 07:53:03 user nova-compute[74348]:       </nova:owner>
Nov 22 07:53:03 user nova-compute[74348]:       <nova:root type="image" uuid="1be7b361-9f4d-4af0-958c-ab6c87e0a8b5"/>
Nov 22 07:53:03 user nova-compute[74348]:       <nova:ports>
Nov 22 07:53:03 user nova-compute[74348]:         <nova:port uuid="c870c926-d416-4c0c-8fcc-873ce1c3b14e">
Nov 22 07:53:03 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 22 07:53:03 user nova-compute[74348]:         </nova:port>
Nov 22 07:53:03 user nova-compute[74348]:       </nova:ports>
Nov 22 07:53:03 user nova-compute[74348]:     </nova:instance>
Nov 22 07:53:03 user nova-compute[74348]:   </metadata>
Nov 22 07:53:03 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 07:53:03 user nova-compute[74348]:     <system>
Nov 22 07:53:03 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 07:53:03 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 07:53:03 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 07:53:03 user nova-compute[74348]:       <entry name="serial">da6aa6c0-2b77-49a5-9942-d6596ac4bd3f</entry>
Nov 22 07:53:03 user nova-compute[74348]:       <entry name="uuid">da6aa6c0-2b77-49a5-9942-d6596ac4bd3f</entry>
Nov 22 07:53:03 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 07:53:03 user nova-compute[74348]:     </system>
Nov 22 07:53:03 user nova-compute[74348]:   </sysinfo>
Nov 22 07:53:03 user nova-compute[74348]:   <os>
Nov 22 07:53:03 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 07:53:03 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 07:53:03 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 07:53:03 user nova-compute[74348]:   </os>
Nov 22 07:53:03 user nova-compute[74348]:   <features>
Nov 22 07:53:03 user nova-compute[74348]:     <acpi/>
Nov 22 07:53:03 user nova-compute[74348]:     <apic/>
Nov 22 07:53:03 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 07:53:03 user nova-compute[74348]:   </features>
Nov 22 07:53:03 user nova-compute[74348]:   <clock offset="utc">
Nov 22 07:53:03 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 07:53:03 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 07:53:03 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 07:53:03 user nova-compute[74348]:   </clock>
Nov 22 07:53:03 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 07:53:03 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 07:53:03 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 07:53:03 user nova-compute[74348]:   </cpu>
Nov 22 07:53:03 user nova-compute[74348]:   <devices>
Nov 22 07:53:03 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 07:53:03 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 07:53:03 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/da6aa6c0-2b77-49a5-9942-d6596ac4bd3f/disk"/>
Nov 22 07:53:03 user nova-compute[74348]:       <target dev="sda" bus="scsi"/>
Nov 22 07:53:03 user nova-compute[74348]:       <address type="drive" controller="0" unit="0"/>
Nov 22 07:53:03 user nova-compute[74348]:     </disk>
Nov 22 07:53:03 user nova-compute[74348]:     <disk type="file" device="cdrom">
Nov 22 07:53:03 user nova-compute[74348]:       <driver name="qemu" type="raw" cache="none"/>
Nov 22 07:53:03 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/da6aa6c0-2b77-49a5-9942-d6596ac4bd3f/disk.config"/>
Nov 22 07:53:03 user nova-compute[74348]:       <target dev="sdb" bus="scsi"/>
Nov 22 07:53:03 user nova-compute[74348]:       <address type="drive" controller="0" unit="1"/>
Nov 22 07:53:03 user nova-compute[74348]:     </disk>
Nov 22 07:53:03 user nova-compute[74348]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 22 07:53:03 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 07:53:03 user nova-compute[74348]:       <mac address="fa:16:3e:06:64:68"/>
Nov 22 07:53:03 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:53:03 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 07:53:03 user nova-compute[74348]:       <target dev="tapc870c926-d4"/>
Nov 22 07:53:03 user nova-compute[74348]:     </interface>
Nov 22 07:53:03 user nova-compute[74348]:     <serial type="pty">
Nov 22 07:53:03 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/da6aa6c0-2b77-49a5-9942-d6596ac4bd3f/console.log" append="off"/>
Nov 22 07:53:03 user nova-compute[74348]:     </serial>
Nov 22 07:53:03 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 07:53:03 user nova-compute[74348]:     <video>
Nov 22 07:53:03 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:53:03 user nova-compute[74348]:     </video>
Nov 22 07:53:03 user nova-compute[74348]:     <rng model="virtio">
Nov 22 07:53:03 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 07:53:03 user nova-compute[74348]:     </rng>
Nov 22 07:53:03 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 07:53:03 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 07:53:03 user nova-compute[74348]:       <stats period="10"/>
Nov 22 07:53:03 user nova-compute[74348]:     </memballoon>
Nov 22 07:53:03 user nova-compute[74348]:   </devices>
Nov 22 07:53:03 user nova-compute[74348]: </domain>
Nov 22 07:53:03 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:52:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1123505270',display_name='tempest-AttachSCSIVolumeTestJSON-server-1123505270',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1123505270',id=6,image_ref='1be7b361-9f4d-4af0-958c-ab6c87e0a8b5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtih7HZpvV+FMcBBM8F22aAkTErmhOyjqz9PaNsThpRcocRH2o3aFn4nQVw2aESc0yTlKXAOt60y02JARrEp+w+xh/OUBybCM6VugB3NIx5yH1cGOrE05w6tw5kqwYV5g==',key_name='tempest-keypair-1731144104',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ebae3234a914be89750e24861ca1166',ramdisk_id='',reservation_id='r-h8izt0dx',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1be7b361-9f4d-4af0-958c-ab6c87e0a8b5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1796317290',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1796317290-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:52:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a4ce1cfe834401b8447059330f357fa',uuid=da6aa6c0-2b77-49a5-9942-d6596ac4bd3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c870c926-d416-4c0c-8fcc-873ce1c3b14e", "address": "fa:16:3e:06:64:68", "network": {"id": "e3c8d160-d362-47c0-9373-7b90d08587d1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1245990371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ebae3234a914be89750e24861ca1166", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc870c926-d4", "ovs_interfaceid": "c870c926-d416-4c0c-8fcc-873ce1c3b14e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Converting VIF {"id": "c870c926-d416-4c0c-8fcc-873ce1c3b14e", "address": "fa:16:3e:06:64:68", "network": {"id": "e3c8d160-d362-47c0-9373-7b90d08587d1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1245990371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ebae3234a914be89750e24861ca1166", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc870c926-d4", "ovs_interfaceid": "c870c926-d416-4c0c-8fcc-873ce1c3b14e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:64:68,bridge_name='br-int',has_traffic_filtering=True,id=c870c926-d416-4c0c-8fcc-873ce1c3b14e,network=Network(e3c8d160-d362-47c0-9373-7b90d08587d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc870c926-d4') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG os_vif [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:64:68,bridge_name='br-int',has_traffic_filtering=True,id=c870c926-d416-4c0c-8fcc-873ce1c3b14e,network=Network(e3c8d160-d362-47c0-9373-7b90d08587d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc870c926-d4') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '94352743-231a-55dd-b3bd-1c29f82960b2', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc870c926-d4, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc870c926-d4, col_values=(('qos', UUID('42f9cf1f-b226-4610-bb4e-c6e78b13a32a')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc870c926-d4, col_values=(('external_ids', {'iface-id': 'c870c926-d416-4c0c-8fcc-873ce1c3b14e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:64:68', 'vm-uuid': 'da6aa6c0-2b77-49a5-9942-d6596ac4bd3f'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:03 user nova-compute[74348]: INFO os_vif [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:64:68,bridge_name='br-int',has_traffic_filtering=True,id=c870c926-d416-4c0c-8fcc-873ce1c3b14e,network=Network(e3c8d160-d362-47c0-9373-7b90d08587d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc870c926-d4')
Nov 22 07:53:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] No BDM found with device name sda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:53:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] No VIF found with MAC fa:16:3e:06:64:68, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 07:53:03 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Using config drive
Nov 22 07:53:04 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Creating config drive at /opt/stack/data/nova/instances/da6aa6c0-2b77-49a5-9942-d6596ac4bd3f/disk.config
Nov 22 07:53:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/da6aa6c0-2b77-49a5-9942-d6596ac4bd3f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpsfmev_rj {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/da6aa6c0-2b77-49a5-9942-d6596ac4bd3f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpsfmev_rj" returned: 0 in 0.074s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:04 user nova-compute[74348]: DEBUG nova.network.neutron [req-84349805-d51d-4de0-9baf-bc67f764b24c req-d0c85baf-c7d3-4d1b-addb-453e2ac85ffa service nova] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Updated VIF entry in instance network info cache for port c870c926-d416-4c0c-8fcc-873ce1c3b14e. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 07:53:04 user nova-compute[74348]: DEBUG nova.network.neutron [req-84349805-d51d-4de0-9baf-bc67f764b24c req-d0c85baf-c7d3-4d1b-addb-453e2ac85ffa service nova] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Updating instance_info_cache with network_info: [{"id": "c870c926-d416-4c0c-8fcc-873ce1c3b14e", "address": "fa:16:3e:06:64:68", "network": {"id": "e3c8d160-d362-47c0-9373-7b90d08587d1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1245990371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ebae3234a914be89750e24861ca1166", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc870c926-d4", "ovs_interfaceid": "c870c926-d416-4c0c-8fcc-873ce1c3b14e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:53:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-84349805-d51d-4de0-9baf-bc67f764b24c req-d0c85baf-c7d3-4d1b-addb-453e2ac85ffa service nova] Releasing lock "refresh_cache-da6aa6c0-2b77-49a5-9942-d6596ac4bd3f" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:53:04 user nova-compute[74348]: DEBUG nova.compute.manager [req-84349805-d51d-4de0-9baf-bc67f764b24c req-d0c85baf-c7d3-4d1b-addb-453e2ac85ffa service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Received event network-vif-plugged-618bd526-892d-4dfb-8ba6-f65e83e3f467 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:53:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-84349805-d51d-4de0-9baf-bc67f764b24c req-d0c85baf-c7d3-4d1b-addb-453e2ac85ffa service nova] Acquiring lock "e36789b1-45e6-40f7-ba97-8962cb116a39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-84349805-d51d-4de0-9baf-bc67f764b24c req-d0c85baf-c7d3-4d1b-addb-453e2ac85ffa service nova] Lock "e36789b1-45e6-40f7-ba97-8962cb116a39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-84349805-d51d-4de0-9baf-bc67f764b24c req-d0c85baf-c7d3-4d1b-addb-453e2ac85ffa service nova] Lock "e36789b1-45e6-40f7-ba97-8962cb116a39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:04 user nova-compute[74348]: DEBUG nova.compute.manager [req-84349805-d51d-4de0-9baf-bc67f764b24c req-d0c85baf-c7d3-4d1b-addb-453e2ac85ffa service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] No waiting events found dispatching network-vif-plugged-618bd526-892d-4dfb-8ba6-f65e83e3f467 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:53:04 user nova-compute[74348]: WARNING nova.compute.manager [req-84349805-d51d-4de0-9baf-bc67f764b24c req-d0c85baf-c7d3-4d1b-addb-453e2ac85ffa service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Received unexpected event network-vif-plugged-618bd526-892d-4dfb-8ba6-f65e83e3f467 for instance with vm_state active and task_state None.
Nov 22 07:53:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Acquiring lock "e93032ee-56bd-48be-8121-b0fd5273345e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Lock "e93032ee-56bd-48be-8121-b0fd5273345e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:06 user nova-compute[74348]: DEBUG nova.compute.manager [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 07:53:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:06 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 07:53:06 user nova-compute[74348]: INFO nova.compute.claims [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Claim successful on node user
Nov 22 07:53:06 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:53:06 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:53:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.637s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:07 user nova-compute[74348]: DEBUG nova.compute.manager [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 07:53:07 user nova-compute[74348]: DEBUG nova.compute.manager [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 07:53:07 user nova-compute[74348]: DEBUG nova.network.neutron [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 07:53:07 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 07:53:07 user nova-compute[74348]: DEBUG nova.compute.manager [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 07:53:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:07 user nova-compute[74348]: DEBUG nova.policy [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'de2cd6e49b88491fac65f905cd339249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d3b860b77e438c8961b6b6919c6b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 07:53:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:07 user nova-compute[74348]: DEBUG nova.compute.manager [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 07:53:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 07:53:07 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Creating image(s)
Nov 22 07:53:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Acquiring lock "/opt/stack/data/nova/instances/e93032ee-56bd-48be-8121-b0fd5273345e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Lock "/opt/stack/data/nova/instances/e93032ee-56bd-48be-8121-b0fd5273345e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Lock "/opt/stack/data/nova/instances/e93032ee-56bd-48be-8121-b0fd5273345e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:07 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:07 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.337s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Acquiring lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:07 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:08 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.212s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:08 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/e93032ee-56bd-48be-8121-b0fd5273345e/disk 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:08 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/e93032ee-56bd-48be-8121-b0fd5273345e/disk 1073741824" returned: 0 in 0.073s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:08 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:08 user nova-compute[74348]: DEBUG nova.compute.manager [req-3b8b7ffb-c189-4c98-91d6-a835994077c6 req-ebf14d1e-2271-42c4-bcdb-8692affb4be5 service nova] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Received event network-vif-plugged-06aa6370-ccfd-4a76-86ca-7bbfad795beb {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:53:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3b8b7ffb-c189-4c98-91d6-a835994077c6 req-ebf14d1e-2271-42c4-bcdb-8692affb4be5 service nova] Acquiring lock "059bde4a-c5c9-45ab-9b4a-c969c74a6083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3b8b7ffb-c189-4c98-91d6-a835994077c6 req-ebf14d1e-2271-42c4-bcdb-8692affb4be5 service nova] Lock "059bde4a-c5c9-45ab-9b4a-c969c74a6083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.033s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3b8b7ffb-c189-4c98-91d6-a835994077c6 req-ebf14d1e-2271-42c4-bcdb-8692affb4be5 service nova] Lock "059bde4a-c5c9-45ab-9b4a-c969c74a6083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:08 user nova-compute[74348]: DEBUG nova.compute.manager [req-3b8b7ffb-c189-4c98-91d6-a835994077c6 req-ebf14d1e-2271-42c4-bcdb-8692affb4be5 service nova] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] No waiting events found dispatching network-vif-plugged-06aa6370-ccfd-4a76-86ca-7bbfad795beb {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:53:08 user nova-compute[74348]: WARNING nova.compute.manager [req-3b8b7ffb-c189-4c98-91d6-a835994077c6 req-ebf14d1e-2271-42c4-bcdb-8692affb4be5 service nova] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Received unexpected event network-vif-plugged-06aa6370-ccfd-4a76-86ca-7bbfad795beb for instance with vm_state active and task_state None.
Nov 22 07:53:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:08 user nova-compute[74348]: DEBUG nova.network.neutron [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Successfully created port: 8ddcc793-e3ca-4db4-aff2-40d8121797a7 {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 07:53:08 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.317s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:08 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e93032ee-56bd-48be-8121-b0fd5273345e/disk. size=1073741824 {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 07:53:08 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e93032ee-56bd-48be-8121-b0fd5273345e/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:08 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e93032ee-56bd-48be-8121-b0fd5273345e/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:08 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Cannot resize image /opt/stack/data/nova/instances/e93032ee-56bd-48be-8121-b0fd5273345e/disk to a smaller size. {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 07:53:08 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 07:53:08 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Ensure instance console log exists: /opt/stack/data/nova/instances/e93032ee-56bd-48be-8121-b0fd5273345e/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 07:53:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:09 user nova-compute[74348]: DEBUG nova.compute.manager [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 07:53:09 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 07:53:09 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Instance spawned successfully.
Nov 22 07:53:09 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 07:53:09 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:53:09 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:53:09 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:53:09 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:53:09 user nova-compute[74348]: INFO nova.compute.manager [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Took 10.17 seconds to spawn the instance on the hypervisor.
Nov 22 07:53:09 user nova-compute[74348]: DEBUG nova.compute.manager [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 07:53:09 user nova-compute[74348]: INFO nova.compute.manager [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Took 11.38 seconds to build instance.
Nov 22 07:53:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-12d98cce-93a1-47d9-9839-f08371c1955c tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Lock "da6aa6c0-2b77-49a5-9942-d6596ac4bd3f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.563s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:09 user nova-compute[74348]: DEBUG nova.network.neutron [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Successfully updated port: 8ddcc793-e3ca-4db4-aff2-40d8121797a7 {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 07:53:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Acquiring lock "refresh_cache-e93032ee-56bd-48be-8121-b0fd5273345e" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:53:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Acquired lock "refresh_cache-e93032ee-56bd-48be-8121-b0fd5273345e" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:53:09 user nova-compute[74348]: DEBUG nova.network.neutron [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 07:53:09 user nova-compute[74348]: DEBUG nova.compute.manager [req-14f48e53-f872-4d2e-a7ce-84004d7c552b req-cd8340c4-664b-4fba-8cd8-c4817891d9f8 service nova] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Received event network-changed-8ddcc793-e3ca-4db4-aff2-40d8121797a7 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:53:09 user nova-compute[74348]: DEBUG nova.compute.manager [req-14f48e53-f872-4d2e-a7ce-84004d7c552b req-cd8340c4-664b-4fba-8cd8-c4817891d9f8 service nova] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Refreshing instance network info cache due to event network-changed-8ddcc793-e3ca-4db4-aff2-40d8121797a7. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:53:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-14f48e53-f872-4d2e-a7ce-84004d7c552b req-cd8340c4-664b-4fba-8cd8-c4817891d9f8 service nova] Acquiring lock "refresh_cache-e93032ee-56bd-48be-8121-b0fd5273345e" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:53:09 user nova-compute[74348]: DEBUG nova.network.neutron [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 07:53:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Acquiring lock "bdad025e-8f6c-419a-99ea-bf277f6c5577" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Lock "bdad025e-8f6c-419a-99ea-bf277f6c5577" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:09 user nova-compute[74348]: DEBUG nova.compute.manager [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 07:53:10 user nova-compute[74348]: INFO nova.compute.claims [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Claim successful on node user
Nov 22 07:53:10 user nova-compute[74348]: DEBUG nova.network.neutron [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Updating instance_info_cache with network_info: [{"id": "8ddcc793-e3ca-4db4-aff2-40d8121797a7", "address": "fa:16:3e:52:83:64", "network": {"id": "9cd1842b-a00c-4bcf-9fe4-1bfd8209bbd4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-186126001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d3b860b77e438c8961b6b6919c6b0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ddcc793-e3", "ovs_interfaceid": "8ddcc793-e3ca-4db4-aff2-40d8121797a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Releasing lock "refresh_cache-e93032ee-56bd-48be-8121-b0fd5273345e" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG nova.compute.manager [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Instance network_info: |[{"id": "8ddcc793-e3ca-4db4-aff2-40d8121797a7", "address": "fa:16:3e:52:83:64", "network": {"id": "9cd1842b-a00c-4bcf-9fe4-1bfd8209bbd4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-186126001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d3b860b77e438c8961b6b6919c6b0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ddcc793-e3", "ovs_interfaceid": "8ddcc793-e3ca-4db4-aff2-40d8121797a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-14f48e53-f872-4d2e-a7ce-84004d7c552b req-cd8340c4-664b-4fba-8cd8-c4817891d9f8 service nova] Acquired lock "refresh_cache-e93032ee-56bd-48be-8121-b0fd5273345e" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG nova.network.neutron [req-14f48e53-f872-4d2e-a7ce-84004d7c552b req-cd8340c4-664b-4fba-8cd8-c4817891d9f8 service nova] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Refreshing network info cache for port 8ddcc793-e3ca-4db4-aff2-40d8121797a7 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Start _get_guest_xml network_info=[{"id": "8ddcc793-e3ca-4db4-aff2-40d8121797a7", "address": "fa:16:3e:52:83:64", "network": {"id": "9cd1842b-a00c-4bcf-9fe4-1bfd8209bbd4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-186126001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d3b860b77e438c8961b6b6919c6b0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ddcc793-e3", "ovs_interfaceid": "8ddcc793-e3ca-4db4-aff2-40d8121797a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 07:53:10 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:53:10 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:53:10 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG nova.compute.manager [req-7cb06d1b-fc87-44fc-b7ca-cb2d71b0243f req-ab58d4df-9528-434c-94e9-7953f784e594 service nova] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Received event network-vif-plugged-06aa6370-ccfd-4a76-86ca-7bbfad795beb {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-7cb06d1b-fc87-44fc-b7ca-cb2d71b0243f req-ab58d4df-9528-434c-94e9-7953f784e594 service nova] Acquiring lock "059bde4a-c5c9-45ab-9b4a-c969c74a6083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-7cb06d1b-fc87-44fc-b7ca-cb2d71b0243f req-ab58d4df-9528-434c-94e9-7953f784e594 service nova] Lock "059bde4a-c5c9-45ab-9b4a-c969c74a6083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-7cb06d1b-fc87-44fc-b7ca-cb2d71b0243f req-ab58d4df-9528-434c-94e9-7953f784e594 service nova] Lock "059bde4a-c5c9-45ab-9b4a-c969c74a6083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG nova.compute.manager [req-7cb06d1b-fc87-44fc-b7ca-cb2d71b0243f req-ab58d4df-9528-434c-94e9-7953f784e594 service nova] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] No waiting events found dispatching network-vif-plugged-06aa6370-ccfd-4a76-86ca-7bbfad795beb {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:53:10 user nova-compute[74348]: WARNING nova.compute.manager [req-7cb06d1b-fc87-44fc-b7ca-cb2d71b0243f req-ab58d4df-9528-434c-94e9-7953f784e594 service nova] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Received unexpected event network-vif-plugged-06aa6370-ccfd-4a76-86ca-7bbfad795beb for instance with vm_state active and task_state None.
Nov 22 07:53:10 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:53:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1879973268',display_name='tempest-TestVolumeSwap-server-1879973268',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1879973268',id=7,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLh/4FmkwLePg6CHlXFuO4YYuopb9Yn8NN8+2qDpGIfhm/HNm553Eq300rrCPrU4JUX6GZSwjDEOxSmOTa0pXnHKHiiG3GSQuY4n46dhe368jkirPNGBUVvBWJ9q326K+Q==',key_name='tempest-keypair-2037151951',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1d3b860b77e438c8961b6b6919c6b0a',ramdisk_id='',reservation_id='r-53kdny44',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1684900043',owner_user_name='tempest-TestVolumeSwap-1684900043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:53:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de2cd6e49b88491fac65f905cd339249',uuid=e93032ee-56bd-48be-8121-b0fd5273345e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ddcc793-e3ca-4db4-aff2-40d8121797a7", "address": "fa:16:3e:52:83:64", "network": {"id": "9cd1842b-a00c-4bcf-9fe4-1bfd8209bbd4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-186126001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d3b860b77e438c8961b6b6919c6b0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ddcc793-e3", "ovs_interfaceid": "8ddcc793-e3ca-4db4-aff2-40d8121797a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Converting VIF {"id": "8ddcc793-e3ca-4db4-aff2-40d8121797a7", "address": "fa:16:3e:52:83:64", "network": {"id": "9cd1842b-a00c-4bcf-9fe4-1bfd8209bbd4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-186126001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d3b860b77e438c8961b6b6919c6b0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ddcc793-e3", "ovs_interfaceid": "8ddcc793-e3ca-4db4-aff2-40d8121797a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:83:64,bridge_name='br-int',has_traffic_filtering=True,id=8ddcc793-e3ca-4db4-aff2-40d8121797a7,network=Network(9cd1842b-a00c-4bcf-9fe4-1bfd8209bbd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ddcc793-e3') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG nova.objects.instance [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Lazy-loading 'pci_devices' on Instance uuid e93032ee-56bd-48be-8121-b0fd5273345e {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] End _get_guest_xml xml=<domain type="kvm">
Nov 22 07:53:10 user nova-compute[74348]:   <uuid>e93032ee-56bd-48be-8121-b0fd5273345e</uuid>
Nov 22 07:53:10 user nova-compute[74348]:   <name>instance-00000007</name>
Nov 22 07:53:10 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 07:53:10 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 07:53:10 user nova-compute[74348]:   <metadata>
Nov 22 07:53:10 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 07:53:10 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 07:53:10 user nova-compute[74348]:       <nova:name>tempest-TestVolumeSwap-server-1879973268</nova:name>
Nov 22 07:53:10 user nova-compute[74348]:       <nova:creationTime>2023-11-22 07:53:10</nova:creationTime>
Nov 22 07:53:10 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 07:53:10 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 07:53:10 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 07:53:10 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 07:53:10 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 07:53:10 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 07:53:10 user nova-compute[74348]:       </nova:flavor>
Nov 22 07:53:10 user nova-compute[74348]:       <nova:owner>
Nov 22 07:53:10 user nova-compute[74348]:         <nova:user uuid="de2cd6e49b88491fac65f905cd339249">tempest-TestVolumeSwap-1684900043-project-member</nova:user>
Nov 22 07:53:10 user nova-compute[74348]:         <nova:project uuid="c1d3b860b77e438c8961b6b6919c6b0a">tempest-TestVolumeSwap-1684900043</nova:project>
Nov 22 07:53:10 user nova-compute[74348]:       </nova:owner>
Nov 22 07:53:10 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 07:53:10 user nova-compute[74348]:       <nova:ports>
Nov 22 07:53:10 user nova-compute[74348]:         <nova:port uuid="8ddcc793-e3ca-4db4-aff2-40d8121797a7">
Nov 22 07:53:10 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 22 07:53:10 user nova-compute[74348]:         </nova:port>
Nov 22 07:53:10 user nova-compute[74348]:       </nova:ports>
Nov 22 07:53:10 user nova-compute[74348]:     </nova:instance>
Nov 22 07:53:10 user nova-compute[74348]:   </metadata>
Nov 22 07:53:10 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 07:53:10 user nova-compute[74348]:     <system>
Nov 22 07:53:10 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 07:53:10 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 07:53:10 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 07:53:10 user nova-compute[74348]:       <entry name="serial">e93032ee-56bd-48be-8121-b0fd5273345e</entry>
Nov 22 07:53:10 user nova-compute[74348]:       <entry name="uuid">e93032ee-56bd-48be-8121-b0fd5273345e</entry>
Nov 22 07:53:10 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 07:53:10 user nova-compute[74348]:     </system>
Nov 22 07:53:10 user nova-compute[74348]:   </sysinfo>
Nov 22 07:53:10 user nova-compute[74348]:   <os>
Nov 22 07:53:10 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 07:53:10 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 07:53:10 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 07:53:10 user nova-compute[74348]:   </os>
Nov 22 07:53:10 user nova-compute[74348]:   <features>
Nov 22 07:53:10 user nova-compute[74348]:     <acpi/>
Nov 22 07:53:10 user nova-compute[74348]:     <apic/>
Nov 22 07:53:10 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 07:53:10 user nova-compute[74348]:   </features>
Nov 22 07:53:10 user nova-compute[74348]:   <clock offset="utc">
Nov 22 07:53:10 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 07:53:10 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 07:53:10 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 07:53:10 user nova-compute[74348]:   </clock>
Nov 22 07:53:10 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 07:53:10 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 07:53:10 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 07:53:10 user nova-compute[74348]:   </cpu>
Nov 22 07:53:10 user nova-compute[74348]:   <devices>
Nov 22 07:53:10 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 07:53:10 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 07:53:10 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/e93032ee-56bd-48be-8121-b0fd5273345e/disk"/>
Nov 22 07:53:10 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 07:53:10 user nova-compute[74348]:     </disk>
Nov 22 07:53:10 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 07:53:10 user nova-compute[74348]:       <mac address="fa:16:3e:52:83:64"/>
Nov 22 07:53:10 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:53:10 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 07:53:10 user nova-compute[74348]:       <target dev="tap8ddcc793-e3"/>
Nov 22 07:53:10 user nova-compute[74348]:     </interface>
Nov 22 07:53:10 user nova-compute[74348]:     <serial type="pty">
Nov 22 07:53:10 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/e93032ee-56bd-48be-8121-b0fd5273345e/console.log" append="off"/>
Nov 22 07:53:10 user nova-compute[74348]:     </serial>
Nov 22 07:53:10 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 07:53:10 user nova-compute[74348]:     <video>
Nov 22 07:53:10 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:53:10 user nova-compute[74348]:     </video>
Nov 22 07:53:10 user nova-compute[74348]:     <rng model="virtio">
Nov 22 07:53:10 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 07:53:10 user nova-compute[74348]:     </rng>
Nov 22 07:53:10 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 07:53:10 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 07:53:10 user nova-compute[74348]:       <stats period="10"/>
Nov 22 07:53:10 user nova-compute[74348]:     </memballoon>
Nov 22 07:53:10 user nova-compute[74348]:   </devices>
Nov 22 07:53:10 user nova-compute[74348]: </domain>
Nov 22 07:53:10 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:53:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1879973268',display_name='tempest-TestVolumeSwap-server-1879973268',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1879973268',id=7,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLh/4FmkwLePg6CHlXFuO4YYuopb9Yn8NN8+2qDpGIfhm/HNm553Eq300rrCPrU4JUX6GZSwjDEOxSmOTa0pXnHKHiiG3GSQuY4n46dhe368jkirPNGBUVvBWJ9q326K+Q==',key_name='tempest-keypair-2037151951',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1d3b860b77e438c8961b6b6919c6b0a',ramdisk_id='',reservation_id='r-53kdny44',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1684900043',owner_user_name='tempest-TestVolumeSwap-1684900043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:53:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de2cd6e49b88491fac65f905cd339249',uuid=e93032ee-56bd-48be-8121-b0fd5273345e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ddcc793-e3ca-4db4-aff2-40d8121797a7", "address": "fa:16:3e:52:83:64", "network": {"id": "9cd1842b-a00c-4bcf-9fe4-1bfd8209bbd4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-186126001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d3b860b77e438c8961b6b6919c6b0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ddcc793-e3", "ovs_interfaceid": "8ddcc793-e3ca-4db4-aff2-40d8121797a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Converting VIF {"id": "8ddcc793-e3ca-4db4-aff2-40d8121797a7", "address": "fa:16:3e:52:83:64", "network": {"id": "9cd1842b-a00c-4bcf-9fe4-1bfd8209bbd4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-186126001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d3b860b77e438c8961b6b6919c6b0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ddcc793-e3", "ovs_interfaceid": "8ddcc793-e3ca-4db4-aff2-40d8121797a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:83:64,bridge_name='br-int',has_traffic_filtering=True,id=8ddcc793-e3ca-4db4-aff2-40d8121797a7,network=Network(9cd1842b-a00c-4bcf-9fe4-1bfd8209bbd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ddcc793-e3') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG os_vif [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:83:64,bridge_name='br-int',has_traffic_filtering=True,id=8ddcc793-e3ca-4db4-aff2-40d8121797a7,network=Network(9cd1842b-a00c-4bcf-9fe4-1bfd8209bbd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ddcc793-e3') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '244ea71f-05b1-5a32-9606-ab0fad431a84', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ddcc793-e3, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8ddcc793-e3, col_values=(('qos', UUID('50a9d705-58a7-4617-9e51-6cfe4fb90f0b')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8ddcc793-e3, col_values=(('external_ids', {'iface-id': '8ddcc793-e3ca-4db4-aff2-40d8121797a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:83:64', 'vm-uuid': 'e93032ee-56bd-48be-8121-b0fd5273345e'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:10 user nova-compute[74348]: INFO os_vif [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:83:64,bridge_name='br-int',has_traffic_filtering=True,id=8ddcc793-e3ca-4db4-aff2-40d8121797a7,network=Network(9cd1842b-a00c-4bcf-9fe4-1bfd8209bbd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ddcc793-e3')
Nov 22 07:53:10 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] No VIF found with MAC fa:16:3e:52:83:64, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:53:10 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:53:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.876s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:11 user nova-compute[74348]: DEBUG nova.compute.manager [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 07:53:11 user nova-compute[74348]: DEBUG nova.compute.manager [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 07:53:11 user nova-compute[74348]: DEBUG nova.network.neutron [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 07:53:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Acquiring lock "88730c14-fd2a-4f63-bc10-96cea0b057eb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Lock "88730c14-fd2a-4f63-bc10-96cea0b057eb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:11 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 07:53:11 user nova-compute[74348]: DEBUG nova.compute.manager [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 07:53:11 user nova-compute[74348]: DEBUG nova.compute.manager [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 07:53:11 user nova-compute[74348]: DEBUG nova.network.neutron [req-14f48e53-f872-4d2e-a7ce-84004d7c552b req-cd8340c4-664b-4fba-8cd8-c4817891d9f8 service nova] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Updated VIF entry in instance network info cache for port 8ddcc793-e3ca-4db4-aff2-40d8121797a7. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 07:53:11 user nova-compute[74348]: DEBUG nova.network.neutron [req-14f48e53-f872-4d2e-a7ce-84004d7c552b req-cd8340c4-664b-4fba-8cd8-c4817891d9f8 service nova] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Updating instance_info_cache with network_info: [{"id": "8ddcc793-e3ca-4db4-aff2-40d8121797a7", "address": "fa:16:3e:52:83:64", "network": {"id": "9cd1842b-a00c-4bcf-9fe4-1bfd8209bbd4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-186126001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d3b860b77e438c8961b6b6919c6b0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ddcc793-e3", "ovs_interfaceid": "8ddcc793-e3ca-4db4-aff2-40d8121797a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:53:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-14f48e53-f872-4d2e-a7ce-84004d7c552b req-cd8340c4-664b-4fba-8cd8-c4817891d9f8 service nova] Releasing lock "refresh_cache-e93032ee-56bd-48be-8121-b0fd5273345e" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:53:11 user nova-compute[74348]: DEBUG nova.policy [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'df4cae77b03e4395887815058f3a8a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f078468965946f6aed352374702843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 07:53:11 user nova-compute[74348]: DEBUG nova.compute.manager [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 07:53:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 07:53:11 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Creating image(s)
Nov 22 07:53:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Acquiring lock "/opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Lock "/opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Lock "/opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:11 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 07:53:11 user nova-compute[74348]: INFO nova.compute.claims [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Claim successful on node user
Nov 22 07:53:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.195s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Acquiring lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.332s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/disk 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/disk 1073741824" returned: 0 in 0.134s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.476s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:12 user nova-compute[74348]: DEBUG nova.network.neutron [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Successfully created port: f47b39b9-31a2-4f9b-a5e5-ec139067b6d4 {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 07:53:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.279s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:12 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/disk. size=1073741824 {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 07:53:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:12 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:53:12 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:53:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.074s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:12 user nova-compute[74348]: DEBUG nova.compute.manager [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 07:53:12 user nova-compute[74348]: DEBUG nova.compute.manager [req-45e4a672-4d63-4497-b8ec-6d520cbb1489 req-b502ed74-448f-4b80-a0c5-3a7fa7ead877 service nova] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Received event network-vif-plugged-8ddcc793-e3ca-4db4-aff2-40d8121797a7 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:53:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-45e4a672-4d63-4497-b8ec-6d520cbb1489 req-b502ed74-448f-4b80-a0c5-3a7fa7ead877 service nova] Acquiring lock "e93032ee-56bd-48be-8121-b0fd5273345e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-45e4a672-4d63-4497-b8ec-6d520cbb1489 req-b502ed74-448f-4b80-a0c5-3a7fa7ead877 service nova] Lock "e93032ee-56bd-48be-8121-b0fd5273345e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-45e4a672-4d63-4497-b8ec-6d520cbb1489 req-b502ed74-448f-4b80-a0c5-3a7fa7ead877 service nova] Lock "e93032ee-56bd-48be-8121-b0fd5273345e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:12 user nova-compute[74348]: DEBUG nova.compute.manager [req-45e4a672-4d63-4497-b8ec-6d520cbb1489 req-b502ed74-448f-4b80-a0c5-3a7fa7ead877 service nova] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] No waiting events found dispatching network-vif-plugged-8ddcc793-e3ca-4db4-aff2-40d8121797a7 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:53:12 user nova-compute[74348]: WARNING nova.compute.manager [req-45e4a672-4d63-4497-b8ec-6d520cbb1489 req-b502ed74-448f-4b80-a0c5-3a7fa7ead877 service nova] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Received unexpected event network-vif-plugged-8ddcc793-e3ca-4db4-aff2-40d8121797a7 for instance with vm_state building and task_state spawning.
Nov 22 07:53:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/disk --force-share --output=json" returned: 0 in 0.362s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:12 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Cannot resize image /opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/disk to a smaller size. {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 07:53:12 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 07:53:12 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Ensure instance console log exists: /opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 07:53:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:12 user nova-compute[74348]: DEBUG nova.compute.manager [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 07:53:12 user nova-compute[74348]: DEBUG nova.network.neutron [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 07:53:12 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 07:53:12 user nova-compute[74348]: DEBUG nova.compute.manager [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 07:53:12 user nova-compute[74348]: DEBUG nova.policy [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8238efe52d2844dba4fc57f733fc8003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9d2d0075b4a4ee7980d9a0b2cb9a220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 07:53:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:13 user nova-compute[74348]: DEBUG nova.compute.manager [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 07:53:13 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 07:53:13 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Creating image(s)
Nov 22 07:53:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Acquiring lock "/opt/stack/data/nova/instances/88730c14-fd2a-4f63-bc10-96cea0b057eb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Lock "/opt/stack/data/nova/instances/88730c14-fd2a-4f63-bc10-96cea0b057eb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Lock "/opt/stack/data/nova/instances/88730c14-fd2a-4f63-bc10-96cea0b057eb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:13 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:13 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.231s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Acquiring lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:13 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:13 user nova-compute[74348]: DEBUG nova.network.neutron [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Successfully updated port: f47b39b9-31a2-4f9b-a5e5-ec139067b6d4 {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 07:53:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Acquiring lock "refresh_cache-bdad025e-8f6c-419a-99ea-bf277f6c5577" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:53:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Acquired lock "refresh_cache-bdad025e-8f6c-419a-99ea-bf277f6c5577" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:53:13 user nova-compute[74348]: DEBUG nova.network.neutron [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 07:53:13 user nova-compute[74348]: DEBUG nova.network.neutron [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 07:53:13 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.337s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:13 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/88730c14-fd2a-4f63-bc10-96cea0b057eb/disk 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:13 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/88730c14-fd2a-4f63-bc10-96cea0b057eb/disk 1073741824" returned: 0 in 0.053s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.397s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:13 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:13 user nova-compute[74348]: DEBUG nova.network.neutron [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Successfully created port: 6a071188-e54b-4bb7-b4dc-e2fce0291c7e {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.279s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Checking if we can resize image /opt/stack/data/nova/instances/88730c14-fd2a-4f63-bc10-96cea0b057eb/disk. size=1073741824 {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88730c14-fd2a-4f63-bc10-96cea0b057eb/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG nova.network.neutron [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Updating instance_info_cache with network_info: [{"id": "f47b39b9-31a2-4f9b-a5e5-ec139067b6d4", "address": "fa:16:3e:36:02:a6", "network": {"id": "e0159f32-e7c5-41b9-b652-8e2ca87f9018", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1248845008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f078468965946f6aed352374702843c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47b39b9-31", "ovs_interfaceid": "f47b39b9-31a2-4f9b-a5e5-ec139067b6d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Releasing lock "refresh_cache-bdad025e-8f6c-419a-99ea-bf277f6c5577" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG nova.compute.manager [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Instance network_info: |[{"id": "f47b39b9-31a2-4f9b-a5e5-ec139067b6d4", "address": "fa:16:3e:36:02:a6", "network": {"id": "e0159f32-e7c5-41b9-b652-8e2ca87f9018", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1248845008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f078468965946f6aed352374702843c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47b39b9-31", "ovs_interfaceid": "f47b39b9-31a2-4f9b-a5e5-ec139067b6d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Start _get_guest_xml network_info=[{"id": "f47b39b9-31a2-4f9b-a5e5-ec139067b6d4", "address": "fa:16:3e:36:02:a6", "network": {"id": "e0159f32-e7c5-41b9-b652-8e2ca87f9018", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1248845008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f078468965946f6aed352374702843c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47b39b9-31", "ovs_interfaceid": "f47b39b9-31a2-4f9b-a5e5-ec139067b6d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 07:53:14 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:53:14 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:53:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-726810190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-726810190',id=8,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2d2AMx5MTcXajy6b7uPsq3+jYxxbAAyYP5uwFXUURVQR6N2+iGSyaCZAQVBr0xq/5GZlgBfcRmwRXF9ZovM3nD3R4hcY3OcZ/S/sjuTSQBqYHlzsArXECyBywfXW3yNw==',key_name='tempest-keypair-266871328',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f078468965946f6aed352374702843c',ramdisk_id='',reservation_id='r-nuqss0no',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-659854772',owner_user_name='tempest-TaggedAttachmentsTest-659854772-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:53:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df4cae77b03e4395887815058f3a8a42',uuid=bdad025e-8f6c-419a-99ea-bf277f6c5577,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f47b39b9-31a2-4f9b-a5e5-ec139067b6d4", "address": "fa:16:3e:36:02:a6", "network": {"id": "e0159f32-e7c5-41b9-b652-8e2ca87f9018", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1248845008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f078468965946f6aed352374702843c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47b39b9-31", "ovs_interfaceid": "f47b39b9-31a2-4f9b-a5e5-ec139067b6d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Converting VIF {"id": "f47b39b9-31a2-4f9b-a5e5-ec139067b6d4", "address": "fa:16:3e:36:02:a6", "network": {"id": "e0159f32-e7c5-41b9-b652-8e2ca87f9018", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1248845008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f078468965946f6aed352374702843c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47b39b9-31", "ovs_interfaceid": "f47b39b9-31a2-4f9b-a5e5-ec139067b6d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:02:a6,bridge_name='br-int',has_traffic_filtering=True,id=f47b39b9-31a2-4f9b-a5e5-ec139067b6d4,network=Network(e0159f32-e7c5-41b9-b652-8e2ca87f9018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf47b39b9-31') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG nova.objects.instance [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Lazy-loading 'pci_devices' on Instance uuid bdad025e-8f6c-419a-99ea-bf277f6c5577 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] End _get_guest_xml xml=<domain type="kvm">
Nov 22 07:53:14 user nova-compute[74348]:   <uuid>bdad025e-8f6c-419a-99ea-bf277f6c5577</uuid>
Nov 22 07:53:14 user nova-compute[74348]:   <name>instance-00000008</name>
Nov 22 07:53:14 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 07:53:14 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 07:53:14 user nova-compute[74348]:   <metadata>
Nov 22 07:53:14 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 07:53:14 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 07:53:14 user nova-compute[74348]:       <nova:name>tempest-device-tagging-server-726810190</nova:name>
Nov 22 07:53:14 user nova-compute[74348]:       <nova:creationTime>2023-11-22 07:53:14</nova:creationTime>
Nov 22 07:53:14 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 07:53:14 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 07:53:14 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 07:53:14 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 07:53:14 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 07:53:14 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 07:53:14 user nova-compute[74348]:       </nova:flavor>
Nov 22 07:53:14 user nova-compute[74348]:       <nova:owner>
Nov 22 07:53:14 user nova-compute[74348]:         <nova:user uuid="df4cae77b03e4395887815058f3a8a42">tempest-TaggedAttachmentsTest-659854772-project-member</nova:user>
Nov 22 07:53:14 user nova-compute[74348]:         <nova:project uuid="2f078468965946f6aed352374702843c">tempest-TaggedAttachmentsTest-659854772</nova:project>
Nov 22 07:53:14 user nova-compute[74348]:       </nova:owner>
Nov 22 07:53:14 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 07:53:14 user nova-compute[74348]:       <nova:ports>
Nov 22 07:53:14 user nova-compute[74348]:         <nova:port uuid="f47b39b9-31a2-4f9b-a5e5-ec139067b6d4">
Nov 22 07:53:14 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 22 07:53:14 user nova-compute[74348]:         </nova:port>
Nov 22 07:53:14 user nova-compute[74348]:       </nova:ports>
Nov 22 07:53:14 user nova-compute[74348]:     </nova:instance>
Nov 22 07:53:14 user nova-compute[74348]:   </metadata>
Nov 22 07:53:14 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 07:53:14 user nova-compute[74348]:     <system>
Nov 22 07:53:14 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 07:53:14 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 07:53:14 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 07:53:14 user nova-compute[74348]:       <entry name="serial">bdad025e-8f6c-419a-99ea-bf277f6c5577</entry>
Nov 22 07:53:14 user nova-compute[74348]:       <entry name="uuid">bdad025e-8f6c-419a-99ea-bf277f6c5577</entry>
Nov 22 07:53:14 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 07:53:14 user nova-compute[74348]:     </system>
Nov 22 07:53:14 user nova-compute[74348]:   </sysinfo>
Nov 22 07:53:14 user nova-compute[74348]:   <os>
Nov 22 07:53:14 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 07:53:14 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 07:53:14 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 07:53:14 user nova-compute[74348]:   </os>
Nov 22 07:53:14 user nova-compute[74348]:   <features>
Nov 22 07:53:14 user nova-compute[74348]:     <acpi/>
Nov 22 07:53:14 user nova-compute[74348]:     <apic/>
Nov 22 07:53:14 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 07:53:14 user nova-compute[74348]:   </features>
Nov 22 07:53:14 user nova-compute[74348]:   <clock offset="utc">
Nov 22 07:53:14 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 07:53:14 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 07:53:14 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 07:53:14 user nova-compute[74348]:   </clock>
Nov 22 07:53:14 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 07:53:14 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 07:53:14 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 07:53:14 user nova-compute[74348]:   </cpu>
Nov 22 07:53:14 user nova-compute[74348]:   <devices>
Nov 22 07:53:14 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 07:53:14 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 07:53:14 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/disk"/>
Nov 22 07:53:14 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 07:53:14 user nova-compute[74348]:     </disk>
Nov 22 07:53:14 user nova-compute[74348]:     <disk type="file" device="cdrom">
Nov 22 07:53:14 user nova-compute[74348]:       <driver name="qemu" type="raw" cache="none"/>
Nov 22 07:53:14 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/disk.config"/>
Nov 22 07:53:14 user nova-compute[74348]:       <target dev="hda" bus="ide"/>
Nov 22 07:53:14 user nova-compute[74348]:     </disk>
Nov 22 07:53:14 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 07:53:14 user nova-compute[74348]:       <mac address="fa:16:3e:36:02:a6"/>
Nov 22 07:53:14 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:53:14 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 07:53:14 user nova-compute[74348]:       <target dev="tapf47b39b9-31"/>
Nov 22 07:53:14 user nova-compute[74348]:     </interface>
Nov 22 07:53:14 user nova-compute[74348]:     <serial type="pty">
Nov 22 07:53:14 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/console.log" append="off"/>
Nov 22 07:53:14 user nova-compute[74348]:     </serial>
Nov 22 07:53:14 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 07:53:14 user nova-compute[74348]:     <video>
Nov 22 07:53:14 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:53:14 user nova-compute[74348]:     </video>
Nov 22 07:53:14 user nova-compute[74348]:     <rng model="virtio">
Nov 22 07:53:14 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 07:53:14 user nova-compute[74348]:     </rng>
Nov 22 07:53:14 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 07:53:14 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 07:53:14 user nova-compute[74348]:       <stats period="10"/>
Nov 22 07:53:14 user nova-compute[74348]:     </memballoon>
Nov 22 07:53:14 user nova-compute[74348]:   </devices>
Nov 22 07:53:14 user nova-compute[74348]: </domain>
Nov 22 07:53:14 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-726810190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-726810190',id=8,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2d2AMx5MTcXajy6b7uPsq3+jYxxbAAyYP5uwFXUURVQR6N2+iGSyaCZAQVBr0xq/5GZlgBfcRmwRXF9ZovM3nD3R4hcY3OcZ/S/sjuTSQBqYHlzsArXECyBywfXW3yNw==',key_name='tempest-keypair-266871328',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f078468965946f6aed352374702843c',ramdisk_id='',reservation_id='r-nuqss0no',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-659854772',owner_user_name='tempest-TaggedAttachmentsTest-659854772-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:53:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df4cae77b03e4395887815058f3a8a42',uuid=bdad025e-8f6c-419a-99ea-bf277f6c5577,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f47b39b9-31a2-4f9b-a5e5-ec139067b6d4", "address": "fa:16:3e:36:02:a6", "network": {"id": "e0159f32-e7c5-41b9-b652-8e2ca87f9018", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1248845008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f078468965946f6aed352374702843c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47b39b9-31", "ovs_interfaceid": "f47b39b9-31a2-4f9b-a5e5-ec139067b6d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Converting VIF {"id": "f47b39b9-31a2-4f9b-a5e5-ec139067b6d4", "address": "fa:16:3e:36:02:a6", "network": {"id": "e0159f32-e7c5-41b9-b652-8e2ca87f9018", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1248845008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f078468965946f6aed352374702843c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47b39b9-31", "ovs_interfaceid": "f47b39b9-31a2-4f9b-a5e5-ec139067b6d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:02:a6,bridge_name='br-int',has_traffic_filtering=True,id=f47b39b9-31a2-4f9b-a5e5-ec139067b6d4,network=Network(e0159f32-e7c5-41b9-b652-8e2ca87f9018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf47b39b9-31') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG os_vif [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:02:a6,bridge_name='br-int',has_traffic_filtering=True,id=f47b39b9-31a2-4f9b-a5e5-ec139067b6d4,network=Network(e0159f32-e7c5-41b9-b652-8e2ca87f9018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf47b39b9-31') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7cf83614-4b6b-50ec-8ad4-401d8fd76551', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf47b39b9-31, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf47b39b9-31, col_values=(('qos', UUID('f3063bbe-5200-4f64-958c-30736ec03c6a')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf47b39b9-31, col_values=(('external_ids', {'iface-id': 'f47b39b9-31a2-4f9b-a5e5-ec139067b6d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:02:a6', 'vm-uuid': 'bdad025e-8f6c-419a-99ea-bf277f6c5577'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88730c14-fd2a-4f63-bc10-96cea0b057eb/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Cannot resize image /opt/stack/data/nova/instances/88730c14-fd2a-4f63-bc10-96cea0b057eb/disk to a smaller size. {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Ensure instance console log exists: /opt/stack/data/nova/instances/88730c14-fd2a-4f63-bc10-96cea0b057eb/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:14 user nova-compute[74348]: INFO os_vif [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:02:a6,bridge_name='br-int',has_traffic_filtering=True,id=f47b39b9-31a2-4f9b-a5e5-ec139067b6d4,network=Network(e0159f32-e7c5-41b9-b652-8e2ca87f9018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf47b39b9-31')
Nov 22 07:53:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] No BDM found with device name hda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] No VIF found with MAC fa:16:3e:36:02:a6, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 07:53:14 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Using config drive
Nov 22 07:53:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG nova.compute.manager [req-4ce18c10-789c-4121-89bd-6b5cc7dee2aa req-41f873c3-cd43-47d4-8795-ded4ef920bb7 service nova] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Received event network-vif-plugged-8ddcc793-e3ca-4db4-aff2-40d8121797a7 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4ce18c10-789c-4121-89bd-6b5cc7dee2aa req-41f873c3-cd43-47d4-8795-ded4ef920bb7 service nova] Acquiring lock "e93032ee-56bd-48be-8121-b0fd5273345e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4ce18c10-789c-4121-89bd-6b5cc7dee2aa req-41f873c3-cd43-47d4-8795-ded4ef920bb7 service nova] Lock "e93032ee-56bd-48be-8121-b0fd5273345e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4ce18c10-789c-4121-89bd-6b5cc7dee2aa req-41f873c3-cd43-47d4-8795-ded4ef920bb7 service nova] Lock "e93032ee-56bd-48be-8121-b0fd5273345e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG nova.compute.manager [req-4ce18c10-789c-4121-89bd-6b5cc7dee2aa req-41f873c3-cd43-47d4-8795-ded4ef920bb7 service nova] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] No waiting events found dispatching network-vif-plugged-8ddcc793-e3ca-4db4-aff2-40d8121797a7 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:53:14 user nova-compute[74348]: WARNING nova.compute.manager [req-4ce18c10-789c-4121-89bd-6b5cc7dee2aa req-41f873c3-cd43-47d4-8795-ded4ef920bb7 service nova] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Received unexpected event network-vif-plugged-8ddcc793-e3ca-4db4-aff2-40d8121797a7 for instance with vm_state building and task_state spawning.
Nov 22 07:53:14 user nova-compute[74348]: DEBUG nova.compute.manager [req-4ce18c10-789c-4121-89bd-6b5cc7dee2aa req-41f873c3-cd43-47d4-8795-ded4ef920bb7 service nova] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Received event network-changed-f47b39b9-31a2-4f9b-a5e5-ec139067b6d4 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG nova.compute.manager [req-4ce18c10-789c-4121-89bd-6b5cc7dee2aa req-41f873c3-cd43-47d4-8795-ded4ef920bb7 service nova] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Refreshing instance network info cache due to event network-changed-f47b39b9-31a2-4f9b-a5e5-ec139067b6d4. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4ce18c10-789c-4121-89bd-6b5cc7dee2aa req-41f873c3-cd43-47d4-8795-ded4ef920bb7 service nova] Acquiring lock "refresh_cache-bdad025e-8f6c-419a-99ea-bf277f6c5577" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4ce18c10-789c-4121-89bd-6b5cc7dee2aa req-41f873c3-cd43-47d4-8795-ded4ef920bb7 service nova] Acquired lock "refresh_cache-bdad025e-8f6c-419a-99ea-bf277f6c5577" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG nova.network.neutron [req-4ce18c10-789c-4121-89bd-6b5cc7dee2aa req-41f873c3-cd43-47d4-8795-ded4ef920bb7 service nova] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Refreshing network info cache for port f47b39b9-31a2-4f9b-a5e5-ec139067b6d4 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:53:14 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Creating config drive at /opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/disk.config
Nov 22 07:53:14 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmplumx_zku {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:14 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmplumx_zku" returned: 0 in 0.062s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:15 user nova-compute[74348]: DEBUG nova.compute.manager [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 07:53:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 07:53:15 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Instance spawned successfully.
Nov 22 07:53:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 07:53:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:53:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:53:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:53:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:53:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:53:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:53:15 user nova-compute[74348]: INFO nova.compute.manager [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Took 7.91 seconds to spawn the instance on the hypervisor.
Nov 22 07:53:15 user nova-compute[74348]: DEBUG nova.compute.manager [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 07:53:15 user nova-compute[74348]: DEBUG nova.network.neutron [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Successfully updated port: 6a071188-e54b-4bb7-b4dc-e2fce0291c7e {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 07:53:15 user nova-compute[74348]: INFO nova.compute.manager [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Took 9.24 seconds to build instance.
Nov 22 07:53:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Acquiring lock "refresh_cache-88730c14-fd2a-4f63-bc10-96cea0b057eb" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:53:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Acquired lock "refresh_cache-88730c14-fd2a-4f63-bc10-96cea0b057eb" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:53:15 user nova-compute[74348]: DEBUG nova.network.neutron [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 07:53:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-25a7b912-dedb-4238-a96c-bd82d06176b6 tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Lock "e93032ee-56bd-48be-8121-b0fd5273345e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.548s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:15 user nova-compute[74348]: DEBUG nova.compute.manager [req-9de40765-181e-45a3-b82a-3b75c67500ce req-9695e26a-a004-41df-bfc4-ae803a0d5d29 service nova] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Received event network-changed-6a071188-e54b-4bb7-b4dc-e2fce0291c7e {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:53:15 user nova-compute[74348]: DEBUG nova.compute.manager [req-9de40765-181e-45a3-b82a-3b75c67500ce req-9695e26a-a004-41df-bfc4-ae803a0d5d29 service nova] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Refreshing instance network info cache due to event network-changed-6a071188-e54b-4bb7-b4dc-e2fce0291c7e. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:53:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9de40765-181e-45a3-b82a-3b75c67500ce req-9695e26a-a004-41df-bfc4-ae803a0d5d29 service nova] Acquiring lock "refresh_cache-88730c14-fd2a-4f63-bc10-96cea0b057eb" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:53:15 user nova-compute[74348]: DEBUG nova.network.neutron [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG nova.network.neutron [req-4ce18c10-789c-4121-89bd-6b5cc7dee2aa req-41f873c3-cd43-47d4-8795-ded4ef920bb7 service nova] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Updated VIF entry in instance network info cache for port f47b39b9-31a2-4f9b-a5e5-ec139067b6d4. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG nova.network.neutron [req-4ce18c10-789c-4121-89bd-6b5cc7dee2aa req-41f873c3-cd43-47d4-8795-ded4ef920bb7 service nova] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Updating instance_info_cache with network_info: [{"id": "f47b39b9-31a2-4f9b-a5e5-ec139067b6d4", "address": "fa:16:3e:36:02:a6", "network": {"id": "e0159f32-e7c5-41b9-b652-8e2ca87f9018", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1248845008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f078468965946f6aed352374702843c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47b39b9-31", "ovs_interfaceid": "f47b39b9-31a2-4f9b-a5e5-ec139067b6d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4ce18c10-789c-4121-89bd-6b5cc7dee2aa req-41f873c3-cd43-47d4-8795-ded4ef920bb7 service nova] Releasing lock "refresh_cache-bdad025e-8f6c-419a-99ea-bf277f6c5577" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG nova.network.neutron [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Updating instance_info_cache with network_info: [{"id": "6a071188-e54b-4bb7-b4dc-e2fce0291c7e", "address": "fa:16:3e:ac:c1:ef", "network": {"id": "47fbdc54-3fce-4cf3-970c-4dbd738b71a6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2128185295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d2d0075b4a4ee7980d9a0b2cb9a220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a071188-e5", "ovs_interfaceid": "6a071188-e54b-4bb7-b4dc-e2fce0291c7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Releasing lock "refresh_cache-88730c14-fd2a-4f63-bc10-96cea0b057eb" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG nova.compute.manager [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Instance network_info: |[{"id": "6a071188-e54b-4bb7-b4dc-e2fce0291c7e", "address": "fa:16:3e:ac:c1:ef", "network": {"id": "47fbdc54-3fce-4cf3-970c-4dbd738b71a6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2128185295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d2d0075b4a4ee7980d9a0b2cb9a220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a071188-e5", "ovs_interfaceid": "6a071188-e54b-4bb7-b4dc-e2fce0291c7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9de40765-181e-45a3-b82a-3b75c67500ce req-9695e26a-a004-41df-bfc4-ae803a0d5d29 service nova] Acquired lock "refresh_cache-88730c14-fd2a-4f63-bc10-96cea0b057eb" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG nova.network.neutron [req-9de40765-181e-45a3-b82a-3b75c67500ce req-9695e26a-a004-41df-bfc4-ae803a0d5d29 service nova] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Refreshing network info cache for port 6a071188-e54b-4bb7-b4dc-e2fce0291c7e {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Start _get_guest_xml network_info=[{"id": "6a071188-e54b-4bb7-b4dc-e2fce0291c7e", "address": "fa:16:3e:ac:c1:ef", "network": {"id": "47fbdc54-3fce-4cf3-970c-4dbd738b71a6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2128185295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d2d0075b4a4ee7980d9a0b2cb9a220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a071188-e5", "ovs_interfaceid": "6a071188-e54b-4bb7-b4dc-e2fce0291c7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 07:53:16 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:53:16 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:53:16 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:53:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1543681504',display_name='tempest-VolumesAssistedSnapshotsTest-server-1543681504',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1543681504',id=9,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZrL4Zme8L5bDgoNSR9ziJX2TyZge1e3/XDHGsbuZ+V20qLhnP2XGt23MvkV9fvpiu1wrovpXO2ZxROkmxZ+WdDgETO0gYYTaunE5sl9Zg/2e5SlPb4uJ9pp4YjPUuj+g==',key_name='tempest-keypair-293749558',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9d2d0075b4a4ee7980d9a0b2cb9a220',ramdisk_id='',reservation_id='r-j7mjj1lr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-855823521',owner_user_name='tempest-VolumesAssistedSnapshotsTest-855823521-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:53:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8238efe52d2844dba4fc57f733fc8003',uuid=88730c14-fd2a-4f63-bc10-96cea0b057eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a071188-e54b-4bb7-b4dc-e2fce0291c7e", "address": "fa:16:3e:ac:c1:ef", "network": {"id": "47fbdc54-3fce-4cf3-970c-4dbd738b71a6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2128185295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d2d0075b4a4ee7980d9a0b2cb9a220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a071188-e5", "ovs_interfaceid": "6a071188-e54b-4bb7-b4dc-e2fce0291c7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Converting VIF {"id": "6a071188-e54b-4bb7-b4dc-e2fce0291c7e", "address": "fa:16:3e:ac:c1:ef", "network": {"id": "47fbdc54-3fce-4cf3-970c-4dbd738b71a6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2128185295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d2d0075b4a4ee7980d9a0b2cb9a220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a071188-e5", "ovs_interfaceid": "6a071188-e54b-4bb7-b4dc-e2fce0291c7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:c1:ef,bridge_name='br-int',has_traffic_filtering=True,id=6a071188-e54b-4bb7-b4dc-e2fce0291c7e,network=Network(47fbdc54-3fce-4cf3-970c-4dbd738b71a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a071188-e5') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG nova.objects.instance [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Lazy-loading 'pci_devices' on Instance uuid 88730c14-fd2a-4f63-bc10-96cea0b057eb {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] End _get_guest_xml xml=<domain type="kvm">
Nov 22 07:53:16 user nova-compute[74348]:   <uuid>88730c14-fd2a-4f63-bc10-96cea0b057eb</uuid>
Nov 22 07:53:16 user nova-compute[74348]:   <name>instance-00000009</name>
Nov 22 07:53:16 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 07:53:16 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 07:53:16 user nova-compute[74348]:   <metadata>
Nov 22 07:53:16 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 07:53:16 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 07:53:16 user nova-compute[74348]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1543681504</nova:name>
Nov 22 07:53:16 user nova-compute[74348]:       <nova:creationTime>2023-11-22 07:53:16</nova:creationTime>
Nov 22 07:53:16 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 07:53:16 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 07:53:16 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 07:53:16 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 07:53:16 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 07:53:16 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 07:53:16 user nova-compute[74348]:       </nova:flavor>
Nov 22 07:53:16 user nova-compute[74348]:       <nova:owner>
Nov 22 07:53:16 user nova-compute[74348]:         <nova:user uuid="8238efe52d2844dba4fc57f733fc8003">tempest-VolumesAssistedSnapshotsTest-855823521-project-member</nova:user>
Nov 22 07:53:16 user nova-compute[74348]:         <nova:project uuid="d9d2d0075b4a4ee7980d9a0b2cb9a220">tempest-VolumesAssistedSnapshotsTest-855823521</nova:project>
Nov 22 07:53:16 user nova-compute[74348]:       </nova:owner>
Nov 22 07:53:16 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 07:53:16 user nova-compute[74348]:       <nova:ports>
Nov 22 07:53:16 user nova-compute[74348]:         <nova:port uuid="6a071188-e54b-4bb7-b4dc-e2fce0291c7e">
Nov 22 07:53:16 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 22 07:53:16 user nova-compute[74348]:         </nova:port>
Nov 22 07:53:16 user nova-compute[74348]:       </nova:ports>
Nov 22 07:53:16 user nova-compute[74348]:     </nova:instance>
Nov 22 07:53:16 user nova-compute[74348]:   </metadata>
Nov 22 07:53:16 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 07:53:16 user nova-compute[74348]:     <system>
Nov 22 07:53:16 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 07:53:16 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 07:53:16 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 07:53:16 user nova-compute[74348]:       <entry name="serial">88730c14-fd2a-4f63-bc10-96cea0b057eb</entry>
Nov 22 07:53:16 user nova-compute[74348]:       <entry name="uuid">88730c14-fd2a-4f63-bc10-96cea0b057eb</entry>
Nov 22 07:53:16 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 07:53:16 user nova-compute[74348]:     </system>
Nov 22 07:53:16 user nova-compute[74348]:   </sysinfo>
Nov 22 07:53:16 user nova-compute[74348]:   <os>
Nov 22 07:53:16 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 07:53:16 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 07:53:16 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 07:53:16 user nova-compute[74348]:   </os>
Nov 22 07:53:16 user nova-compute[74348]:   <features>
Nov 22 07:53:16 user nova-compute[74348]:     <acpi/>
Nov 22 07:53:16 user nova-compute[74348]:     <apic/>
Nov 22 07:53:16 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 07:53:16 user nova-compute[74348]:   </features>
Nov 22 07:53:16 user nova-compute[74348]:   <clock offset="utc">
Nov 22 07:53:16 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 07:53:16 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 07:53:16 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 07:53:16 user nova-compute[74348]:   </clock>
Nov 22 07:53:16 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 07:53:16 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 07:53:16 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 07:53:16 user nova-compute[74348]:   </cpu>
Nov 22 07:53:16 user nova-compute[74348]:   <devices>
Nov 22 07:53:16 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 07:53:16 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 07:53:16 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/88730c14-fd2a-4f63-bc10-96cea0b057eb/disk"/>
Nov 22 07:53:16 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 07:53:16 user nova-compute[74348]:     </disk>
Nov 22 07:53:16 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 07:53:16 user nova-compute[74348]:       <mac address="fa:16:3e:ac:c1:ef"/>
Nov 22 07:53:16 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:53:16 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 07:53:16 user nova-compute[74348]:       <target dev="tap6a071188-e5"/>
Nov 22 07:53:16 user nova-compute[74348]:     </interface>
Nov 22 07:53:16 user nova-compute[74348]:     <serial type="pty">
Nov 22 07:53:16 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/88730c14-fd2a-4f63-bc10-96cea0b057eb/console.log" append="off"/>
Nov 22 07:53:16 user nova-compute[74348]:     </serial>
Nov 22 07:53:16 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 07:53:16 user nova-compute[74348]:     <video>
Nov 22 07:53:16 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:53:16 user nova-compute[74348]:     </video>
Nov 22 07:53:16 user nova-compute[74348]:     <rng model="virtio">
Nov 22 07:53:16 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 07:53:16 user nova-compute[74348]:     </rng>
Nov 22 07:53:16 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 07:53:16 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 07:53:16 user nova-compute[74348]:       <stats period="10"/>
Nov 22 07:53:16 user nova-compute[74348]:     </memballoon>
Nov 22 07:53:16 user nova-compute[74348]:   </devices>
Nov 22 07:53:16 user nova-compute[74348]: </domain>
Nov 22 07:53:16 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:53:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1543681504',display_name='tempest-VolumesAssistedSnapshotsTest-server-1543681504',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1543681504',id=9,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZrL4Zme8L5bDgoNSR9ziJX2TyZge1e3/XDHGsbuZ+V20qLhnP2XGt23MvkV9fvpiu1wrovpXO2ZxROkmxZ+WdDgETO0gYYTaunE5sl9Zg/2e5SlPb4uJ9pp4YjPUuj+g==',key_name='tempest-keypair-293749558',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9d2d0075b4a4ee7980d9a0b2cb9a220',ramdisk_id='',reservation_id='r-j7mjj1lr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-855823521',owner_user_name='tempest-VolumesAssistedSnapshotsTest-855823521-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:53:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8238efe52d2844dba4fc57f733fc8003',uuid=88730c14-fd2a-4f63-bc10-96cea0b057eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a071188-e54b-4bb7-b4dc-e2fce0291c7e", "address": "fa:16:3e:ac:c1:ef", "network": {"id": "47fbdc54-3fce-4cf3-970c-4dbd738b71a6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2128185295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d2d0075b4a4ee7980d9a0b2cb9a220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a071188-e5", "ovs_interfaceid": "6a071188-e54b-4bb7-b4dc-e2fce0291c7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Converting VIF {"id": "6a071188-e54b-4bb7-b4dc-e2fce0291c7e", "address": "fa:16:3e:ac:c1:ef", "network": {"id": "47fbdc54-3fce-4cf3-970c-4dbd738b71a6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2128185295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d2d0075b4a4ee7980d9a0b2cb9a220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a071188-e5", "ovs_interfaceid": "6a071188-e54b-4bb7-b4dc-e2fce0291c7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:c1:ef,bridge_name='br-int',has_traffic_filtering=True,id=6a071188-e54b-4bb7-b4dc-e2fce0291c7e,network=Network(47fbdc54-3fce-4cf3-970c-4dbd738b71a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a071188-e5') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG os_vif [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:c1:ef,bridge_name='br-int',has_traffic_filtering=True,id=6a071188-e54b-4bb7-b4dc-e2fce0291c7e,network=Network(47fbdc54-3fce-4cf3-970c-4dbd738b71a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a071188-e5') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf3c5cd8-4f63-555e-b691-a6b1baf52431', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a071188-e5, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6a071188-e5, col_values=(('qos', UUID('f9004757-fa16-4391-a536-ea458b89d98f')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6a071188-e5, col_values=(('external_ids', {'iface-id': '6a071188-e54b-4bb7-b4dc-e2fce0291c7e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:c1:ef', 'vm-uuid': '88730c14-fd2a-4f63-bc10-96cea0b057eb'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:16 user nova-compute[74348]: INFO os_vif [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:c1:ef,bridge_name='br-int',has_traffic_filtering=True,id=6a071188-e54b-4bb7-b4dc-e2fce0291c7e,network=Network(47fbdc54-3fce-4cf3-970c-4dbd738b71a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a071188-e5')
Nov 22 07:53:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Acquiring lock "abd7f2ed-b0c4-4e05-8161-b141a611f125" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Lock "abd7f2ed-b0c4-4e05-8161-b141a611f125" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] No VIF found with MAC fa:16:3e:ac:c1:ef, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG nova.compute.manager [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:16 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 07:53:16 user nova-compute[74348]: INFO nova.compute.claims [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Claim successful on node user
Nov 22 07:53:17 user nova-compute[74348]: DEBUG nova.network.neutron [req-9de40765-181e-45a3-b82a-3b75c67500ce req-9695e26a-a004-41df-bfc4-ae803a0d5d29 service nova] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Updated VIF entry in instance network info cache for port 6a071188-e54b-4bb7-b4dc-e2fce0291c7e. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 07:53:17 user nova-compute[74348]: DEBUG nova.network.neutron [req-9de40765-181e-45a3-b82a-3b75c67500ce req-9695e26a-a004-41df-bfc4-ae803a0d5d29 service nova] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Updating instance_info_cache with network_info: [{"id": "6a071188-e54b-4bb7-b4dc-e2fce0291c7e", "address": "fa:16:3e:ac:c1:ef", "network": {"id": "47fbdc54-3fce-4cf3-970c-4dbd738b71a6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2128185295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d2d0075b4a4ee7980d9a0b2cb9a220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a071188-e5", "ovs_interfaceid": "6a071188-e54b-4bb7-b4dc-e2fce0291c7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:53:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9de40765-181e-45a3-b82a-3b75c67500ce req-9695e26a-a004-41df-bfc4-ae803a0d5d29 service nova] Releasing lock "refresh_cache-88730c14-fd2a-4f63-bc10-96cea0b057eb" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:53:17 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:53:17 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:53:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.701s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:17 user nova-compute[74348]: DEBUG nova.compute.manager [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 07:53:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:17 user nova-compute[74348]: DEBUG nova.compute.manager [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 07:53:17 user nova-compute[74348]: DEBUG nova.network.neutron [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 07:53:17 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 07:53:17 user nova-compute[74348]: DEBUG nova.compute.manager [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 07:53:17 user nova-compute[74348]: DEBUG nova.compute.manager [req-c19dc8ab-d8cd-4087-ba21-dbc5d29bb9aa req-69efa29b-e842-41f4-a942-aac62ce202b0 service nova] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Received event network-vif-plugged-f47b39b9-31a2-4f9b-a5e5-ec139067b6d4 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:53:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c19dc8ab-d8cd-4087-ba21-dbc5d29bb9aa req-69efa29b-e842-41f4-a942-aac62ce202b0 service nova] Acquiring lock "bdad025e-8f6c-419a-99ea-bf277f6c5577-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c19dc8ab-d8cd-4087-ba21-dbc5d29bb9aa req-69efa29b-e842-41f4-a942-aac62ce202b0 service nova] Lock "bdad025e-8f6c-419a-99ea-bf277f6c5577-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c19dc8ab-d8cd-4087-ba21-dbc5d29bb9aa req-69efa29b-e842-41f4-a942-aac62ce202b0 service nova] Lock "bdad025e-8f6c-419a-99ea-bf277f6c5577-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:17 user nova-compute[74348]: DEBUG nova.compute.manager [req-c19dc8ab-d8cd-4087-ba21-dbc5d29bb9aa req-69efa29b-e842-41f4-a942-aac62ce202b0 service nova] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] No waiting events found dispatching network-vif-plugged-f47b39b9-31a2-4f9b-a5e5-ec139067b6d4 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:53:17 user nova-compute[74348]: WARNING nova.compute.manager [req-c19dc8ab-d8cd-4087-ba21-dbc5d29bb9aa req-69efa29b-e842-41f4-a942-aac62ce202b0 service nova] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Received unexpected event network-vif-plugged-f47b39b9-31a2-4f9b-a5e5-ec139067b6d4 for instance with vm_state building and task_state spawning.
Nov 22 07:53:17 user nova-compute[74348]: DEBUG nova.compute.manager [req-c19dc8ab-d8cd-4087-ba21-dbc5d29bb9aa req-69efa29b-e842-41f4-a942-aac62ce202b0 service nova] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Received event network-vif-plugged-f47b39b9-31a2-4f9b-a5e5-ec139067b6d4 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:53:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c19dc8ab-d8cd-4087-ba21-dbc5d29bb9aa req-69efa29b-e842-41f4-a942-aac62ce202b0 service nova] Acquiring lock "bdad025e-8f6c-419a-99ea-bf277f6c5577-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c19dc8ab-d8cd-4087-ba21-dbc5d29bb9aa req-69efa29b-e842-41f4-a942-aac62ce202b0 service nova] Lock "bdad025e-8f6c-419a-99ea-bf277f6c5577-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c19dc8ab-d8cd-4087-ba21-dbc5d29bb9aa req-69efa29b-e842-41f4-a942-aac62ce202b0 service nova] Lock "bdad025e-8f6c-419a-99ea-bf277f6c5577-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:17 user nova-compute[74348]: DEBUG nova.compute.manager [req-c19dc8ab-d8cd-4087-ba21-dbc5d29bb9aa req-69efa29b-e842-41f4-a942-aac62ce202b0 service nova] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] No waiting events found dispatching network-vif-plugged-f47b39b9-31a2-4f9b-a5e5-ec139067b6d4 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:53:17 user nova-compute[74348]: WARNING nova.compute.manager [req-c19dc8ab-d8cd-4087-ba21-dbc5d29bb9aa req-69efa29b-e842-41f4-a942-aac62ce202b0 service nova] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Received unexpected event network-vif-plugged-f47b39b9-31a2-4f9b-a5e5-ec139067b6d4 for instance with vm_state building and task_state spawning.
Nov 22 07:53:17 user nova-compute[74348]: DEBUG nova.policy [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad47d30fba8048b99bf017fc43335532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4a9f365081417e81c935755cb6ddb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 07:53:17 user nova-compute[74348]: INFO nova.virt.block_device [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Booting with volume bf17ece2-1f33-4fa3-af81-8534b3fe79af at /dev/vda
Nov 22 07:53:17 user nova-compute[74348]: DEBUG os_brick.utils [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:53:17 user nova-compute[74348]: INFO oslo.privsep.daemon [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp66bjtbk1/privsep.sock']
Nov 22 07:53:17 user sudo[85085]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp66bjtbk1/privsep.sock
Nov 22 07:53:17 user sudo[85085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 22 07:53:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:18 user nova-compute[74348]: DEBUG nova.network.neutron [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Successfully created port: c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3 {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 07:53:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:19 user nova-compute[74348]: DEBUG nova.network.neutron [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Successfully updated port: c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3 {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 07:53:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Acquiring lock "refresh_cache-abd7f2ed-b0c4-4e05-8161-b141a611f125" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:53:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Acquired lock "refresh_cache-abd7f2ed-b0c4-4e05-8161-b141a611f125" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:53:19 user nova-compute[74348]: DEBUG nova.network.neutron [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 07:53:19 user nova-compute[74348]: DEBUG nova.network.neutron [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 07:53:19 user nova-compute[74348]: DEBUG nova.network.neutron [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Updating instance_info_cache with network_info: [{"id": "c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3", "address": "fa:16:3e:d1:85:73", "network": {"id": "5826faef-2095-4993-a655-a168237a5018", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1612032334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac4a9f365081417e81c935755cb6ddb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f3237e-bc", "ovs_interfaceid": "c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:53:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Releasing lock "refresh_cache-abd7f2ed-b0c4-4e05-8161-b141a611f125" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:53:19 user nova-compute[74348]: DEBUG nova.compute.manager [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Instance network_info: |[{"id": "c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3", "address": "fa:16:3e:d1:85:73", "network": {"id": "5826faef-2095-4993-a655-a168237a5018", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1612032334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac4a9f365081417e81c935755cb6ddb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f3237e-bc", "ovs_interfaceid": "c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 07:53:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:19 user nova-compute[74348]: DEBUG nova.compute.manager [req-372e83b7-defd-4393-93f7-eade734304d1 req-ca28bd15-8cda-4471-a003-290ec63d4718 service nova] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Received event network-changed-c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:53:19 user nova-compute[74348]: DEBUG nova.compute.manager [req-372e83b7-defd-4393-93f7-eade734304d1 req-ca28bd15-8cda-4471-a003-290ec63d4718 service nova] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Refreshing instance network info cache due to event network-changed-c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:53:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-372e83b7-defd-4393-93f7-eade734304d1 req-ca28bd15-8cda-4471-a003-290ec63d4718 service nova] Acquiring lock "refresh_cache-abd7f2ed-b0c4-4e05-8161-b141a611f125" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:53:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-372e83b7-defd-4393-93f7-eade734304d1 req-ca28bd15-8cda-4471-a003-290ec63d4718 service nova] Acquired lock "refresh_cache-abd7f2ed-b0c4-4e05-8161-b141a611f125" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:53:19 user nova-compute[74348]: DEBUG nova.network.neutron [req-372e83b7-defd-4393-93f7-eade734304d1 req-ca28bd15-8cda-4471-a003-290ec63d4718 service nova] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Refreshing network info cache for port c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:53:19 user sudo[85085]: pam_unix(sudo:session): session closed for user root
Nov 22 07:53:19 user nova-compute[74348]: INFO oslo.privsep.daemon [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Spawned new privsep daemon via rootwrap
Nov 22 07:53:19 user nova-compute[74348]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 22 07:53:19 user nova-compute[74348]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 22 07:53:19 user nova-compute[74348]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 22 07:53:19 user nova-compute[74348]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85159
Nov 22 07:53:19 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f9c558-c5db-443f-b429-d13d39edff72]: (2,) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:20 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:20 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:20 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fbaaa5-d14e-4fc3-bd6e-845d5e9e1482]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:20 user nova-compute[74348]: WARNING os_brick.initiator.connectors.nvmeof [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 22 07:53:20 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:20 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:20 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a22e69-76c1-4057-be96-5f66f9a511ac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:20 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:20 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:20 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0e04d3-6199-4f47-948e-bafd399e0d6c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:20 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cff941-65aa-4943-8950-8e034e188979]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:20 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:20 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 07:53:20 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 07:53:20 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:20 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 07:53:20 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 07:53:20 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e442f9-8922-4877-8814-48b4186c7ec2]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:20 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 07:53:20 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 07:53:20 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 07:53:20 user nova-compute[74348]: DEBUG os_brick.utils [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] <== get_connector_properties: return (2410ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:53:20 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Updating existing volume attachment record: 8c88a07d-e20f-4a7c-a84f-a7db397b0ec2 {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 07:53:20 user nova-compute[74348]: DEBUG nova.network.neutron [req-372e83b7-defd-4393-93f7-eade734304d1 req-ca28bd15-8cda-4471-a003-290ec63d4718 service nova] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Updated VIF entry in instance network info cache for port c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 07:53:20 user nova-compute[74348]: DEBUG nova.network.neutron [req-372e83b7-defd-4393-93f7-eade734304d1 req-ca28bd15-8cda-4471-a003-290ec63d4718 service nova] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Updating instance_info_cache with network_info: [{"id": "c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3", "address": "fa:16:3e:d1:85:73", "network": {"id": "5826faef-2095-4993-a655-a168237a5018", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1612032334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac4a9f365081417e81c935755cb6ddb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f3237e-bc", "ovs_interfaceid": "c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:53:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-372e83b7-defd-4393-93f7-eade734304d1 req-ca28bd15-8cda-4471-a003-290ec63d4718 service nova] Releasing lock "refresh_cache-abd7f2ed-b0c4-4e05-8161-b141a611f125" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:53:20 user nova-compute[74348]: DEBUG nova.compute.manager [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 07:53:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 07:53:20 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Instance spawned successfully.
Nov 22 07:53:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 07:53:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:53:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:53:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:53:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:53:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:53:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:53:21 user nova-compute[74348]: INFO nova.compute.manager [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Took 9.65 seconds to spawn the instance on the hypervisor.
Nov 22 07:53:21 user nova-compute[74348]: DEBUG nova.compute.manager [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 07:53:21 user nova-compute[74348]: INFO nova.compute.manager [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Took 11.11 seconds to build instance.
Nov 22 07:53:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3eb7f85e-f478-446c-a3cd-9cd71ca426a9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Lock "bdad025e-8f6c-419a-99ea-bf277f6c5577" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.261s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:21 user nova-compute[74348]: DEBUG nova.compute.manager [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 07:53:21 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 07:53:21 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Instance spawned successfully.
Nov 22 07:53:21 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 07:53:21 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:53:21 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:53:21 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:53:21 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:53:21 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:53:21 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:53:21 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:21 user nova-compute[74348]: INFO nova.compute.manager [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Took 8.43 seconds to spawn the instance on the hypervisor.
Nov 22 07:53:21 user nova-compute[74348]: DEBUG nova.compute.manager [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 07:53:21 user nova-compute[74348]: INFO nova.compute.manager [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Took 10.29 seconds to build instance.
Nov 22 07:53:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-bccec1bb-8818-4b62-b4a8-1bee225f292d tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Lock "88730c14-fd2a-4f63-bc10-96cea0b057eb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.662s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:23 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:53:23 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Cleaning up deleted instances {{(pid=74348) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 22 07:53:23 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] There are 0 instances to clean {{(pid=74348) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 22 07:53:23 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:53:23 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74348) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 22 07:53:23 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:53:26 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:26 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:53:26 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:53:26 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 07:53:26 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Rebuilding the list of instances to heal {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 07:53:26 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Skipping network cache update for instance because it is Building. {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 22 07:53:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-059bde4a-c5c9-45ab-9b4a-c969c74a6083" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:53:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-059bde4a-c5c9-45ab-9b4a-c969c74a6083" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:53:26 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 07:53:26 user nova-compute[74348]: DEBUG nova.objects.instance [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lazy-loading 'info_cache' on Instance uuid 059bde4a-c5c9-45ab-9b4a-c969c74a6083 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:53:27 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Updating instance_info_cache with network_info: [{"id": "06aa6370-ccfd-4a76-86ca-7bbfad795beb", "address": "fa:16:3e:0d:49:2d", "network": {"id": "7f692ef6-9a86-4aba-a055-8877d70394ba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1993883418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee2e6be4a484d32bac3fda2043aa23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06aa6370-cc", "ovs_interfaceid": "06aa6370-ccfd-4a76-86ca-7bbfad795beb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:53:27 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-059bde4a-c5c9-45ab-9b4a-c969c74a6083" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:53:27 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 07:53:27 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:53:27 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:53:27 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:53:27 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 07:53:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:28 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG nova.compute.manager [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 07:53:29 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Creating image(s)
Nov 22 07:53:29 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Did not create local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Ensure instance console log exists: /opt/stack/data/nova/instances/abd7f2ed-b0c4-4e05-8161-b141a611f125/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Start _get_guest_xml network_info=[{"id": "c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3", "address": "fa:16:3e:d1:85:73", "network": {"id": "5826faef-2095-4993-a655-a168237a5018", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1612032334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac4a9f365081417e81c935755cb6ddb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f3237e-bc", "ovs_interfaceid": "c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UHWXwBSk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'abd7f2ed-b0c4-4e05-8161-b141a611f125', 'attached_at': '', 'detached_at': '', 'volume_id': 'bf17ece2-1f33-4fa3-af81-8534b3fe79af', 'serial': 'bf17ece2-1f33-4fa3-af81-8534b3fe79af'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '8c88a07d-e20f-4a7c-a84f-a7db397b0ec2', 'volume_type': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 07:53:29 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:53:29 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:53:29 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG os_brick.initiator.connector [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Factory for ISCSI on None {{(pid=74348) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UHWXwBSk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:53:29 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:53:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:53:29 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:53:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:53:29 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 07:53:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ef8243-a36e-46c2-855f-62d042d55f4e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 07:53:29 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b085dcf-fa2d-4991-8d79-0fd5a5e09f9a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af] added
Nov 22 07:53:29 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c472bae-abc9-4293-b603-645058f0b0c5]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e259760f-93ba-4dd7-a4d2-c7ba26f6b0d1]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UHWXwBSk {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UHWXwBSk" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be0b97f-8bdd-4a2f-84ef-b3b10544fb4b]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UHWXwBSk'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d76634-9031-4ca4-9b0b-635c652189c7]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.069s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32fd6e6-91ec-4bbb-b2b8-f3a12b50c6a6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 22 07:53:29 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 22 07:53:29 user nova-compute[74348]:  {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:53:29 user nova-compute[74348]: WARNING os_brick.initiator.connectors.iscsi [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 22 07:53:29 user nova-compute[74348]: 
Nov 22 07:53:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8474fc54-57dd-4bc9-916f-3e2a5496e062]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af, portal: 172.16.0.220,3260]
Nov 22 07:53:29 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af, portal: 172.16.0.220,3260] successful.
Nov 22 07:53:29 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[29510933-a5de-4979-ab4c-d31ba08af1f9]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee549e60-b047-436d-9997-d283839e11f6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:53:29 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:53:29 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc60ed6-8796-4b76-b735-0ff667642d3c]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UHWXwBSk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 07:53:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3bbae3-babf-44d2-96da-c459fb77d9c7/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3bbae3-babf-44d2-96da-c459fb77d9c7/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3bbae3-babf-44d2-96da-c459fb77d9c7/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3bbae3-babf-44d2-96da-c459fb77d9c7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88730c14-fd2a-4f63-bc10-96cea0b057eb/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88730c14-fd2a-4f63-bc10-96cea0b057eb/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88730c14-fd2a-4f63-bc10-96cea0b057eb/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88730c14-fd2a-4f63-bc10-96cea0b057eb/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6aa6c0-2b77-49a5-9942-d6596ac4bd3f/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:53:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '23336393336653864', 'path': '/dev/sdb'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:53:30 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336393336653864', 'path': '/dev/sdb'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 07:53:30 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:53:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1680569585',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1680569585',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO27qptUwzzdqwLnhCZkr2apu987NWn6IIEhHr7PT4GpTS02zQZcCrEc7XvQW2xsPa1rEu/bPT5i3T2uHMpmNx2zLdQ2Q19AVu91BBTgcbEZQzR0OotNI2TgNid7aWNdEg==',key_name='tempest-keypair-2082604002',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac4a9f365081417e81c935755cb6ddb7',ramdisk_id='',reservation_id='r-2h02xod7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-628585113',owner_user_name='tempest-ServerActionsV293TestJSON-628585113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:53:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad47d30fba8048b99bf017fc43335532',uuid=abd7f2ed-b0c4-4e05-8161-b141a611f125,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3", "address": "fa:16:3e:d1:85:73", "network": {"id": "5826faef-2095-4993-a655-a168237a5018", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1612032334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac4a9f365081417e81c935755cb6ddb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f3237e-bc", "ovs_interfaceid": "c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 07:53:30 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Converting VIF {"id": "c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3", "address": "fa:16:3e:d1:85:73", "network": {"id": "5826faef-2095-4993-a655-a168237a5018", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1612032334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac4a9f365081417e81c935755cb6ddb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f3237e-bc", "ovs_interfaceid": "c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:53:30 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:85:73,bridge_name='br-int',has_traffic_filtering=True,id=c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3,network=Network(5826faef-2095-4993-a655-a168237a5018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f3237e-bc') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:53:30 user nova-compute[74348]: DEBUG nova.objects.instance [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Lazy-loading 'pci_devices' on Instance uuid abd7f2ed-b0c4-4e05-8161-b141a611f125 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:53:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6aa6c0-2b77-49a5-9942-d6596ac4bd3f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6aa6c0-2b77-49a5-9942-d6596ac4bd3f/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:30 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] End _get_guest_xml xml=<domain type="kvm">
Nov 22 07:53:30 user nova-compute[74348]:   <uuid>abd7f2ed-b0c4-4e05-8161-b141a611f125</uuid>
Nov 22 07:53:30 user nova-compute[74348]:   <name>instance-0000000a</name>
Nov 22 07:53:30 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 07:53:30 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 07:53:30 user nova-compute[74348]:   <metadata>
Nov 22 07:53:30 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 07:53:30 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 07:53:30 user nova-compute[74348]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1680569585</nova:name>
Nov 22 07:53:30 user nova-compute[74348]:       <nova:creationTime>2023-11-22 07:53:29</nova:creationTime>
Nov 22 07:53:30 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 07:53:30 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 07:53:30 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 07:53:30 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 07:53:30 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 07:53:30 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 07:53:30 user nova-compute[74348]:       </nova:flavor>
Nov 22 07:53:30 user nova-compute[74348]:       <nova:owner>
Nov 22 07:53:30 user nova-compute[74348]:         <nova:user uuid="ad47d30fba8048b99bf017fc43335532">tempest-ServerActionsV293TestJSON-628585113-project-member</nova:user>
Nov 22 07:53:30 user nova-compute[74348]:         <nova:project uuid="ac4a9f365081417e81c935755cb6ddb7">tempest-ServerActionsV293TestJSON-628585113</nova:project>
Nov 22 07:53:30 user nova-compute[74348]:       </nova:owner>
Nov 22 07:53:30 user nova-compute[74348]:       <nova:ports>
Nov 22 07:53:30 user nova-compute[74348]:         <nova:port uuid="c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3">
Nov 22 07:53:30 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 22 07:53:30 user nova-compute[74348]:         </nova:port>
Nov 22 07:53:30 user nova-compute[74348]:       </nova:ports>
Nov 22 07:53:30 user nova-compute[74348]:     </nova:instance>
Nov 22 07:53:30 user nova-compute[74348]:   </metadata>
Nov 22 07:53:30 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 07:53:30 user nova-compute[74348]:     <system>
Nov 22 07:53:30 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 07:53:30 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 07:53:30 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 07:53:30 user nova-compute[74348]:       <entry name="serial">abd7f2ed-b0c4-4e05-8161-b141a611f125</entry>
Nov 22 07:53:30 user nova-compute[74348]:       <entry name="uuid">abd7f2ed-b0c4-4e05-8161-b141a611f125</entry>
Nov 22 07:53:30 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 07:53:30 user nova-compute[74348]:     </system>
Nov 22 07:53:30 user nova-compute[74348]:   </sysinfo>
Nov 22 07:53:30 user nova-compute[74348]:   <os>
Nov 22 07:53:30 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 07:53:30 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 07:53:30 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 07:53:30 user nova-compute[74348]:   </os>
Nov 22 07:53:30 user nova-compute[74348]:   <features>
Nov 22 07:53:30 user nova-compute[74348]:     <acpi/>
Nov 22 07:53:30 user nova-compute[74348]:     <apic/>
Nov 22 07:53:30 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 07:53:30 user nova-compute[74348]:   </features>
Nov 22 07:53:30 user nova-compute[74348]:   <clock offset="utc">
Nov 22 07:53:30 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 07:53:30 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 07:53:30 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 07:53:30 user nova-compute[74348]:   </clock>
Nov 22 07:53:30 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 07:53:30 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 07:53:30 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 07:53:30 user nova-compute[74348]:   </cpu>
Nov 22 07:53:30 user nova-compute[74348]:   <devices>
Nov 22 07:53:30 user nova-compute[74348]:     <disk type="block" device="disk">
Nov 22 07:53:30 user nova-compute[74348]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 07:53:30 user nova-compute[74348]:       <source dev="/dev/sdb"/>
Nov 22 07:53:30 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 07:53:30 user nova-compute[74348]:       <serial>bf17ece2-1f33-4fa3-af81-8534b3fe79af</serial>
Nov 22 07:53:30 user nova-compute[74348]:     </disk>
Nov 22 07:53:30 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 07:53:30 user nova-compute[74348]:       <mac address="fa:16:3e:d1:85:73"/>
Nov 22 07:53:30 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:53:30 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 07:53:30 user nova-compute[74348]:       <target dev="tapc6f3237e-bc"/>
Nov 22 07:53:30 user nova-compute[74348]:     </interface>
Nov 22 07:53:30 user nova-compute[74348]:     <serial type="pty">
Nov 22 07:53:30 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/abd7f2ed-b0c4-4e05-8161-b141a611f125/console.log" append="off"/>
Nov 22 07:53:30 user nova-compute[74348]:     </serial>
Nov 22 07:53:30 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 07:53:30 user nova-compute[74348]:     <video>
Nov 22 07:53:30 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:53:30 user nova-compute[74348]:     </video>
Nov 22 07:53:30 user nova-compute[74348]:     <rng model="virtio">
Nov 22 07:53:30 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 07:53:30 user nova-compute[74348]:     </rng>
Nov 22 07:53:30 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 07:53:30 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 07:53:30 user nova-compute[74348]:       <stats period="10"/>
Nov 22 07:53:30 user nova-compute[74348]:     </memballoon>
Nov 22 07:53:30 user nova-compute[74348]:   </devices>
Nov 22 07:53:30 user nova-compute[74348]: </domain>
Nov 22 07:53:30 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 07:53:30 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:53:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1680569585',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1680569585',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO27qptUwzzdqwLnhCZkr2apu987NWn6IIEhHr7PT4GpTS02zQZcCrEc7XvQW2xsPa1rEu/bPT5i3T2uHMpmNx2zLdQ2Q19AVu91BBTgcbEZQzR0OotNI2TgNid7aWNdEg==',key_name='tempest-keypair-2082604002',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac4a9f365081417e81c935755cb6ddb7',ramdisk_id='',reservation_id='r-2h02xod7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-628585113',owner_user_name='tempest-ServerActionsV293TestJSON-628585113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:53:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad47d30fba8048b99bf017fc43335532',uuid=abd7f2ed-b0c4-4e05-8161-b141a611f125,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3", "address": "fa:16:3e:d1:85:73", "network": {"id": "5826faef-2095-4993-a655-a168237a5018", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1612032334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac4a9f365081417e81c935755cb6ddb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f3237e-bc", "ovs_interfaceid": "c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 07:53:30 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Converting VIF {"id": "c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3", "address": "fa:16:3e:d1:85:73", "network": {"id": "5826faef-2095-4993-a655-a168237a5018", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1612032334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac4a9f365081417e81c935755cb6ddb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f3237e-bc", "ovs_interfaceid": "c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:53:30 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:85:73,bridge_name='br-int',has_traffic_filtering=True,id=c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3,network=Network(5826faef-2095-4993-a655-a168237a5018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f3237e-bc') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:53:30 user nova-compute[74348]: DEBUG os_vif [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:85:73,bridge_name='br-int',has_traffic_filtering=True,id=c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3,network=Network(5826faef-2095-4993-a655-a168237a5018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f3237e-bc') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 07:53:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:53:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 07:53:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b49a116a-9c13-5575-ba24-81f54d8b46f7', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:53:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:53:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc6f3237e-bc, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:53:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc6f3237e-bc, col_values=(('qos', UUID('64591310-425f-4946-ac0f-adeb733ddd2d')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:53:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc6f3237e-bc, col_values=(('external_ids', {'iface-id': 'c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:85:73', 'vm-uuid': 'abd7f2ed-b0c4-4e05-8161-b141a611f125'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:53:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:53:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:30 user nova-compute[74348]: INFO os_vif [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:85:73,bridge_name='br-int',has_traffic_filtering=True,id=c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3,network=Network(5826faef-2095-4993-a655-a168237a5018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f3237e-bc')
Nov 22 07:53:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:53:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] No VIF found with MAC fa:16:3e:d1:85:73, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 07:53:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6aa6c0-2b77-49a5-9942-d6596ac4bd3f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/522f5959-4874-4c61-888d-6fb1cc4d72e6/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/522f5959-4874-4c61-888d-6fb1cc4d72e6/disk --force-share --output=json" returned: 0 in 0.355s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/522f5959-4874-4c61-888d-6fb1cc4d72e6/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/522f5959-4874-4c61-888d-6fb1cc4d72e6/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059bde4a-c5c9-45ab-9b4a-c969c74a6083/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059bde4a-c5c9-45ab-9b4a-c969c74a6083/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059bde4a-c5c9-45ab-9b4a-c969c74a6083/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059bde4a-c5c9-45ab-9b4a-c969c74a6083/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e93032ee-56bd-48be-8121-b0fd5273345e/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:32 user nova-compute[74348]: DEBUG nova.compute.manager [req-745eca70-4e39-4493-8997-09b920497e12 req-10459c17-d4ae-48bc-ab19-088107f6ad04 service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Received event network-vif-plugged-07295502-d217-400f-8b56-9ff1ccd600cf {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:53:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-745eca70-4e39-4493-8997-09b920497e12 req-10459c17-d4ae-48bc-ab19-088107f6ad04 service nova] Acquiring lock "bcedb385-b72a-49c2-b363-cf6da5804b60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-745eca70-4e39-4493-8997-09b920497e12 req-10459c17-d4ae-48bc-ab19-088107f6ad04 service nova] Lock "bcedb385-b72a-49c2-b363-cf6da5804b60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-745eca70-4e39-4493-8997-09b920497e12 req-10459c17-d4ae-48bc-ab19-088107f6ad04 service nova] Lock "bcedb385-b72a-49c2-b363-cf6da5804b60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:32 user nova-compute[74348]: DEBUG nova.compute.manager [req-745eca70-4e39-4493-8997-09b920497e12 req-10459c17-d4ae-48bc-ab19-088107f6ad04 service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] No waiting events found dispatching network-vif-plugged-07295502-d217-400f-8b56-9ff1ccd600cf {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:53:32 user nova-compute[74348]: WARNING nova.compute.manager [req-745eca70-4e39-4493-8997-09b920497e12 req-10459c17-d4ae-48bc-ab19-088107f6ad04 service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Received unexpected event network-vif-plugged-07295502-d217-400f-8b56-9ff1ccd600cf for instance with vm_state active and task_state None.
Nov 22 07:53:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e93032ee-56bd-48be-8121-b0fd5273345e/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e93032ee-56bd-48be-8121-b0fd5273345e/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:32 user nova-compute[74348]: DEBUG nova.compute.manager [req-841b6887-6a5e-494d-b4d0-8aa50c54e038 req-8d8d6fe1-96d3-4ba6-aeeb-1b6390c454d5 service nova] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Received event network-vif-plugged-c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:53:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-841b6887-6a5e-494d-b4d0-8aa50c54e038 req-8d8d6fe1-96d3-4ba6-aeeb-1b6390c454d5 service nova] Acquiring lock "abd7f2ed-b0c4-4e05-8161-b141a611f125-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-841b6887-6a5e-494d-b4d0-8aa50c54e038 req-8d8d6fe1-96d3-4ba6-aeeb-1b6390c454d5 service nova] Lock "abd7f2ed-b0c4-4e05-8161-b141a611f125-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-841b6887-6a5e-494d-b4d0-8aa50c54e038 req-8d8d6fe1-96d3-4ba6-aeeb-1b6390c454d5 service nova] Lock "abd7f2ed-b0c4-4e05-8161-b141a611f125-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:32 user nova-compute[74348]: DEBUG nova.compute.manager [req-841b6887-6a5e-494d-b4d0-8aa50c54e038 req-8d8d6fe1-96d3-4ba6-aeeb-1b6390c454d5 service nova] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] No waiting events found dispatching network-vif-plugged-c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:53:32 user nova-compute[74348]: WARNING nova.compute.manager [req-841b6887-6a5e-494d-b4d0-8aa50c54e038 req-8d8d6fe1-96d3-4ba6-aeeb-1b6390c454d5 service nova] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Received unexpected event network-vif-plugged-c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3 for instance with vm_state building and task_state spawning.
Nov 22 07:53:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e93032ee-56bd-48be-8121-b0fd5273345e/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:35 user nova-compute[74348]: DEBUG nova.compute.manager [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 07:53:35 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 07:53:35 user nova-compute[74348]: DEBUG nova.compute.manager [req-bb439c7c-e8c8-4786-b8b3-a1d6f7d0e36c req-6071fcfb-28e4-4bcb-b6d0-81057f838e2d service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Received event network-vif-plugged-07295502-d217-400f-8b56-9ff1ccd600cf {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:53:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-bb439c7c-e8c8-4786-b8b3-a1d6f7d0e36c req-6071fcfb-28e4-4bcb-b6d0-81057f838e2d service nova] Acquiring lock "bcedb385-b72a-49c2-b363-cf6da5804b60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-bb439c7c-e8c8-4786-b8b3-a1d6f7d0e36c req-6071fcfb-28e4-4bcb-b6d0-81057f838e2d service nova] Lock "bcedb385-b72a-49c2-b363-cf6da5804b60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-bb439c7c-e8c8-4786-b8b3-a1d6f7d0e36c req-6071fcfb-28e4-4bcb-b6d0-81057f838e2d service nova] Lock "bcedb385-b72a-49c2-b363-cf6da5804b60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:35 user nova-compute[74348]: DEBUG nova.compute.manager [req-bb439c7c-e8c8-4786-b8b3-a1d6f7d0e36c req-6071fcfb-28e4-4bcb-b6d0-81057f838e2d service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] No waiting events found dispatching network-vif-plugged-07295502-d217-400f-8b56-9ff1ccd600cf {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:53:35 user nova-compute[74348]: WARNING nova.compute.manager [req-bb439c7c-e8c8-4786-b8b3-a1d6f7d0e36c req-6071fcfb-28e4-4bcb-b6d0-81057f838e2d service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Received unexpected event network-vif-plugged-07295502-d217-400f-8b56-9ff1ccd600cf for instance with vm_state active and task_state None.
Nov 22 07:53:35 user nova-compute[74348]: DEBUG nova.compute.manager [req-5d7ba820-7e7f-420b-a14d-a2e77724a842 req-bef23dab-0e0d-438e-aead-bc29d0fca5f9 service nova] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Received event network-vif-plugged-c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:53:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-5d7ba820-7e7f-420b-a14d-a2e77724a842 req-bef23dab-0e0d-438e-aead-bc29d0fca5f9 service nova] Acquiring lock "abd7f2ed-b0c4-4e05-8161-b141a611f125-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-5d7ba820-7e7f-420b-a14d-a2e77724a842 req-bef23dab-0e0d-438e-aead-bc29d0fca5f9 service nova] Lock "abd7f2ed-b0c4-4e05-8161-b141a611f125-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-5d7ba820-7e7f-420b-a14d-a2e77724a842 req-bef23dab-0e0d-438e-aead-bc29d0fca5f9 service nova] Lock "abd7f2ed-b0c4-4e05-8161-b141a611f125-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:35 user nova-compute[74348]: DEBUG nova.compute.manager [req-5d7ba820-7e7f-420b-a14d-a2e77724a842 req-bef23dab-0e0d-438e-aead-bc29d0fca5f9 service nova] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] No waiting events found dispatching network-vif-plugged-c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:53:35 user nova-compute[74348]: WARNING nova.compute.manager [req-5d7ba820-7e7f-420b-a14d-a2e77724a842 req-bef23dab-0e0d-438e-aead-bc29d0fca5f9 service nova] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Received unexpected event network-vif-plugged-c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3 for instance with vm_state building and task_state spawning.
Nov 22 07:53:35 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Instance spawned successfully.
Nov 22 07:53:35 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:53:35 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:53:35 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=7349MB free_disk=25.421653747558594GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 07:53:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:35 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 07:53:35 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:53:35 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:53:35 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:53:35 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:53:35 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:53:35 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:53:35 user nova-compute[74348]: INFO nova.compute.manager [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Took 6.00 seconds to spawn the instance on the hypervisor.
Nov 22 07:53:35 user nova-compute[74348]: DEBUG nova.compute.manager [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 07:53:35 user nova-compute[74348]: INFO nova.compute.manager [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Took 18.65 seconds to build instance.
Nov 22 07:53:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3dfb94a3-0c3f-4f38-8ceb-db1a38f07d07 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Lock "abd7f2ed-b0c4-4e05-8161-b141a611f125" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.927s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:35 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 059bde4a-c5c9-45ab-9b4a-c969c74a6083 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:53:35 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 522f5959-4874-4c61-888d-6fb1cc4d72e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:53:35 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance bcedb385-b72a-49c2-b363-cf6da5804b60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:53:35 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance e36789b1-45e6-40f7-ba97-8962cb116a39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:53:35 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 5f3bbae3-babf-44d2-96da-c459fb77d9c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:53:35 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance da6aa6c0-2b77-49a5-9942-d6596ac4bd3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:53:35 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance e93032ee-56bd-48be-8121-b0fd5273345e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:53:35 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance bdad025e-8f6c-419a-99ea-bf277f6c5577 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:53:35 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 88730c14-fd2a-4f63-bc10-96cea0b057eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:53:35 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance abd7f2ed-b0c4-4e05-8161-b141a611f125 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:53:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Acquiring lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:35 user nova-compute[74348]: DEBUG nova.compute.manager [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 07:53:35 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 9e2f3a3e-ee9b-4250-8744-5eb7982285f2 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 22 07:53:35 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 07:53:35 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 07:53:35 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Refreshing inventories for resource provider 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 22 07:53:35 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Updating ProviderTree inventory for provider 52690f6a-773f-4e8d-be85-d278b6522975 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 22 07:53:35 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Updating inventory in ProviderTree for provider 52690f6a-773f-4e8d-be85-d278b6522975 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 22 07:53:35 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Refreshing aggregate associations for resource provider 52690f6a-773f-4e8d-be85-d278b6522975, aggregates: None {{(pid=74348) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 22 07:53:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:35 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Refreshing trait associations for resource provider 52690f6a-773f-4e8d-be85-d278b6522975, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=74348) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 22 07:53:35 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:36 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:53:36 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:53:36 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 07:53:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.133s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.454s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:36 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 07:53:36 user nova-compute[74348]: INFO nova.compute.claims [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Claim successful on node user
Nov 22 07:53:36 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:53:36 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:53:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.513s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:36 user nova-compute[74348]: DEBUG nova.compute.manager [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 07:53:36 user nova-compute[74348]: DEBUG nova.compute.manager [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 07:53:36 user nova-compute[74348]: DEBUG nova.network.neutron [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 07:53:36 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 07:53:37 user nova-compute[74348]: DEBUG nova.compute.manager [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 07:53:37 user nova-compute[74348]: INFO nova.virt.block_device [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Booting with volume b19fd726-3664-469a-b6fe-7269b9235cea at /dev/vda
Nov 22 07:53:37 user nova-compute[74348]: DEBUG os_brick.utils [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:53:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:37 user nova-compute[74348]: DEBUG nova.policy [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd846d2c399e47db9dbd74e4beaeb0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d9889b4c704e2c9370420262898383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 07:53:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:37 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e27ea4-5ba4-490e-a9b8-8a3b6efe59aa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:37 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c170eab-25d7-4c27-b927-86d2ec68946a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:37 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44a670c-84df-4c06-9093-a6f1ea27543d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:37 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfb2cbd-6d03-459e-9c38-f77e85ed73ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 07:53:37 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 07:53:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 07:53:37 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 07:53:37 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[34278845-3f0e-42ca-acc1-12cc2f0a299f]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:37 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 07:53:37 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 07:53:37 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 07:53:37 user nova-compute[74348]: DEBUG os_brick.utils [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:53:37 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Updating existing volume attachment record: 4ae0dd13-ab22-4e18-b55e-1205129d776b {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 07:53:37 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:53:37 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:53:37 user nova-compute[74348]: DEBUG nova.network.neutron [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Successfully created port: 4a8ea7e1-9e80-4686-a3a9-4142b9de0049 {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 07:53:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Acquiring lock "8527ae47-a025-492d-9820-b9c5ee309d81" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Lock "8527ae47-a025-492d-9820-b9c5ee309d81" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:38 user nova-compute[74348]: DEBUG nova.compute.manager [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 07:53:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:38 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 07:53:38 user nova-compute[74348]: INFO nova.compute.claims [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Claim successful on node user
Nov 22 07:53:38 user nova-compute[74348]: DEBUG nova.network.neutron [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Successfully created port: f0f55187-e53f-468d-83a8-cca33ff1380e {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 07:53:38 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:53:38 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:53:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.553s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:38 user nova-compute[74348]: DEBUG nova.compute.manager [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 07:53:38 user nova-compute[74348]: DEBUG nova.compute.manager [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 07:53:38 user nova-compute[74348]: DEBUG nova.network.neutron [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 07:53:38 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 07:53:38 user nova-compute[74348]: DEBUG nova.compute.manager [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 07:53:38 user nova-compute[74348]: DEBUG nova.compute.manager [req-1fc349a9-2c7c-4539-ae61-28f1cb105c60 req-980dc55e-4020-403f-9d57-ef167468e123 service nova] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Received event network-vif-plugged-094232d9-8ec1-401f-8908-2a698a5385bb {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:53:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-1fc349a9-2c7c-4539-ae61-28f1cb105c60 req-980dc55e-4020-403f-9d57-ef167468e123 service nova] Acquiring lock "5f3bbae3-babf-44d2-96da-c459fb77d9c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-1fc349a9-2c7c-4539-ae61-28f1cb105c60 req-980dc55e-4020-403f-9d57-ef167468e123 service nova] Lock "5f3bbae3-babf-44d2-96da-c459fb77d9c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-1fc349a9-2c7c-4539-ae61-28f1cb105c60 req-980dc55e-4020-403f-9d57-ef167468e123 service nova] Lock "5f3bbae3-babf-44d2-96da-c459fb77d9c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:38 user nova-compute[74348]: DEBUG nova.compute.manager [req-1fc349a9-2c7c-4539-ae61-28f1cb105c60 req-980dc55e-4020-403f-9d57-ef167468e123 service nova] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] No waiting events found dispatching network-vif-plugged-094232d9-8ec1-401f-8908-2a698a5385bb {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:53:38 user nova-compute[74348]: WARNING nova.compute.manager [req-1fc349a9-2c7c-4539-ae61-28f1cb105c60 req-980dc55e-4020-403f-9d57-ef167468e123 service nova] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Received unexpected event network-vif-plugged-094232d9-8ec1-401f-8908-2a698a5385bb for instance with vm_state active and task_state None.
Nov 22 07:53:38 user nova-compute[74348]: INFO nova.virt.block_device [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Booting with volume d7d26d2e-5794-43e8-b642-76b54ab2e6f5 at /dev/vda
Nov 22 07:53:38 user nova-compute[74348]: DEBUG os_brick.utils [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:53:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:39 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b02aaf5-5f62-4134-8b27-57f08fa1c7db]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:39 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4890d9a1-221b-4ca1-8843-17ea208c685f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:39 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecdb7bc-0f71-4454-a68b-6f643339e20f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:39 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ab8ad3-ddcc-4ea2-993b-e5778395b890]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 07:53:39 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 07:53:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 07:53:39 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 07:53:39 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef548e8a-396d-47c5-b8b3-ea81fa4df262]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:39 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 07:53:39 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 07:53:39 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 07:53:39 user nova-compute[74348]: DEBUG os_brick.utils [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:53:39 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Updating existing volume attachment record: da91a701-d2f8-4b5d-bbe9-ef4d0dbf22d5 {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 07:53:39 user nova-compute[74348]: DEBUG nova.policy [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd026e5b011144beb9340e6ceb58583f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a08625e4d04478297484c875ac9a5c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 07:53:39 user nova-compute[74348]: DEBUG nova.network.neutron [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Successfully created port: 5a68d2be-be4c-462b-9dd4-15e222160557 {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 07:53:40 user nova-compute[74348]: DEBUG nova.network.neutron [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Successfully created port: 6221165b-f588-475c-a3b1-afdf5c60c113 {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 07:53:40 user nova-compute[74348]: DEBUG nova.network.neutron [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Successfully created port: 9aa74044-d952-47e5-9cc1-948615a01eb3 {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 07:53:40 user nova-compute[74348]: DEBUG nova.compute.manager [req-46807a9a-cb87-499e-b67d-5ab41482dd63 req-85d7c0ad-213c-4d35-948b-71e09321de10 service nova] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Received event network-vif-plugged-094232d9-8ec1-401f-8908-2a698a5385bb {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:53:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-46807a9a-cb87-499e-b67d-5ab41482dd63 req-85d7c0ad-213c-4d35-948b-71e09321de10 service nova] Acquiring lock "5f3bbae3-babf-44d2-96da-c459fb77d9c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-46807a9a-cb87-499e-b67d-5ab41482dd63 req-85d7c0ad-213c-4d35-948b-71e09321de10 service nova] Lock "5f3bbae3-babf-44d2-96da-c459fb77d9c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-46807a9a-cb87-499e-b67d-5ab41482dd63 req-85d7c0ad-213c-4d35-948b-71e09321de10 service nova] Lock "5f3bbae3-babf-44d2-96da-c459fb77d9c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:40 user nova-compute[74348]: DEBUG nova.compute.manager [req-46807a9a-cb87-499e-b67d-5ab41482dd63 req-85d7c0ad-213c-4d35-948b-71e09321de10 service nova] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] No waiting events found dispatching network-vif-plugged-094232d9-8ec1-401f-8908-2a698a5385bb {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:53:40 user nova-compute[74348]: WARNING nova.compute.manager [req-46807a9a-cb87-499e-b67d-5ab41482dd63 req-85d7c0ad-213c-4d35-948b-71e09321de10 service nova] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Received unexpected event network-vif-plugged-094232d9-8ec1-401f-8908-2a698a5385bb for instance with vm_state active and task_state None.
Nov 22 07:53:40 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:41 user nova-compute[74348]: DEBUG nova.network.neutron [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Successfully created port: 969790c1-f8a4-4d98-86d9-1ed932c83daa {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 07:53:41 user nova-compute[74348]: DEBUG nova.network.neutron [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Successfully created port: 579fb42b-b8b6-4122-8ec3-8817c9e0881a {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 07:53:42 user nova-compute[74348]: DEBUG nova.network.neutron [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Successfully created port: 748e5281-27d7-43b4-ba47-2f0daed1181e {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 07:53:43 user nova-compute[74348]: DEBUG nova.network.neutron [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Successfully updated port: 4a8ea7e1-9e80-4686-a3a9-4142b9de0049 {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 07:53:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:43 user nova-compute[74348]: DEBUG nova.compute.manager [req-364a6357-a243-4909-8886-196d935d3516 req-c288bf11-fb4a-4b02-8457-331a1b22ea29 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-changed-4a8ea7e1-9e80-4686-a3a9-4142b9de0049 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:53:43 user nova-compute[74348]: DEBUG nova.compute.manager [req-364a6357-a243-4909-8886-196d935d3516 req-c288bf11-fb4a-4b02-8457-331a1b22ea29 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Refreshing instance network info cache due to event network-changed-4a8ea7e1-9e80-4686-a3a9-4142b9de0049. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:53:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-364a6357-a243-4909-8886-196d935d3516 req-c288bf11-fb4a-4b02-8457-331a1b22ea29 service nova] Acquiring lock "refresh_cache-9e2f3a3e-ee9b-4250-8744-5eb7982285f2" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:53:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-364a6357-a243-4909-8886-196d935d3516 req-c288bf11-fb4a-4b02-8457-331a1b22ea29 service nova] Acquired lock "refresh_cache-9e2f3a3e-ee9b-4250-8744-5eb7982285f2" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:53:43 user nova-compute[74348]: DEBUG nova.network.neutron [req-364a6357-a243-4909-8886-196d935d3516 req-c288bf11-fb4a-4b02-8457-331a1b22ea29 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Refreshing network info cache for port 4a8ea7e1-9e80-4686-a3a9-4142b9de0049 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:53:43 user nova-compute[74348]: DEBUG nova.network.neutron [req-364a6357-a243-4909-8886-196d935d3516 req-c288bf11-fb4a-4b02-8457-331a1b22ea29 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 07:53:43 user nova-compute[74348]: DEBUG nova.network.neutron [req-364a6357-a243-4909-8886-196d935d3516 req-c288bf11-fb4a-4b02-8457-331a1b22ea29 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:53:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-364a6357-a243-4909-8886-196d935d3516 req-c288bf11-fb4a-4b02-8457-331a1b22ea29 service nova] Releasing lock "refresh_cache-9e2f3a3e-ee9b-4250-8744-5eb7982285f2" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:53:43 user nova-compute[74348]: INFO nova.virt.block_device [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Booting with volume f28856c9-75f8-44e9-b622-fab2df90d65c at /dev/vdb
Nov 22 07:53:43 user nova-compute[74348]: DEBUG os_brick.utils [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:53:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:43 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2abb678-8e4f-479d-a590-f8cf00a937a5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.029s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:43 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1942b263-ba1f-4e4c-9235-21f64bf71362]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:43 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b17005c-5144-42f0-acc6-3d5dab2bc7a3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:43 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c717ea5-282f-4d7b-b6c6-c1c803230958]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 07:53:43 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 07:53:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 07:53:43 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 07:53:43 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[49362a01-da84-4cf1-95f8-d2ab9902d048]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:43 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 07:53:43 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 07:53:43 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 07:53:43 user nova-compute[74348]: DEBUG os_brick.utils [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:53:43 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Updating existing volume attachment record: 1c7dc158-5175-4504-b462-c14b44fd0736 {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 07:53:43 user nova-compute[74348]: DEBUG nova.network.neutron [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Successfully created port: d77c2a03-a402-4288-8a40-2f88200a8f22 {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 07:53:44 user nova-compute[74348]: DEBUG nova.network.neutron [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Successfully updated port: e30deaf5-1258-4909-bc71-044c88f2995f {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 07:53:45 user nova-compute[74348]: DEBUG nova.network.neutron [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Successfully created port: a64b4a32-73f1-4a48-8b80-86d353d1d40b {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 07:53:45 user nova-compute[74348]: DEBUG nova.compute.manager [req-c6b0f0e3-636c-434b-ac18-abf3c62c35fb req-0937c7e9-461d-499f-8408-f25d35e33456 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-changed-e30deaf5-1258-4909-bc71-044c88f2995f {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:53:45 user nova-compute[74348]: DEBUG nova.compute.manager [req-c6b0f0e3-636c-434b-ac18-abf3c62c35fb req-0937c7e9-461d-499f-8408-f25d35e33456 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Refreshing instance network info cache due to event network-changed-e30deaf5-1258-4909-bc71-044c88f2995f. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:53:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c6b0f0e3-636c-434b-ac18-abf3c62c35fb req-0937c7e9-461d-499f-8408-f25d35e33456 service nova] Acquiring lock "refresh_cache-9e2f3a3e-ee9b-4250-8744-5eb7982285f2" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:53:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c6b0f0e3-636c-434b-ac18-abf3c62c35fb req-0937c7e9-461d-499f-8408-f25d35e33456 service nova] Acquired lock "refresh_cache-9e2f3a3e-ee9b-4250-8744-5eb7982285f2" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:53:45 user nova-compute[74348]: DEBUG nova.network.neutron [req-c6b0f0e3-636c-434b-ac18-abf3c62c35fb req-0937c7e9-461d-499f-8408-f25d35e33456 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Refreshing network info cache for port e30deaf5-1258-4909-bc71-044c88f2995f {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:53:45 user nova-compute[74348]: DEBUG nova.network.neutron [req-c6b0f0e3-636c-434b-ac18-abf3c62c35fb req-0937c7e9-461d-499f-8408-f25d35e33456 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 07:53:45 user nova-compute[74348]: DEBUG nova.network.neutron [req-c6b0f0e3-636c-434b-ac18-abf3c62c35fb req-0937c7e9-461d-499f-8408-f25d35e33456 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:53:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c6b0f0e3-636c-434b-ac18-abf3c62c35fb req-0937c7e9-461d-499f-8408-f25d35e33456 service nova] Releasing lock "refresh_cache-9e2f3a3e-ee9b-4250-8744-5eb7982285f2" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:53:45 user nova-compute[74348]: INFO nova.virt.block_device [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Booting with volume 2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 at /dev/vdb
Nov 22 07:53:45 user nova-compute[74348]: DEBUG os_brick.utils [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:53:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.026s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:45 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f6729a-2ded-442b-a9dd-fb4241c52ed4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:45 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5369fb7e-8ade-4d32-be19-c7bd727df37b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:45 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2907e1-1697-439e-af26-80c81014036e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:45 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a020838-30fa-49f7-8c43-bd485ed915c5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 07:53:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 07:53:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 07:53:45 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 07:53:45 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec0f3eb-374d-4b33-aa72-21f69bbbfbae]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 07:53:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 07:53:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 07:53:45 user nova-compute[74348]: DEBUG os_brick.utils [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:53:45 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Updating existing volume attachment record: b83ee2e5-56a2-4870-a473-18b43a650ba3 {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 07:53:45 user nova-compute[74348]: DEBUG nova.network.neutron [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Successfully updated port: 298ce71b-894a-4e29-904e-1ba5d4495fcb {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 07:53:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:46 user nova-compute[74348]: DEBUG nova.network.neutron [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Successfully updated port: 6221165b-f588-475c-a3b1-afdf5c60c113 {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 07:53:46 user nova-compute[74348]: DEBUG nova.network.neutron [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Successfully updated port: f0f55187-e53f-468d-83a8-cca33ff1380e {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 07:53:47 user nova-compute[74348]: DEBUG nova.compute.manager [req-bae67e21-1bc6-430f-85fc-b947aec1ccb3 req-dd1401e2-5271-4a47-af8b-1217330c81f2 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-changed-298ce71b-894a-4e29-904e-1ba5d4495fcb {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:53:47 user nova-compute[74348]: DEBUG nova.compute.manager [req-bae67e21-1bc6-430f-85fc-b947aec1ccb3 req-dd1401e2-5271-4a47-af8b-1217330c81f2 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Refreshing instance network info cache due to event network-changed-298ce71b-894a-4e29-904e-1ba5d4495fcb. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:53:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-bae67e21-1bc6-430f-85fc-b947aec1ccb3 req-dd1401e2-5271-4a47-af8b-1217330c81f2 service nova] Acquiring lock "refresh_cache-9e2f3a3e-ee9b-4250-8744-5eb7982285f2" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:53:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-bae67e21-1bc6-430f-85fc-b947aec1ccb3 req-dd1401e2-5271-4a47-af8b-1217330c81f2 service nova] Acquired lock "refresh_cache-9e2f3a3e-ee9b-4250-8744-5eb7982285f2" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:53:47 user nova-compute[74348]: DEBUG nova.network.neutron [req-bae67e21-1bc6-430f-85fc-b947aec1ccb3 req-dd1401e2-5271-4a47-af8b-1217330c81f2 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Refreshing network info cache for port 298ce71b-894a-4e29-904e-1ba5d4495fcb {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:53:47 user nova-compute[74348]: DEBUG nova.network.neutron [req-bae67e21-1bc6-430f-85fc-b947aec1ccb3 req-dd1401e2-5271-4a47-af8b-1217330c81f2 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 07:53:47 user nova-compute[74348]: DEBUG nova.network.neutron [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Successfully updated port: 62ed8403-ebcd-4e41-ac81-0056cf71738c {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 07:53:47 user nova-compute[74348]: DEBUG nova.network.neutron [req-bae67e21-1bc6-430f-85fc-b947aec1ccb3 req-dd1401e2-5271-4a47-af8b-1217330c81f2 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:53:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-bae67e21-1bc6-430f-85fc-b947aec1ccb3 req-dd1401e2-5271-4a47-af8b-1217330c81f2 service nova] Releasing lock "refresh_cache-9e2f3a3e-ee9b-4250-8744-5eb7982285f2" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:53:47 user nova-compute[74348]: DEBUG nova.compute.manager [req-bae67e21-1bc6-430f-85fc-b947aec1ccb3 req-dd1401e2-5271-4a47-af8b-1217330c81f2 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-changed-6221165b-f588-475c-a3b1-afdf5c60c113 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:53:47 user nova-compute[74348]: DEBUG nova.compute.manager [req-bae67e21-1bc6-430f-85fc-b947aec1ccb3 req-dd1401e2-5271-4a47-af8b-1217330c81f2 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Refreshing instance network info cache due to event network-changed-6221165b-f588-475c-a3b1-afdf5c60c113. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:53:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-bae67e21-1bc6-430f-85fc-b947aec1ccb3 req-dd1401e2-5271-4a47-af8b-1217330c81f2 service nova] Acquiring lock "refresh_cache-8527ae47-a025-492d-9820-b9c5ee309d81" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:53:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-bae67e21-1bc6-430f-85fc-b947aec1ccb3 req-dd1401e2-5271-4a47-af8b-1217330c81f2 service nova] Acquired lock "refresh_cache-8527ae47-a025-492d-9820-b9c5ee309d81" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:53:47 user nova-compute[74348]: DEBUG nova.network.neutron [req-bae67e21-1bc6-430f-85fc-b947aec1ccb3 req-dd1401e2-5271-4a47-af8b-1217330c81f2 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Refreshing network info cache for port 6221165b-f588-475c-a3b1-afdf5c60c113 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:53:47 user nova-compute[74348]: DEBUG nova.network.neutron [req-bae67e21-1bc6-430f-85fc-b947aec1ccb3 req-dd1401e2-5271-4a47-af8b-1217330c81f2 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 07:53:47 user nova-compute[74348]: DEBUG nova.network.neutron [req-bae67e21-1bc6-430f-85fc-b947aec1ccb3 req-dd1401e2-5271-4a47-af8b-1217330c81f2 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:53:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-bae67e21-1bc6-430f-85fc-b947aec1ccb3 req-dd1401e2-5271-4a47-af8b-1217330c81f2 service nova] Releasing lock "refresh_cache-8527ae47-a025-492d-9820-b9c5ee309d81" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:53:47 user nova-compute[74348]: DEBUG nova.compute.manager [req-bae67e21-1bc6-430f-85fc-b947aec1ccb3 req-dd1401e2-5271-4a47-af8b-1217330c81f2 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-changed-f0f55187-e53f-468d-83a8-cca33ff1380e {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:53:47 user nova-compute[74348]: DEBUG nova.compute.manager [req-bae67e21-1bc6-430f-85fc-b947aec1ccb3 req-dd1401e2-5271-4a47-af8b-1217330c81f2 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Refreshing instance network info cache due to event network-changed-f0f55187-e53f-468d-83a8-cca33ff1380e. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:53:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-bae67e21-1bc6-430f-85fc-b947aec1ccb3 req-dd1401e2-5271-4a47-af8b-1217330c81f2 service nova] Acquiring lock "refresh_cache-9e2f3a3e-ee9b-4250-8744-5eb7982285f2" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:53:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-bae67e21-1bc6-430f-85fc-b947aec1ccb3 req-dd1401e2-5271-4a47-af8b-1217330c81f2 service nova] Acquired lock "refresh_cache-9e2f3a3e-ee9b-4250-8744-5eb7982285f2" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:53:47 user nova-compute[74348]: DEBUG nova.network.neutron [req-bae67e21-1bc6-430f-85fc-b947aec1ccb3 req-dd1401e2-5271-4a47-af8b-1217330c81f2 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Refreshing network info cache for port f0f55187-e53f-468d-83a8-cca33ff1380e {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:53:47 user nova-compute[74348]: DEBUG nova.network.neutron [req-bae67e21-1bc6-430f-85fc-b947aec1ccb3 req-dd1401e2-5271-4a47-af8b-1217330c81f2 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 07:53:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:48 user nova-compute[74348]: DEBUG nova.network.neutron [req-bae67e21-1bc6-430f-85fc-b947aec1ccb3 req-dd1401e2-5271-4a47-af8b-1217330c81f2 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:53:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-bae67e21-1bc6-430f-85fc-b947aec1ccb3 req-dd1401e2-5271-4a47-af8b-1217330c81f2 service nova] Releasing lock "refresh_cache-9e2f3a3e-ee9b-4250-8744-5eb7982285f2" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:53:48 user nova-compute[74348]: DEBUG nova.network.neutron [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Successfully updated port: 5a68d2be-be4c-462b-9dd4-15e222160557 {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 07:53:49 user nova-compute[74348]: DEBUG nova.network.neutron [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Successfully updated port: 63fc17ce-ef08-4f7e-ab83-b1040733d228 {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 07:53:49 user nova-compute[74348]: DEBUG nova.compute.manager [req-3121b5b0-d2a0-4d86-9028-d2acc7a4637b req-705096be-7e10-420c-b0d1-e5efd0e6506a service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-changed-62ed8403-ebcd-4e41-ac81-0056cf71738c {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:53:49 user nova-compute[74348]: DEBUG nova.compute.manager [req-3121b5b0-d2a0-4d86-9028-d2acc7a4637b req-705096be-7e10-420c-b0d1-e5efd0e6506a service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Refreshing instance network info cache due to event network-changed-62ed8403-ebcd-4e41-ac81-0056cf71738c. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:53:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3121b5b0-d2a0-4d86-9028-d2acc7a4637b req-705096be-7e10-420c-b0d1-e5efd0e6506a service nova] Acquiring lock "refresh_cache-8527ae47-a025-492d-9820-b9c5ee309d81" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:53:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3121b5b0-d2a0-4d86-9028-d2acc7a4637b req-705096be-7e10-420c-b0d1-e5efd0e6506a service nova] Acquired lock "refresh_cache-8527ae47-a025-492d-9820-b9c5ee309d81" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:53:49 user nova-compute[74348]: DEBUG nova.network.neutron [req-3121b5b0-d2a0-4d86-9028-d2acc7a4637b req-705096be-7e10-420c-b0d1-e5efd0e6506a service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Refreshing network info cache for port 62ed8403-ebcd-4e41-ac81-0056cf71738c {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:53:49 user nova-compute[74348]: DEBUG nova.network.neutron [req-3121b5b0-d2a0-4d86-9028-d2acc7a4637b req-705096be-7e10-420c-b0d1-e5efd0e6506a service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 07:53:49 user nova-compute[74348]: DEBUG nova.network.neutron [req-3121b5b0-d2a0-4d86-9028-d2acc7a4637b req-705096be-7e10-420c-b0d1-e5efd0e6506a service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:53:49 user nova-compute[74348]: DEBUG nova.network.neutron [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Successfully updated port: 9aa74044-d952-47e5-9cc1-948615a01eb3 {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 07:53:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3121b5b0-d2a0-4d86-9028-d2acc7a4637b req-705096be-7e10-420c-b0d1-e5efd0e6506a service nova] Releasing lock "refresh_cache-8527ae47-a025-492d-9820-b9c5ee309d81" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:53:49 user nova-compute[74348]: DEBUG nova.compute.manager [req-3121b5b0-d2a0-4d86-9028-d2acc7a4637b req-705096be-7e10-420c-b0d1-e5efd0e6506a service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-changed-5a68d2be-be4c-462b-9dd4-15e222160557 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:53:49 user nova-compute[74348]: DEBUG nova.compute.manager [req-3121b5b0-d2a0-4d86-9028-d2acc7a4637b req-705096be-7e10-420c-b0d1-e5efd0e6506a service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Refreshing instance network info cache due to event network-changed-5a68d2be-be4c-462b-9dd4-15e222160557. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:53:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3121b5b0-d2a0-4d86-9028-d2acc7a4637b req-705096be-7e10-420c-b0d1-e5efd0e6506a service nova] Acquiring lock "refresh_cache-9e2f3a3e-ee9b-4250-8744-5eb7982285f2" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:53:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3121b5b0-d2a0-4d86-9028-d2acc7a4637b req-705096be-7e10-420c-b0d1-e5efd0e6506a service nova] Acquired lock "refresh_cache-9e2f3a3e-ee9b-4250-8744-5eb7982285f2" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:53:49 user nova-compute[74348]: DEBUG nova.network.neutron [req-3121b5b0-d2a0-4d86-9028-d2acc7a4637b req-705096be-7e10-420c-b0d1-e5efd0e6506a service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Refreshing network info cache for port 5a68d2be-be4c-462b-9dd4-15e222160557 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:53:49 user nova-compute[74348]: DEBUG nova.network.neutron [req-3121b5b0-d2a0-4d86-9028-d2acc7a4637b req-705096be-7e10-420c-b0d1-e5efd0e6506a service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 07:53:49 user nova-compute[74348]: DEBUG nova.network.neutron [req-3121b5b0-d2a0-4d86-9028-d2acc7a4637b req-705096be-7e10-420c-b0d1-e5efd0e6506a service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:53:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3121b5b0-d2a0-4d86-9028-d2acc7a4637b req-705096be-7e10-420c-b0d1-e5efd0e6506a service nova] Releasing lock "refresh_cache-9e2f3a3e-ee9b-4250-8744-5eb7982285f2" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:53:49 user nova-compute[74348]: DEBUG nova.compute.manager [req-3121b5b0-d2a0-4d86-9028-d2acc7a4637b req-705096be-7e10-420c-b0d1-e5efd0e6506a service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-changed-63fc17ce-ef08-4f7e-ab83-b1040733d228 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:53:49 user nova-compute[74348]: DEBUG nova.compute.manager [req-3121b5b0-d2a0-4d86-9028-d2acc7a4637b req-705096be-7e10-420c-b0d1-e5efd0e6506a service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Refreshing instance network info cache due to event network-changed-63fc17ce-ef08-4f7e-ab83-b1040733d228. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:53:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3121b5b0-d2a0-4d86-9028-d2acc7a4637b req-705096be-7e10-420c-b0d1-e5efd0e6506a service nova] Acquiring lock "refresh_cache-8527ae47-a025-492d-9820-b9c5ee309d81" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:53:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3121b5b0-d2a0-4d86-9028-d2acc7a4637b req-705096be-7e10-420c-b0d1-e5efd0e6506a service nova] Acquired lock "refresh_cache-8527ae47-a025-492d-9820-b9c5ee309d81" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:53:49 user nova-compute[74348]: DEBUG nova.network.neutron [req-3121b5b0-d2a0-4d86-9028-d2acc7a4637b req-705096be-7e10-420c-b0d1-e5efd0e6506a service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Refreshing network info cache for port 63fc17ce-ef08-4f7e-ab83-b1040733d228 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:53:50 user nova-compute[74348]: DEBUG nova.network.neutron [req-3121b5b0-d2a0-4d86-9028-d2acc7a4637b req-705096be-7e10-420c-b0d1-e5efd0e6506a service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 07:53:50 user nova-compute[74348]: DEBUG nova.network.neutron [req-3121b5b0-d2a0-4d86-9028-d2acc7a4637b req-705096be-7e10-420c-b0d1-e5efd0e6506a service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:53:50 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3121b5b0-d2a0-4d86-9028-d2acc7a4637b req-705096be-7e10-420c-b0d1-e5efd0e6506a service nova] Releasing lock "refresh_cache-8527ae47-a025-492d-9820-b9c5ee309d81" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:53:50 user nova-compute[74348]: DEBUG nova.network.neutron [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Successfully updated port: 969790c1-f8a4-4d98-86d9-1ed932c83daa {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 07:53:50 user nova-compute[74348]: INFO nova.virt.block_device [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Booting with volume a27ac02b-fae8-438b-a31e-8683997015c7 at /dev/vdc
Nov 22 07:53:50 user nova-compute[74348]: DEBUG os_brick.utils [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:53:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:50 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d6cbb8-70b0-4974-b62f-b45b84e4de27]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:50 user nova-compute[74348]: DEBUG nova.network.neutron [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Successfully updated port: 579fb42b-b8b6-4122-8ec3-8817c9e0881a {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 07:53:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:50 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Acquiring lock "refresh_cache-9e2f3a3e-ee9b-4250-8744-5eb7982285f2" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:53:50 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Acquired lock "refresh_cache-9e2f3a3e-ee9b-4250-8744-5eb7982285f2" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:53:50 user nova-compute[74348]: DEBUG nova.network.neutron [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 07:53:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:50 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[715f0203-90fb-4c9f-b0a4-59eea8393a64]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:50 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c6bc9e-c670-46ce-9b82-0fb637686d94]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:50 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6853f83e-6c08-4dac-bf30-3b9cd0fe9328]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 07:53:50 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:50 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 07:53:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 07:53:50 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 07:53:50 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[37895f6c-ca64-4637-bbdf-fa07131d4cb8]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:50 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 07:53:50 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 07:53:50 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 07:53:50 user nova-compute[74348]: DEBUG os_brick.utils [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:53:50 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Updating existing volume attachment record: 161b9116-94f1-46df-8b66-8baf064e8114 {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 07:53:51 user nova-compute[74348]: DEBUG nova.network.neutron [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 07:53:51 user nova-compute[74348]: DEBUG nova.compute.manager [req-27ec699c-9199-4d53-a331-7d610659d686 req-66d174f0-35f5-4fcb-ba3b-a763725d6074 service nova] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Received event network-vif-plugged-c870c926-d416-4c0c-8fcc-873ce1c3b14e {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:53:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-27ec699c-9199-4d53-a331-7d610659d686 req-66d174f0-35f5-4fcb-ba3b-a763725d6074 service nova] Acquiring lock "da6aa6c0-2b77-49a5-9942-d6596ac4bd3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-27ec699c-9199-4d53-a331-7d610659d686 req-66d174f0-35f5-4fcb-ba3b-a763725d6074 service nova] Lock "da6aa6c0-2b77-49a5-9942-d6596ac4bd3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-27ec699c-9199-4d53-a331-7d610659d686 req-66d174f0-35f5-4fcb-ba3b-a763725d6074 service nova] Lock "da6aa6c0-2b77-49a5-9942-d6596ac4bd3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:51 user nova-compute[74348]: DEBUG nova.compute.manager [req-27ec699c-9199-4d53-a331-7d610659d686 req-66d174f0-35f5-4fcb-ba3b-a763725d6074 service nova] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] No waiting events found dispatching network-vif-plugged-c870c926-d416-4c0c-8fcc-873ce1c3b14e {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:53:51 user nova-compute[74348]: WARNING nova.compute.manager [req-27ec699c-9199-4d53-a331-7d610659d686 req-66d174f0-35f5-4fcb-ba3b-a763725d6074 service nova] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Received unexpected event network-vif-plugged-c870c926-d416-4c0c-8fcc-873ce1c3b14e for instance with vm_state active and task_state None.
Nov 22 07:53:51 user nova-compute[74348]: DEBUG nova.network.neutron [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Successfully updated port: 748e5281-27d7-43b4-ba47-2f0daed1181e {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 07:53:51 user nova-compute[74348]: DEBUG nova.compute.manager [req-4535144d-ee95-4b34-8b74-0c894cc92a50 req-d1046728-0f5c-4b3b-a4b0-50641bc90e43 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-changed-9aa74044-d952-47e5-9cc1-948615a01eb3 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:53:51 user nova-compute[74348]: DEBUG nova.compute.manager [req-4535144d-ee95-4b34-8b74-0c894cc92a50 req-d1046728-0f5c-4b3b-a4b0-50641bc90e43 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Refreshing instance network info cache due to event network-changed-9aa74044-d952-47e5-9cc1-948615a01eb3. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:53:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4535144d-ee95-4b34-8b74-0c894cc92a50 req-d1046728-0f5c-4b3b-a4b0-50641bc90e43 service nova] Acquiring lock "refresh_cache-9e2f3a3e-ee9b-4250-8744-5eb7982285f2" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:53:52 user nova-compute[74348]: INFO nova.virt.block_device [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Booting with volume fe1c9310-8a44-4188-8500-088ec8cd7799 at /dev/vdc
Nov 22 07:53:52 user nova-compute[74348]: DEBUG os_brick.utils [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:53:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:52 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f775973-1ecd-4a0c-a139-615e4ce302ef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:52 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0a45b2-45cf-4142-ba6e-5db8b34b0fa1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:52 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab334f51-0092-4a08-aca2-13c117e54f15]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:52 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28b07a3-1d42-48bf-864d-b60f2b18a6a5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 07:53:52 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 07:53:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 07:53:52 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 07:53:52 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5206fb91-1ad7-4781-a8e0-c5daddd9de18]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:52 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 07:53:52 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 07:53:52 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 07:53:52 user nova-compute[74348]: DEBUG os_brick.utils [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:53:52 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Updating existing volume attachment record: 0cb4591e-230c-4fe9-898a-f45771c1ddc2 {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 07:53:52 user nova-compute[74348]: DEBUG nova.network.neutron [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Successfully updated port: d77c2a03-a402-4288-8a40-2f88200a8f22 {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 07:53:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:53 user nova-compute[74348]: DEBUG nova.compute.manager [req-00111c8e-e9c1-4962-bab0-d0e122e1d831 req-6c3bc5d2-861e-431c-bf55-43d69ce98901 service nova] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Received event network-vif-plugged-c870c926-d416-4c0c-8fcc-873ce1c3b14e {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:53:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-00111c8e-e9c1-4962-bab0-d0e122e1d831 req-6c3bc5d2-861e-431c-bf55-43d69ce98901 service nova] Acquiring lock "da6aa6c0-2b77-49a5-9942-d6596ac4bd3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-00111c8e-e9c1-4962-bab0-d0e122e1d831 req-6c3bc5d2-861e-431c-bf55-43d69ce98901 service nova] Lock "da6aa6c0-2b77-49a5-9942-d6596ac4bd3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-00111c8e-e9c1-4962-bab0-d0e122e1d831 req-6c3bc5d2-861e-431c-bf55-43d69ce98901 service nova] Lock "da6aa6c0-2b77-49a5-9942-d6596ac4bd3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:53 user nova-compute[74348]: DEBUG nova.compute.manager [req-00111c8e-e9c1-4962-bab0-d0e122e1d831 req-6c3bc5d2-861e-431c-bf55-43d69ce98901 service nova] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] No waiting events found dispatching network-vif-plugged-c870c926-d416-4c0c-8fcc-873ce1c3b14e {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:53:53 user nova-compute[74348]: WARNING nova.compute.manager [req-00111c8e-e9c1-4962-bab0-d0e122e1d831 req-6c3bc5d2-861e-431c-bf55-43d69ce98901 service nova] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Received unexpected event network-vif-plugged-c870c926-d416-4c0c-8fcc-873ce1c3b14e for instance with vm_state active and task_state None.
Nov 22 07:53:53 user nova-compute[74348]: DEBUG nova.compute.manager [req-00111c8e-e9c1-4962-bab0-d0e122e1d831 req-6c3bc5d2-861e-431c-bf55-43d69ce98901 service nova] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Received event network-vif-plugged-6a071188-e54b-4bb7-b4dc-e2fce0291c7e {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:53:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-00111c8e-e9c1-4962-bab0-d0e122e1d831 req-6c3bc5d2-861e-431c-bf55-43d69ce98901 service nova] Acquiring lock "88730c14-fd2a-4f63-bc10-96cea0b057eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-00111c8e-e9c1-4962-bab0-d0e122e1d831 req-6c3bc5d2-861e-431c-bf55-43d69ce98901 service nova] Lock "88730c14-fd2a-4f63-bc10-96cea0b057eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-00111c8e-e9c1-4962-bab0-d0e122e1d831 req-6c3bc5d2-861e-431c-bf55-43d69ce98901 service nova] Lock "88730c14-fd2a-4f63-bc10-96cea0b057eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:53 user nova-compute[74348]: DEBUG nova.compute.manager [req-00111c8e-e9c1-4962-bab0-d0e122e1d831 req-6c3bc5d2-861e-431c-bf55-43d69ce98901 service nova] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] No waiting events found dispatching network-vif-plugged-6a071188-e54b-4bb7-b4dc-e2fce0291c7e {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:53:53 user nova-compute[74348]: WARNING nova.compute.manager [req-00111c8e-e9c1-4962-bab0-d0e122e1d831 req-6c3bc5d2-861e-431c-bf55-43d69ce98901 service nova] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Received unexpected event network-vif-plugged-6a071188-e54b-4bb7-b4dc-e2fce0291c7e for instance with vm_state active and task_state None.
Nov 22 07:53:53 user nova-compute[74348]: DEBUG nova.compute.manager [req-00111c8e-e9c1-4962-bab0-d0e122e1d831 req-6c3bc5d2-861e-431c-bf55-43d69ce98901 service nova] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Received event network-vif-plugged-6a071188-e54b-4bb7-b4dc-e2fce0291c7e {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:53:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-00111c8e-e9c1-4962-bab0-d0e122e1d831 req-6c3bc5d2-861e-431c-bf55-43d69ce98901 service nova] Acquiring lock "88730c14-fd2a-4f63-bc10-96cea0b057eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-00111c8e-e9c1-4962-bab0-d0e122e1d831 req-6c3bc5d2-861e-431c-bf55-43d69ce98901 service nova] Lock "88730c14-fd2a-4f63-bc10-96cea0b057eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-00111c8e-e9c1-4962-bab0-d0e122e1d831 req-6c3bc5d2-861e-431c-bf55-43d69ce98901 service nova] Lock "88730c14-fd2a-4f63-bc10-96cea0b057eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:53 user nova-compute[74348]: DEBUG nova.compute.manager [req-00111c8e-e9c1-4962-bab0-d0e122e1d831 req-6c3bc5d2-861e-431c-bf55-43d69ce98901 service nova] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] No waiting events found dispatching network-vif-plugged-6a071188-e54b-4bb7-b4dc-e2fce0291c7e {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:53:53 user nova-compute[74348]: WARNING nova.compute.manager [req-00111c8e-e9c1-4962-bab0-d0e122e1d831 req-6c3bc5d2-861e-431c-bf55-43d69ce98901 service nova] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Received unexpected event network-vif-plugged-6a071188-e54b-4bb7-b4dc-e2fce0291c7e for instance with vm_state active and task_state None.
Nov 22 07:53:53 user nova-compute[74348]: DEBUG nova.compute.manager [req-b8339ac9-8140-45d9-8665-b8c69831a1e4 req-ed681f86-dfed-44eb-865c-eaadc54aa9a0 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-changed-d77c2a03-a402-4288-8a40-2f88200a8f22 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:53:53 user nova-compute[74348]: DEBUG nova.compute.manager [req-b8339ac9-8140-45d9-8665-b8c69831a1e4 req-ed681f86-dfed-44eb-865c-eaadc54aa9a0 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Refreshing instance network info cache due to event network-changed-d77c2a03-a402-4288-8a40-2f88200a8f22. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:53:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b8339ac9-8140-45d9-8665-b8c69831a1e4 req-ed681f86-dfed-44eb-865c-eaadc54aa9a0 service nova] Acquiring lock "refresh_cache-8527ae47-a025-492d-9820-b9c5ee309d81" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:53:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b8339ac9-8140-45d9-8665-b8c69831a1e4 req-ed681f86-dfed-44eb-865c-eaadc54aa9a0 service nova] Acquired lock "refresh_cache-8527ae47-a025-492d-9820-b9c5ee309d81" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:53:53 user nova-compute[74348]: DEBUG nova.network.neutron [req-b8339ac9-8140-45d9-8665-b8c69831a1e4 req-ed681f86-dfed-44eb-865c-eaadc54aa9a0 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Refreshing network info cache for port d77c2a03-a402-4288-8a40-2f88200a8f22 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:53:53 user nova-compute[74348]: DEBUG nova.network.neutron [req-b8339ac9-8140-45d9-8665-b8c69831a1e4 req-ed681f86-dfed-44eb-865c-eaadc54aa9a0 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 07:53:53 user nova-compute[74348]: DEBUG nova.network.neutron [req-b8339ac9-8140-45d9-8665-b8c69831a1e4 req-ed681f86-dfed-44eb-865c-eaadc54aa9a0 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:53:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b8339ac9-8140-45d9-8665-b8c69831a1e4 req-ed681f86-dfed-44eb-865c-eaadc54aa9a0 service nova] Releasing lock "refresh_cache-8527ae47-a025-492d-9820-b9c5ee309d81" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:53:53 user nova-compute[74348]: DEBUG nova.network.neutron [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Successfully updated port: a64b4a32-73f1-4a48-8b80-86d353d1d40b {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 07:53:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Acquiring lock "refresh_cache-8527ae47-a025-492d-9820-b9c5ee309d81" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:53:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Acquired lock "refresh_cache-8527ae47-a025-492d-9820-b9c5ee309d81" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:53:53 user nova-compute[74348]: DEBUG nova.network.neutron [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 07:53:53 user nova-compute[74348]: DEBUG nova.network.neutron [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 07:53:54 user nova-compute[74348]: DEBUG nova.network.neutron [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Updating instance_info_cache with network_info: [{"id": "4a8ea7e1-9e80-4686-a3a9-4142b9de0049", "address": "fa:16:3e:7e:13:ad", "network": {"id": "c9f2b2b7-e34f-4891-b68c-786534d7ed95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-766683782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8ea7e1-9e", "ovs_interfaceid": "4a8ea7e1-9e80-4686-a3a9-4142b9de0049", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e30deaf5-1258-4909-bc71-044c88f2995f", "address": "fa:16:3e:c8:34:fc", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30deaf5-12", "ovs_interfaceid": "e30deaf5-1258-4909-bc71-044c88f2995f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "298ce71b-894a-4e29-904e-1ba5d4495fcb", "address": "fa:16:3e:b3:83:8f", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298ce71b-89", "ovs_interfaceid": "298ce71b-894a-4e29-904e-1ba5d4495fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f0f55187-e53f-468d-83a8-cca33ff1380e", "address": "fa:16:3e:8d:36:2e", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f55187-e5", "ovs_interfaceid": "f0f55187-e53f-468d-83a8-cca33ff1380e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5a68d2be-be4c-462b-9dd4-15e222160557", "address": "fa:16:3e:ea:a3:83", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a68d2be-be", "ovs_interfaceid": "5a68d2be-be4c-462b-9dd4-15e222160557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9aa74044-d952-47e5-9cc1-948615a01eb3", "address": "fa:16:3e:6d:8e:f9", "network": {"id": "7f9b7b76-9f0d-4fbd-90c9-6ceee5e0c50e", "bridge": "br-int", "label": "tempest-device-tagging-net2-487890789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aa74044-d9", "ovs_interfaceid": "9aa74044-d952-47e5-9cc1-948615a01eb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "579fb42b-b8b6-4122-8ec3-8817c9e0881a", "address": "fa:16:3e:06:8e:e5", "network": {"id": "7f9b7b76-9f0d-4fbd-90c9-6ceee5e0c50e", "bridge": "br-int", "label": "tempest-device-tagging-net2-487890789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap579fb42b-b8", "ovs_interfaceid": "579fb42b-b8b6-4122-8ec3-8817c9e0881a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:53:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Releasing lock "refresh_cache-9e2f3a3e-ee9b-4250-8744-5eb7982285f2" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:53:54 user nova-compute[74348]: DEBUG nova.compute.manager [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Instance network_info: |[{"id": "4a8ea7e1-9e80-4686-a3a9-4142b9de0049", "address": "fa:16:3e:7e:13:ad", "network": {"id": "c9f2b2b7-e34f-4891-b68c-786534d7ed95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-766683782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8ea7e1-9e", "ovs_interfaceid": "4a8ea7e1-9e80-4686-a3a9-4142b9de0049", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e30deaf5-1258-4909-bc71-044c88f2995f", "address": "fa:16:3e:c8:34:fc", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30deaf5-12", "ovs_interfaceid": "e30deaf5-1258-4909-bc71-044c88f2995f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "298ce71b-894a-4e29-904e-1ba5d4495fcb", "address": "fa:16:3e:b3:83:8f", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298ce71b-89", "ovs_interfaceid": "298ce71b-894a-4e29-904e-1ba5d4495fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f0f55187-e53f-468d-83a8-cca33ff1380e", "address": "fa:16:3e:8d:36:2e", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f55187-e5", "ovs_interfaceid": "f0f55187-e53f-468d-83a8-cca33ff1380e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5a68d2be-be4c-462b-9dd4-15e222160557", "address": "fa:16:3e:ea:a3:83", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a68d2be-be", "ovs_interfaceid": "5a68d2be-be4c-462b-9dd4-15e222160557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9aa74044-d952-47e5-9cc1-948615a01eb3", "address": "fa:16:3e:6d:8e:f9", "network": {"id": "7f9b7b76-9f0d-4fbd-90c9-6ceee5e0c50e", "bridge": "br-int", "label": "tempest-device-tagging-net2-487890789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aa74044-d9", "ovs_interfaceid": "9aa74044-d952-47e5-9cc1-948615a01eb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "579fb42b-b8b6-4122-8ec3-8817c9e0881a", "address": "fa:16:3e:06:8e:e5", "network": {"id": "7f9b7b76-9f0d-4fbd-90c9-6ceee5e0c50e", "bridge": "br-int", "label": "tempest-device-tagging-net2-487890789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap579fb42b-b8", "ovs_interfaceid": "579fb42b-b8b6-4122-8ec3-8817c9e0881a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 07:53:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4535144d-ee95-4b34-8b74-0c894cc92a50 req-d1046728-0f5c-4b3b-a4b0-50641bc90e43 service nova] Acquired lock "refresh_cache-9e2f3a3e-ee9b-4250-8744-5eb7982285f2" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:53:54 user nova-compute[74348]: DEBUG nova.network.neutron [req-4535144d-ee95-4b34-8b74-0c894cc92a50 req-d1046728-0f5c-4b3b-a4b0-50641bc90e43 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Refreshing network info cache for port 9aa74044-d952-47e5-9cc1-948615a01eb3 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:53:54 user nova-compute[74348]: DEBUG nova.network.neutron [req-4535144d-ee95-4b34-8b74-0c894cc92a50 req-d1046728-0f5c-4b3b-a4b0-50641bc90e43 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Updated VIF entry in instance network info cache for port 9aa74044-d952-47e5-9cc1-948615a01eb3. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 07:53:54 user nova-compute[74348]: DEBUG nova.network.neutron [req-4535144d-ee95-4b34-8b74-0c894cc92a50 req-d1046728-0f5c-4b3b-a4b0-50641bc90e43 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Updating instance_info_cache with network_info: [{"id": "4a8ea7e1-9e80-4686-a3a9-4142b9de0049", "address": "fa:16:3e:7e:13:ad", "network": {"id": "c9f2b2b7-e34f-4891-b68c-786534d7ed95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-766683782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8ea7e1-9e", "ovs_interfaceid": "4a8ea7e1-9e80-4686-a3a9-4142b9de0049", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e30deaf5-1258-4909-bc71-044c88f2995f", "address": "fa:16:3e:c8:34:fc", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30deaf5-12", "ovs_interfaceid": "e30deaf5-1258-4909-bc71-044c88f2995f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "298ce71b-894a-4e29-904e-1ba5d4495fcb", "address": "fa:16:3e:b3:83:8f", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298ce71b-89", "ovs_interfaceid": "298ce71b-894a-4e29-904e-1ba5d4495fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f0f55187-e53f-468d-83a8-cca33ff1380e", "address": "fa:16:3e:8d:36:2e", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f55187-e5", "ovs_interfaceid": "f0f55187-e53f-468d-83a8-cca33ff1380e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5a68d2be-be4c-462b-9dd4-15e222160557", "address": "fa:16:3e:ea:a3:83", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a68d2be-be", "ovs_interfaceid": "5a68d2be-be4c-462b-9dd4-15e222160557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9aa74044-d952-47e5-9cc1-948615a01eb3", "address": "fa:16:3e:6d:8e:f9", "network": {"id": "7f9b7b76-9f0d-4fbd-90c9-6ceee5e0c50e", "bridge": "br-int", "label": "tempest-device-tagging-net2-487890789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aa74044-d9", "ovs_interfaceid": "9aa74044-d952-47e5-9cc1-948615a01eb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "579fb42b-b8b6-4122-8ec3-8817c9e0881a", "address": "fa:16:3e:06:8e:e5", "network": {"id": "7f9b7b76-9f0d-4fbd-90c9-6ceee5e0c50e", "bridge": "br-int", "label": "tempest-device-tagging-net2-487890789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap579fb42b-b8", "ovs_interfaceid": "579fb42b-b8b6-4122-8ec3-8817c9e0881a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:53:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4535144d-ee95-4b34-8b74-0c894cc92a50 req-d1046728-0f5c-4b3b-a4b0-50641bc90e43 service nova] Releasing lock "refresh_cache-9e2f3a3e-ee9b-4250-8744-5eb7982285f2" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:53:54 user nova-compute[74348]: DEBUG nova.compute.manager [req-4535144d-ee95-4b34-8b74-0c894cc92a50 req-d1046728-0f5c-4b3b-a4b0-50641bc90e43 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-changed-969790c1-f8a4-4d98-86d9-1ed932c83daa {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:53:54 user nova-compute[74348]: DEBUG nova.compute.manager [req-4535144d-ee95-4b34-8b74-0c894cc92a50 req-d1046728-0f5c-4b3b-a4b0-50641bc90e43 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Refreshing instance network info cache due to event network-changed-969790c1-f8a4-4d98-86d9-1ed932c83daa. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:53:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4535144d-ee95-4b34-8b74-0c894cc92a50 req-d1046728-0f5c-4b3b-a4b0-50641bc90e43 service nova] Acquiring lock "refresh_cache-8527ae47-a025-492d-9820-b9c5ee309d81" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:53:55 user nova-compute[74348]: DEBUG nova.compute.manager [req-c262206e-c07a-4aae-8e78-3e5af4d423ae req-f6d6e847-d641-4a6e-86aa-99af08b65da7 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-changed-a64b4a32-73f1-4a48-8b80-86d353d1d40b {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:53:55 user nova-compute[74348]: DEBUG nova.compute.manager [req-c262206e-c07a-4aae-8e78-3e5af4d423ae req-f6d6e847-d641-4a6e-86aa-99af08b65da7 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Refreshing instance network info cache due to event network-changed-a64b4a32-73f1-4a48-8b80-86d353d1d40b. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:53:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c262206e-c07a-4aae-8e78-3e5af4d423ae req-f6d6e847-d641-4a6e-86aa-99af08b65da7 service nova] Acquiring lock "refresh_cache-8527ae47-a025-492d-9820-b9c5ee309d81" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:53:55 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:56 user nova-compute[74348]: DEBUG nova.network.neutron [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Updating instance_info_cache with network_info: [{"id": "6221165b-f588-475c-a3b1-afdf5c60c113", "address": "fa:16:3e:6a:1c:a3", "network": {"id": "414e020d-3fcc-4afd-9fee-be68687a0418", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-184417969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6221165b-f5", "ovs_interfaceid": "6221165b-f588-475c-a3b1-afdf5c60c113", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "62ed8403-ebcd-4e41-ac81-0056cf71738c", "address": "fa:16:3e:9a:78:38", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62ed8403-eb", "ovs_interfaceid": "62ed8403-ebcd-4e41-ac81-0056cf71738c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "63fc17ce-ef08-4f7e-ab83-b1040733d228", "address": "fa:16:3e:92:70:d1", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fc17ce-ef", "ovs_interfaceid": "63fc17ce-ef08-4f7e-ab83-b1040733d228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "969790c1-f8a4-4d98-86d9-1ed932c83daa", "address": "fa:16:3e:6d:21:36", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969790c1-f8", "ovs_interfaceid": "969790c1-f8a4-4d98-86d9-1ed932c83daa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "748e5281-27d7-43b4-ba47-2f0daed1181e", "address": "fa:16:3e:f9:d2:8f", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap748e5281-27", "ovs_interfaceid": "748e5281-27d7-43b4-ba47-2f0daed1181e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d77c2a03-a402-4288-8a40-2f88200a8f22", "address": "fa:16:3e:b2:36:f8", "network": {"id": "f39bd97a-26ce-4373-bf3b-ceb5c8dc21ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-224466528", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd77c2a03-a4", "ovs_interfaceid": "d77c2a03-a402-4288-8a40-2f88200a8f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a64b4a32-73f1-4a48-8b80-86d353d1d40b", "address": "fa:16:3e:be:1c:23", "network": {"id": "f39bd97a-26ce-4373-bf3b-ceb5c8dc21ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-224466528", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64b4a32-73", "ovs_interfaceid": "a64b4a32-73f1-4a48-8b80-86d353d1d40b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:53:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Releasing lock "refresh_cache-8527ae47-a025-492d-9820-b9c5ee309d81" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:53:56 user nova-compute[74348]: DEBUG nova.compute.manager [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Instance network_info: |[{"id": "6221165b-f588-475c-a3b1-afdf5c60c113", "address": "fa:16:3e:6a:1c:a3", "network": {"id": "414e020d-3fcc-4afd-9fee-be68687a0418", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-184417969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6221165b-f5", "ovs_interfaceid": "6221165b-f588-475c-a3b1-afdf5c60c113", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "62ed8403-ebcd-4e41-ac81-0056cf71738c", "address": "fa:16:3e:9a:78:38", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62ed8403-eb", "ovs_interfaceid": "62ed8403-ebcd-4e41-ac81-0056cf71738c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "63fc17ce-ef08-4f7e-ab83-b1040733d228", "address": "fa:16:3e:92:70:d1", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fc17ce-ef", "ovs_interfaceid": "63fc17ce-ef08-4f7e-ab83-b1040733d228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "969790c1-f8a4-4d98-86d9-1ed932c83daa", "address": "fa:16:3e:6d:21:36", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969790c1-f8", "ovs_interfaceid": "969790c1-f8a4-4d98-86d9-1ed932c83daa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "748e5281-27d7-43b4-ba47-2f0daed1181e", "address": "fa:16:3e:f9:d2:8f", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap748e5281-27", "ovs_interfaceid": "748e5281-27d7-43b4-ba47-2f0daed1181e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d77c2a03-a402-4288-8a40-2f88200a8f22", "address": "fa:16:3e:b2:36:f8", "network": {"id": "f39bd97a-26ce-4373-bf3b-ceb5c8dc21ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-224466528", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd77c2a03-a4", "ovs_interfaceid": "d77c2a03-a402-4288-8a40-2f88200a8f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a64b4a32-73f1-4a48-8b80-86d353d1d40b", "address": "fa:16:3e:be:1c:23", "network": {"id": "f39bd97a-26ce-4373-bf3b-ceb5c8dc21ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-224466528", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64b4a32-73", "ovs_interfaceid": "a64b4a32-73f1-4a48-8b80-86d353d1d40b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 07:53:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4535144d-ee95-4b34-8b74-0c894cc92a50 req-d1046728-0f5c-4b3b-a4b0-50641bc90e43 service nova] Acquired lock "refresh_cache-8527ae47-a025-492d-9820-b9c5ee309d81" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:53:56 user nova-compute[74348]: DEBUG nova.network.neutron [req-4535144d-ee95-4b34-8b74-0c894cc92a50 req-d1046728-0f5c-4b3b-a4b0-50641bc90e43 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Refreshing network info cache for port 969790c1-f8a4-4d98-86d9-1ed932c83daa {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:53:56 user nova-compute[74348]: DEBUG nova.network.neutron [req-4535144d-ee95-4b34-8b74-0c894cc92a50 req-d1046728-0f5c-4b3b-a4b0-50641bc90e43 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Updated VIF entry in instance network info cache for port 969790c1-f8a4-4d98-86d9-1ed932c83daa. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 07:53:56 user nova-compute[74348]: DEBUG nova.network.neutron [req-4535144d-ee95-4b34-8b74-0c894cc92a50 req-d1046728-0f5c-4b3b-a4b0-50641bc90e43 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Updating instance_info_cache with network_info: [{"id": "6221165b-f588-475c-a3b1-afdf5c60c113", "address": "fa:16:3e:6a:1c:a3", "network": {"id": "414e020d-3fcc-4afd-9fee-be68687a0418", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-184417969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6221165b-f5", "ovs_interfaceid": "6221165b-f588-475c-a3b1-afdf5c60c113", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "62ed8403-ebcd-4e41-ac81-0056cf71738c", "address": "fa:16:3e:9a:78:38", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62ed8403-eb", "ovs_interfaceid": "62ed8403-ebcd-4e41-ac81-0056cf71738c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "63fc17ce-ef08-4f7e-ab83-b1040733d228", "address": "fa:16:3e:92:70:d1", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fc17ce-ef", "ovs_interfaceid": "63fc17ce-ef08-4f7e-ab83-b1040733d228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "969790c1-f8a4-4d98-86d9-1ed932c83daa", "address": "fa:16:3e:6d:21:36", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969790c1-f8", "ovs_interfaceid": "969790c1-f8a4-4d98-86d9-1ed932c83daa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "748e5281-27d7-43b4-ba47-2f0daed1181e", "address": "fa:16:3e:f9:d2:8f", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap748e5281-27", "ovs_interfaceid": "748e5281-27d7-43b4-ba47-2f0daed1181e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d77c2a03-a402-4288-8a40-2f88200a8f22", "address": "fa:16:3e:b2:36:f8", "network": {"id": "f39bd97a-26ce-4373-bf3b-ceb5c8dc21ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-224466528", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd77c2a03-a4", "ovs_interfaceid": "d77c2a03-a402-4288-8a40-2f88200a8f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a64b4a32-73f1-4a48-8b80-86d353d1d40b", "address": "fa:16:3e:be:1c:23", "network": {"id": "f39bd97a-26ce-4373-bf3b-ceb5c8dc21ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-224466528", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64b4a32-73", "ovs_interfaceid": "a64b4a32-73f1-4a48-8b80-86d353d1d40b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:53:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4535144d-ee95-4b34-8b74-0c894cc92a50 req-d1046728-0f5c-4b3b-a4b0-50641bc90e43 service nova] Releasing lock "refresh_cache-8527ae47-a025-492d-9820-b9c5ee309d81" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:53:56 user nova-compute[74348]: DEBUG nova.compute.manager [req-4535144d-ee95-4b34-8b74-0c894cc92a50 req-d1046728-0f5c-4b3b-a4b0-50641bc90e43 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-changed-579fb42b-b8b6-4122-8ec3-8817c9e0881a {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:53:56 user nova-compute[74348]: DEBUG nova.compute.manager [req-4535144d-ee95-4b34-8b74-0c894cc92a50 req-d1046728-0f5c-4b3b-a4b0-50641bc90e43 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Refreshing instance network info cache due to event network-changed-579fb42b-b8b6-4122-8ec3-8817c9e0881a. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:53:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4535144d-ee95-4b34-8b74-0c894cc92a50 req-d1046728-0f5c-4b3b-a4b0-50641bc90e43 service nova] Acquiring lock "refresh_cache-9e2f3a3e-ee9b-4250-8744-5eb7982285f2" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:53:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4535144d-ee95-4b34-8b74-0c894cc92a50 req-d1046728-0f5c-4b3b-a4b0-50641bc90e43 service nova] Acquired lock "refresh_cache-9e2f3a3e-ee9b-4250-8744-5eb7982285f2" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:53:56 user nova-compute[74348]: DEBUG nova.network.neutron [req-4535144d-ee95-4b34-8b74-0c894cc92a50 req-d1046728-0f5c-4b3b-a4b0-50641bc90e43 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Refreshing network info cache for port 579fb42b-b8b6-4122-8ec3-8817c9e0881a {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:53:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c262206e-c07a-4aae-8e78-3e5af4d423ae req-f6d6e847-d641-4a6e-86aa-99af08b65da7 service nova] Acquired lock "refresh_cache-8527ae47-a025-492d-9820-b9c5ee309d81" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:53:56 user nova-compute[74348]: DEBUG nova.network.neutron [req-c262206e-c07a-4aae-8e78-3e5af4d423ae req-f6d6e847-d641-4a6e-86aa-99af08b65da7 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Refreshing network info cache for port a64b4a32-73f1-4a48-8b80-86d353d1d40b {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG nova.compute.manager [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 07:53:57 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Creating image(s)
Nov 22 07:53:57 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Did not create local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Ensure instance console log exists: /opt/stack/data/nova/instances/9e2f3a3e-ee9b-4250-8744-5eb7982285f2/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Start _get_guest_xml network_info=[{"id": "4a8ea7e1-9e80-4686-a3a9-4142b9de0049", "address": "fa:16:3e:7e:13:ad", "network": {"id": "c9f2b2b7-e34f-4891-b68c-786534d7ed95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-766683782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8ea7e1-9e", "ovs_interfaceid": "4a8ea7e1-9e80-4686-a3a9-4142b9de0049", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e30deaf5-1258-4909-bc71-044c88f2995f", "address": "fa:16:3e:c8:34:fc", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30deaf5-12", "ovs_interfaceid": "e30deaf5-1258-4909-bc71-044c88f2995f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "298ce71b-894a-4e29-904e-1ba5d4495fcb", "address": "fa:16:3e:b3:83:8f", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298ce71b-89", "ovs_interfaceid": "298ce71b-894a-4e29-904e-1ba5d4495fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f0f55187-e53f-468d-83a8-cca33ff1380e", "address": "fa:16:3e:8d:36:2e", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f55187-e5", "ovs_interfaceid": "f0f55187-e53f-468d-83a8-cca33ff1380e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5a68d2be-be4c-462b-9dd4-15e222160557", "address": "fa:16:3e:ea:a3:83", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a68d2be-be", "ovs_interfaceid": "5a68d2be-be4c-462b-9dd4-15e222160557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9aa74044-d952-47e5-9cc1-948615a01eb3", "address": "fa:16:3e:6d:8e:f9", "network": {"id": "7f9b7b76-9f0d-4fbd-90c9-6ceee5e0c50e", "bridge": "br-int", "label": "tempest-device-tagging-net2-487890789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aa74044-d9", "ovs_interfaceid": "9aa74044-d952-47e5-9cc1-948615a01eb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "579fb42b-b8b6-4122-8ec3-8817c9e0881a", "address": "fa:16:3e:06:8e:e5", "network": {"id": "7f9b7b76-9f0d-4fbd-90c9-6ceee5e0c50e", "bridge": "br-int", "label": "tempest-device-tagging-net2-487890789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap579fb42b-b8", "ovs_interfaceid": "579fb42b-b8b6-4122-8ec3-8817c9e0881a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gAqQkbdw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9e2f3a3e-ee9b-4250-8744-5eb7982285f2', 'attached_at': '', 'detached_at': '', 'volume_id': 'b19fd726-3664-469a-b6fe-7269b9235cea', 'serial': 'b19fd726-3664-469a-b6fe-7269b9235cea'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '4ae0dd13-ab22-4e18-b55e-1205129d776b', 'volume_type': None}, {'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'grUfbqtL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9e2f3a3e-ee9b-4250-8744-5eb7982285f2', 'attached_at': '', 'detached_at': '', 'volume_id': 'f28856c9-75f8-44e9-b622-fab2df90d65c', 'serial': 'f28856c9-75f8-44e9-b622-fab2df90d65c'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 1, 'attachment_id': '1c7dc158-5175-4504-b462-c14b44fd0736', 'volume_type': None}, {'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lnWwiSfY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9e2f3a3e-ee9b-4250-8744-5eb7982285f2', 'attached_at': '', 'detached_at': '', 'volume_id': 'a27ac02b-fae8-438b-a31e-8683997015c7', 'serial': 'a27ac02b-fae8-438b-a31e-8683997015c7'}, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 2, 'attachment_id': '161b9116-94f1-46df-8b66-8baf064e8114', 'volume_type': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 07:53:57 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:53:57 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:53:57 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gAqQkbdw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:53:57 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:53:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:53:57 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:53:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:53:57 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 07:53:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d15bb3-e379-4f0b-ad33-5693bf6e302d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 07:53:57 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[21526188-e8c6-416c-9b7f-0721c64171da]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea] added
Nov 22 07:53:57 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f133fa-aac2-4efb-a81f-f60929de5733]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ad987d-efcd-4dd9-805e-ec81aeb2fc3e]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gAqQkbdw {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gAqQkbdw" returned: 0 in 0.175s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5490209-2514-477e-aba5-500ae574bd34]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gAqQkbdw'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3beeed-597f-419c-880d-3b94e134c8cf]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6a2613-49f4-43d7-a23c-d4dbe73c29a5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:53:57 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:53:57 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG nova.network.neutron [req-c262206e-c07a-4aae-8e78-3e5af4d423ae req-f6d6e847-d641-4a6e-86aa-99af08b65da7 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Updated VIF entry in instance network info cache for port a64b4a32-73f1-4a48-8b80-86d353d1d40b. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG nova.network.neutron [req-c262206e-c07a-4aae-8e78-3e5af4d423ae req-f6d6e847-d641-4a6e-86aa-99af08b65da7 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Updating instance_info_cache with network_info: [{"id": "6221165b-f588-475c-a3b1-afdf5c60c113", "address": "fa:16:3e:6a:1c:a3", "network": {"id": "414e020d-3fcc-4afd-9fee-be68687a0418", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-184417969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6221165b-f5", "ovs_interfaceid": "6221165b-f588-475c-a3b1-afdf5c60c113", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "62ed8403-ebcd-4e41-ac81-0056cf71738c", "address": "fa:16:3e:9a:78:38", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62ed8403-eb", "ovs_interfaceid": "62ed8403-ebcd-4e41-ac81-0056cf71738c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "63fc17ce-ef08-4f7e-ab83-b1040733d228", "address": "fa:16:3e:92:70:d1", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fc17ce-ef", "ovs_interfaceid": "63fc17ce-ef08-4f7e-ab83-b1040733d228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "969790c1-f8a4-4d98-86d9-1ed932c83daa", "address": "fa:16:3e:6d:21:36", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969790c1-f8", "ovs_interfaceid": "969790c1-f8a4-4d98-86d9-1ed932c83daa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "748e5281-27d7-43b4-ba47-2f0daed1181e", "address": "fa:16:3e:f9:d2:8f", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap748e5281-27", "ovs_interfaceid": "748e5281-27d7-43b4-ba47-2f0daed1181e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d77c2a03-a402-4288-8a40-2f88200a8f22", "address": "fa:16:3e:b2:36:f8", "network": {"id": "f39bd97a-26ce-4373-bf3b-ceb5c8dc21ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-224466528", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd77c2a03-a4", "ovs_interfaceid": "d77c2a03-a402-4288-8a40-2f88200a8f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a64b4a32-73f1-4a48-8b80-86d353d1d40b", "address": "fa:16:3e:be:1c:23", "network": {"id": "f39bd97a-26ce-4373-bf3b-ceb5c8dc21ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-224466528", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64b4a32-73", "ovs_interfaceid": "a64b4a32-73f1-4a48-8b80-86d353d1d40b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG nova.network.neutron [req-4535144d-ee95-4b34-8b74-0c894cc92a50 req-d1046728-0f5c-4b3b-a4b0-50641bc90e43 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Updated VIF entry in instance network info cache for port 579fb42b-b8b6-4122-8ec3-8817c9e0881a. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG nova.network.neutron [req-4535144d-ee95-4b34-8b74-0c894cc92a50 req-d1046728-0f5c-4b3b-a4b0-50641bc90e43 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Updating instance_info_cache with network_info: [{"id": "4a8ea7e1-9e80-4686-a3a9-4142b9de0049", "address": "fa:16:3e:7e:13:ad", "network": {"id": "c9f2b2b7-e34f-4891-b68c-786534d7ed95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-766683782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8ea7e1-9e", "ovs_interfaceid": "4a8ea7e1-9e80-4686-a3a9-4142b9de0049", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e30deaf5-1258-4909-bc71-044c88f2995f", "address": "fa:16:3e:c8:34:fc", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30deaf5-12", "ovs_interfaceid": "e30deaf5-1258-4909-bc71-044c88f2995f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "298ce71b-894a-4e29-904e-1ba5d4495fcb", "address": "fa:16:3e:b3:83:8f", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298ce71b-89", "ovs_interfaceid": "298ce71b-894a-4e29-904e-1ba5d4495fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f0f55187-e53f-468d-83a8-cca33ff1380e", "address": "fa:16:3e:8d:36:2e", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f55187-e5", "ovs_interfaceid": "f0f55187-e53f-468d-83a8-cca33ff1380e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5a68d2be-be4c-462b-9dd4-15e222160557", "address": "fa:16:3e:ea:a3:83", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a68d2be-be", "ovs_interfaceid": "5a68d2be-be4c-462b-9dd4-15e222160557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9aa74044-d952-47e5-9cc1-948615a01eb3", "address": "fa:16:3e:6d:8e:f9", "network": {"id": "7f9b7b76-9f0d-4fbd-90c9-6ceee5e0c50e", "bridge": "br-int", "label": "tempest-device-tagging-net2-487890789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aa74044-d9", "ovs_interfaceid": "9aa74044-d952-47e5-9cc1-948615a01eb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "579fb42b-b8b6-4122-8ec3-8817c9e0881a", "address": "fa:16:3e:06:8e:e5", "network": {"id": "7f9b7b76-9f0d-4fbd-90c9-6ceee5e0c50e", "bridge": "br-int", "label": "tempest-device-tagging-net2-487890789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap579fb42b-b8", "ovs_interfaceid": "579fb42b-b8b6-4122-8ec3-8817c9e0881a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e768918e-c1e2-4e14-accc-c1d6152efba2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea, portal: 172.16.0.220,3260]
Nov 22 07:53:57 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea, portal: 172.16.0.220,3260] successful.
Nov 22 07:53:57 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4535144d-ee95-4b34-8b74-0c894cc92a50 req-d1046728-0f5c-4b3b-a4b0-50641bc90e43 service nova] Releasing lock "refresh_cache-9e2f3a3e-ee9b-4250-8744-5eb7982285f2" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG nova.compute.manager [req-4535144d-ee95-4b34-8b74-0c894cc92a50 req-d1046728-0f5c-4b3b-a4b0-50641bc90e43 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-changed-748e5281-27d7-43b4-ba47-2f0daed1181e {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG nova.compute.manager [req-4535144d-ee95-4b34-8b74-0c894cc92a50 req-d1046728-0f5c-4b3b-a4b0-50641bc90e43 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Refreshing instance network info cache due to event network-changed-748e5281-27d7-43b4-ba47-2f0daed1181e. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4535144d-ee95-4b34-8b74-0c894cc92a50 req-d1046728-0f5c-4b3b-a4b0-50641bc90e43 service nova] Acquiring lock "refresh_cache-8527ae47-a025-492d-9820-b9c5ee309d81" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c262206e-c07a-4aae-8e78-3e5af4d423ae req-f6d6e847-d641-4a6e-86aa-99af08b65da7 service nova] Releasing lock "refresh_cache-8527ae47-a025-492d-9820-b9c5ee309d81" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4535144d-ee95-4b34-8b74-0c894cc92a50 req-d1046728-0f5c-4b3b-a4b0-50641bc90e43 service nova] Acquired lock "refresh_cache-8527ae47-a025-492d-9820-b9c5ee309d81" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG nova.network.neutron [req-4535144d-ee95-4b34-8b74-0c894cc92a50 req-d1046728-0f5c-4b3b-a4b0-50641bc90e43 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Refreshing network info cache for port 748e5281-27d7-43b4-ba47-2f0daed1181e {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[35657b46-99f7-4fe3-8cd4-935f7aecec48]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef5347d-7a3e-49fd-920b-42a12c2a9e4c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:53:57 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:53:57 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:53:57 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:53:57 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.436s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dae386a-63f0-48dc-83bb-efa990b44472]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 07:53:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gAqQkbdw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 07:53:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:53:58 user nova-compute[74348]: DEBUG nova.network.neutron [req-4535144d-ee95-4b34-8b74-0c894cc92a50 req-d1046728-0f5c-4b3b-a4b0-50641bc90e43 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Updated VIF entry in instance network info cache for port 748e5281-27d7-43b4-ba47-2f0daed1181e. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 07:53:58 user nova-compute[74348]: DEBUG nova.network.neutron [req-4535144d-ee95-4b34-8b74-0c894cc92a50 req-d1046728-0f5c-4b3b-a4b0-50641bc90e43 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Updating instance_info_cache with network_info: [{"id": "6221165b-f588-475c-a3b1-afdf5c60c113", "address": "fa:16:3e:6a:1c:a3", "network": {"id": "414e020d-3fcc-4afd-9fee-be68687a0418", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-184417969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6221165b-f5", "ovs_interfaceid": "6221165b-f588-475c-a3b1-afdf5c60c113", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "62ed8403-ebcd-4e41-ac81-0056cf71738c", "address": "fa:16:3e:9a:78:38", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62ed8403-eb", "ovs_interfaceid": "62ed8403-ebcd-4e41-ac81-0056cf71738c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "63fc17ce-ef08-4f7e-ab83-b1040733d228", "address": "fa:16:3e:92:70:d1", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fc17ce-ef", "ovs_interfaceid": "63fc17ce-ef08-4f7e-ab83-b1040733d228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "969790c1-f8a4-4d98-86d9-1ed932c83daa", "address": "fa:16:3e:6d:21:36", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969790c1-f8", "ovs_interfaceid": "969790c1-f8a4-4d98-86d9-1ed932c83daa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "748e5281-27d7-43b4-ba47-2f0daed1181e", "address": "fa:16:3e:f9:d2:8f", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap748e5281-27", "ovs_interfaceid": "748e5281-27d7-43b4-ba47-2f0daed1181e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d77c2a03-a402-4288-8a40-2f88200a8f22", "address": "fa:16:3e:b2:36:f8", "network": {"id": "f39bd97a-26ce-4373-bf3b-ceb5c8dc21ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-224466528", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd77c2a03-a4", "ovs_interfaceid": "d77c2a03-a402-4288-8a40-2f88200a8f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a64b4a32-73f1-4a48-8b80-86d353d1d40b", "address": "fa:16:3e:be:1c:23", "network": {"id": "f39bd97a-26ce-4373-bf3b-ceb5c8dc21ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-224466528", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64b4a32-73", "ovs_interfaceid": "a64b4a32-73f1-4a48-8b80-86d353d1d40b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:53:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4535144d-ee95-4b34-8b74-0c894cc92a50 req-d1046728-0f5c-4b3b-a4b0-50641bc90e43 service nova] Releasing lock "refresh_cache-8527ae47-a025-492d-9820-b9c5ee309d81" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:53:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.469s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:53:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] <== connect_volume: return (1471ms) {'type': 'block', 'scsi_wwn': '26130306162366632', 'path': '/dev/sdc'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:53:58 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130306162366632', 'path': '/dev/sdc'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 07:53:58 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 07:53:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'grUfbqtL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:53:58 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:53:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:53:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:53:58 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:53:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:53:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:53:58 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 07:53:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:58 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff2fbff-ed1b-4318-ae19-38dcacebb897]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 07:53:58 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:53:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b612d0c-b45b-4a1c-9a5b-b2b463c57700]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c] added
Nov 22 07:53:59 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac5be42-b926-4cd2-9416-c12082b3ee2e]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8dccb2-475f-4d50-93ec-30d56ad9232c]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v grUfbqtL {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v grUfbqtL" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e30edff-cd39-4814-b78a-463824a6d171]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'grUfbqtL'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fed557-c225-4665-b39f-d04c61c729a0]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b033594-c9b9-4443-82d5-cb03fe6a97d3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:53:59 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:53:59 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:53:59 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:53:59 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e64d8f-8022-4caa-900b-6fa1ed899486]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c, portal: 172.16.0.220,3260]
Nov 22 07:53:59 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c, portal: 172.16.0.220,3260] successful.
Nov 22 07:53:59 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d803775c-178e-45ac-a9ac-7e1aa221f46e]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9fc307-4e64-43df-b976-7d7e088d8804]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:53:59 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:53:59 user nova-compute[74348]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)
Nov 22 07:53:59 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:53:59 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:53:59 user nova-compute[74348]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)
Nov 22 07:53:59 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5bb545-f9f2-4c08-b213-a2c4fe56c23c]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'grUfbqtL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG nova.compute.manager [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 07:53:59 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Creating image(s)
Nov 22 07:53:59 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Did not create local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Ensure instance console log exists: /opt/stack/data/nova/instances/8527ae47-a025-492d-9820-b9c5ee309d81/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Start _get_guest_xml network_info=[{"id": "6221165b-f588-475c-a3b1-afdf5c60c113", "address": "fa:16:3e:6a:1c:a3", "network": {"id": "414e020d-3fcc-4afd-9fee-be68687a0418", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-184417969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6221165b-f5", "ovs_interfaceid": "6221165b-f588-475c-a3b1-afdf5c60c113", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "62ed8403-ebcd-4e41-ac81-0056cf71738c", "address": "fa:16:3e:9a:78:38", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62ed8403-eb", "ovs_interfaceid": "62ed8403-ebcd-4e41-ac81-0056cf71738c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "63fc17ce-ef08-4f7e-ab83-b1040733d228", "address": "fa:16:3e:92:70:d1", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fc17ce-ef", "ovs_interfaceid": "63fc17ce-ef08-4f7e-ab83-b1040733d228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "969790c1-f8a4-4d98-86d9-1ed932c83daa", "address": "fa:16:3e:6d:21:36", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969790c1-f8", "ovs_interfaceid": "969790c1-f8a4-4d98-86d9-1ed932c83daa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "748e5281-27d7-43b4-ba47-2f0daed1181e", "address": "fa:16:3e:f9:d2:8f", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap748e5281-27", "ovs_interfaceid": "748e5281-27d7-43b4-ba47-2f0daed1181e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d77c2a03-a402-4288-8a40-2f88200a8f22", "address": "fa:16:3e:b2:36:f8", "network": {"id": "f39bd97a-26ce-4373-bf3b-ceb5c8dc21ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-224466528", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd77c2a03-a4", "ovs_interfaceid": "d77c2a03-a402-4288-8a40-2f88200a8f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a64b4a32-73f1-4a48-8b80-86d353d1d40b", "address": "fa:16:3e:be:1c:23", "network": {"id": "f39bd97a-26ce-4373-bf3b-ceb5c8dc21ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-224466528", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64b4a32-73", "ovs_interfaceid": "a64b4a32-73f1-4a48-8b80-86d353d1d40b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sNkymoHE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8527ae47-a025-492d-9820-b9c5ee309d81', 'attached_at': '', 'detached_at': '', 'volume_id': 'd7d26d2e-5794-43e8-b642-76b54ab2e6f5', 'serial': 'd7d26d2e-5794-43e8-b642-76b54ab2e6f5'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'da91a701-d2f8-4b5d-bbe9-ef4d0dbf22d5', 'volume_type': None}, {'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WPGKRcyT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8527ae47-a025-492d-9820-b9c5ee309d81', 'attached_at': '', 'detached_at': '', 'volume_id': '2b5f5253-e3b6-4ba1-b9e7-df518d4ad054', 'serial': '2b5f5253-e3b6-4ba1-b9e7-df518d4ad054'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 1, 'attachment_id': 'b83ee2e5-56a2-4870-a473-18b43a650ba3', 'volume_type': None}, {'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ptBeJEUv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8527ae47-a025-492d-9820-b9c5ee309d81', 'attached_at': '', 'detached_at': '', 'volume_id': 'fe1c9310-8a44-4188-8500-088ec8cd7799', 'serial': 'fe1c9310-8a44-4188-8500-088ec8cd7799'}, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 2, 'attachment_id': '0cb4591e-230c-4fe9-898a-f45771c1ddc2', 'volume_type': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 07:53:59 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:53:59 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:53:59 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 07:53:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sNkymoHE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:53:59 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:53:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23236376433626537', 'path': '/dev/sdd'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236376433626537', 'path': '/dev/sdd'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.807s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:54:00 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:54:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:54:00 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 07:54:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e7aa5f-d1cc-48c5-90b0-979ab57e2b86]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 07:54:00 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lnWwiSfY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:54:00 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:54:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6aedbc-0bcc-4ffb-93b3-aefc2ce3c6bf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5] added
Nov 22 07:54:00 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfac1911-7707-4d28-966b-a0e69456b2af]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7fd6b73-9ddf-4993-a8d5-72d2fb3bccb7]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sNkymoHE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sNkymoHE" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a969a0-ebd5-4179-bfd0-292defc79cec]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sNkymoHE'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fae698a-757e-4d57-889d-cc17bb1ef9fd]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3faa707c-b15b-4b10-acab-a4a342335439]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:54:00 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:54:00 user nova-compute[74348]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)
Nov 22 07:54:00 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:54:00 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:54:00 user nova-compute[74348]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)
Nov 22 07:54:00 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a28af1-54c1-406d-a7d8-2f0b9d4cfd0f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5, portal: 172.16.0.220,3260]
Nov 22 07:54:00 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5, portal: 172.16.0.220,3260] successful.
Nov 22 07:54:00 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3962c5-5fcb-4ba2-9a68-10f491394eab]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b9918a-efbc-4ba3-970d-23b5065f90dc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:54:00 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:54:00 user nova-compute[74348]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)
Nov 22 07:54:00 user nova-compute[74348]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)
Nov 22 07:54:00 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:54:00 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:54:00 user nova-compute[74348]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)
Nov 22 07:54:00 user nova-compute[74348]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)
Nov 22 07:54:00 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48e19ef-6432-41d1-a713-6d7d9b2ec523]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sNkymoHE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 07:54:00 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] <== connect_volume: return (2108ms) {'type': 'block', 'scsi_wwn': '23730663962303264', 'path': '/dev/sde'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730663962303264', 'path': '/dev/sde'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.272s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:54:01 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:54:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:54:01 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 07:54:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[600b3a4d-f8ca-4847-a161-6239ce027d1f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 07:54:01 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WPGKRcyT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:54:01 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:54:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f7ad50-2733-419c-a90b-aee7281bd1af]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7] added
Nov 22 07:54:01 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[313ec095-681b-49e4-902e-6ccbbeaf0b95]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d9a454-d2e1-4942-87cb-ea89d8065ec9]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lnWwiSfY {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lnWwiSfY" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b80c0f-f126-4e52-be8f-94710bd0e93b]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lnWwiSfY'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df74423-03c0-4a52-ba13-dc2f4d4e1037]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[44bca254-c48b-4a8f-80b9-bbb8ccd91b1d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:54:01 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:54:01 user nova-compute[74348]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)
Nov 22 07:54:01 user nova-compute[74348]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)
Nov 22 07:54:01 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:54:01 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:54:01 user nova-compute[74348]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)
Nov 22 07:54:01 user nova-compute[74348]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)
Nov 22 07:54:01 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9937ac3f-95c3-4f88-8d0f-e7552b33282d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7, portal: 172.16.0.220,3260]
Nov 22 07:54:01 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7, portal: 172.16.0.220,3260] successful.
Nov 22 07:54:01 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0864c82-ce7f-4ae9-bd9c-1ae928e6c363]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4b3879-ef36-4137-a81c-0b89df05b363]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:54:01 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:54:01 user nova-compute[74348]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)
Nov 22 07:54:01 user nova-compute[74348]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)
Nov 22 07:54:01 user nova-compute[74348]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)
Nov 22 07:54:01 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:54:01 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:54:01 user nova-compute[74348]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)
Nov 22 07:54:01 user nova-compute[74348]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)
Nov 22 07:54:01 user nova-compute[74348]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)
Nov 22 07:54:01 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ed4bac-90ef-460e-b5e7-5c11dd664545]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 07:54:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lnWwiSfY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 07:54:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:54:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] <== connect_volume: return (2633ms) {'type': 'block', 'scsi_wwn': '26561346239333430', 'path': '/dev/sdf'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:54:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561346239333430', 'path': '/dev/sdf'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 07:54:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.323s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:54:02 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:54:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:54:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:54:02 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 07:54:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:02 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b47635-3b05-4f5e-87fa-f44cca3c2608]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 07:54:02 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:54:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2036316503',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2036316503',id=11,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnzYYP3Ptdmty3Rvwlh9fqssqqfrkRsWiJRiTKv6iY6VU5FnFmpw0lxwm8OKyeaQHOy3kJ8p8VF2y7jVGbQU/CO6Efmk0az16dQ9hu0FyN5s6f1p9PgD9PdzeRpGGp4hw==',key_name='tempest-keypair-342579863',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8d9889b4c704e2c9370420262898383',ramdisk_id='',reservation_id='r-8fge7g0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1369728832',owner_user_name='tempest-TaggedBootDevicesTest_v242-1369728832-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:53:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd846d2c399e47db9dbd74e4beaeb0f4',uuid=9e2f3a3e-ee9b-4250-8744-5eb7982285f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a8ea7e1-9e80-4686-a3a9-4142b9de0049", "address": "fa:16:3e:7e:13:ad", "network": {"id": "c9f2b2b7-e34f-4891-b68c-786534d7ed95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-766683782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8ea7e1-9e", "ovs_interfaceid": "4a8ea7e1-9e80-4686-a3a9-4142b9de0049", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 07:54:02 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Converting VIF {"id": "4a8ea7e1-9e80-4686-a3a9-4142b9de0049", "address": "fa:16:3e:7e:13:ad", "network": {"id": "c9f2b2b7-e34f-4891-b68c-786534d7ed95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-766683782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8ea7e1-9e", "ovs_interfaceid": "4a8ea7e1-9e80-4686-a3a9-4142b9de0049", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:54:02 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:13:ad,bridge_name='br-int',has_traffic_filtering=True,id=4a8ea7e1-9e80-4686-a3a9-4142b9de0049,network=Network(c9f2b2b7-e34f-4891-b68c-786534d7ed95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a8ea7e1-9e') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:54:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2036316503',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2036316503',id=11,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnzYYP3Ptdmty3Rvwlh9fqssqqfrkRsWiJRiTKv6iY6VU5FnFmpw0lxwm8OKyeaQHOy3kJ8p8VF2y7jVGbQU/CO6Efmk0az16dQ9hu0FyN5s6f1p9PgD9PdzeRpGGp4hw==',key_name='tempest-keypair-342579863',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8d9889b4c704e2c9370420262898383',ramdisk_id='',reservation_id='r-8fge7g0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1369728832',owner_user_name='tempest-TaggedBootDevicesTest_v242-1369728832-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:53:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd846d2c399e47db9dbd74e4beaeb0f4',uuid=9e2f3a3e-ee9b-4250-8744-5eb7982285f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e30deaf5-1258-4909-bc71-044c88f2995f", "address": "fa:16:3e:c8:34:fc", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30deaf5-12", "ovs_interfaceid": "e30deaf5-1258-4909-bc71-044c88f2995f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 07:54:02 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Converting VIF {"id": "e30deaf5-1258-4909-bc71-044c88f2995f", "address": "fa:16:3e:c8:34:fc", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30deaf5-12", "ovs_interfaceid": "e30deaf5-1258-4909-bc71-044c88f2995f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:54:02 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:34:fc,bridge_name='br-int',has_traffic_filtering=True,id=e30deaf5-1258-4909-bc71-044c88f2995f,network=Network(fc6897f6-ca20-4f4e-9e55-a61241ccd39f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape30deaf5-12') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:54:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2036316503',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2036316503',id=11,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnzYYP3Ptdmty3Rvwlh9fqssqqfrkRsWiJRiTKv6iY6VU5FnFmpw0lxwm8OKyeaQHOy3kJ8p8VF2y7jVGbQU/CO6Efmk0az16dQ9hu0FyN5s6f1p9PgD9PdzeRpGGp4hw==',key_name='tempest-keypair-342579863',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8d9889b4c704e2c9370420262898383',ramdisk_id='',reservation_id='r-8fge7g0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1369728832',owner_user_name='tempest-TaggedBootDevicesTest_v242-1369728832-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:53:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd846d2c399e47db9dbd74e4beaeb0f4',uuid=9e2f3a3e-ee9b-4250-8744-5eb7982285f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "298ce71b-894a-4e29-904e-1ba5d4495fcb", "address": "fa:16:3e:b3:83:8f", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298ce71b-89", "ovs_interfaceid": "298ce71b-894a-4e29-904e-1ba5d4495fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 07:54:02 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Converting VIF {"id": "298ce71b-894a-4e29-904e-1ba5d4495fcb", "address": "fa:16:3e:b3:83:8f", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298ce71b-89", "ovs_interfaceid": "298ce71b-894a-4e29-904e-1ba5d4495fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:54:02 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:83:8f,bridge_name='br-int',has_traffic_filtering=True,id=298ce71b-894a-4e29-904e-1ba5d4495fcb,network=Network(fc6897f6-ca20-4f4e-9e55-a61241ccd39f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap298ce71b-89') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:54:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2036316503',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2036316503',id=11,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnzYYP3Ptdmty3Rvwlh9fqssqqfrkRsWiJRiTKv6iY6VU5FnFmpw0lxwm8OKyeaQHOy3kJ8p8VF2y7jVGbQU/CO6Efmk0az16dQ9hu0FyN5s6f1p9PgD9PdzeRpGGp4hw==',key_name='tempest-keypair-342579863',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8d9889b4c704e2c9370420262898383',ramdisk_id='',reservation_id='r-8fge7g0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1369728832',owner_user_name='tempest-TaggedBootDevicesTest_v242-1369728832-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:53:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd846d2c399e47db9dbd74e4beaeb0f4',uuid=9e2f3a3e-ee9b-4250-8744-5eb7982285f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0f55187-e53f-468d-83a8-cca33ff1380e", "address": "fa:16:3e:8d:36:2e", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f55187-e5", "ovs_interfaceid": "f0f55187-e53f-468d-83a8-cca33ff1380e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 07:54:02 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Converting VIF {"id": "f0f55187-e53f-468d-83a8-cca33ff1380e", "address": "fa:16:3e:8d:36:2e", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f55187-e5", "ovs_interfaceid": "f0f55187-e53f-468d-83a8-cca33ff1380e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:54:02 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:36:2e,bridge_name='br-int',has_traffic_filtering=True,id=f0f55187-e53f-468d-83a8-cca33ff1380e,network=Network(fc6897f6-ca20-4f4e-9e55-a61241ccd39f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0f55187-e5') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:54:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2036316503',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2036316503',id=11,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnzYYP3Ptdmty3Rvwlh9fqssqqfrkRsWiJRiTKv6iY6VU5FnFmpw0lxwm8OKyeaQHOy3kJ8p8VF2y7jVGbQU/CO6Efmk0az16dQ9hu0FyN5s6f1p9PgD9PdzeRpGGp4hw==',key_name='tempest-keypair-342579863',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8d9889b4c704e2c9370420262898383',ramdisk_id='',reservation_id='r-8fge7g0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1369728832',owner_user_name='tempest-TaggedBootDevicesTest_v242-1369728832-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:53:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd846d2c399e47db9dbd74e4beaeb0f4',uuid=9e2f3a3e-ee9b-4250-8744-5eb7982285f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a68d2be-be4c-462b-9dd4-15e222160557", "address": "fa:16:3e:ea:a3:83", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a68d2be-be", "ovs_interfaceid": "5a68d2be-be4c-462b-9dd4-15e222160557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 07:54:02 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Converting VIF {"id": "5a68d2be-be4c-462b-9dd4-15e222160557", "address": "fa:16:3e:ea:a3:83", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a68d2be-be", "ovs_interfaceid": "5a68d2be-be4c-462b-9dd4-15e222160557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:54:02 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a3:83,bridge_name='br-int',has_traffic_filtering=True,id=5a68d2be-be4c-462b-9dd4-15e222160557,network=Network(fc6897f6-ca20-4f4e-9e55-a61241ccd39f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a68d2be-be') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:54:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2036316503',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2036316503',id=11,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnzYYP3Ptdmty3Rvwlh9fqssqqfrkRsWiJRiTKv6iY6VU5FnFmpw0lxwm8OKyeaQHOy3kJ8p8VF2y7jVGbQU/CO6Efmk0az16dQ9hu0FyN5s6f1p9PgD9PdzeRpGGp4hw==',key_name='tempest-keypair-342579863',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8d9889b4c704e2c9370420262898383',ramdisk_id='',reservation_id='r-8fge7g0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1369728832',owner_user_name='tempest-TaggedBootDevicesTest_v242-1369728832-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:53:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd846d2c399e47db9dbd74e4beaeb0f4',uuid=9e2f3a3e-ee9b-4250-8744-5eb7982285f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9aa74044-d952-47e5-9cc1-948615a01eb3", "address": "fa:16:3e:6d:8e:f9", "network": {"id": "7f9b7b76-9f0d-4fbd-90c9-6ceee5e0c50e", "bridge": "br-int", "label": "tempest-device-tagging-net2-487890789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aa74044-d9", "ovs_interfaceid": "9aa74044-d952-47e5-9cc1-948615a01eb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 07:54:02 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Converting VIF {"id": "9aa74044-d952-47e5-9cc1-948615a01eb3", "address": "fa:16:3e:6d:8e:f9", "network": {"id": "7f9b7b76-9f0d-4fbd-90c9-6ceee5e0c50e", "bridge": "br-int", "label": "tempest-device-tagging-net2-487890789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aa74044-d9", "ovs_interfaceid": "9aa74044-d952-47e5-9cc1-948615a01eb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:54:02 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:8e:f9,bridge_name='br-int',has_traffic_filtering=True,id=9aa74044-d952-47e5-9cc1-948615a01eb3,network=Network(7f9b7b76-9f0d-4fbd-90c9-6ceee5e0c50e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aa74044-d9') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:54:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2036316503',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2036316503',id=11,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnzYYP3Ptdmty3Rvwlh9fqssqqfrkRsWiJRiTKv6iY6VU5FnFmpw0lxwm8OKyeaQHOy3kJ8p8VF2y7jVGbQU/CO6Efmk0az16dQ9hu0FyN5s6f1p9PgD9PdzeRpGGp4hw==',key_name='tempest-keypair-342579863',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8d9889b4c704e2c9370420262898383',ramdisk_id='',reservation_id='r-8fge7g0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1369728832',owner_user_name='tempest-TaggedBootDevicesTest_v242-1369728832-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:53:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd846d2c399e47db9dbd74e4beaeb0f4',uuid=9e2f3a3e-ee9b-4250-8744-5eb7982285f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "579fb42b-b8b6-4122-8ec3-8817c9e0881a", "address": "fa:16:3e:06:8e:e5", "network": {"id": "7f9b7b76-9f0d-4fbd-90c9-6ceee5e0c50e", "bridge": "br-int", "label": "tempest-device-tagging-net2-487890789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap579fb42b-b8", "ovs_interfaceid": "579fb42b-b8b6-4122-8ec3-8817c9e0881a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 07:54:02 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Converting VIF {"id": "579fb42b-b8b6-4122-8ec3-8817c9e0881a", "address": "fa:16:3e:06:8e:e5", "network": {"id": "7f9b7b76-9f0d-4fbd-90c9-6ceee5e0c50e", "bridge": "br-int", "label": "tempest-device-tagging-net2-487890789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap579fb42b-b8", "ovs_interfaceid": "579fb42b-b8b6-4122-8ec3-8817c9e0881a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:54:02 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:8e:e5,bridge_name='br-int',has_traffic_filtering=True,id=579fb42b-b8b6-4122-8ec3-8817c9e0881a,network=Network(7f9b7b76-9f0d-4fbd-90c9-6ceee5e0c50e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap579fb42b-b8') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:54:02 user nova-compute[74348]: DEBUG nova.objects.instance [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e2f3a3e-ee9b-4250-8744-5eb7982285f2 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:54:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:02 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85d811b-3b5f-4144-9d72-d4c20d0c4cd0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054] added
Nov 22 07:54:02 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:54:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] End _get_guest_xml xml=<domain type="kvm">
Nov 22 07:54:02 user nova-compute[74348]:   <uuid>9e2f3a3e-ee9b-4250-8744-5eb7982285f2</uuid>
Nov 22 07:54:02 user nova-compute[74348]:   <name>instance-0000000b</name>
Nov 22 07:54:02 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 07:54:02 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 07:54:02 user nova-compute[74348]:   <metadata>
Nov 22 07:54:02 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 07:54:02 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 07:54:02 user nova-compute[74348]:       <nova:name>tempest-device-tagging-server-2036316503</nova:name>
Nov 22 07:54:02 user nova-compute[74348]:       <nova:creationTime>2023-11-22 07:53:57</nova:creationTime>
Nov 22 07:54:02 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 07:54:02 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 07:54:02 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 07:54:02 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 07:54:02 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 07:54:02 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 07:54:02 user nova-compute[74348]:       </nova:flavor>
Nov 22 07:54:02 user nova-compute[74348]:       <nova:owner>
Nov 22 07:54:02 user nova-compute[74348]:         <nova:user uuid="bd846d2c399e47db9dbd74e4beaeb0f4">tempest-TaggedBootDevicesTest_v242-1369728832-project-member</nova:user>
Nov 22 07:54:02 user nova-compute[74348]:         <nova:project uuid="c8d9889b4c704e2c9370420262898383">tempest-TaggedBootDevicesTest_v242-1369728832</nova:project>
Nov 22 07:54:02 user nova-compute[74348]:       </nova:owner>
Nov 22 07:54:02 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 07:54:02 user nova-compute[74348]:       <nova:ports>
Nov 22 07:54:02 user nova-compute[74348]:         <nova:port uuid="4a8ea7e1-9e80-4686-a3a9-4142b9de0049">
Nov 22 07:54:02 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 22 07:54:02 user nova-compute[74348]:         </nova:port>
Nov 22 07:54:02 user nova-compute[74348]:         <nova:port uuid="e30deaf5-1258-4909-bc71-044c88f2995f">
Nov 22 07:54:02 user nova-compute[74348]:           <nova:ip type="fixed" address="10.1.1.215" ipVersion="4"/>
Nov 22 07:54:02 user nova-compute[74348]:         </nova:port>
Nov 22 07:54:02 user nova-compute[74348]:         <nova:port uuid="298ce71b-894a-4e29-904e-1ba5d4495fcb">
Nov 22 07:54:02 user nova-compute[74348]:           <nova:ip type="fixed" address="10.1.1.129" ipVersion="4"/>
Nov 22 07:54:02 user nova-compute[74348]:         </nova:port>
Nov 22 07:54:02 user nova-compute[74348]:         <nova:port uuid="f0f55187-e53f-468d-83a8-cca33ff1380e">
Nov 22 07:54:02 user nova-compute[74348]:           <nova:ip type="fixed" address="10.1.1.238" ipVersion="4"/>
Nov 22 07:54:02 user nova-compute[74348]:         </nova:port>
Nov 22 07:54:02 user nova-compute[74348]:         <nova:port uuid="5a68d2be-be4c-462b-9dd4-15e222160557">
Nov 22 07:54:02 user nova-compute[74348]:           <nova:ip type="fixed" address="10.1.1.204" ipVersion="4"/>
Nov 22 07:54:02 user nova-compute[74348]:         </nova:port>
Nov 22 07:54:02 user nova-compute[74348]:         <nova:port uuid="9aa74044-d952-47e5-9cc1-948615a01eb3">
Nov 22 07:54:02 user nova-compute[74348]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 22 07:54:02 user nova-compute[74348]:         </nova:port>
Nov 22 07:54:02 user nova-compute[74348]:         <nova:port uuid="579fb42b-b8b6-4122-8ec3-8817c9e0881a">
Nov 22 07:54:02 user nova-compute[74348]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 22 07:54:02 user nova-compute[74348]:         </nova:port>
Nov 22 07:54:02 user nova-compute[74348]:       </nova:ports>
Nov 22 07:54:02 user nova-compute[74348]:     </nova:instance>
Nov 22 07:54:02 user nova-compute[74348]:   </metadata>
Nov 22 07:54:02 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 07:54:02 user nova-compute[74348]:     <system>
Nov 22 07:54:02 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 07:54:02 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 07:54:02 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 07:54:02 user nova-compute[74348]:       <entry name="serial">9e2f3a3e-ee9b-4250-8744-5eb7982285f2</entry>
Nov 22 07:54:02 user nova-compute[74348]:       <entry name="uuid">9e2f3a3e-ee9b-4250-8744-5eb7982285f2</entry>
Nov 22 07:54:02 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 07:54:02 user nova-compute[74348]:     </system>
Nov 22 07:54:02 user nova-compute[74348]:   </sysinfo>
Nov 22 07:54:02 user nova-compute[74348]:   <os>
Nov 22 07:54:02 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 07:54:02 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 07:54:02 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 07:54:02 user nova-compute[74348]:   </os>
Nov 22 07:54:02 user nova-compute[74348]:   <features>
Nov 22 07:54:02 user nova-compute[74348]:     <acpi/>
Nov 22 07:54:02 user nova-compute[74348]:     <apic/>
Nov 22 07:54:02 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 07:54:02 user nova-compute[74348]:   </features>
Nov 22 07:54:02 user nova-compute[74348]:   <clock offset="utc">
Nov 22 07:54:02 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 07:54:02 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 07:54:02 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 07:54:02 user nova-compute[74348]:   </clock>
Nov 22 07:54:02 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 07:54:02 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 07:54:02 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 07:54:02 user nova-compute[74348]:   </cpu>
Nov 22 07:54:02 user nova-compute[74348]:   <devices>
Nov 22 07:54:02 user nova-compute[74348]:     <disk type="file" device="cdrom">
Nov 22 07:54:02 user nova-compute[74348]:       <driver name="qemu" type="raw" cache="none"/>
Nov 22 07:54:02 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/9e2f3a3e-ee9b-4250-8744-5eb7982285f2/disk.config"/>
Nov 22 07:54:02 user nova-compute[74348]:       <target dev="hda" bus="ide"/>
Nov 22 07:54:02 user nova-compute[74348]:     </disk>
Nov 22 07:54:02 user nova-compute[74348]:     <disk type="block" device="disk">
Nov 22 07:54:02 user nova-compute[74348]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 07:54:02 user nova-compute[74348]:       <source dev="/dev/sdc"/>
Nov 22 07:54:02 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 07:54:02 user nova-compute[74348]:       <serial>b19fd726-3664-469a-b6fe-7269b9235cea</serial>
Nov 22 07:54:02 user nova-compute[74348]:     </disk>
Nov 22 07:54:02 user nova-compute[74348]:     <disk type="block" device="disk">
Nov 22 07:54:02 user nova-compute[74348]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 07:54:02 user nova-compute[74348]:       <source dev="/dev/sdd"/>
Nov 22 07:54:02 user nova-compute[74348]:       <target dev="vdb" bus="virtio"/>
Nov 22 07:54:02 user nova-compute[74348]:       <serial>f28856c9-75f8-44e9-b622-fab2df90d65c</serial>
Nov 22 07:54:02 user nova-compute[74348]:     </disk>
Nov 22 07:54:02 user nova-compute[74348]:     <disk type="block" device="disk">
Nov 22 07:54:02 user nova-compute[74348]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 07:54:02 user nova-compute[74348]:       <source dev="/dev/sdf"/>
Nov 22 07:54:02 user nova-compute[74348]:       <target dev="vdc" bus="virtio"/>
Nov 22 07:54:02 user nova-compute[74348]:       <serial>a27ac02b-fae8-438b-a31e-8683997015c7</serial>
Nov 22 07:54:02 user nova-compute[74348]:     </disk>
Nov 22 07:54:02 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 07:54:02 user nova-compute[74348]:       <mac address="fa:16:3e:7e:13:ad"/>
Nov 22 07:54:02 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:54:02 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 07:54:02 user nova-compute[74348]:       <target dev="tap4a8ea7e1-9e"/>
Nov 22 07:54:02 user nova-compute[74348]:     </interface>
Nov 22 07:54:02 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 07:54:02 user nova-compute[74348]:       <mac address="fa:16:3e:c8:34:fc"/>
Nov 22 07:54:02 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:54:02 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 07:54:02 user nova-compute[74348]:       <target dev="tape30deaf5-12"/>
Nov 22 07:54:02 user nova-compute[74348]:     </interface>
Nov 22 07:54:02 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 07:54:02 user nova-compute[74348]:       <mac address="fa:16:3e:b3:83:8f"/>
Nov 22 07:54:02 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:54:02 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 07:54:02 user nova-compute[74348]:       <target dev="tap298ce71b-89"/>
Nov 22 07:54:02 user nova-compute[74348]:     </interface>
Nov 22 07:54:02 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 07:54:02 user nova-compute[74348]:       <mac address="fa:16:3e:8d:36:2e"/>
Nov 22 07:54:02 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:54:02 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 07:54:02 user nova-compute[74348]:       <target dev="tapf0f55187-e5"/>
Nov 22 07:54:02 user nova-compute[74348]:     </interface>
Nov 22 07:54:02 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 07:54:02 user nova-compute[74348]:       <mac address="fa:16:3e:ea:a3:83"/>
Nov 22 07:54:02 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:54:02 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 07:54:02 user nova-compute[74348]:       <target dev="tap5a68d2be-be"/>
Nov 22 07:54:02 user nova-compute[74348]:     </interface>
Nov 22 07:54:02 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 07:54:02 user nova-compute[74348]:       <mac address="fa:16:3e:6d:8e:f9"/>
Nov 22 07:54:02 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:54:02 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 07:54:02 user nova-compute[74348]:       <target dev="tap9aa74044-d9"/>
Nov 22 07:54:02 user nova-compute[74348]:     </interface>
Nov 22 07:54:02 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 07:54:02 user nova-compute[74348]:       <mac address="fa:16:3e:06:8e:e5"/>
Nov 22 07:54:02 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:54:02 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 07:54:02 user nova-compute[74348]:       <target dev="tap579fb42b-b8"/>
Nov 22 07:54:02 user nova-compute[74348]:     </interface>
Nov 22 07:54:02 user nova-compute[74348]:     <serial type="pty">
Nov 22 07:54:02 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/9e2f3a3e-ee9b-4250-8744-5eb7982285f2/console.log" append="off"/>
Nov 22 07:54:02 user nova-compute[74348]:     </serial>
Nov 22 07:54:02 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 07:54:02 user nova-compute[74348]:     <video>
Nov 22 07:54:02 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:54:02 user nova-compute[74348]:     </video>
Nov 22 07:54:02 user nova-compute[74348]:     <rng model="virtio">
Nov 22 07:54:02 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 07:54:02 user nova-compute[74348]:     </rng>
Nov 22 07:54:02 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 07:54:02 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 07:54:02 user nova-compute[74348]:       <stats period="10"/>
Nov 22 07:54:02 user nova-compute[74348]:     </memballoon>
Nov 22 07:54:02 user nova-compute[74348]:   </devices>
Nov 22 07:54:02 user nova-compute[74348]: </domain>
Nov 22 07:54:02 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2036316503',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2036316503',id=11,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnzYYP3Ptdmty3Rvwlh9fqssqqfrkRsWiJRiTKv6iY6VU5FnFmpw0lxwm8OKyeaQHOy3kJ8p8VF2y7jVGbQU/CO6Efmk0az16dQ9hu0FyN5s6f1p9PgD9PdzeRpGGp4hw==',key_name='tempest-keypair-342579863',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8d9889b4c704e2c9370420262898383',ramdisk_id='',reservation_id='r-8fge7g0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1369728832',owner_user_name='tempest-TaggedBootDevicesTest_v242-1369728832-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:53:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd846d2c399e47db9dbd74e4beaeb0f4',uuid=9e2f3a3e-ee9b-4250-8744-5eb7982285f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a8ea7e1-9e80-4686-a3a9-4142b9de0049", "address": "fa:16:3e:7e:13:ad", "network": {"id": "c9f2b2b7-e34f-4891-b68c-786534d7ed95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-766683782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8ea7e1-9e", "ovs_interfaceid": "4a8ea7e1-9e80-4686-a3a9-4142b9de0049", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Converting VIF {"id": "4a8ea7e1-9e80-4686-a3a9-4142b9de0049", "address": "fa:16:3e:7e:13:ad", "network": {"id": "c9f2b2b7-e34f-4891-b68c-786534d7ed95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-766683782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8ea7e1-9e", "ovs_interfaceid": "4a8ea7e1-9e80-4686-a3a9-4142b9de0049", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:13:ad,bridge_name='br-int',has_traffic_filtering=True,id=4a8ea7e1-9e80-4686-a3a9-4142b9de0049,network=Network(c9f2b2b7-e34f-4891-b68c-786534d7ed95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a8ea7e1-9e') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG os_vif [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:13:ad,bridge_name='br-int',has_traffic_filtering=True,id=4a8ea7e1-9e80-4686-a3a9-4142b9de0049,network=Network(c9f2b2b7-e34f-4891-b68c-786534d7ed95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a8ea7e1-9e') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a8443a58-c722-5b0a-8e46-5de55b0eb0df', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d747f9-9a77-440b-a9c9-a2efff07013e]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a8ea7e1-9e, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4a8ea7e1-9e, col_values=(('qos', UUID('6680b596-ef2c-4eb2-a2e8-c7b2f2caf8af')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4a8ea7e1-9e, col_values=(('external_ids', {'iface-id': '4a8ea7e1-9e80-4686-a3a9-4142b9de0049', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:13:ad', 'vm-uuid': '9e2f3a3e-ee9b-4250-8744-5eb7982285f2'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: INFO os_vif [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:13:ad,bridge_name='br-int',has_traffic_filtering=True,id=4a8ea7e1-9e80-4686-a3a9-4142b9de0049,network=Network(c9f2b2b7-e34f-4891-b68c-786534d7ed95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a8ea7e1-9e')
Nov 22 07:54:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2036316503',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2036316503',id=11,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnzYYP3Ptdmty3Rvwlh9fqssqqfrkRsWiJRiTKv6iY6VU5FnFmpw0lxwm8OKyeaQHOy3kJ8p8VF2y7jVGbQU/CO6Efmk0az16dQ9hu0FyN5s6f1p9PgD9PdzeRpGGp4hw==',key_name='tempest-keypair-342579863',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8d9889b4c704e2c9370420262898383',ramdisk_id='',reservation_id='r-8fge7g0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1369728832',owner_user_name='tempest-TaggedBootDevicesTest_v242-1369728832-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:53:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd846d2c399e47db9dbd74e4beaeb0f4',uuid=9e2f3a3e-ee9b-4250-8744-5eb7982285f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e30deaf5-1258-4909-bc71-044c88f2995f", "address": "fa:16:3e:c8:34:fc", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30deaf5-12", "ovs_interfaceid": "e30deaf5-1258-4909-bc71-044c88f2995f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Converting VIF {"id": "e30deaf5-1258-4909-bc71-044c88f2995f", "address": "fa:16:3e:c8:34:fc", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30deaf5-12", "ovs_interfaceid": "e30deaf5-1258-4909-bc71-044c88f2995f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:34:fc,bridge_name='br-int',has_traffic_filtering=True,id=e30deaf5-1258-4909-bc71-044c88f2995f,network=Network(fc6897f6-ca20-4f4e-9e55-a61241ccd39f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape30deaf5-12') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG os_vif [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:34:fc,bridge_name='br-int',has_traffic_filtering=True,id=e30deaf5-1258-4909-bc71-044c88f2995f,network=Network(fc6897f6-ca20-4f4e-9e55-a61241ccd39f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape30deaf5-12') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a267d6-fc9e-43ed-bb02-cb65573f0da1]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '378b3001-1e35-5f5b-acdb-0dabec62d660', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WPGKRcyT {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape30deaf5-12, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape30deaf5-12, col_values=(('qos', UUID('e2156d69-e9e8-494a-aed4-2f106750db66')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape30deaf5-12, col_values=(('external_ids', {'iface-id': 'e30deaf5-1258-4909-bc71-044c88f2995f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:34:fc', 'vm-uuid': '9e2f3a3e-ee9b-4250-8744-5eb7982285f2'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WPGKRcyT" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4f4c6c-da15-4e6e-af60-9acb5bee1117]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WPGKRcyT'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: INFO os_vif [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:34:fc,bridge_name='br-int',has_traffic_filtering=True,id=e30deaf5-1258-4909-bc71-044c88f2995f,network=Network(fc6897f6-ca20-4f4e-9e55-a61241ccd39f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape30deaf5-12')
Nov 22 07:54:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2036316503',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2036316503',id=11,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnzYYP3Ptdmty3Rvwlh9fqssqqfrkRsWiJRiTKv6iY6VU5FnFmpw0lxwm8OKyeaQHOy3kJ8p8VF2y7jVGbQU/CO6Efmk0az16dQ9hu0FyN5s6f1p9PgD9PdzeRpGGp4hw==',key_name='tempest-keypair-342579863',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8d9889b4c704e2c9370420262898383',ramdisk_id='',reservation_id='r-8fge7g0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1369728832',owner_user_name='tempest-TaggedBootDevicesTest_v242-1369728832-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:53:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd846d2c399e47db9dbd74e4beaeb0f4',uuid=9e2f3a3e-ee9b-4250-8744-5eb7982285f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "298ce71b-894a-4e29-904e-1ba5d4495fcb", "address": "fa:16:3e:b3:83:8f", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298ce71b-89", "ovs_interfaceid": "298ce71b-894a-4e29-904e-1ba5d4495fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Converting VIF {"id": "298ce71b-894a-4e29-904e-1ba5d4495fcb", "address": "fa:16:3e:b3:83:8f", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298ce71b-89", "ovs_interfaceid": "298ce71b-894a-4e29-904e-1ba5d4495fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:83:8f,bridge_name='br-int',has_traffic_filtering=True,id=298ce71b-894a-4e29-904e-1ba5d4495fcb,network=Network(fc6897f6-ca20-4f4e-9e55-a61241ccd39f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap298ce71b-89') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG os_vif [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:83:8f,bridge_name='br-int',has_traffic_filtering=True,id=298ce71b-894a-4e29-904e-1ba5d4495fcb,network=Network(fc6897f6-ca20-4f4e-9e55-a61241ccd39f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap298ce71b-89') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b0f32cbb-c1a6-5b61-9b6e-d350cf8cfad7', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6377313-e52b-4ace-925b-63640db2304d]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0462e26a-4d32-4213-af4e-4992aef50e9c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:54:03 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:54:03 user nova-compute[74348]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)
Nov 22 07:54:03 user nova-compute[74348]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)
Nov 22 07:54:03 user nova-compute[74348]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)
Nov 22 07:54:03 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:54:03 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:54:03 user nova-compute[74348]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)
Nov 22 07:54:03 user nova-compute[74348]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)
Nov 22 07:54:03 user nova-compute[74348]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)
Nov 22 07:54:03 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap298ce71b-89, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap298ce71b-89, col_values=(('qos', UUID('1a291e94-1a95-4751-93f5-cfac113260ab')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap298ce71b-89, col_values=(('external_ids', {'iface-id': '298ce71b-894a-4e29-904e-1ba5d4495fcb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:83:8f', 'vm-uuid': '9e2f3a3e-ee9b-4250-8744-5eb7982285f2'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: INFO os_vif [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:83:8f,bridge_name='br-int',has_traffic_filtering=True,id=298ce71b-894a-4e29-904e-1ba5d4495fcb,network=Network(fc6897f6-ca20-4f4e-9e55-a61241ccd39f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap298ce71b-89')
Nov 22 07:54:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2036316503',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2036316503',id=11,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnzYYP3Ptdmty3Rvwlh9fqssqqfrkRsWiJRiTKv6iY6VU5FnFmpw0lxwm8OKyeaQHOy3kJ8p8VF2y7jVGbQU/CO6Efmk0az16dQ9hu0FyN5s6f1p9PgD9PdzeRpGGp4hw==',key_name='tempest-keypair-342579863',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8d9889b4c704e2c9370420262898383',ramdisk_id='',reservation_id='r-8fge7g0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1369728832',owner_user_name='tempest-TaggedBootDevicesTest_v242-1369728832-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:53:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd846d2c399e47db9dbd74e4beaeb0f4',uuid=9e2f3a3e-ee9b-4250-8744-5eb7982285f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0f55187-e53f-468d-83a8-cca33ff1380e", "address": "fa:16:3e:8d:36:2e", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f55187-e5", "ovs_interfaceid": "f0f55187-e53f-468d-83a8-cca33ff1380e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Converting VIF {"id": "f0f55187-e53f-468d-83a8-cca33ff1380e", "address": "fa:16:3e:8d:36:2e", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f55187-e5", "ovs_interfaceid": "f0f55187-e53f-468d-83a8-cca33ff1380e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:36:2e,bridge_name='br-int',has_traffic_filtering=True,id=f0f55187-e53f-468d-83a8-cca33ff1380e,network=Network(fc6897f6-ca20-4f4e-9e55-a61241ccd39f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0f55187-e5') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG os_vif [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:36:2e,bridge_name='br-int',has_traffic_filtering=True,id=f0f55187-e53f-468d-83a8-cca33ff1380e,network=Network(fc6897f6-ca20-4f4e-9e55-a61241ccd39f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0f55187-e5') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a7a707d5-2b20-5f19-8f56-449791edd6b9', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0f55187-e5, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf0f55187-e5, col_values=(('qos', UUID('1d888a13-e8c2-4e37-8d19-8731d8c00401')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf0f55187-e5, col_values=(('external_ids', {'iface-id': 'f0f55187-e53f-468d-83a8-cca33ff1380e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:36:2e', 'vm-uuid': '9e2f3a3e-ee9b-4250-8744-5eb7982285f2'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95eaa2b-16d4-48fa-bcf7-9e938bb62923]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054, portal: 172.16.0.220,3260]
Nov 22 07:54:03 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054, portal: 172.16.0.220,3260] successful.
Nov 22 07:54:03 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c585194b-acb9-4177-92ec-a6cd026f1a7a]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: INFO os_vif [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:36:2e,bridge_name='br-int',has_traffic_filtering=True,id=f0f55187-e53f-468d-83a8-cca33ff1380e,network=Network(fc6897f6-ca20-4f4e-9e55-a61241ccd39f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0f55187-e5')
Nov 22 07:54:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2036316503',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2036316503',id=11,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnzYYP3Ptdmty3Rvwlh9fqssqqfrkRsWiJRiTKv6iY6VU5FnFmpw0lxwm8OKyeaQHOy3kJ8p8VF2y7jVGbQU/CO6Efmk0az16dQ9hu0FyN5s6f1p9PgD9PdzeRpGGp4hw==',key_name='tempest-keypair-342579863',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8d9889b4c704e2c9370420262898383',ramdisk_id='',reservation_id='r-8fge7g0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1369728832',owner_user_name='tempest-TaggedBootDevicesTest_v242-1369728832-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:53:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd846d2c399e47db9dbd74e4beaeb0f4',uuid=9e2f3a3e-ee9b-4250-8744-5eb7982285f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a68d2be-be4c-462b-9dd4-15e222160557", "address": "fa:16:3e:ea:a3:83", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a68d2be-be", "ovs_interfaceid": "5a68d2be-be4c-462b-9dd4-15e222160557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Converting VIF {"id": "5a68d2be-be4c-462b-9dd4-15e222160557", "address": "fa:16:3e:ea:a3:83", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a68d2be-be", "ovs_interfaceid": "5a68d2be-be4c-462b-9dd4-15e222160557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a3:83,bridge_name='br-int',has_traffic_filtering=True,id=5a68d2be-be4c-462b-9dd4-15e222160557,network=Network(fc6897f6-ca20-4f4e-9e55-a61241ccd39f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a68d2be-be') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG os_vif [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a3:83,bridge_name='br-int',has_traffic_filtering=True,id=5a68d2be-be4c-462b-9dd4-15e222160557,network=Network(fc6897f6-ca20-4f4e-9e55-a61241ccd39f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a68d2be-be') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a789ea0d-45e6-53c3-b3bf-ae34fa696205', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efc4adc-1d8c-4825-97be-edf686475c09]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:54:03 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:54:03 user nova-compute[74348]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)
Nov 22 07:54:03 user nova-compute[74348]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)
Nov 22 07:54:03 user nova-compute[74348]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)
Nov 22 07:54:03 user nova-compute[74348]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)
Nov 22 07:54:03 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:54:03 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:54:03 user nova-compute[74348]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)
Nov 22 07:54:03 user nova-compute[74348]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)
Nov 22 07:54:03 user nova-compute[74348]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)
Nov 22 07:54:03 user nova-compute[74348]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)
Nov 22 07:54:03 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fce1ba8-cbe9-4396-945a-84e28a462caf]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WPGKRcyT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a68d2be-be, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5a68d2be-be, col_values=(('qos', UUID('94151df4-e159-4c8c-b27c-5ca9e8bd2c50')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5a68d2be-be, col_values=(('external_ids', {'iface-id': '5a68d2be-be4c-462b-9dd4-15e222160557', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:a3:83', 'vm-uuid': '9e2f3a3e-ee9b-4250-8744-5eb7982285f2'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: INFO os_vif [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a3:83,bridge_name='br-int',has_traffic_filtering=True,id=5a68d2be-be4c-462b-9dd4-15e222160557,network=Network(fc6897f6-ca20-4f4e-9e55-a61241ccd39f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a68d2be-be')
Nov 22 07:54:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2036316503',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2036316503',id=11,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnzYYP3Ptdmty3Rvwlh9fqssqqfrkRsWiJRiTKv6iY6VU5FnFmpw0lxwm8OKyeaQHOy3kJ8p8VF2y7jVGbQU/CO6Efmk0az16dQ9hu0FyN5s6f1p9PgD9PdzeRpGGp4hw==',key_name='tempest-keypair-342579863',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8d9889b4c704e2c9370420262898383',ramdisk_id='',reservation_id='r-8fge7g0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1369728832',owner_user_name='tempest-TaggedBootDevicesTest_v242-1369728832-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:53:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd846d2c399e47db9dbd74e4beaeb0f4',uuid=9e2f3a3e-ee9b-4250-8744-5eb7982285f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9aa74044-d952-47e5-9cc1-948615a01eb3", "address": "fa:16:3e:6d:8e:f9", "network": {"id": "7f9b7b76-9f0d-4fbd-90c9-6ceee5e0c50e", "bridge": "br-int", "label": "tempest-device-tagging-net2-487890789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aa74044-d9", "ovs_interfaceid": "9aa74044-d952-47e5-9cc1-948615a01eb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Converting VIF {"id": "9aa74044-d952-47e5-9cc1-948615a01eb3", "address": "fa:16:3e:6d:8e:f9", "network": {"id": "7f9b7b76-9f0d-4fbd-90c9-6ceee5e0c50e", "bridge": "br-int", "label": "tempest-device-tagging-net2-487890789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aa74044-d9", "ovs_interfaceid": "9aa74044-d952-47e5-9cc1-948615a01eb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:8e:f9,bridge_name='br-int',has_traffic_filtering=True,id=9aa74044-d952-47e5-9cc1-948615a01eb3,network=Network(7f9b7b76-9f0d-4fbd-90c9-6ceee5e0c50e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aa74044-d9') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG os_vif [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:8e:f9,bridge_name='br-int',has_traffic_filtering=True,id=9aa74044-d952-47e5-9cc1-948615a01eb3,network=Network(7f9b7b76-9f0d-4fbd-90c9-6ceee5e0c50e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aa74044-d9') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fa9b4250-9b06-5502-b881-6077a24e1183', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9aa74044-d9, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9aa74044-d9, col_values=(('qos', UUID('93309b90-3148-4eb7-952c-cc1e15f79a35')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9aa74044-d9, col_values=(('external_ids', {'iface-id': '9aa74044-d952-47e5-9cc1-948615a01eb3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:8e:f9', 'vm-uuid': '9e2f3a3e-ee9b-4250-8744-5eb7982285f2'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: INFO os_vif [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:8e:f9,bridge_name='br-int',has_traffic_filtering=True,id=9aa74044-d952-47e5-9cc1-948615a01eb3,network=Network(7f9b7b76-9f0d-4fbd-90c9-6ceee5e0c50e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aa74044-d9')
Nov 22 07:54:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2036316503',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2036316503',id=11,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnzYYP3Ptdmty3Rvwlh9fqssqqfrkRsWiJRiTKv6iY6VU5FnFmpw0lxwm8OKyeaQHOy3kJ8p8VF2y7jVGbQU/CO6Efmk0az16dQ9hu0FyN5s6f1p9PgD9PdzeRpGGp4hw==',key_name='tempest-keypair-342579863',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8d9889b4c704e2c9370420262898383',ramdisk_id='',reservation_id='r-8fge7g0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1369728832',owner_user_name='tempest-TaggedBootDevicesTest_v242-1369728832-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:53:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd846d2c399e47db9dbd74e4beaeb0f4',uuid=9e2f3a3e-ee9b-4250-8744-5eb7982285f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "579fb42b-b8b6-4122-8ec3-8817c9e0881a", "address": "fa:16:3e:06:8e:e5", "network": {"id": "7f9b7b76-9f0d-4fbd-90c9-6ceee5e0c50e", "bridge": "br-int", "label": "tempest-device-tagging-net2-487890789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap579fb42b-b8", "ovs_interfaceid": "579fb42b-b8b6-4122-8ec3-8817c9e0881a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Converting VIF {"id": "579fb42b-b8b6-4122-8ec3-8817c9e0881a", "address": "fa:16:3e:06:8e:e5", "network": {"id": "7f9b7b76-9f0d-4fbd-90c9-6ceee5e0c50e", "bridge": "br-int", "label": "tempest-device-tagging-net2-487890789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap579fb42b-b8", "ovs_interfaceid": "579fb42b-b8b6-4122-8ec3-8817c9e0881a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:8e:e5,bridge_name='br-int',has_traffic_filtering=True,id=579fb42b-b8b6-4122-8ec3-8817c9e0881a,network=Network(7f9b7b76-9f0d-4fbd-90c9-6ceee5e0c50e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap579fb42b-b8') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG os_vif [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:8e:e5,bridge_name='br-int',has_traffic_filtering=True,id=579fb42b-b8b6-4122-8ec3-8817c9e0881a,network=Network(7f9b7b76-9f0d-4fbd-90c9-6ceee5e0c50e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap579fb42b-b8') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1ff76449-fc2d-53e6-ad9c-d0f4c73e03c3', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap579fb42b-b8, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap579fb42b-b8, col_values=(('qos', UUID('eccf51fa-9c08-4c28-99fb-2d688bb99878')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap579fb42b-b8, col_values=(('external_ids', {'iface-id': '579fb42b-b8b6-4122-8ec3-8817c9e0881a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:8e:e5', 'vm-uuid': '9e2f3a3e-ee9b-4250-8744-5eb7982285f2'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:03 user nova-compute[74348]: INFO os_vif [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:8e:e5,bridge_name='br-int',has_traffic_filtering=True,id=579fb42b-b8b6-4122-8ec3-8817c9e0881a,network=Network(7f9b7b76-9f0d-4fbd-90c9-6ceee5e0c50e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap579fb42b-b8')
Nov 22 07:54:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] No BDM found with device name hda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] No VIF found with MAC fa:16:3e:7e:13:ad, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] No VIF found with MAC fa:16:3e:ea:a3:83, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 07:54:03 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Using config drive
Nov 22 07:54:03 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Creating config drive at /opt/stack/data/nova/instances/9e2f3a3e-ee9b-4250-8744-5eb7982285f2/disk.config
Nov 22 07:54:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9e2f3a3e-ee9b-4250-8744-5eb7982285f2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpju5dzsvl {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9e2f3a3e-ee9b-4250-8744-5eb7982285f2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpju5dzsvl" returned: 0 in 0.068s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] <== connect_volume: return (2697ms) {'type': 'block', 'scsi_wwn': '26136636634643562', 'path': '/dev/sdg'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136636634643562', 'path': '/dev/sdg'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ptBeJEUv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:54:04 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:54:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:54:04 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:54:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:54:04 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 07:54:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[66aa0947-e995-458e-9c5e-6341096f9041]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 07:54:04 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69524dd-fa9d-4d09-8e9e-a5626e72ee67]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799] added
Nov 22 07:54:04 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[469e2ba9-773e-4488-9c7b-c8a50ea3afdd]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[462235b8-172a-4433-ba5d-8ec5cf302c72]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ptBeJEUv {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ptBeJEUv" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8502ef-aa18-41d4-8bf0-eadd53ac0be3]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ptBeJEUv'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a7756e-3c81-4edb-8d70-8c3a28611f53]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5619d2-cee0-4679-86d7-df139392a801]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:54:04 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:54:04 user nova-compute[74348]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)
Nov 22 07:54:04 user nova-compute[74348]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)
Nov 22 07:54:04 user nova-compute[74348]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)
Nov 22 07:54:04 user nova-compute[74348]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)
Nov 22 07:54:04 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:54:04 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:54:04 user nova-compute[74348]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)
Nov 22 07:54:04 user nova-compute[74348]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)
Nov 22 07:54:04 user nova-compute[74348]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)
Nov 22 07:54:04 user nova-compute[74348]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)
Nov 22 07:54:04 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba4bb50-891b-4108-8cc4-0e60ded02f32]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799, portal: 172.16.0.220,3260]
Nov 22 07:54:04 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799, portal: 172.16.0.220,3260] successful.
Nov 22 07:54:04 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd67d30a-a729-48e5-afbf-50aeef5eb43d]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e96098d-e92c-4858-a509-6c0084f4ac39]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:54:04 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:54:04 user nova-compute[74348]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)
Nov 22 07:54:04 user nova-compute[74348]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)
Nov 22 07:54:04 user nova-compute[74348]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)
Nov 22 07:54:04 user nova-compute[74348]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)
Nov 22 07:54:04 user nova-compute[74348]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)
Nov 22 07:54:04 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:54:04 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:54:04 user nova-compute[74348]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)
Nov 22 07:54:04 user nova-compute[74348]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)
Nov 22 07:54:04 user nova-compute[74348]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)
Nov 22 07:54:04 user nova-compute[74348]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)
Nov 22 07:54:04 user nova-compute[74348]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)
Nov 22 07:54:04 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.029s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d8ffa0-e237-43e4-aa1a-177b3de8592e]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 07:54:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ptBeJEUv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '26338646262386232', 'path': '/dev/sdh'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338646262386232', 'path': '/dev/sdh'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-574357068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-574357068',id=12,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPh8WrgN05Udth7XNATbD0Z+g0hoWMflQ1e+XdiOuBd1xLNGVHWp/bZGSnlbVFto/38wc6mSlPbrRK9XwiDx6Yn5HNC2pFZ8C7kB6aRkT1jiYcW2IxcpgmJM/7ZZJUwqcw==',key_name='tempest-keypair-436025460',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a08625e4d04478297484c875ac9a5c3',ramdisk_id='',reservation_id='r-7l9plp3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1955894791',owner_user_name='tempest-TaggedBootDevicesTest-1955894791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:53:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d026e5b011144beb9340e6ceb58583f3',uuid=8527ae47-a025-492d-9820-b9c5ee309d81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6221165b-f588-475c-a3b1-afdf5c60c113", "address": "fa:16:3e:6a:1c:a3", "network": {"id": "414e020d-3fcc-4afd-9fee-be68687a0418", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-184417969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6221165b-f5", "ovs_interfaceid": "6221165b-f588-475c-a3b1-afdf5c60c113", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Converting VIF {"id": "6221165b-f588-475c-a3b1-afdf5c60c113", "address": "fa:16:3e:6a:1c:a3", "network": {"id": "414e020d-3fcc-4afd-9fee-be68687a0418", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-184417969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6221165b-f5", "ovs_interfaceid": "6221165b-f588-475c-a3b1-afdf5c60c113", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:1c:a3,bridge_name='br-int',has_traffic_filtering=True,id=6221165b-f588-475c-a3b1-afdf5c60c113,network=Network(414e020d-3fcc-4afd-9fee-be68687a0418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6221165b-f5') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-574357068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-574357068',id=12,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPh8WrgN05Udth7XNATbD0Z+g0hoWMflQ1e+XdiOuBd1xLNGVHWp/bZGSnlbVFto/38wc6mSlPbrRK9XwiDx6Yn5HNC2pFZ8C7kB6aRkT1jiYcW2IxcpgmJM/7ZZJUwqcw==',key_name='tempest-keypair-436025460',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a08625e4d04478297484c875ac9a5c3',ramdisk_id='',reservation_id='r-7l9plp3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1955894791',owner_user_name='tempest-TaggedBootDevicesTest-1955894791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:53:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d026e5b011144beb9340e6ceb58583f3',uuid=8527ae47-a025-492d-9820-b9c5ee309d81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62ed8403-ebcd-4e41-ac81-0056cf71738c", "address": "fa:16:3e:9a:78:38", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62ed8403-eb", "ovs_interfaceid": "62ed8403-ebcd-4e41-ac81-0056cf71738c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Converting VIF {"id": "62ed8403-ebcd-4e41-ac81-0056cf71738c", "address": "fa:16:3e:9a:78:38", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62ed8403-eb", "ovs_interfaceid": "62ed8403-ebcd-4e41-ac81-0056cf71738c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:78:38,bridge_name='br-int',has_traffic_filtering=True,id=62ed8403-ebcd-4e41-ac81-0056cf71738c,network=Network(3f843b34-4601-4294-93d6-36cfbbf94a95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap62ed8403-eb') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-574357068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-574357068',id=12,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPh8WrgN05Udth7XNATbD0Z+g0hoWMflQ1e+XdiOuBd1xLNGVHWp/bZGSnlbVFto/38wc6mSlPbrRK9XwiDx6Yn5HNC2pFZ8C7kB6aRkT1jiYcW2IxcpgmJM/7ZZJUwqcw==',key_name='tempest-keypair-436025460',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a08625e4d04478297484c875ac9a5c3',ramdisk_id='',reservation_id='r-7l9plp3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1955894791',owner_user_name='tempest-TaggedBootDevicesTest-1955894791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:53:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d026e5b011144beb9340e6ceb58583f3',uuid=8527ae47-a025-492d-9820-b9c5ee309d81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63fc17ce-ef08-4f7e-ab83-b1040733d228", "address": "fa:16:3e:92:70:d1", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fc17ce-ef", "ovs_interfaceid": "63fc17ce-ef08-4f7e-ab83-b1040733d228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Converting VIF {"id": "63fc17ce-ef08-4f7e-ab83-b1040733d228", "address": "fa:16:3e:92:70:d1", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fc17ce-ef", "ovs_interfaceid": "63fc17ce-ef08-4f7e-ab83-b1040733d228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:70:d1,bridge_name='br-int',has_traffic_filtering=True,id=63fc17ce-ef08-4f7e-ab83-b1040733d228,network=Network(3f843b34-4601-4294-93d6-36cfbbf94a95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap63fc17ce-ef') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-574357068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-574357068',id=12,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPh8WrgN05Udth7XNATbD0Z+g0hoWMflQ1e+XdiOuBd1xLNGVHWp/bZGSnlbVFto/38wc6mSlPbrRK9XwiDx6Yn5HNC2pFZ8C7kB6aRkT1jiYcW2IxcpgmJM/7ZZJUwqcw==',key_name='tempest-keypair-436025460',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a08625e4d04478297484c875ac9a5c3',ramdisk_id='',reservation_id='r-7l9plp3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1955894791',owner_user_name='tempest-TaggedBootDevicesTest-1955894791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:53:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d026e5b011144beb9340e6ceb58583f3',uuid=8527ae47-a025-492d-9820-b9c5ee309d81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "969790c1-f8a4-4d98-86d9-1ed932c83daa", "address": "fa:16:3e:6d:21:36", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969790c1-f8", "ovs_interfaceid": "969790c1-f8a4-4d98-86d9-1ed932c83daa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Converting VIF {"id": "969790c1-f8a4-4d98-86d9-1ed932c83daa", "address": "fa:16:3e:6d:21:36", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969790c1-f8", "ovs_interfaceid": "969790c1-f8a4-4d98-86d9-1ed932c83daa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:21:36,bridge_name='br-int',has_traffic_filtering=True,id=969790c1-f8a4-4d98-86d9-1ed932c83daa,network=Network(3f843b34-4601-4294-93d6-36cfbbf94a95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap969790c1-f8') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-574357068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-574357068',id=12,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPh8WrgN05Udth7XNATbD0Z+g0hoWMflQ1e+XdiOuBd1xLNGVHWp/bZGSnlbVFto/38wc6mSlPbrRK9XwiDx6Yn5HNC2pFZ8C7kB6aRkT1jiYcW2IxcpgmJM/7ZZJUwqcw==',key_name='tempest-keypair-436025460',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a08625e4d04478297484c875ac9a5c3',ramdisk_id='',reservation_id='r-7l9plp3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1955894791',owner_user_name='tempest-TaggedBootDevicesTest-1955894791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:53:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d026e5b011144beb9340e6ceb58583f3',uuid=8527ae47-a025-492d-9820-b9c5ee309d81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "748e5281-27d7-43b4-ba47-2f0daed1181e", "address": "fa:16:3e:f9:d2:8f", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap748e5281-27", "ovs_interfaceid": "748e5281-27d7-43b4-ba47-2f0daed1181e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Converting VIF {"id": "748e5281-27d7-43b4-ba47-2f0daed1181e", "address": "fa:16:3e:f9:d2:8f", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap748e5281-27", "ovs_interfaceid": "748e5281-27d7-43b4-ba47-2f0daed1181e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:d2:8f,bridge_name='br-int',has_traffic_filtering=True,id=748e5281-27d7-43b4-ba47-2f0daed1181e,network=Network(3f843b34-4601-4294-93d6-36cfbbf94a95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap748e5281-27') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-574357068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-574357068',id=12,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPh8WrgN05Udth7XNATbD0Z+g0hoWMflQ1e+XdiOuBd1xLNGVHWp/bZGSnlbVFto/38wc6mSlPbrRK9XwiDx6Yn5HNC2pFZ8C7kB6aRkT1jiYcW2IxcpgmJM/7ZZJUwqcw==',key_name='tempest-keypair-436025460',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a08625e4d04478297484c875ac9a5c3',ramdisk_id='',reservation_id='r-7l9plp3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1955894791',owner_user_name='tempest-TaggedBootDevicesTest-1955894791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:53:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d026e5b011144beb9340e6ceb58583f3',uuid=8527ae47-a025-492d-9820-b9c5ee309d81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d77c2a03-a402-4288-8a40-2f88200a8f22", "address": "fa:16:3e:b2:36:f8", "network": {"id": "f39bd97a-26ce-4373-bf3b-ceb5c8dc21ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-224466528", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd77c2a03-a4", "ovs_interfaceid": "d77c2a03-a402-4288-8a40-2f88200a8f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Converting VIF {"id": "d77c2a03-a402-4288-8a40-2f88200a8f22", "address": "fa:16:3e:b2:36:f8", "network": {"id": "f39bd97a-26ce-4373-bf3b-ceb5c8dc21ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-224466528", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd77c2a03-a4", "ovs_interfaceid": "d77c2a03-a402-4288-8a40-2f88200a8f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:36:f8,bridge_name='br-int',has_traffic_filtering=True,id=d77c2a03-a402-4288-8a40-2f88200a8f22,network=Network(f39bd97a-26ce-4373-bf3b-ceb5c8dc21ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd77c2a03-a4') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-574357068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-574357068',id=12,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPh8WrgN05Udth7XNATbD0Z+g0hoWMflQ1e+XdiOuBd1xLNGVHWp/bZGSnlbVFto/38wc6mSlPbrRK9XwiDx6Yn5HNC2pFZ8C7kB6aRkT1jiYcW2IxcpgmJM/7ZZJUwqcw==',key_name='tempest-keypair-436025460',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a08625e4d04478297484c875ac9a5c3',ramdisk_id='',reservation_id='r-7l9plp3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1955894791',owner_user_name='tempest-TaggedBootDevicesTest-1955894791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:53:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d026e5b011144beb9340e6ceb58583f3',uuid=8527ae47-a025-492d-9820-b9c5ee309d81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a64b4a32-73f1-4a48-8b80-86d353d1d40b", "address": "fa:16:3e:be:1c:23", "network": {"id": "f39bd97a-26ce-4373-bf3b-ceb5c8dc21ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-224466528", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64b4a32-73", "ovs_interfaceid": "a64b4a32-73f1-4a48-8b80-86d353d1d40b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Converting VIF {"id": "a64b4a32-73f1-4a48-8b80-86d353d1d40b", "address": "fa:16:3e:be:1c:23", "network": {"id": "f39bd97a-26ce-4373-bf3b-ceb5c8dc21ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-224466528", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64b4a32-73", "ovs_interfaceid": "a64b4a32-73f1-4a48-8b80-86d353d1d40b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:1c:23,bridge_name='br-int',has_traffic_filtering=True,id=a64b4a32-73f1-4a48-8b80-86d353d1d40b,network=Network(f39bd97a-26ce-4373-bf3b-ceb5c8dc21ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa64b4a32-73') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG nova.objects.instance [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Lazy-loading 'pci_devices' on Instance uuid 8527ae47-a025-492d-9820-b9c5ee309d81 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] End _get_guest_xml xml=<domain type="kvm">
Nov 22 07:54:05 user nova-compute[74348]:   <uuid>8527ae47-a025-492d-9820-b9c5ee309d81</uuid>
Nov 22 07:54:05 user nova-compute[74348]:   <name>instance-0000000c</name>
Nov 22 07:54:05 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 07:54:05 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 07:54:05 user nova-compute[74348]:   <metadata>
Nov 22 07:54:05 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 07:54:05 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 07:54:05 user nova-compute[74348]:       <nova:name>tempest-device-tagging-server-574357068</nova:name>
Nov 22 07:54:05 user nova-compute[74348]:       <nova:creationTime>2023-11-22 07:53:59</nova:creationTime>
Nov 22 07:54:05 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 07:54:05 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 07:54:05 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 07:54:05 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 07:54:05 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 07:54:05 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 07:54:05 user nova-compute[74348]:       </nova:flavor>
Nov 22 07:54:05 user nova-compute[74348]:       <nova:owner>
Nov 22 07:54:05 user nova-compute[74348]:         <nova:user uuid="d026e5b011144beb9340e6ceb58583f3">tempest-TaggedBootDevicesTest-1955894791-project-member</nova:user>
Nov 22 07:54:05 user nova-compute[74348]:         <nova:project uuid="7a08625e4d04478297484c875ac9a5c3">tempest-TaggedBootDevicesTest-1955894791</nova:project>
Nov 22 07:54:05 user nova-compute[74348]:       </nova:owner>
Nov 22 07:54:05 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 07:54:05 user nova-compute[74348]:       <nova:ports>
Nov 22 07:54:05 user nova-compute[74348]:         <nova:port uuid="6221165b-f588-475c-a3b1-afdf5c60c113">
Nov 22 07:54:05 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 22 07:54:05 user nova-compute[74348]:         </nova:port>
Nov 22 07:54:05 user nova-compute[74348]:         <nova:port uuid="62ed8403-ebcd-4e41-ac81-0056cf71738c">
Nov 22 07:54:05 user nova-compute[74348]:           <nova:ip type="fixed" address="10.1.1.116" ipVersion="4"/>
Nov 22 07:54:05 user nova-compute[74348]:         </nova:port>
Nov 22 07:54:05 user nova-compute[74348]:         <nova:port uuid="63fc17ce-ef08-4f7e-ab83-b1040733d228">
Nov 22 07:54:05 user nova-compute[74348]:           <nova:ip type="fixed" address="10.1.1.193" ipVersion="4"/>
Nov 22 07:54:05 user nova-compute[74348]:         </nova:port>
Nov 22 07:54:05 user nova-compute[74348]:         <nova:port uuid="969790c1-f8a4-4d98-86d9-1ed932c83daa">
Nov 22 07:54:05 user nova-compute[74348]:           <nova:ip type="fixed" address="10.1.1.251" ipVersion="4"/>
Nov 22 07:54:05 user nova-compute[74348]:         </nova:port>
Nov 22 07:54:05 user nova-compute[74348]:         <nova:port uuid="748e5281-27d7-43b4-ba47-2f0daed1181e">
Nov 22 07:54:05 user nova-compute[74348]:           <nova:ip type="fixed" address="10.1.1.159" ipVersion="4"/>
Nov 22 07:54:05 user nova-compute[74348]:         </nova:port>
Nov 22 07:54:05 user nova-compute[74348]:         <nova:port uuid="d77c2a03-a402-4288-8a40-2f88200a8f22">
Nov 22 07:54:05 user nova-compute[74348]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 22 07:54:05 user nova-compute[74348]:         </nova:port>
Nov 22 07:54:05 user nova-compute[74348]:         <nova:port uuid="a64b4a32-73f1-4a48-8b80-86d353d1d40b">
Nov 22 07:54:05 user nova-compute[74348]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 22 07:54:05 user nova-compute[74348]:         </nova:port>
Nov 22 07:54:05 user nova-compute[74348]:       </nova:ports>
Nov 22 07:54:05 user nova-compute[74348]:     </nova:instance>
Nov 22 07:54:05 user nova-compute[74348]:   </metadata>
Nov 22 07:54:05 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 07:54:05 user nova-compute[74348]:     <system>
Nov 22 07:54:05 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 07:54:05 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 07:54:05 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 07:54:05 user nova-compute[74348]:       <entry name="serial">8527ae47-a025-492d-9820-b9c5ee309d81</entry>
Nov 22 07:54:05 user nova-compute[74348]:       <entry name="uuid">8527ae47-a025-492d-9820-b9c5ee309d81</entry>
Nov 22 07:54:05 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 07:54:05 user nova-compute[74348]:     </system>
Nov 22 07:54:05 user nova-compute[74348]:   </sysinfo>
Nov 22 07:54:05 user nova-compute[74348]:   <os>
Nov 22 07:54:05 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 07:54:05 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 07:54:05 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 07:54:05 user nova-compute[74348]:   </os>
Nov 22 07:54:05 user nova-compute[74348]:   <features>
Nov 22 07:54:05 user nova-compute[74348]:     <acpi/>
Nov 22 07:54:05 user nova-compute[74348]:     <apic/>
Nov 22 07:54:05 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 07:54:05 user nova-compute[74348]:   </features>
Nov 22 07:54:05 user nova-compute[74348]:   <clock offset="utc">
Nov 22 07:54:05 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 07:54:05 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 07:54:05 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 07:54:05 user nova-compute[74348]:   </clock>
Nov 22 07:54:05 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 07:54:05 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 07:54:05 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 07:54:05 user nova-compute[74348]:   </cpu>
Nov 22 07:54:05 user nova-compute[74348]:   <devices>
Nov 22 07:54:05 user nova-compute[74348]:     <disk type="file" device="cdrom">
Nov 22 07:54:05 user nova-compute[74348]:       <driver name="qemu" type="raw" cache="none"/>
Nov 22 07:54:05 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/8527ae47-a025-492d-9820-b9c5ee309d81/disk.config"/>
Nov 22 07:54:05 user nova-compute[74348]:       <target dev="hda" bus="ide"/>
Nov 22 07:54:05 user nova-compute[74348]:     </disk>
Nov 22 07:54:05 user nova-compute[74348]:     <disk type="block" device="disk">
Nov 22 07:54:05 user nova-compute[74348]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 07:54:05 user nova-compute[74348]:       <source dev="/dev/sde"/>
Nov 22 07:54:05 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 07:54:05 user nova-compute[74348]:       <serial>d7d26d2e-5794-43e8-b642-76b54ab2e6f5</serial>
Nov 22 07:54:05 user nova-compute[74348]:     </disk>
Nov 22 07:54:05 user nova-compute[74348]:     <disk type="block" device="disk">
Nov 22 07:54:05 user nova-compute[74348]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 07:54:05 user nova-compute[74348]:       <source dev="/dev/sdg"/>
Nov 22 07:54:05 user nova-compute[74348]:       <target dev="vdb" bus="virtio"/>
Nov 22 07:54:05 user nova-compute[74348]:       <serial>2b5f5253-e3b6-4ba1-b9e7-df518d4ad054</serial>
Nov 22 07:54:05 user nova-compute[74348]:     </disk>
Nov 22 07:54:05 user nova-compute[74348]:     <disk type="block" device="disk">
Nov 22 07:54:05 user nova-compute[74348]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 07:54:05 user nova-compute[74348]:       <source dev="/dev/sdh"/>
Nov 22 07:54:05 user nova-compute[74348]:       <target dev="vdc" bus="virtio"/>
Nov 22 07:54:05 user nova-compute[74348]:       <serial>fe1c9310-8a44-4188-8500-088ec8cd7799</serial>
Nov 22 07:54:05 user nova-compute[74348]:     </disk>
Nov 22 07:54:05 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 07:54:05 user nova-compute[74348]:       <mac address="fa:16:3e:6a:1c:a3"/>
Nov 22 07:54:05 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:54:05 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 07:54:05 user nova-compute[74348]:       <target dev="tap6221165b-f5"/>
Nov 22 07:54:05 user nova-compute[74348]:     </interface>
Nov 22 07:54:05 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 07:54:05 user nova-compute[74348]:       <mac address="fa:16:3e:9a:78:38"/>
Nov 22 07:54:05 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:54:05 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 07:54:05 user nova-compute[74348]:       <target dev="tap62ed8403-eb"/>
Nov 22 07:54:05 user nova-compute[74348]:     </interface>
Nov 22 07:54:05 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 07:54:05 user nova-compute[74348]:       <mac address="fa:16:3e:92:70:d1"/>
Nov 22 07:54:05 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:54:05 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 07:54:05 user nova-compute[74348]:       <target dev="tap63fc17ce-ef"/>
Nov 22 07:54:05 user nova-compute[74348]:     </interface>
Nov 22 07:54:05 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 07:54:05 user nova-compute[74348]:       <mac address="fa:16:3e:6d:21:36"/>
Nov 22 07:54:05 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:54:05 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 07:54:05 user nova-compute[74348]:       <target dev="tap969790c1-f8"/>
Nov 22 07:54:05 user nova-compute[74348]:     </interface>
Nov 22 07:54:05 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 07:54:05 user nova-compute[74348]:       <mac address="fa:16:3e:f9:d2:8f"/>
Nov 22 07:54:05 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:54:05 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 07:54:05 user nova-compute[74348]:       <target dev="tap748e5281-27"/>
Nov 22 07:54:05 user nova-compute[74348]:     </interface>
Nov 22 07:54:05 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 07:54:05 user nova-compute[74348]:       <mac address="fa:16:3e:b2:36:f8"/>
Nov 22 07:54:05 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:54:05 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 07:54:05 user nova-compute[74348]:       <target dev="tapd77c2a03-a4"/>
Nov 22 07:54:05 user nova-compute[74348]:     </interface>
Nov 22 07:54:05 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 07:54:05 user nova-compute[74348]:       <mac address="fa:16:3e:be:1c:23"/>
Nov 22 07:54:05 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:54:05 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 07:54:05 user nova-compute[74348]:       <target dev="tapa64b4a32-73"/>
Nov 22 07:54:05 user nova-compute[74348]:     </interface>
Nov 22 07:54:05 user nova-compute[74348]:     <serial type="pty">
Nov 22 07:54:05 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/8527ae47-a025-492d-9820-b9c5ee309d81/console.log" append="off"/>
Nov 22 07:54:05 user nova-compute[74348]:     </serial>
Nov 22 07:54:05 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 07:54:05 user nova-compute[74348]:     <video>
Nov 22 07:54:05 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:54:05 user nova-compute[74348]:     </video>
Nov 22 07:54:05 user nova-compute[74348]:     <rng model="virtio">
Nov 22 07:54:05 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 07:54:05 user nova-compute[74348]:     </rng>
Nov 22 07:54:05 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 07:54:05 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 07:54:05 user nova-compute[74348]:       <stats period="10"/>
Nov 22 07:54:05 user nova-compute[74348]:     </memballoon>
Nov 22 07:54:05 user nova-compute[74348]:   </devices>
Nov 22 07:54:05 user nova-compute[74348]: </domain>
Nov 22 07:54:05 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-574357068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-574357068',id=12,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPh8WrgN05Udth7XNATbD0Z+g0hoWMflQ1e+XdiOuBd1xLNGVHWp/bZGSnlbVFto/38wc6mSlPbrRK9XwiDx6Yn5HNC2pFZ8C7kB6aRkT1jiYcW2IxcpgmJM/7ZZJUwqcw==',key_name='tempest-keypair-436025460',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a08625e4d04478297484c875ac9a5c3',ramdisk_id='',reservation_id='r-7l9plp3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1955894791',owner_user_name='tempest-TaggedBootDevicesTest-1955894791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:53:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d026e5b011144beb9340e6ceb58583f3',uuid=8527ae47-a025-492d-9820-b9c5ee309d81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6221165b-f588-475c-a3b1-afdf5c60c113", "address": "fa:16:3e:6a:1c:a3", "network": {"id": "414e020d-3fcc-4afd-9fee-be68687a0418", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-184417969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6221165b-f5", "ovs_interfaceid": "6221165b-f588-475c-a3b1-afdf5c60c113", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Converting VIF {"id": "6221165b-f588-475c-a3b1-afdf5c60c113", "address": "fa:16:3e:6a:1c:a3", "network": {"id": "414e020d-3fcc-4afd-9fee-be68687a0418", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-184417969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6221165b-f5", "ovs_interfaceid": "6221165b-f588-475c-a3b1-afdf5c60c113", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:1c:a3,bridge_name='br-int',has_traffic_filtering=True,id=6221165b-f588-475c-a3b1-afdf5c60c113,network=Network(414e020d-3fcc-4afd-9fee-be68687a0418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6221165b-f5') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG os_vif [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:1c:a3,bridge_name='br-int',has_traffic_filtering=True,id=6221165b-f588-475c-a3b1-afdf5c60c113,network=Network(414e020d-3fcc-4afd-9fee-be68687a0418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6221165b-f5') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'afecfb2a-9ec0-5420-9e29-3bf4f5642669', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG nova.compute.manager [req-4abcc9f3-4ac8-46b2-9c58-a545f2add9ff req-a0f6b307-e867-42db-b678-39ba3f5e3079 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-vif-plugged-4a8ea7e1-9e80-4686-a3a9-4142b9de0049 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4abcc9f3-4ac8-46b2-9c58-a545f2add9ff req-a0f6b307-e867-42db-b678-39ba3f5e3079 service nova] Acquiring lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4abcc9f3-4ac8-46b2-9c58-a545f2add9ff req-a0f6b307-e867-42db-b678-39ba3f5e3079 service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4abcc9f3-4ac8-46b2-9c58-a545f2add9ff req-a0f6b307-e867-42db-b678-39ba3f5e3079 service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG nova.compute.manager [req-4abcc9f3-4ac8-46b2-9c58-a545f2add9ff req-a0f6b307-e867-42db-b678-39ba3f5e3079 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] No waiting events found dispatching network-vif-plugged-4a8ea7e1-9e80-4686-a3a9-4142b9de0049 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:54:05 user nova-compute[74348]: WARNING nova.compute.manager [req-4abcc9f3-4ac8-46b2-9c58-a545f2add9ff req-a0f6b307-e867-42db-b678-39ba3f5e3079 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received unexpected event network-vif-plugged-4a8ea7e1-9e80-4686-a3a9-4142b9de0049 for instance with vm_state building and task_state spawning.
Nov 22 07:54:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6221165b-f5, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6221165b-f5, col_values=(('qos', UUID('25a63f79-9974-4fab-8a7e-f77d22100262')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6221165b-f5, col_values=(('external_ids', {'iface-id': '6221165b-f588-475c-a3b1-afdf5c60c113', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:1c:a3', 'vm-uuid': '8527ae47-a025-492d-9820-b9c5ee309d81'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:06 user nova-compute[74348]: INFO os_vif [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:1c:a3,bridge_name='br-int',has_traffic_filtering=True,id=6221165b-f588-475c-a3b1-afdf5c60c113,network=Network(414e020d-3fcc-4afd-9fee-be68687a0418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6221165b-f5')
Nov 22 07:54:06 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-574357068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-574357068',id=12,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPh8WrgN05Udth7XNATbD0Z+g0hoWMflQ1e+XdiOuBd1xLNGVHWp/bZGSnlbVFto/38wc6mSlPbrRK9XwiDx6Yn5HNC2pFZ8C7kB6aRkT1jiYcW2IxcpgmJM/7ZZJUwqcw==',key_name='tempest-keypair-436025460',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a08625e4d04478297484c875ac9a5c3',ramdisk_id='',reservation_id='r-7l9plp3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1955894791',owner_user_name='tempest-TaggedBootDevicesTest-1955894791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:53:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d026e5b011144beb9340e6ceb58583f3',uuid=8527ae47-a025-492d-9820-b9c5ee309d81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62ed8403-ebcd-4e41-ac81-0056cf71738c", "address": "fa:16:3e:9a:78:38", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62ed8403-eb", "ovs_interfaceid": "62ed8403-ebcd-4e41-ac81-0056cf71738c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Converting VIF {"id": "62ed8403-ebcd-4e41-ac81-0056cf71738c", "address": "fa:16:3e:9a:78:38", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62ed8403-eb", "ovs_interfaceid": "62ed8403-ebcd-4e41-ac81-0056cf71738c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:78:38,bridge_name='br-int',has_traffic_filtering=True,id=62ed8403-ebcd-4e41-ac81-0056cf71738c,network=Network(3f843b34-4601-4294-93d6-36cfbbf94a95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap62ed8403-eb') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG os_vif [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:78:38,bridge_name='br-int',has_traffic_filtering=True,id=62ed8403-ebcd-4e41-ac81-0056cf71738c,network=Network(3f843b34-4601-4294-93d6-36cfbbf94a95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap62ed8403-eb') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '996f28d0-07cb-5919-919f-5940454a0271', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG nova.compute.manager [req-d84d15dd-3eb0-4960-ba62-da7a6ff038a6 req-3977fd93-d067-4ca9-a9b5-bf5bd0627719 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-vif-plugged-e30deaf5-1258-4909-bc71-044c88f2995f {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d84d15dd-3eb0-4960-ba62-da7a6ff038a6 req-3977fd93-d067-4ca9-a9b5-bf5bd0627719 service nova] Acquiring lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d84d15dd-3eb0-4960-ba62-da7a6ff038a6 req-3977fd93-d067-4ca9-a9b5-bf5bd0627719 service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d84d15dd-3eb0-4960-ba62-da7a6ff038a6 req-3977fd93-d067-4ca9-a9b5-bf5bd0627719 service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG nova.compute.manager [req-d84d15dd-3eb0-4960-ba62-da7a6ff038a6 req-3977fd93-d067-4ca9-a9b5-bf5bd0627719 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] No waiting events found dispatching network-vif-plugged-e30deaf5-1258-4909-bc71-044c88f2995f {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:54:06 user nova-compute[74348]: WARNING nova.compute.manager [req-d84d15dd-3eb0-4960-ba62-da7a6ff038a6 req-3977fd93-d067-4ca9-a9b5-bf5bd0627719 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received unexpected event network-vif-plugged-e30deaf5-1258-4909-bc71-044c88f2995f for instance with vm_state building and task_state spawning.
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62ed8403-eb, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap62ed8403-eb, col_values=(('qos', UUID('8c35741c-aa2f-4fa6-bb96-2d342b35159a')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap62ed8403-eb, col_values=(('external_ids', {'iface-id': '62ed8403-ebcd-4e41-ac81-0056cf71738c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:78:38', 'vm-uuid': '8527ae47-a025-492d-9820-b9c5ee309d81'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:06 user nova-compute[74348]: INFO os_vif [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:78:38,bridge_name='br-int',has_traffic_filtering=True,id=62ed8403-ebcd-4e41-ac81-0056cf71738c,network=Network(3f843b34-4601-4294-93d6-36cfbbf94a95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap62ed8403-eb')
Nov 22 07:54:06 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-574357068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-574357068',id=12,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPh8WrgN05Udth7XNATbD0Z+g0hoWMflQ1e+XdiOuBd1xLNGVHWp/bZGSnlbVFto/38wc6mSlPbrRK9XwiDx6Yn5HNC2pFZ8C7kB6aRkT1jiYcW2IxcpgmJM/7ZZJUwqcw==',key_name='tempest-keypair-436025460',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a08625e4d04478297484c875ac9a5c3',ramdisk_id='',reservation_id='r-7l9plp3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1955894791',owner_user_name='tempest-TaggedBootDevicesTest-1955894791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:53:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d026e5b011144beb9340e6ceb58583f3',uuid=8527ae47-a025-492d-9820-b9c5ee309d81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63fc17ce-ef08-4f7e-ab83-b1040733d228", "address": "fa:16:3e:92:70:d1", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fc17ce-ef", "ovs_interfaceid": "63fc17ce-ef08-4f7e-ab83-b1040733d228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Converting VIF {"id": "63fc17ce-ef08-4f7e-ab83-b1040733d228", "address": "fa:16:3e:92:70:d1", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fc17ce-ef", "ovs_interfaceid": "63fc17ce-ef08-4f7e-ab83-b1040733d228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:70:d1,bridge_name='br-int',has_traffic_filtering=True,id=63fc17ce-ef08-4f7e-ab83-b1040733d228,network=Network(3f843b34-4601-4294-93d6-36cfbbf94a95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap63fc17ce-ef') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG os_vif [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:70:d1,bridge_name='br-int',has_traffic_filtering=True,id=63fc17ce-ef08-4f7e-ab83-b1040733d228,network=Network(3f843b34-4601-4294-93d6-36cfbbf94a95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap63fc17ce-ef') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3ae91447-1205-5f74-abc0-bf85ba5721a7', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG nova.compute.manager [req-f24cf934-e7e4-454c-83fa-7bbd14bcb11c req-fecd4d73-18ef-4fce-9ee6-5b1de0cce454 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-vif-plugged-298ce71b-894a-4e29-904e-1ba5d4495fcb {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f24cf934-e7e4-454c-83fa-7bbd14bcb11c req-fecd4d73-18ef-4fce-9ee6-5b1de0cce454 service nova] Acquiring lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f24cf934-e7e4-454c-83fa-7bbd14bcb11c req-fecd4d73-18ef-4fce-9ee6-5b1de0cce454 service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f24cf934-e7e4-454c-83fa-7bbd14bcb11c req-fecd4d73-18ef-4fce-9ee6-5b1de0cce454 service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG nova.compute.manager [req-f24cf934-e7e4-454c-83fa-7bbd14bcb11c req-fecd4d73-18ef-4fce-9ee6-5b1de0cce454 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] No waiting events found dispatching network-vif-plugged-298ce71b-894a-4e29-904e-1ba5d4495fcb {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:54:06 user nova-compute[74348]: WARNING nova.compute.manager [req-f24cf934-e7e4-454c-83fa-7bbd14bcb11c req-fecd4d73-18ef-4fce-9ee6-5b1de0cce454 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received unexpected event network-vif-plugged-298ce71b-894a-4e29-904e-1ba5d4495fcb for instance with vm_state building and task_state spawning.
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63fc17ce-ef, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap63fc17ce-ef, col_values=(('qos', UUID('a465de26-f5b5-4f4a-8796-196c3f368983')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap63fc17ce-ef, col_values=(('external_ids', {'iface-id': '63fc17ce-ef08-4f7e-ab83-b1040733d228', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:70:d1', 'vm-uuid': '8527ae47-a025-492d-9820-b9c5ee309d81'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:06 user nova-compute[74348]: INFO os_vif [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:70:d1,bridge_name='br-int',has_traffic_filtering=True,id=63fc17ce-ef08-4f7e-ab83-b1040733d228,network=Network(3f843b34-4601-4294-93d6-36cfbbf94a95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap63fc17ce-ef')
Nov 22 07:54:06 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-574357068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-574357068',id=12,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPh8WrgN05Udth7XNATbD0Z+g0hoWMflQ1e+XdiOuBd1xLNGVHWp/bZGSnlbVFto/38wc6mSlPbrRK9XwiDx6Yn5HNC2pFZ8C7kB6aRkT1jiYcW2IxcpgmJM/7ZZJUwqcw==',key_name='tempest-keypair-436025460',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a08625e4d04478297484c875ac9a5c3',ramdisk_id='',reservation_id='r-7l9plp3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1955894791',owner_user_name='tempest-TaggedBootDevicesTest-1955894791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:53:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d026e5b011144beb9340e6ceb58583f3',uuid=8527ae47-a025-492d-9820-b9c5ee309d81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "969790c1-f8a4-4d98-86d9-1ed932c83daa", "address": "fa:16:3e:6d:21:36", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969790c1-f8", "ovs_interfaceid": "969790c1-f8a4-4d98-86d9-1ed932c83daa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Converting VIF {"id": "969790c1-f8a4-4d98-86d9-1ed932c83daa", "address": "fa:16:3e:6d:21:36", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969790c1-f8", "ovs_interfaceid": "969790c1-f8a4-4d98-86d9-1ed932c83daa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:21:36,bridge_name='br-int',has_traffic_filtering=True,id=969790c1-f8a4-4d98-86d9-1ed932c83daa,network=Network(3f843b34-4601-4294-93d6-36cfbbf94a95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap969790c1-f8') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG os_vif [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:21:36,bridge_name='br-int',has_traffic_filtering=True,id=969790c1-f8a4-4d98-86d9-1ed932c83daa,network=Network(3f843b34-4601-4294-93d6-36cfbbf94a95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap969790c1-f8') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e0c29f1d-f6ae-51d9-97fa-69dd018b5cbf', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap969790c1-f8, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap969790c1-f8, col_values=(('qos', UUID('f25ff883-8013-4c44-b4f5-b4e7dd03279c')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap969790c1-f8, col_values=(('external_ids', {'iface-id': '969790c1-f8a4-4d98-86d9-1ed932c83daa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:21:36', 'vm-uuid': '8527ae47-a025-492d-9820-b9c5ee309d81'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:06 user nova-compute[74348]: INFO os_vif [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:21:36,bridge_name='br-int',has_traffic_filtering=True,id=969790c1-f8a4-4d98-86d9-1ed932c83daa,network=Network(3f843b34-4601-4294-93d6-36cfbbf94a95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap969790c1-f8')
Nov 22 07:54:06 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-574357068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-574357068',id=12,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPh8WrgN05Udth7XNATbD0Z+g0hoWMflQ1e+XdiOuBd1xLNGVHWp/bZGSnlbVFto/38wc6mSlPbrRK9XwiDx6Yn5HNC2pFZ8C7kB6aRkT1jiYcW2IxcpgmJM/7ZZJUwqcw==',key_name='tempest-keypair-436025460',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a08625e4d04478297484c875ac9a5c3',ramdisk_id='',reservation_id='r-7l9plp3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1955894791',owner_user_name='tempest-TaggedBootDevicesTest-1955894791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:53:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d026e5b011144beb9340e6ceb58583f3',uuid=8527ae47-a025-492d-9820-b9c5ee309d81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "748e5281-27d7-43b4-ba47-2f0daed1181e", "address": "fa:16:3e:f9:d2:8f", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap748e5281-27", "ovs_interfaceid": "748e5281-27d7-43b4-ba47-2f0daed1181e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Converting VIF {"id": "748e5281-27d7-43b4-ba47-2f0daed1181e", "address": "fa:16:3e:f9:d2:8f", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap748e5281-27", "ovs_interfaceid": "748e5281-27d7-43b4-ba47-2f0daed1181e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:d2:8f,bridge_name='br-int',has_traffic_filtering=True,id=748e5281-27d7-43b4-ba47-2f0daed1181e,network=Network(3f843b34-4601-4294-93d6-36cfbbf94a95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap748e5281-27') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG os_vif [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:d2:8f,bridge_name='br-int',has_traffic_filtering=True,id=748e5281-27d7-43b4-ba47-2f0daed1181e,network=Network(3f843b34-4601-4294-93d6-36cfbbf94a95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap748e5281-27') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '64b8b4ff-7216-54dd-b763-927d0b8e897d', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap748e5281-27, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap748e5281-27, col_values=(('qos', UUID('a2500caf-1bea-41f9-bb0f-0c6c281abca3')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap748e5281-27, col_values=(('external_ids', {'iface-id': '748e5281-27d7-43b4-ba47-2f0daed1181e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:d2:8f', 'vm-uuid': '8527ae47-a025-492d-9820-b9c5ee309d81'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:07 user nova-compute[74348]: INFO os_vif [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:d2:8f,bridge_name='br-int',has_traffic_filtering=True,id=748e5281-27d7-43b4-ba47-2f0daed1181e,network=Network(3f843b34-4601-4294-93d6-36cfbbf94a95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap748e5281-27')
Nov 22 07:54:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-574357068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-574357068',id=12,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPh8WrgN05Udth7XNATbD0Z+g0hoWMflQ1e+XdiOuBd1xLNGVHWp/bZGSnlbVFto/38wc6mSlPbrRK9XwiDx6Yn5HNC2pFZ8C7kB6aRkT1jiYcW2IxcpgmJM/7ZZJUwqcw==',key_name='tempest-keypair-436025460',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a08625e4d04478297484c875ac9a5c3',ramdisk_id='',reservation_id='r-7l9plp3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1955894791',owner_user_name='tempest-TaggedBootDevicesTest-1955894791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:53:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d026e5b011144beb9340e6ceb58583f3',uuid=8527ae47-a025-492d-9820-b9c5ee309d81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d77c2a03-a402-4288-8a40-2f88200a8f22", "address": "fa:16:3e:b2:36:f8", "network": {"id": "f39bd97a-26ce-4373-bf3b-ceb5c8dc21ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-224466528", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd77c2a03-a4", "ovs_interfaceid": "d77c2a03-a402-4288-8a40-2f88200a8f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Converting VIF {"id": "d77c2a03-a402-4288-8a40-2f88200a8f22", "address": "fa:16:3e:b2:36:f8", "network": {"id": "f39bd97a-26ce-4373-bf3b-ceb5c8dc21ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-224466528", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd77c2a03-a4", "ovs_interfaceid": "d77c2a03-a402-4288-8a40-2f88200a8f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:36:f8,bridge_name='br-int',has_traffic_filtering=True,id=d77c2a03-a402-4288-8a40-2f88200a8f22,network=Network(f39bd97a-26ce-4373-bf3b-ceb5c8dc21ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd77c2a03-a4') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG os_vif [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:36:f8,bridge_name='br-int',has_traffic_filtering=True,id=d77c2a03-a402-4288-8a40-2f88200a8f22,network=Network(f39bd97a-26ce-4373-bf3b-ceb5c8dc21ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd77c2a03-a4') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7685f4d3-fd50-5a0f-bbe3-e250e0f312b2', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd77c2a03-a4, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd77c2a03-a4, col_values=(('qos', UUID('810312be-6602-4a14-98e7-d4b80644531b')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd77c2a03-a4, col_values=(('external_ids', {'iface-id': 'd77c2a03-a402-4288-8a40-2f88200a8f22', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:36:f8', 'vm-uuid': '8527ae47-a025-492d-9820-b9c5ee309d81'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:07 user nova-compute[74348]: INFO os_vif [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:36:f8,bridge_name='br-int',has_traffic_filtering=True,id=d77c2a03-a402-4288-8a40-2f88200a8f22,network=Network(f39bd97a-26ce-4373-bf3b-ceb5c8dc21ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd77c2a03-a4')
Nov 22 07:54:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-574357068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-574357068',id=12,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPh8WrgN05Udth7XNATbD0Z+g0hoWMflQ1e+XdiOuBd1xLNGVHWp/bZGSnlbVFto/38wc6mSlPbrRK9XwiDx6Yn5HNC2pFZ8C7kB6aRkT1jiYcW2IxcpgmJM/7ZZJUwqcw==',key_name='tempest-keypair-436025460',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a08625e4d04478297484c875ac9a5c3',ramdisk_id='',reservation_id='r-7l9plp3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1955894791',owner_user_name='tempest-TaggedBootDevicesTest-1955894791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:53:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d026e5b011144beb9340e6ceb58583f3',uuid=8527ae47-a025-492d-9820-b9c5ee309d81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a64b4a32-73f1-4a48-8b80-86d353d1d40b", "address": "fa:16:3e:be:1c:23", "network": {"id": "f39bd97a-26ce-4373-bf3b-ceb5c8dc21ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-224466528", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64b4a32-73", "ovs_interfaceid": "a64b4a32-73f1-4a48-8b80-86d353d1d40b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Converting VIF {"id": "a64b4a32-73f1-4a48-8b80-86d353d1d40b", "address": "fa:16:3e:be:1c:23", "network": {"id": "f39bd97a-26ce-4373-bf3b-ceb5c8dc21ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-224466528", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64b4a32-73", "ovs_interfaceid": "a64b4a32-73f1-4a48-8b80-86d353d1d40b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:1c:23,bridge_name='br-int',has_traffic_filtering=True,id=a64b4a32-73f1-4a48-8b80-86d353d1d40b,network=Network(f39bd97a-26ce-4373-bf3b-ceb5c8dc21ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa64b4a32-73') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG os_vif [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:1c:23,bridge_name='br-int',has_traffic_filtering=True,id=a64b4a32-73f1-4a48-8b80-86d353d1d40b,network=Network(f39bd97a-26ce-4373-bf3b-ceb5c8dc21ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa64b4a32-73') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0e1187f4-aeda-5ad4-ac84-a80e82895c21', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa64b4a32-73, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa64b4a32-73, col_values=(('qos', UUID('12bb5241-d61d-4e10-98f9-ae8f3cc7c2f9')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa64b4a32-73, col_values=(('external_ids', {'iface-id': 'a64b4a32-73f1-4a48-8b80-86d353d1d40b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:1c:23', 'vm-uuid': '8527ae47-a025-492d-9820-b9c5ee309d81'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:07 user nova-compute[74348]: INFO os_vif [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:1c:23,bridge_name='br-int',has_traffic_filtering=True,id=a64b4a32-73f1-4a48-8b80-86d353d1d40b,network=Network(f39bd97a-26ce-4373-bf3b-ceb5c8dc21ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa64b4a32-73')
Nov 22 07:54:07 user nova-compute[74348]: DEBUG nova.compute.manager [req-a52f4519-b5e9-4e3a-930d-839f2314152a req-682baf19-9434-475c-98c4-4f3a7e6ff7ac service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-vif-plugged-4a8ea7e1-9e80-4686-a3a9-4142b9de0049 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a52f4519-b5e9-4e3a-930d-839f2314152a req-682baf19-9434-475c-98c4-4f3a7e6ff7ac service nova] Acquiring lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a52f4519-b5e9-4e3a-930d-839f2314152a req-682baf19-9434-475c-98c4-4f3a7e6ff7ac service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a52f4519-b5e9-4e3a-930d-839f2314152a req-682baf19-9434-475c-98c4-4f3a7e6ff7ac service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG nova.compute.manager [req-a52f4519-b5e9-4e3a-930d-839f2314152a req-682baf19-9434-475c-98c4-4f3a7e6ff7ac service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] No waiting events found dispatching network-vif-plugged-4a8ea7e1-9e80-4686-a3a9-4142b9de0049 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:54:07 user nova-compute[74348]: WARNING nova.compute.manager [req-a52f4519-b5e9-4e3a-930d-839f2314152a req-682baf19-9434-475c-98c4-4f3a7e6ff7ac service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received unexpected event network-vif-plugged-4a8ea7e1-9e80-4686-a3a9-4142b9de0049 for instance with vm_state building and task_state spawning.
Nov 22 07:54:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] No BDM found with device name hda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] No VIF found with MAC fa:16:3e:6a:1c:a3, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 07:54:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] No VIF found with MAC fa:16:3e:f9:d2:8f, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 07:54:07 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Using config drive
Nov 22 07:54:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:08 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Creating config drive at /opt/stack/data/nova/instances/8527ae47-a025-492d-9820-b9c5ee309d81/disk.config
Nov 22 07:54:08 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8527ae47-a025-492d-9820-b9c5ee309d81/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpuaq12m5i {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:08 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8527ae47-a025-492d-9820-b9c5ee309d81/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpuaq12m5i" returned: 0 in 0.068s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:08 user nova-compute[74348]: DEBUG nova.compute.manager [req-ae0da01b-8e0f-4f31-b911-00a08ea095bb req-89feb97a-c2a9-458c-b966-5231a6267300 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-vif-plugged-e30deaf5-1258-4909-bc71-044c88f2995f {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:54:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-ae0da01b-8e0f-4f31-b911-00a08ea095bb req-89feb97a-c2a9-458c-b966-5231a6267300 service nova] Acquiring lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-ae0da01b-8e0f-4f31-b911-00a08ea095bb req-89feb97a-c2a9-458c-b966-5231a6267300 service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-ae0da01b-8e0f-4f31-b911-00a08ea095bb req-89feb97a-c2a9-458c-b966-5231a6267300 service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:08 user nova-compute[74348]: DEBUG nova.compute.manager [req-ae0da01b-8e0f-4f31-b911-00a08ea095bb req-89feb97a-c2a9-458c-b966-5231a6267300 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] No waiting events found dispatching network-vif-plugged-e30deaf5-1258-4909-bc71-044c88f2995f {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:54:08 user nova-compute[74348]: WARNING nova.compute.manager [req-ae0da01b-8e0f-4f31-b911-00a08ea095bb req-89feb97a-c2a9-458c-b966-5231a6267300 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received unexpected event network-vif-plugged-e30deaf5-1258-4909-bc71-044c88f2995f for instance with vm_state building and task_state spawning.
Nov 22 07:54:08 user nova-compute[74348]: DEBUG nova.compute.manager [req-ae0da01b-8e0f-4f31-b911-00a08ea095bb req-89feb97a-c2a9-458c-b966-5231a6267300 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-vif-plugged-f0f55187-e53f-468d-83a8-cca33ff1380e {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:54:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-ae0da01b-8e0f-4f31-b911-00a08ea095bb req-89feb97a-c2a9-458c-b966-5231a6267300 service nova] Acquiring lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-ae0da01b-8e0f-4f31-b911-00a08ea095bb req-89feb97a-c2a9-458c-b966-5231a6267300 service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-ae0da01b-8e0f-4f31-b911-00a08ea095bb req-89feb97a-c2a9-458c-b966-5231a6267300 service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:08 user nova-compute[74348]: DEBUG nova.compute.manager [req-ae0da01b-8e0f-4f31-b911-00a08ea095bb req-89feb97a-c2a9-458c-b966-5231a6267300 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] No waiting events found dispatching network-vif-plugged-f0f55187-e53f-468d-83a8-cca33ff1380e {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:54:08 user nova-compute[74348]: WARNING nova.compute.manager [req-ae0da01b-8e0f-4f31-b911-00a08ea095bb req-89feb97a-c2a9-458c-b966-5231a6267300 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received unexpected event network-vif-plugged-f0f55187-e53f-468d-83a8-cca33ff1380e for instance with vm_state building and task_state spawning.
Nov 22 07:54:08 user nova-compute[74348]: DEBUG nova.compute.manager [req-ae0da01b-8e0f-4f31-b911-00a08ea095bb req-89feb97a-c2a9-458c-b966-5231a6267300 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-vif-plugged-f0f55187-e53f-468d-83a8-cca33ff1380e {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:54:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-ae0da01b-8e0f-4f31-b911-00a08ea095bb req-89feb97a-c2a9-458c-b966-5231a6267300 service nova] Acquiring lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-ae0da01b-8e0f-4f31-b911-00a08ea095bb req-89feb97a-c2a9-458c-b966-5231a6267300 service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-ae0da01b-8e0f-4f31-b911-00a08ea095bb req-89feb97a-c2a9-458c-b966-5231a6267300 service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:08 user nova-compute[74348]: DEBUG nova.compute.manager [req-ae0da01b-8e0f-4f31-b911-00a08ea095bb req-89feb97a-c2a9-458c-b966-5231a6267300 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] No waiting events found dispatching network-vif-plugged-f0f55187-e53f-468d-83a8-cca33ff1380e {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:54:08 user nova-compute[74348]: WARNING nova.compute.manager [req-ae0da01b-8e0f-4f31-b911-00a08ea095bb req-89feb97a-c2a9-458c-b966-5231a6267300 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received unexpected event network-vif-plugged-f0f55187-e53f-468d-83a8-cca33ff1380e for instance with vm_state building and task_state spawning.
Nov 22 07:54:08 user nova-compute[74348]: DEBUG nova.compute.manager [req-ae0da01b-8e0f-4f31-b911-00a08ea095bb req-89feb97a-c2a9-458c-b966-5231a6267300 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-vif-plugged-5a68d2be-be4c-462b-9dd4-15e222160557 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:54:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-ae0da01b-8e0f-4f31-b911-00a08ea095bb req-89feb97a-c2a9-458c-b966-5231a6267300 service nova] Acquiring lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-ae0da01b-8e0f-4f31-b911-00a08ea095bb req-89feb97a-c2a9-458c-b966-5231a6267300 service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-ae0da01b-8e0f-4f31-b911-00a08ea095bb req-89feb97a-c2a9-458c-b966-5231a6267300 service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:08 user nova-compute[74348]: DEBUG nova.compute.manager [req-ae0da01b-8e0f-4f31-b911-00a08ea095bb req-89feb97a-c2a9-458c-b966-5231a6267300 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] No waiting events found dispatching network-vif-plugged-5a68d2be-be4c-462b-9dd4-15e222160557 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:54:08 user nova-compute[74348]: WARNING nova.compute.manager [req-ae0da01b-8e0f-4f31-b911-00a08ea095bb req-89feb97a-c2a9-458c-b966-5231a6267300 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received unexpected event network-vif-plugged-5a68d2be-be4c-462b-9dd4-15e222160557 for instance with vm_state building and task_state spawning.
Nov 22 07:54:08 user nova-compute[74348]: DEBUG nova.compute.manager [req-ae0da01b-8e0f-4f31-b911-00a08ea095bb req-89feb97a-c2a9-458c-b966-5231a6267300 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-vif-plugged-5a68d2be-be4c-462b-9dd4-15e222160557 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:54:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-ae0da01b-8e0f-4f31-b911-00a08ea095bb req-89feb97a-c2a9-458c-b966-5231a6267300 service nova] Acquiring lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-ae0da01b-8e0f-4f31-b911-00a08ea095bb req-89feb97a-c2a9-458c-b966-5231a6267300 service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-ae0da01b-8e0f-4f31-b911-00a08ea095bb req-89feb97a-c2a9-458c-b966-5231a6267300 service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:08 user nova-compute[74348]: DEBUG nova.compute.manager [req-ae0da01b-8e0f-4f31-b911-00a08ea095bb req-89feb97a-c2a9-458c-b966-5231a6267300 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] No waiting events found dispatching network-vif-plugged-5a68d2be-be4c-462b-9dd4-15e222160557 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:54:08 user nova-compute[74348]: WARNING nova.compute.manager [req-ae0da01b-8e0f-4f31-b911-00a08ea095bb req-89feb97a-c2a9-458c-b966-5231a6267300 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received unexpected event network-vif-plugged-5a68d2be-be4c-462b-9dd4-15e222160557 for instance with vm_state building and task_state spawning.
Nov 22 07:54:08 user nova-compute[74348]: DEBUG nova.compute.manager [req-ae0da01b-8e0f-4f31-b911-00a08ea095bb req-89feb97a-c2a9-458c-b966-5231a6267300 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-vif-plugged-9aa74044-d952-47e5-9cc1-948615a01eb3 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:54:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-ae0da01b-8e0f-4f31-b911-00a08ea095bb req-89feb97a-c2a9-458c-b966-5231a6267300 service nova] Acquiring lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-ae0da01b-8e0f-4f31-b911-00a08ea095bb req-89feb97a-c2a9-458c-b966-5231a6267300 service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-ae0da01b-8e0f-4f31-b911-00a08ea095bb req-89feb97a-c2a9-458c-b966-5231a6267300 service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:08 user nova-compute[74348]: DEBUG nova.compute.manager [req-ae0da01b-8e0f-4f31-b911-00a08ea095bb req-89feb97a-c2a9-458c-b966-5231a6267300 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] No waiting events found dispatching network-vif-plugged-9aa74044-d952-47e5-9cc1-948615a01eb3 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:54:08 user nova-compute[74348]: WARNING nova.compute.manager [req-ae0da01b-8e0f-4f31-b911-00a08ea095bb req-89feb97a-c2a9-458c-b966-5231a6267300 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received unexpected event network-vif-plugged-9aa74044-d952-47e5-9cc1-948615a01eb3 for instance with vm_state building and task_state spawning.
Nov 22 07:54:08 user nova-compute[74348]: DEBUG nova.compute.manager [req-ae0da01b-8e0f-4f31-b911-00a08ea095bb req-89feb97a-c2a9-458c-b966-5231a6267300 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-vif-plugged-9aa74044-d952-47e5-9cc1-948615a01eb3 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:54:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-ae0da01b-8e0f-4f31-b911-00a08ea095bb req-89feb97a-c2a9-458c-b966-5231a6267300 service nova] Acquiring lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-ae0da01b-8e0f-4f31-b911-00a08ea095bb req-89feb97a-c2a9-458c-b966-5231a6267300 service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-ae0da01b-8e0f-4f31-b911-00a08ea095bb req-89feb97a-c2a9-458c-b966-5231a6267300 service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:08 user nova-compute[74348]: DEBUG nova.compute.manager [req-ae0da01b-8e0f-4f31-b911-00a08ea095bb req-89feb97a-c2a9-458c-b966-5231a6267300 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] No waiting events found dispatching network-vif-plugged-9aa74044-d952-47e5-9cc1-948615a01eb3 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:54:08 user nova-compute[74348]: WARNING nova.compute.manager [req-ae0da01b-8e0f-4f31-b911-00a08ea095bb req-89feb97a-c2a9-458c-b966-5231a6267300 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received unexpected event network-vif-plugged-9aa74044-d952-47e5-9cc1-948615a01eb3 for instance with vm_state building and task_state spawning.
Nov 22 07:54:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:08 user nova-compute[74348]: DEBUG nova.compute.manager [req-a69d5579-163b-42d6-bd02-d6b4553a503a req-3ab69ff6-d999-4324-b046-445942ff376e service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-vif-plugged-298ce71b-894a-4e29-904e-1ba5d4495fcb {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:54:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a69d5579-163b-42d6-bd02-d6b4553a503a req-3ab69ff6-d999-4324-b046-445942ff376e service nova] Acquiring lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a69d5579-163b-42d6-bd02-d6b4553a503a req-3ab69ff6-d999-4324-b046-445942ff376e service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a69d5579-163b-42d6-bd02-d6b4553a503a req-3ab69ff6-d999-4324-b046-445942ff376e service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:08 user nova-compute[74348]: DEBUG nova.compute.manager [req-a69d5579-163b-42d6-bd02-d6b4553a503a req-3ab69ff6-d999-4324-b046-445942ff376e service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] No waiting events found dispatching network-vif-plugged-298ce71b-894a-4e29-904e-1ba5d4495fcb {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:54:08 user nova-compute[74348]: WARNING nova.compute.manager [req-a69d5579-163b-42d6-bd02-d6b4553a503a req-3ab69ff6-d999-4324-b046-445942ff376e service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received unexpected event network-vif-plugged-298ce71b-894a-4e29-904e-1ba5d4495fcb for instance with vm_state building and task_state spawning.
Nov 22 07:54:08 user nova-compute[74348]: DEBUG nova.compute.manager [req-a69d5579-163b-42d6-bd02-d6b4553a503a req-3ab69ff6-d999-4324-b046-445942ff376e service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-vif-plugged-579fb42b-b8b6-4122-8ec3-8817c9e0881a {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:54:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a69d5579-163b-42d6-bd02-d6b4553a503a req-3ab69ff6-d999-4324-b046-445942ff376e service nova] Acquiring lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a69d5579-163b-42d6-bd02-d6b4553a503a req-3ab69ff6-d999-4324-b046-445942ff376e service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a69d5579-163b-42d6-bd02-d6b4553a503a req-3ab69ff6-d999-4324-b046-445942ff376e service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:08 user nova-compute[74348]: DEBUG nova.compute.manager [req-a69d5579-163b-42d6-bd02-d6b4553a503a req-3ab69ff6-d999-4324-b046-445942ff376e service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] No waiting events found dispatching network-vif-plugged-579fb42b-b8b6-4122-8ec3-8817c9e0881a {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:54:08 user nova-compute[74348]: WARNING nova.compute.manager [req-a69d5579-163b-42d6-bd02-d6b4553a503a req-3ab69ff6-d999-4324-b046-445942ff376e service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received unexpected event network-vif-plugged-579fb42b-b8b6-4122-8ec3-8817c9e0881a for instance with vm_state building and task_state spawning.
Nov 22 07:54:08 user nova-compute[74348]: DEBUG nova.compute.manager [req-a69d5579-163b-42d6-bd02-d6b4553a503a req-3ab69ff6-d999-4324-b046-445942ff376e service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-vif-plugged-579fb42b-b8b6-4122-8ec3-8817c9e0881a {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:54:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a69d5579-163b-42d6-bd02-d6b4553a503a req-3ab69ff6-d999-4324-b046-445942ff376e service nova] Acquiring lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a69d5579-163b-42d6-bd02-d6b4553a503a req-3ab69ff6-d999-4324-b046-445942ff376e service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a69d5579-163b-42d6-bd02-d6b4553a503a req-3ab69ff6-d999-4324-b046-445942ff376e service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:08 user nova-compute[74348]: DEBUG nova.compute.manager [req-a69d5579-163b-42d6-bd02-d6b4553a503a req-3ab69ff6-d999-4324-b046-445942ff376e service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] No waiting events found dispatching network-vif-plugged-579fb42b-b8b6-4122-8ec3-8817c9e0881a {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:54:08 user nova-compute[74348]: WARNING nova.compute.manager [req-a69d5579-163b-42d6-bd02-d6b4553a503a req-3ab69ff6-d999-4324-b046-445942ff376e service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received unexpected event network-vif-plugged-579fb42b-b8b6-4122-8ec3-8817c9e0881a for instance with vm_state building and task_state spawning.
Nov 22 07:54:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:09 user nova-compute[74348]: DEBUG nova.compute.manager [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 07:54:09 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 07:54:09 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Instance spawned successfully.
Nov 22 07:54:09 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 07:54:09 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:54:09 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:54:09 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:54:09 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:54:09 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:54:09 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:54:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:09 user nova-compute[74348]: INFO nova.compute.manager [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Took 12.58 seconds to spawn the instance on the hypervisor.
Nov 22 07:54:09 user nova-compute[74348]: DEBUG nova.compute.manager [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 07:54:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:10 user nova-compute[74348]: INFO nova.compute.manager [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Took 34.28 seconds to build instance.
Nov 22 07:54:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-89d98e7c-8fe6-4310-8318-6e2776960c93 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.448s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:10 user nova-compute[74348]: DEBUG nova.compute.manager [req-23c1d137-0cdf-4924-990a-dd4a87a16b0c req-b75531d9-9d4c-4fce-b1f4-c76ef9105ac1 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-vif-plugged-6221165b-f588-475c-a3b1-afdf5c60c113 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:54:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-23c1d137-0cdf-4924-990a-dd4a87a16b0c req-b75531d9-9d4c-4fce-b1f4-c76ef9105ac1 service nova] Acquiring lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-23c1d137-0cdf-4924-990a-dd4a87a16b0c req-b75531d9-9d4c-4fce-b1f4-c76ef9105ac1 service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-23c1d137-0cdf-4924-990a-dd4a87a16b0c req-b75531d9-9d4c-4fce-b1f4-c76ef9105ac1 service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:10 user nova-compute[74348]: DEBUG nova.compute.manager [req-23c1d137-0cdf-4924-990a-dd4a87a16b0c req-b75531d9-9d4c-4fce-b1f4-c76ef9105ac1 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] No waiting events found dispatching network-vif-plugged-6221165b-f588-475c-a3b1-afdf5c60c113 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:54:10 user nova-compute[74348]: WARNING nova.compute.manager [req-23c1d137-0cdf-4924-990a-dd4a87a16b0c req-b75531d9-9d4c-4fce-b1f4-c76ef9105ac1 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received unexpected event network-vif-plugged-6221165b-f588-475c-a3b1-afdf5c60c113 for instance with vm_state building and task_state spawning.
Nov 22 07:54:10 user nova-compute[74348]: DEBUG nova.compute.manager [req-23c1d137-0cdf-4924-990a-dd4a87a16b0c req-b75531d9-9d4c-4fce-b1f4-c76ef9105ac1 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-vif-plugged-6221165b-f588-475c-a3b1-afdf5c60c113 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:54:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-23c1d137-0cdf-4924-990a-dd4a87a16b0c req-b75531d9-9d4c-4fce-b1f4-c76ef9105ac1 service nova] Acquiring lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-23c1d137-0cdf-4924-990a-dd4a87a16b0c req-b75531d9-9d4c-4fce-b1f4-c76ef9105ac1 service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-23c1d137-0cdf-4924-990a-dd4a87a16b0c req-b75531d9-9d4c-4fce-b1f4-c76ef9105ac1 service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:10 user nova-compute[74348]: DEBUG nova.compute.manager [req-23c1d137-0cdf-4924-990a-dd4a87a16b0c req-b75531d9-9d4c-4fce-b1f4-c76ef9105ac1 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] No waiting events found dispatching network-vif-plugged-6221165b-f588-475c-a3b1-afdf5c60c113 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:54:10 user nova-compute[74348]: WARNING nova.compute.manager [req-23c1d137-0cdf-4924-990a-dd4a87a16b0c req-b75531d9-9d4c-4fce-b1f4-c76ef9105ac1 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received unexpected event network-vif-plugged-6221165b-f588-475c-a3b1-afdf5c60c113 for instance with vm_state building and task_state spawning.
Nov 22 07:54:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:10 user nova-compute[74348]: DEBUG nova.compute.manager [req-641f921c-60af-4fbc-88e0-1041f1208677 req-644f9c95-25bb-4b81-a425-19a051a0988c service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-vif-plugged-63fc17ce-ef08-4f7e-ab83-b1040733d228 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:54:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-641f921c-60af-4fbc-88e0-1041f1208677 req-644f9c95-25bb-4b81-a425-19a051a0988c service nova] Acquiring lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-641f921c-60af-4fbc-88e0-1041f1208677 req-644f9c95-25bb-4b81-a425-19a051a0988c service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-641f921c-60af-4fbc-88e0-1041f1208677 req-644f9c95-25bb-4b81-a425-19a051a0988c service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:10 user nova-compute[74348]: DEBUG nova.compute.manager [req-641f921c-60af-4fbc-88e0-1041f1208677 req-644f9c95-25bb-4b81-a425-19a051a0988c service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] No waiting events found dispatching network-vif-plugged-63fc17ce-ef08-4f7e-ab83-b1040733d228 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:54:10 user nova-compute[74348]: WARNING nova.compute.manager [req-641f921c-60af-4fbc-88e0-1041f1208677 req-644f9c95-25bb-4b81-a425-19a051a0988c service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received unexpected event network-vif-plugged-63fc17ce-ef08-4f7e-ab83-b1040733d228 for instance with vm_state building and task_state spawning.
Nov 22 07:54:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:10 user nova-compute[74348]: DEBUG nova.compute.manager [req-02db02df-c863-40f2-b1d6-4d9c80094d41 req-2e06fcbc-db3e-407e-9922-268042ce6929 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-vif-plugged-62ed8403-ebcd-4e41-ac81-0056cf71738c {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:54:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-02db02df-c863-40f2-b1d6-4d9c80094d41 req-2e06fcbc-db3e-407e-9922-268042ce6929 service nova] Acquiring lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-02db02df-c863-40f2-b1d6-4d9c80094d41 req-2e06fcbc-db3e-407e-9922-268042ce6929 service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-02db02df-c863-40f2-b1d6-4d9c80094d41 req-2e06fcbc-db3e-407e-9922-268042ce6929 service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:10 user nova-compute[74348]: DEBUG nova.compute.manager [req-02db02df-c863-40f2-b1d6-4d9c80094d41 req-2e06fcbc-db3e-407e-9922-268042ce6929 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] No waiting events found dispatching network-vif-plugged-62ed8403-ebcd-4e41-ac81-0056cf71738c {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:54:10 user nova-compute[74348]: WARNING nova.compute.manager [req-02db02df-c863-40f2-b1d6-4d9c80094d41 req-2e06fcbc-db3e-407e-9922-268042ce6929 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received unexpected event network-vif-plugged-62ed8403-ebcd-4e41-ac81-0056cf71738c for instance with vm_state building and task_state spawning.
Nov 22 07:54:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG nova.compute.manager [req-84b78665-b7be-44b7-ae61-aaf2f9423c96 req-a6a83bb0-3267-47e8-b6e0-b377a08252a7 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-vif-plugged-969790c1-f8a4-4d98-86d9-1ed932c83daa {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-84b78665-b7be-44b7-ae61-aaf2f9423c96 req-a6a83bb0-3267-47e8-b6e0-b377a08252a7 service nova] Acquiring lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-84b78665-b7be-44b7-ae61-aaf2f9423c96 req-a6a83bb0-3267-47e8-b6e0-b377a08252a7 service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-84b78665-b7be-44b7-ae61-aaf2f9423c96 req-a6a83bb0-3267-47e8-b6e0-b377a08252a7 service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG nova.compute.manager [req-84b78665-b7be-44b7-ae61-aaf2f9423c96 req-a6a83bb0-3267-47e8-b6e0-b377a08252a7 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] No waiting events found dispatching network-vif-plugged-969790c1-f8a4-4d98-86d9-1ed932c83daa {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:54:12 user nova-compute[74348]: WARNING nova.compute.manager [req-84b78665-b7be-44b7-ae61-aaf2f9423c96 req-a6a83bb0-3267-47e8-b6e0-b377a08252a7 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received unexpected event network-vif-plugged-969790c1-f8a4-4d98-86d9-1ed932c83daa for instance with vm_state building and task_state spawning.
Nov 22 07:54:12 user nova-compute[74348]: DEBUG nova.compute.manager [req-84b78665-b7be-44b7-ae61-aaf2f9423c96 req-a6a83bb0-3267-47e8-b6e0-b377a08252a7 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-vif-plugged-969790c1-f8a4-4d98-86d9-1ed932c83daa {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-84b78665-b7be-44b7-ae61-aaf2f9423c96 req-a6a83bb0-3267-47e8-b6e0-b377a08252a7 service nova] Acquiring lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-84b78665-b7be-44b7-ae61-aaf2f9423c96 req-a6a83bb0-3267-47e8-b6e0-b377a08252a7 service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-84b78665-b7be-44b7-ae61-aaf2f9423c96 req-a6a83bb0-3267-47e8-b6e0-b377a08252a7 service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG nova.compute.manager [req-84b78665-b7be-44b7-ae61-aaf2f9423c96 req-a6a83bb0-3267-47e8-b6e0-b377a08252a7 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] No waiting events found dispatching network-vif-plugged-969790c1-f8a4-4d98-86d9-1ed932c83daa {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:54:12 user nova-compute[74348]: WARNING nova.compute.manager [req-84b78665-b7be-44b7-ae61-aaf2f9423c96 req-a6a83bb0-3267-47e8-b6e0-b377a08252a7 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received unexpected event network-vif-plugged-969790c1-f8a4-4d98-86d9-1ed932c83daa for instance with vm_state building and task_state spawning.
Nov 22 07:54:12 user nova-compute[74348]: DEBUG nova.compute.manager [req-48ce9b66-b6ac-4e2c-ad97-02932c849294 req-167669f3-7a8d-4bd3-a776-3f00c8d9e9f9 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-vif-plugged-63fc17ce-ef08-4f7e-ab83-b1040733d228 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-48ce9b66-b6ac-4e2c-ad97-02932c849294 req-167669f3-7a8d-4bd3-a776-3f00c8d9e9f9 service nova] Acquiring lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-48ce9b66-b6ac-4e2c-ad97-02932c849294 req-167669f3-7a8d-4bd3-a776-3f00c8d9e9f9 service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-48ce9b66-b6ac-4e2c-ad97-02932c849294 req-167669f3-7a8d-4bd3-a776-3f00c8d9e9f9 service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG nova.compute.manager [req-48ce9b66-b6ac-4e2c-ad97-02932c849294 req-167669f3-7a8d-4bd3-a776-3f00c8d9e9f9 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] No waiting events found dispatching network-vif-plugged-63fc17ce-ef08-4f7e-ab83-b1040733d228 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:54:12 user nova-compute[74348]: WARNING nova.compute.manager [req-48ce9b66-b6ac-4e2c-ad97-02932c849294 req-167669f3-7a8d-4bd3-a776-3f00c8d9e9f9 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received unexpected event network-vif-plugged-63fc17ce-ef08-4f7e-ab83-b1040733d228 for instance with vm_state building and task_state spawning.
Nov 22 07:54:12 user nova-compute[74348]: DEBUG nova.compute.manager [req-48ce9b66-b6ac-4e2c-ad97-02932c849294 req-167669f3-7a8d-4bd3-a776-3f00c8d9e9f9 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-vif-plugged-d77c2a03-a402-4288-8a40-2f88200a8f22 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-48ce9b66-b6ac-4e2c-ad97-02932c849294 req-167669f3-7a8d-4bd3-a776-3f00c8d9e9f9 service nova] Acquiring lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-48ce9b66-b6ac-4e2c-ad97-02932c849294 req-167669f3-7a8d-4bd3-a776-3f00c8d9e9f9 service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-48ce9b66-b6ac-4e2c-ad97-02932c849294 req-167669f3-7a8d-4bd3-a776-3f00c8d9e9f9 service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG nova.compute.manager [req-48ce9b66-b6ac-4e2c-ad97-02932c849294 req-167669f3-7a8d-4bd3-a776-3f00c8d9e9f9 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] No waiting events found dispatching network-vif-plugged-d77c2a03-a402-4288-8a40-2f88200a8f22 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:54:12 user nova-compute[74348]: WARNING nova.compute.manager [req-48ce9b66-b6ac-4e2c-ad97-02932c849294 req-167669f3-7a8d-4bd3-a776-3f00c8d9e9f9 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received unexpected event network-vif-plugged-d77c2a03-a402-4288-8a40-2f88200a8f22 for instance with vm_state building and task_state spawning.
Nov 22 07:54:12 user nova-compute[74348]: DEBUG nova.compute.manager [req-48ce9b66-b6ac-4e2c-ad97-02932c849294 req-167669f3-7a8d-4bd3-a776-3f00c8d9e9f9 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-vif-plugged-d77c2a03-a402-4288-8a40-2f88200a8f22 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-48ce9b66-b6ac-4e2c-ad97-02932c849294 req-167669f3-7a8d-4bd3-a776-3f00c8d9e9f9 service nova] Acquiring lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-48ce9b66-b6ac-4e2c-ad97-02932c849294 req-167669f3-7a8d-4bd3-a776-3f00c8d9e9f9 service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-48ce9b66-b6ac-4e2c-ad97-02932c849294 req-167669f3-7a8d-4bd3-a776-3f00c8d9e9f9 service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG nova.compute.manager [req-48ce9b66-b6ac-4e2c-ad97-02932c849294 req-167669f3-7a8d-4bd3-a776-3f00c8d9e9f9 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] No waiting events found dispatching network-vif-plugged-d77c2a03-a402-4288-8a40-2f88200a8f22 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:54:12 user nova-compute[74348]: WARNING nova.compute.manager [req-48ce9b66-b6ac-4e2c-ad97-02932c849294 req-167669f3-7a8d-4bd3-a776-3f00c8d9e9f9 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received unexpected event network-vif-plugged-d77c2a03-a402-4288-8a40-2f88200a8f22 for instance with vm_state building and task_state spawning.
Nov 22 07:54:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG nova.compute.manager [req-44777b60-e15c-4935-83d3-fce8bdf9df93 req-fd10ce84-5d6f-487c-95a0-d31b00cbc462 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-vif-plugged-62ed8403-ebcd-4e41-ac81-0056cf71738c {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-44777b60-e15c-4935-83d3-fce8bdf9df93 req-fd10ce84-5d6f-487c-95a0-d31b00cbc462 service nova] Acquiring lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-44777b60-e15c-4935-83d3-fce8bdf9df93 req-fd10ce84-5d6f-487c-95a0-d31b00cbc462 service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-44777b60-e15c-4935-83d3-fce8bdf9df93 req-fd10ce84-5d6f-487c-95a0-d31b00cbc462 service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG nova.compute.manager [req-44777b60-e15c-4935-83d3-fce8bdf9df93 req-fd10ce84-5d6f-487c-95a0-d31b00cbc462 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] No waiting events found dispatching network-vif-plugged-62ed8403-ebcd-4e41-ac81-0056cf71738c {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:54:12 user nova-compute[74348]: WARNING nova.compute.manager [req-44777b60-e15c-4935-83d3-fce8bdf9df93 req-fd10ce84-5d6f-487c-95a0-d31b00cbc462 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received unexpected event network-vif-plugged-62ed8403-ebcd-4e41-ac81-0056cf71738c for instance with vm_state building and task_state spawning.
Nov 22 07:54:12 user nova-compute[74348]: DEBUG nova.compute.manager [req-44777b60-e15c-4935-83d3-fce8bdf9df93 req-fd10ce84-5d6f-487c-95a0-d31b00cbc462 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-vif-plugged-748e5281-27d7-43b4-ba47-2f0daed1181e {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-44777b60-e15c-4935-83d3-fce8bdf9df93 req-fd10ce84-5d6f-487c-95a0-d31b00cbc462 service nova] Acquiring lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-44777b60-e15c-4935-83d3-fce8bdf9df93 req-fd10ce84-5d6f-487c-95a0-d31b00cbc462 service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-44777b60-e15c-4935-83d3-fce8bdf9df93 req-fd10ce84-5d6f-487c-95a0-d31b00cbc462 service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG nova.compute.manager [req-44777b60-e15c-4935-83d3-fce8bdf9df93 req-fd10ce84-5d6f-487c-95a0-d31b00cbc462 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] No waiting events found dispatching network-vif-plugged-748e5281-27d7-43b4-ba47-2f0daed1181e {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:54:12 user nova-compute[74348]: WARNING nova.compute.manager [req-44777b60-e15c-4935-83d3-fce8bdf9df93 req-fd10ce84-5d6f-487c-95a0-d31b00cbc462 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received unexpected event network-vif-plugged-748e5281-27d7-43b4-ba47-2f0daed1181e for instance with vm_state building and task_state spawning.
Nov 22 07:54:12 user nova-compute[74348]: DEBUG nova.compute.manager [req-44777b60-e15c-4935-83d3-fce8bdf9df93 req-fd10ce84-5d6f-487c-95a0-d31b00cbc462 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-vif-plugged-748e5281-27d7-43b4-ba47-2f0daed1181e {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-44777b60-e15c-4935-83d3-fce8bdf9df93 req-fd10ce84-5d6f-487c-95a0-d31b00cbc462 service nova] Acquiring lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-44777b60-e15c-4935-83d3-fce8bdf9df93 req-fd10ce84-5d6f-487c-95a0-d31b00cbc462 service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-44777b60-e15c-4935-83d3-fce8bdf9df93 req-fd10ce84-5d6f-487c-95a0-d31b00cbc462 service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG nova.compute.manager [req-44777b60-e15c-4935-83d3-fce8bdf9df93 req-fd10ce84-5d6f-487c-95a0-d31b00cbc462 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] No waiting events found dispatching network-vif-plugged-748e5281-27d7-43b4-ba47-2f0daed1181e {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:54:12 user nova-compute[74348]: WARNING nova.compute.manager [req-44777b60-e15c-4935-83d3-fce8bdf9df93 req-fd10ce84-5d6f-487c-95a0-d31b00cbc462 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received unexpected event network-vif-plugged-748e5281-27d7-43b4-ba47-2f0daed1181e for instance with vm_state building and task_state spawning.
Nov 22 07:54:12 user nova-compute[74348]: DEBUG nova.compute.manager [req-44777b60-e15c-4935-83d3-fce8bdf9df93 req-fd10ce84-5d6f-487c-95a0-d31b00cbc462 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-vif-plugged-a64b4a32-73f1-4a48-8b80-86d353d1d40b {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-44777b60-e15c-4935-83d3-fce8bdf9df93 req-fd10ce84-5d6f-487c-95a0-d31b00cbc462 service nova] Acquiring lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-44777b60-e15c-4935-83d3-fce8bdf9df93 req-fd10ce84-5d6f-487c-95a0-d31b00cbc462 service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-44777b60-e15c-4935-83d3-fce8bdf9df93 req-fd10ce84-5d6f-487c-95a0-d31b00cbc462 service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG nova.compute.manager [req-44777b60-e15c-4935-83d3-fce8bdf9df93 req-fd10ce84-5d6f-487c-95a0-d31b00cbc462 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] No waiting events found dispatching network-vif-plugged-a64b4a32-73f1-4a48-8b80-86d353d1d40b {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:54:12 user nova-compute[74348]: WARNING nova.compute.manager [req-44777b60-e15c-4935-83d3-fce8bdf9df93 req-fd10ce84-5d6f-487c-95a0-d31b00cbc462 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received unexpected event network-vif-plugged-a64b4a32-73f1-4a48-8b80-86d353d1d40b for instance with vm_state building and task_state spawning.
Nov 22 07:54:12 user nova-compute[74348]: DEBUG nova.compute.manager [req-44777b60-e15c-4935-83d3-fce8bdf9df93 req-fd10ce84-5d6f-487c-95a0-d31b00cbc462 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-vif-plugged-a64b4a32-73f1-4a48-8b80-86d353d1d40b {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-44777b60-e15c-4935-83d3-fce8bdf9df93 req-fd10ce84-5d6f-487c-95a0-d31b00cbc462 service nova] Acquiring lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-44777b60-e15c-4935-83d3-fce8bdf9df93 req-fd10ce84-5d6f-487c-95a0-d31b00cbc462 service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-44777b60-e15c-4935-83d3-fce8bdf9df93 req-fd10ce84-5d6f-487c-95a0-d31b00cbc462 service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG nova.compute.manager [req-44777b60-e15c-4935-83d3-fce8bdf9df93 req-fd10ce84-5d6f-487c-95a0-d31b00cbc462 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] No waiting events found dispatching network-vif-plugged-a64b4a32-73f1-4a48-8b80-86d353d1d40b {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:54:12 user nova-compute[74348]: WARNING nova.compute.manager [req-44777b60-e15c-4935-83d3-fce8bdf9df93 req-fd10ce84-5d6f-487c-95a0-d31b00cbc462 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received unexpected event network-vif-plugged-a64b4a32-73f1-4a48-8b80-86d353d1d40b for instance with vm_state building and task_state spawning.
Nov 22 07:54:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:14 user nova-compute[74348]: DEBUG nova.compute.manager [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 07:54:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 07:54:14 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Instance spawned successfully.
Nov 22 07:54:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 07:54:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:54:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:54:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:54:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:54:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:54:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:54:14 user nova-compute[74348]: INFO nova.compute.manager [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Took 15.00 seconds to spawn the instance on the hypervisor.
Nov 22 07:54:14 user nova-compute[74348]: DEBUG nova.compute.manager [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 07:54:14 user nova-compute[74348]: INFO nova.compute.manager [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Took 36.41 seconds to build instance.
Nov 22 07:54:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-dc99882d-ad2d-4c07-bdba-d52161f54aec tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Lock "8527ae47-a025-492d-9820-b9c5ee309d81" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 36.530s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Acquiring lock "e042fd98-eb22-4c6e-9eec-4bb0908fd5ce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Lock "e042fd98-eb22-4c6e-9eec-4bb0908fd5ce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:25 user nova-compute[74348]: DEBUG nova.compute.manager [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 07:54:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:25 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 07:54:25 user nova-compute[74348]: INFO nova.compute.claims [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Claim successful on node user
Nov 22 07:54:25 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:54:25 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:54:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.499s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:25 user nova-compute[74348]: DEBUG nova.compute.manager [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 07:54:25 user nova-compute[74348]: DEBUG nova.compute.manager [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 07:54:25 user nova-compute[74348]: DEBUG nova.network.neutron [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 07:54:25 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 07:54:26 user nova-compute[74348]: DEBUG nova.compute.manager [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 07:54:26 user nova-compute[74348]: DEBUG nova.policy [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d2925596cad453baed756b931a54586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee2e6be4a484d32bac3fda2043aa23d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 07:54:26 user nova-compute[74348]: DEBUG nova.compute.manager [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 07:54:26 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 07:54:26 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Creating image(s)
Nov 22 07:54:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Acquiring lock "/opt/stack/data/nova/instances/e042fd98-eb22-4c6e-9eec-4bb0908fd5ce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Lock "/opt/stack/data/nova/instances/e042fd98-eb22-4c6e-9eec-4bb0908fd5ce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Lock "/opt/stack/data/nova/instances/e042fd98-eb22-4c6e-9eec-4bb0908fd5ce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:26 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:26 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:26 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:54:26 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 07:54:26 user nova-compute[74348]: DEBUG nova.network.neutron [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Successfully created port: f45f964e-a3d7-44c5-8629-db0cbcaeff15 {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 07:54:26 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.424s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Acquiring lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:26 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:26 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.218s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:26 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/e042fd98-eb22-4c6e-9eec-4bb0908fd5ce/disk 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:26 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/e042fd98-eb22-4c6e-9eec-4bb0908fd5ce/disk 1073741824" returned: 0 in 0.055s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:26 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-522f5959-4874-4c61-888d-6fb1cc4d72e6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:54:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-522f5959-4874-4c61-888d-6fb1cc4d72e6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:54:26 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 07:54:27 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.334s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:27 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e042fd98-eb22-4c6e-9eec-4bb0908fd5ce/disk. size=1073741824 {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 07:54:27 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e042fd98-eb22-4c6e-9eec-4bb0908fd5ce/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:27 user nova-compute[74348]: DEBUG nova.compute.manager [req-5c471307-169c-41f7-a75d-07d13b066ffe req-5460e0a7-4f83-47a8-9450-dc728f44321f service nova] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Received event network-changed-72ea4eea-6e08-44b2-9274-0f849d534f05 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:54:27 user nova-compute[74348]: DEBUG nova.compute.manager [req-5c471307-169c-41f7-a75d-07d13b066ffe req-5460e0a7-4f83-47a8-9450-dc728f44321f service nova] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Refreshing instance network info cache due to event network-changed-72ea4eea-6e08-44b2-9274-0f849d534f05. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:54:27 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-5c471307-169c-41f7-a75d-07d13b066ffe req-5460e0a7-4f83-47a8-9450-dc728f44321f service nova] Acquiring lock "refresh_cache-522f5959-4874-4c61-888d-6fb1cc4d72e6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:54:27 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e042fd98-eb22-4c6e-9eec-4bb0908fd5ce/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:27 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Cannot resize image /opt/stack/data/nova/instances/e042fd98-eb22-4c6e-9eec-4bb0908fd5ce/disk to a smaller size. {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 07:54:27 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 07:54:27 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Ensure instance console log exists: /opt/stack/data/nova/instances/e042fd98-eb22-4c6e-9eec-4bb0908fd5ce/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 07:54:27 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:27 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:27 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Updating instance_info_cache with network_info: [{"id": "72ea4eea-6e08-44b2-9274-0f849d534f05", "address": "fa:16:3e:1e:82:7c", "network": {"id": "5c50496a-0882-415b-8115-ddf7b65516a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-531638472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f569146bb9b04838ad8044260da6ad58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72ea4eea-6e", "ovs_interfaceid": "72ea4eea-6e08-44b2-9274-0f849d534f05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-522f5959-4874-4c61-888d-6fb1cc4d72e6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-5c471307-169c-41f7-a75d-07d13b066ffe req-5460e0a7-4f83-47a8-9450-dc728f44321f service nova] Acquired lock "refresh_cache-522f5959-4874-4c61-888d-6fb1cc4d72e6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG nova.network.neutron [req-5c471307-169c-41f7-a75d-07d13b066ffe req-5460e0a7-4f83-47a8-9450-dc728f44321f service nova] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Refreshing network info cache for port 72ea4eea-6e08-44b2-9274-0f849d534f05 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG nova.network.neutron [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Successfully updated port: f45f964e-a3d7-44c5-8629-db0cbcaeff15 {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Acquiring lock "refresh_cache-e042fd98-eb22-4c6e-9eec-4bb0908fd5ce" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Acquired lock "refresh_cache-e042fd98-eb22-4c6e-9eec-4bb0908fd5ce" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG nova.network.neutron [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG nova.compute.manager [req-9c4dbf7f-cb03-4a93-8913-267ce2d252ce req-62d19c6e-aad6-4194-a1f6-7b5d37e6e3a6 service nova] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Received event network-changed-f45f964e-a3d7-44c5-8629-db0cbcaeff15 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG nova.compute.manager [req-9c4dbf7f-cb03-4a93-8913-267ce2d252ce req-62d19c6e-aad6-4194-a1f6-7b5d37e6e3a6 service nova] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Refreshing instance network info cache due to event network-changed-f45f964e-a3d7-44c5-8629-db0cbcaeff15. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9c4dbf7f-cb03-4a93-8913-267ce2d252ce req-62d19c6e-aad6-4194-a1f6-7b5d37e6e3a6 service nova] Acquiring lock "refresh_cache-e042fd98-eb22-4c6e-9eec-4bb0908fd5ce" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG nova.network.neutron [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG nova.network.neutron [req-5c471307-169c-41f7-a75d-07d13b066ffe req-5460e0a7-4f83-47a8-9450-dc728f44321f service nova] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Updated VIF entry in instance network info cache for port 72ea4eea-6e08-44b2-9274-0f849d534f05. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG nova.network.neutron [req-5c471307-169c-41f7-a75d-07d13b066ffe req-5460e0a7-4f83-47a8-9450-dc728f44321f service nova] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Updating instance_info_cache with network_info: [{"id": "72ea4eea-6e08-44b2-9274-0f849d534f05", "address": "fa:16:3e:1e:82:7c", "network": {"id": "5c50496a-0882-415b-8115-ddf7b65516a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-531638472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f569146bb9b04838ad8044260da6ad58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72ea4eea-6e", "ovs_interfaceid": "72ea4eea-6e08-44b2-9274-0f849d534f05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-5c471307-169c-41f7-a75d-07d13b066ffe req-5460e0a7-4f83-47a8-9450-dc728f44321f service nova] Releasing lock "refresh_cache-522f5959-4874-4c61-888d-6fb1cc4d72e6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG nova.network.neutron [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Updating instance_info_cache with network_info: [{"id": "f45f964e-a3d7-44c5-8629-db0cbcaeff15", "address": "fa:16:3e:f0:ab:86", "network": {"id": "7f692ef6-9a86-4aba-a055-8877d70394ba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1993883418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee2e6be4a484d32bac3fda2043aa23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf45f964e-a3", "ovs_interfaceid": "f45f964e-a3d7-44c5-8629-db0cbcaeff15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Releasing lock "refresh_cache-e042fd98-eb22-4c6e-9eec-4bb0908fd5ce" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG nova.compute.manager [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Instance network_info: |[{"id": "f45f964e-a3d7-44c5-8629-db0cbcaeff15", "address": "fa:16:3e:f0:ab:86", "network": {"id": "7f692ef6-9a86-4aba-a055-8877d70394ba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1993883418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee2e6be4a484d32bac3fda2043aa23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf45f964e-a3", "ovs_interfaceid": "f45f964e-a3d7-44c5-8629-db0cbcaeff15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9c4dbf7f-cb03-4a93-8913-267ce2d252ce req-62d19c6e-aad6-4194-a1f6-7b5d37e6e3a6 service nova] Acquired lock "refresh_cache-e042fd98-eb22-4c6e-9eec-4bb0908fd5ce" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG nova.network.neutron [req-9c4dbf7f-cb03-4a93-8913-267ce2d252ce req-62d19c6e-aad6-4194-a1f6-7b5d37e6e3a6 service nova] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Refreshing network info cache for port f45f964e-a3d7-44c5-8629-db0cbcaeff15 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Start _get_guest_xml network_info=[{"id": "f45f964e-a3d7-44c5-8629-db0cbcaeff15", "address": "fa:16:3e:f0:ab:86", "network": {"id": "7f692ef6-9a86-4aba-a055-8877d70394ba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1993883418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee2e6be4a484d32bac3fda2043aa23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf45f964e-a3", "ovs_interfaceid": "f45f964e-a3d7-44c5-8629-db0cbcaeff15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 07:54:28 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:54:28 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:54:28 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:54:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-633870897',display_name='tempest-ServersNegativeTestJSON-server-633870897',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-633870897',id=13,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dee2e6be4a484d32bac3fda2043aa23d',ramdisk_id='',reservation_id='r-u1ypc3ee',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1255640261',owner_user_name='tempest-ServersNegativeTestJSON-1255640261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:54:26Z,user_data=None,user_id='8d2925596cad453baed756b931a54586',uuid=e042fd98-eb22-4c6e-9eec-4bb0908fd5ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f45f964e-a3d7-44c5-8629-db0cbcaeff15", "address": "fa:16:3e:f0:ab:86", "network": {"id": "7f692ef6-9a86-4aba-a055-8877d70394ba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1993883418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee2e6be4a484d32bac3fda2043aa23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf45f964e-a3", "ovs_interfaceid": "f45f964e-a3d7-44c5-8629-db0cbcaeff15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Converting VIF {"id": "f45f964e-a3d7-44c5-8629-db0cbcaeff15", "address": "fa:16:3e:f0:ab:86", "network": {"id": "7f692ef6-9a86-4aba-a055-8877d70394ba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1993883418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee2e6be4a484d32bac3fda2043aa23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf45f964e-a3", "ovs_interfaceid": "f45f964e-a3d7-44c5-8629-db0cbcaeff15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:ab:86,bridge_name='br-int',has_traffic_filtering=True,id=f45f964e-a3d7-44c5-8629-db0cbcaeff15,network=Network(7f692ef6-9a86-4aba-a055-8877d70394ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf45f964e-a3') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG nova.objects.instance [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Lazy-loading 'pci_devices' on Instance uuid e042fd98-eb22-4c6e-9eec-4bb0908fd5ce {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] End _get_guest_xml xml=<domain type="kvm">
Nov 22 07:54:28 user nova-compute[74348]:   <uuid>e042fd98-eb22-4c6e-9eec-4bb0908fd5ce</uuid>
Nov 22 07:54:28 user nova-compute[74348]:   <name>instance-0000000d</name>
Nov 22 07:54:28 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 07:54:28 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 07:54:28 user nova-compute[74348]:   <metadata>
Nov 22 07:54:28 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 07:54:28 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 07:54:28 user nova-compute[74348]:       <nova:name>tempest-ServersNegativeTestJSON-server-633870897</nova:name>
Nov 22 07:54:28 user nova-compute[74348]:       <nova:creationTime>2023-11-22 07:54:28</nova:creationTime>
Nov 22 07:54:28 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 07:54:28 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 07:54:28 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 07:54:28 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 07:54:28 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 07:54:28 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 07:54:28 user nova-compute[74348]:       </nova:flavor>
Nov 22 07:54:28 user nova-compute[74348]:       <nova:owner>
Nov 22 07:54:28 user nova-compute[74348]:         <nova:user uuid="8d2925596cad453baed756b931a54586">tempest-ServersNegativeTestJSON-1255640261-project-member</nova:user>
Nov 22 07:54:28 user nova-compute[74348]:         <nova:project uuid="dee2e6be4a484d32bac3fda2043aa23d">tempest-ServersNegativeTestJSON-1255640261</nova:project>
Nov 22 07:54:28 user nova-compute[74348]:       </nova:owner>
Nov 22 07:54:28 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 07:54:28 user nova-compute[74348]:       <nova:ports>
Nov 22 07:54:28 user nova-compute[74348]:         <nova:port uuid="f45f964e-a3d7-44c5-8629-db0cbcaeff15">
Nov 22 07:54:28 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 22 07:54:28 user nova-compute[74348]:         </nova:port>
Nov 22 07:54:28 user nova-compute[74348]:       </nova:ports>
Nov 22 07:54:28 user nova-compute[74348]:     </nova:instance>
Nov 22 07:54:28 user nova-compute[74348]:   </metadata>
Nov 22 07:54:28 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 07:54:28 user nova-compute[74348]:     <system>
Nov 22 07:54:28 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 07:54:28 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 07:54:28 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 07:54:28 user nova-compute[74348]:       <entry name="serial">e042fd98-eb22-4c6e-9eec-4bb0908fd5ce</entry>
Nov 22 07:54:28 user nova-compute[74348]:       <entry name="uuid">e042fd98-eb22-4c6e-9eec-4bb0908fd5ce</entry>
Nov 22 07:54:28 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 07:54:28 user nova-compute[74348]:     </system>
Nov 22 07:54:28 user nova-compute[74348]:   </sysinfo>
Nov 22 07:54:28 user nova-compute[74348]:   <os>
Nov 22 07:54:28 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 07:54:28 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 07:54:28 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 07:54:28 user nova-compute[74348]:   </os>
Nov 22 07:54:28 user nova-compute[74348]:   <features>
Nov 22 07:54:28 user nova-compute[74348]:     <acpi/>
Nov 22 07:54:28 user nova-compute[74348]:     <apic/>
Nov 22 07:54:28 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 07:54:28 user nova-compute[74348]:   </features>
Nov 22 07:54:28 user nova-compute[74348]:   <clock offset="utc">
Nov 22 07:54:28 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 07:54:28 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 07:54:28 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 07:54:28 user nova-compute[74348]:   </clock>
Nov 22 07:54:28 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 07:54:28 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 07:54:28 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 07:54:28 user nova-compute[74348]:   </cpu>
Nov 22 07:54:28 user nova-compute[74348]:   <devices>
Nov 22 07:54:28 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 07:54:28 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 07:54:28 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/e042fd98-eb22-4c6e-9eec-4bb0908fd5ce/disk"/>
Nov 22 07:54:28 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 07:54:28 user nova-compute[74348]:     </disk>
Nov 22 07:54:28 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 07:54:28 user nova-compute[74348]:       <mac address="fa:16:3e:f0:ab:86"/>
Nov 22 07:54:28 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:54:28 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 07:54:28 user nova-compute[74348]:       <target dev="tapf45f964e-a3"/>
Nov 22 07:54:28 user nova-compute[74348]:     </interface>
Nov 22 07:54:28 user nova-compute[74348]:     <serial type="pty">
Nov 22 07:54:28 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/e042fd98-eb22-4c6e-9eec-4bb0908fd5ce/console.log" append="off"/>
Nov 22 07:54:28 user nova-compute[74348]:     </serial>
Nov 22 07:54:28 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 07:54:28 user nova-compute[74348]:     <video>
Nov 22 07:54:28 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:54:28 user nova-compute[74348]:     </video>
Nov 22 07:54:28 user nova-compute[74348]:     <rng model="virtio">
Nov 22 07:54:28 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 07:54:28 user nova-compute[74348]:     </rng>
Nov 22 07:54:28 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 07:54:28 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 07:54:28 user nova-compute[74348]:       <stats period="10"/>
Nov 22 07:54:28 user nova-compute[74348]:     </memballoon>
Nov 22 07:54:28 user nova-compute[74348]:   </devices>
Nov 22 07:54:28 user nova-compute[74348]: </domain>
Nov 22 07:54:28 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:54:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-633870897',display_name='tempest-ServersNegativeTestJSON-server-633870897',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-633870897',id=13,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dee2e6be4a484d32bac3fda2043aa23d',ramdisk_id='',reservation_id='r-u1ypc3ee',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1255640261',owner_user_name='tempest-ServersNegativeTestJSON-1255640261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:54:26Z,user_data=None,user_id='8d2925596cad453baed756b931a54586',uuid=e042fd98-eb22-4c6e-9eec-4bb0908fd5ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f45f964e-a3d7-44c5-8629-db0cbcaeff15", "address": "fa:16:3e:f0:ab:86", "network": {"id": "7f692ef6-9a86-4aba-a055-8877d70394ba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1993883418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee2e6be4a484d32bac3fda2043aa23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf45f964e-a3", "ovs_interfaceid": "f45f964e-a3d7-44c5-8629-db0cbcaeff15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Converting VIF {"id": "f45f964e-a3d7-44c5-8629-db0cbcaeff15", "address": "fa:16:3e:f0:ab:86", "network": {"id": "7f692ef6-9a86-4aba-a055-8877d70394ba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1993883418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee2e6be4a484d32bac3fda2043aa23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf45f964e-a3", "ovs_interfaceid": "f45f964e-a3d7-44c5-8629-db0cbcaeff15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:ab:86,bridge_name='br-int',has_traffic_filtering=True,id=f45f964e-a3d7-44c5-8629-db0cbcaeff15,network=Network(7f692ef6-9a86-4aba-a055-8877d70394ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf45f964e-a3') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG os_vif [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:ab:86,bridge_name='br-int',has_traffic_filtering=True,id=f45f964e-a3d7-44c5-8629-db0cbcaeff15,network=Network(7f692ef6-9a86-4aba-a055-8877d70394ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf45f964e-a3') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '012e99c6-9f2a-5d62-abb4-f1d1a5a55569', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf45f964e-a3, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf45f964e-a3, col_values=(('qos', UUID('ff50aaa5-c8bd-487f-94b4-0d3b937e75d0')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf45f964e-a3, col_values=(('external_ids', {'iface-id': 'f45f964e-a3d7-44c5-8629-db0cbcaeff15', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:ab:86', 'vm-uuid': 'e042fd98-eb22-4c6e-9eec-4bb0908fd5ce'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:54:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:28 user nova-compute[74348]: INFO os_vif [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:ab:86,bridge_name='br-int',has_traffic_filtering=True,id=f45f964e-a3d7-44c5-8629-db0cbcaeff15,network=Network(7f692ef6-9a86-4aba-a055-8877d70394ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf45f964e-a3')
Nov 22 07:54:29 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:54:29 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] No VIF found with MAC fa:16:3e:f0:ab:86, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 07:54:29 user nova-compute[74348]: DEBUG nova.network.neutron [req-9c4dbf7f-cb03-4a93-8913-267ce2d252ce req-62d19c6e-aad6-4194-a1f6-7b5d37e6e3a6 service nova] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Updated VIF entry in instance network info cache for port f45f964e-a3d7-44c5-8629-db0cbcaeff15. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 07:54:29 user nova-compute[74348]: DEBUG nova.network.neutron [req-9c4dbf7f-cb03-4a93-8913-267ce2d252ce req-62d19c6e-aad6-4194-a1f6-7b5d37e6e3a6 service nova] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Updating instance_info_cache with network_info: [{"id": "f45f964e-a3d7-44c5-8629-db0cbcaeff15", "address": "fa:16:3e:f0:ab:86", "network": {"id": "7f692ef6-9a86-4aba-a055-8877d70394ba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1993883418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee2e6be4a484d32bac3fda2043aa23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf45f964e-a3", "ovs_interfaceid": "f45f964e-a3d7-44c5-8629-db0cbcaeff15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:54:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9c4dbf7f-cb03-4a93-8913-267ce2d252ce req-62d19c6e-aad6-4194-a1f6-7b5d37e6e3a6 service nova] Releasing lock "refresh_cache-e042fd98-eb22-4c6e-9eec-4bb0908fd5ce" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:54:29 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:54:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:29 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 07:54:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "522f5959-4874-4c61-888d-6fb1cc4d72e6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "522f5959-4874-4c61-888d-6fb1cc4d72e6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:30 user nova-compute[74348]: DEBUG nova.objects.instance [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lazy-loading 'flavor' on Instance uuid 522f5959-4874-4c61-888d-6fb1cc4d72e6 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:54:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "522f5959-4874-4c61-888d-6fb1cc4d72e6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.111s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "522f5959-4874-4c61-888d-6fb1cc4d72e6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "522f5959-4874-4c61-888d-6fb1cc4d72e6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:30 user nova-compute[74348]: INFO nova.compute.manager [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Attaching volume 0c375792-1e67-4f49-81d8-fb2d11c2e223 to /dev/vdb
Nov 22 07:54:30 user nova-compute[74348]: DEBUG os_brick.utils [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:54:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:30 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fd78aa-8e21-4254-8f4c-bf7c85e31a07]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.035s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:30 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e049bb-1dd0-4a71-8574-70a8e7625e80]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:30 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5aa78f6-a4af-4fda-8960-6a64a15e4cd7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:30 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4faff5-242a-4c7f-9750-32d0426b54f9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 07:54:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 07:54:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 07:54:30 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 07:54:30 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58e2c18-2869-4545-80c2-4ea624596add]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 07:54:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 07:54:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 07:54:30 user nova-compute[74348]: DEBUG os_brick.utils [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:54:30 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Updating existing volume attachment record: 193af7db-2766-46b5-baa2-bef8008a1d40 {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 07:54:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 07:54:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 07:54:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 07:54:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3bbae3-babf-44d2-96da-c459fb77d9c7/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:31 user nova-compute[74348]: DEBUG nova.compute.manager [req-8d85953d-d80c-47ae-a699-85011e59a24c req-807f3122-135b-4879-ae02-dd0146b4142c service nova] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Received event network-vif-plugged-f45f964e-a3d7-44c5-8629-db0cbcaeff15 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:54:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-8d85953d-d80c-47ae-a699-85011e59a24c req-807f3122-135b-4879-ae02-dd0146b4142c service nova] Acquiring lock "e042fd98-eb22-4c6e-9eec-4bb0908fd5ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-8d85953d-d80c-47ae-a699-85011e59a24c req-807f3122-135b-4879-ae02-dd0146b4142c service nova] Lock "e042fd98-eb22-4c6e-9eec-4bb0908fd5ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-8d85953d-d80c-47ae-a699-85011e59a24c req-807f3122-135b-4879-ae02-dd0146b4142c service nova] Lock "e042fd98-eb22-4c6e-9eec-4bb0908fd5ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:31 user nova-compute[74348]: DEBUG nova.compute.manager [req-8d85953d-d80c-47ae-a699-85011e59a24c req-807f3122-135b-4879-ae02-dd0146b4142c service nova] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] No waiting events found dispatching network-vif-plugged-f45f964e-a3d7-44c5-8629-db0cbcaeff15 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:54:31 user nova-compute[74348]: WARNING nova.compute.manager [req-8d85953d-d80c-47ae-a699-85011e59a24c req-807f3122-135b-4879-ae02-dd0146b4142c service nova] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Received unexpected event network-vif-plugged-f45f964e-a3d7-44c5-8629-db0cbcaeff15 for instance with vm_state building and task_state spawning.
Nov 22 07:54:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3bbae3-babf-44d2-96da-c459fb77d9c7/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3bbae3-babf-44d2-96da-c459fb77d9c7/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3bbae3-babf-44d2-96da-c459fb77d9c7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88730c14-fd2a-4f63-bc10-96cea0b057eb/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88730c14-fd2a-4f63-bc10-96cea0b057eb/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88730c14-fd2a-4f63-bc10-96cea0b057eb/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88730c14-fd2a-4f63-bc10-96cea0b057eb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6aa6c0-2b77-49a5-9942-d6596ac4bd3f/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6aa6c0-2b77-49a5-9942-d6596ac4bd3f/disk --force-share --output=json" returned: 0 in 0.403s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6aa6c0-2b77-49a5-9942-d6596ac4bd3f/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6aa6c0-2b77-49a5-9942-d6596ac4bd3f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/522f5959-4874-4c61-888d-6fb1cc4d72e6/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/522f5959-4874-4c61-888d-6fb1cc4d72e6/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/522f5959-4874-4c61-888d-6fb1cc4d72e6/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:32 user nova-compute[74348]: DEBUG nova.compute.manager [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 07:54:32 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 07:54:32 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Instance spawned successfully.
Nov 22 07:54:32 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 07:54:32 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:54:32 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:54:32 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:54:32 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:54:32 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:54:32 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:54:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/522f5959-4874-4c61-888d-6fb1cc4d72e6/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:32 user nova-compute[74348]: INFO nova.compute.manager [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Took 6.87 seconds to spawn the instance on the hypervisor.
Nov 22 07:54:32 user nova-compute[74348]: DEBUG nova.compute.manager [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 07:54:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059bde4a-c5c9-45ab-9b4a-c969c74a6083/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:33 user nova-compute[74348]: INFO nova.compute.manager [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Took 7.81 seconds to build instance.
Nov 22 07:54:33 user nova-compute[74348]: DEBUG nova.compute.manager [None req-a360b420-cbaa-42b6-9306-3e9334a6fb70 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 07:54:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f04b05e8-6ac9-487a-b5e5-70a4f814ad98 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Lock "e042fd98-eb22-4c6e-9eec-4bb0908fd5ce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.909s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059bde4a-c5c9-45ab-9b4a-c969c74a6083/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059bde4a-c5c9-45ab-9b4a-c969c74a6083/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:33 user nova-compute[74348]: INFO nova.compute.manager [None req-a360b420-cbaa-42b6-9306-3e9334a6fb70 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] instance snapshotting
Nov 22 07:54:33 user nova-compute[74348]: DEBUG nova.compute.manager [req-c86f1d8e-ddb8-4581-ba19-84c163e357c8 req-6a7e11e7-48f9-4fff-9f8f-d8a5920d61f3 service nova] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Received event network-vif-plugged-f45f964e-a3d7-44c5-8629-db0cbcaeff15 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:54:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c86f1d8e-ddb8-4581-ba19-84c163e357c8 req-6a7e11e7-48f9-4fff-9f8f-d8a5920d61f3 service nova] Acquiring lock "e042fd98-eb22-4c6e-9eec-4bb0908fd5ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c86f1d8e-ddb8-4581-ba19-84c163e357c8 req-6a7e11e7-48f9-4fff-9f8f-d8a5920d61f3 service nova] Lock "e042fd98-eb22-4c6e-9eec-4bb0908fd5ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c86f1d8e-ddb8-4581-ba19-84c163e357c8 req-6a7e11e7-48f9-4fff-9f8f-d8a5920d61f3 service nova] Lock "e042fd98-eb22-4c6e-9eec-4bb0908fd5ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:33 user nova-compute[74348]: DEBUG nova.compute.manager [req-c86f1d8e-ddb8-4581-ba19-84c163e357c8 req-6a7e11e7-48f9-4fff-9f8f-d8a5920d61f3 service nova] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] No waiting events found dispatching network-vif-plugged-f45f964e-a3d7-44c5-8629-db0cbcaeff15 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:54:33 user nova-compute[74348]: WARNING nova.compute.manager [req-c86f1d8e-ddb8-4581-ba19-84c163e357c8 req-6a7e11e7-48f9-4fff-9f8f-d8a5920d61f3 service nova] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Received unexpected event network-vif-plugged-f45f964e-a3d7-44c5-8629-db0cbcaeff15 for instance with vm_state active and task_state None.
Nov 22 07:54:33 user nova-compute[74348]: DEBUG nova.compute.manager [req-c86f1d8e-ddb8-4581-ba19-84c163e357c8 req-6a7e11e7-48f9-4fff-9f8f-d8a5920d61f3 service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Received event network-changed-07295502-d217-400f-8b56-9ff1ccd600cf {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:54:33 user nova-compute[74348]: DEBUG nova.compute.manager [req-c86f1d8e-ddb8-4581-ba19-84c163e357c8 req-6a7e11e7-48f9-4fff-9f8f-d8a5920d61f3 service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Refreshing instance network info cache due to event network-changed-07295502-d217-400f-8b56-9ff1ccd600cf. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:54:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c86f1d8e-ddb8-4581-ba19-84c163e357c8 req-6a7e11e7-48f9-4fff-9f8f-d8a5920d61f3 service nova] Acquiring lock "refresh_cache-bcedb385-b72a-49c2-b363-cf6da5804b60" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:54:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c86f1d8e-ddb8-4581-ba19-84c163e357c8 req-6a7e11e7-48f9-4fff-9f8f-d8a5920d61f3 service nova] Acquired lock "refresh_cache-bcedb385-b72a-49c2-b363-cf6da5804b60" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:54:33 user nova-compute[74348]: DEBUG nova.network.neutron [req-c86f1d8e-ddb8-4581-ba19-84c163e357c8 req-6a7e11e7-48f9-4fff-9f8f-d8a5920d61f3 service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Refreshing network info cache for port 07295502-d217-400f-8b56-9ff1ccd600cf {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:54:33 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-a360b420-cbaa-42b6-9306-3e9334a6fb70 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Beginning live snapshot process
Nov 22 07:54:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059bde4a-c5c9-45ab-9b4a-c969c74a6083/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e042fd98-eb22-4c6e-9eec-4bb0908fd5ce/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-a360b420-cbaa-42b6-9306-3e9334a6fb70 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk --force-share --output=json -f qcow2 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e042fd98-eb22-4c6e-9eec-4bb0908fd5ce/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e042fd98-eb22-4c6e-9eec-4bb0908fd5ce/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-a360b420-cbaa-42b6-9306-3e9334a6fb70 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk --force-share --output=json -f qcow2" returned: 0 in 0.169s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-a360b420-cbaa-42b6-9306-3e9334a6fb70 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk --force-share --output=json -f qcow2 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e042fd98-eb22-4c6e-9eec-4bb0908fd5ce/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:33 user nova-compute[74348]: DEBUG nova.network.neutron [req-c86f1d8e-ddb8-4581-ba19-84c163e357c8 req-6a7e11e7-48f9-4fff-9f8f-d8a5920d61f3 service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Updated VIF entry in instance network info cache for port 07295502-d217-400f-8b56-9ff1ccd600cf. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 07:54:33 user nova-compute[74348]: DEBUG nova.network.neutron [req-c86f1d8e-ddb8-4581-ba19-84c163e357c8 req-6a7e11e7-48f9-4fff-9f8f-d8a5920d61f3 service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Updating instance_info_cache with network_info: [{"id": "07295502-d217-400f-8b56-9ff1ccd600cf", "address": "fa:16:3e:50:0c:08", "network": {"id": "fd2e1dc2-9099-48b4-b56d-bc5d09c892fe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1689843295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52a21c1ef18473aa64c139de7b920ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07295502-d2", "ovs_interfaceid": "07295502-d217-400f-8b56-9ff1ccd600cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:54:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c86f1d8e-ddb8-4581-ba19-84c163e357c8 req-6a7e11e7-48f9-4fff-9f8f-d8a5920d61f3 service nova] Releasing lock "refresh_cache-bcedb385-b72a-49c2-b363-cf6da5804b60" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:54:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-a360b420-cbaa-42b6-9306-3e9334a6fb70 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-a360b420-cbaa-42b6-9306-3e9334a6fb70 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-a360b420-cbaa-42b6-9306-3e9334a6fb70 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.174s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-a360b420-cbaa-42b6-9306-3e9334a6fb70 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpbolhnrd6/f17b360aaeb947708a66e01be8b6b68e.delta 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-a360b420-cbaa-42b6-9306-3e9334a6fb70 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpbolhnrd6/f17b360aaeb947708a66e01be8b6b68e.delta 1073741824" returned: 0 in 0.068s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:34 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-a360b420-cbaa-42b6-9306-3e9334a6fb70 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 22 07:54:34 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-a360b420-cbaa-42b6-9306-3e9334a6fb70 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74348) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 22 07:54:34 user nova-compute[74348]: INFO nova.virt.libvirt.host [None req-a360b420-cbaa-42b6-9306-3e9334a6fb70 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] UEFI support detected
Nov 22 07:54:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e93032ee-56bd-48be-8121-b0fd5273345e/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e93032ee-56bd-48be-8121-b0fd5273345e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e93032ee-56bd-48be-8121-b0fd5273345e/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e93032ee-56bd-48be-8121-b0fd5273345e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:34 user nova-compute[74348]: DEBUG nova.compute.manager [req-dadd83a9-116c-4036-b35b-99dc5509221e req-9e55b599-f276-4f0b-a6c5-435f1d75e7a0 service nova] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Received event network-changed-094232d9-8ec1-401f-8908-2a698a5385bb {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:54:34 user nova-compute[74348]: DEBUG nova.compute.manager [req-dadd83a9-116c-4036-b35b-99dc5509221e req-9e55b599-f276-4f0b-a6c5-435f1d75e7a0 service nova] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Refreshing instance network info cache due to event network-changed-094232d9-8ec1-401f-8908-2a698a5385bb. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:54:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-dadd83a9-116c-4036-b35b-99dc5509221e req-9e55b599-f276-4f0b-a6c5-435f1d75e7a0 service nova] Acquiring lock "refresh_cache-5f3bbae3-babf-44d2-96da-c459fb77d9c7" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:54:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-dadd83a9-116c-4036-b35b-99dc5509221e req-9e55b599-f276-4f0b-a6c5-435f1d75e7a0 service nova] Acquired lock "refresh_cache-5f3bbae3-babf-44d2-96da-c459fb77d9c7" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:54:34 user nova-compute[74348]: DEBUG nova.network.neutron [req-dadd83a9-116c-4036-b35b-99dc5509221e req-9e55b599-f276-4f0b-a6c5-435f1d75e7a0 service nova] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Refreshing network info cache for port 094232d9-8ec1-401f-8908-2a698a5385bb {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:54:35 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-a360b420-cbaa-42b6-9306-3e9334a6fb70 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74348) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 07:54:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:35 user nova-compute[74348]: DEBUG nova.compute.manager [req-166c6b6b-a49c-4c2d-9542-2619c8e12eeb req-2dc63fa3-27f8-4b1e-ac23-ec60ff8e2f18 service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Received event network-changed-618bd526-892d-4dfb-8ba6-f65e83e3f467 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:54:35 user nova-compute[74348]: DEBUG nova.compute.manager [req-166c6b6b-a49c-4c2d-9542-2619c8e12eeb req-2dc63fa3-27f8-4b1e-ac23-ec60ff8e2f18 service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Refreshing instance network info cache due to event network-changed-618bd526-892d-4dfb-8ba6-f65e83e3f467. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:54:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-166c6b6b-a49c-4c2d-9542-2619c8e12eeb req-2dc63fa3-27f8-4b1e-ac23-ec60ff8e2f18 service nova] Acquiring lock "refresh_cache-e36789b1-45e6-40f7-ba97-8962cb116a39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:54:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-166c6b6b-a49c-4c2d-9542-2619c8e12eeb req-2dc63fa3-27f8-4b1e-ac23-ec60ff8e2f18 service nova] Acquired lock "refresh_cache-e36789b1-45e6-40f7-ba97-8962cb116a39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:54:35 user nova-compute[74348]: DEBUG nova.network.neutron [req-166c6b6b-a49c-4c2d-9542-2619c8e12eeb req-2dc63fa3-27f8-4b1e-ac23-ec60ff8e2f18 service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Refreshing network info cache for port 618bd526-892d-4dfb-8ba6-f65e83e3f467 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:54:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:35 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 07:54:35 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 07:54:35 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 07:54:35 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 07:54:35 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-a360b420-cbaa-42b6-9306-3e9334a6fb70 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] COPY block job progress, current cursor: 26607616 final cursor: 75497472 {{(pid=74348) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 07:54:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-a360b420-cbaa-42b6-9306-3e9334a6fb70 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74348) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 07:54:36 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-a360b420-cbaa-42b6-9306-3e9334a6fb70 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 22 07:54:36 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:54:36 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:54:36 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=6689MB free_disk=25.320667266845703GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 07:54:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:36 user nova-compute[74348]: DEBUG nova.privsep.utils [None req-a360b420-cbaa-42b6-9306-3e9334a6fb70 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74348) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 07:54:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-a360b420-cbaa-42b6-9306-3e9334a6fb70 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpbolhnrd6/f17b360aaeb947708a66e01be8b6b68e.delta /opt/stack/data/nova/instances/snapshots/tmpbolhnrd6/f17b360aaeb947708a66e01be8b6b68e {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:36 user nova-compute[74348]: DEBUG nova.network.neutron [req-dadd83a9-116c-4036-b35b-99dc5509221e req-9e55b599-f276-4f0b-a6c5-435f1d75e7a0 service nova] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Updated VIF entry in instance network info cache for port 094232d9-8ec1-401f-8908-2a698a5385bb. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 07:54:36 user nova-compute[74348]: DEBUG nova.network.neutron [req-dadd83a9-116c-4036-b35b-99dc5509221e req-9e55b599-f276-4f0b-a6c5-435f1d75e7a0 service nova] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Updating instance_info_cache with network_info: [{"id": "094232d9-8ec1-401f-8908-2a698a5385bb", "address": "fa:16:3e:db:2f:02", "network": {"id": "4ef640bb-4a2f-4f98-8b01-b5df87fcb35a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1216437312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444367658c0241d0b5b377a73fedb52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap094232d9-8e", "ovs_interfaceid": "094232d9-8ec1-401f-8908-2a698a5385bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:54:36 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 059bde4a-c5c9-45ab-9b4a-c969c74a6083 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:54:36 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 522f5959-4874-4c61-888d-6fb1cc4d72e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:54:36 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance bcedb385-b72a-49c2-b363-cf6da5804b60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:54:36 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance e36789b1-45e6-40f7-ba97-8962cb116a39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:54:36 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 5f3bbae3-babf-44d2-96da-c459fb77d9c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:54:36 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance da6aa6c0-2b77-49a5-9942-d6596ac4bd3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:54:36 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance e93032ee-56bd-48be-8121-b0fd5273345e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:54:36 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance bdad025e-8f6c-419a-99ea-bf277f6c5577 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:54:36 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 88730c14-fd2a-4f63-bc10-96cea0b057eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:54:36 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance abd7f2ed-b0c4-4e05-8161-b141a611f125 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:54:36 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 9e2f3a3e-ee9b-4250-8744-5eb7982285f2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:54:36 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 8527ae47-a025-492d-9820-b9c5ee309d81 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:54:36 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance e042fd98-eb22-4c6e-9eec-4bb0908fd5ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:54:36 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 07:54:36 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 07:54:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-dadd83a9-116c-4036-b35b-99dc5509221e req-9e55b599-f276-4f0b-a6c5-435f1d75e7a0 service nova] Releasing lock "refresh_cache-5f3bbae3-babf-44d2-96da-c459fb77d9c7" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:54:37 user nova-compute[74348]: DEBUG nova.network.neutron [req-166c6b6b-a49c-4c2d-9542-2619c8e12eeb req-2dc63fa3-27f8-4b1e-ac23-ec60ff8e2f18 service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Updated VIF entry in instance network info cache for port 618bd526-892d-4dfb-8ba6-f65e83e3f467. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 07:54:37 user nova-compute[74348]: DEBUG nova.network.neutron [req-166c6b6b-a49c-4c2d-9542-2619c8e12eeb req-2dc63fa3-27f8-4b1e-ac23-ec60ff8e2f18 service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Updating instance_info_cache with network_info: [{"id": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "address": "fa:16:3e:a7:50:2a", "network": {"id": "8a783b63-dae2-41eb-a00a-5cf8e94a5412", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872095489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beaa9566ba2842d49f843dbddc59854d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap618bd526-89", "ovs_interfaceid": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:54:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-166c6b6b-a49c-4c2d-9542-2619c8e12eeb req-2dc63fa3-27f8-4b1e-ac23-ec60ff8e2f18 service nova] Releasing lock "refresh_cache-e36789b1-45e6-40f7-ba97-8962cb116a39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:54:37 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:54:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-a360b420-cbaa-42b6-9306-3e9334a6fb70 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpbolhnrd6/f17b360aaeb947708a66e01be8b6b68e.delta /opt/stack/data/nova/instances/snapshots/tmpbolhnrd6/f17b360aaeb947708a66e01be8b6b68e" returned: 0 in 1.060s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:37 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-a360b420-cbaa-42b6-9306-3e9334a6fb70 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Snapshot extracted, beginning image upload
Nov 22 07:54:37 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:54:37 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 07:54:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.219s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:38 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:54:38 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:54:38 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:54:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WZYfOwLR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:54:39 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:54:39 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:54:39 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:54:39 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:54:39 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 07:54:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 -p 172.16.0.220:3260" returned: 21 in 0.040s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee141ef-75c4-4409-84a4-c12797f1fd4b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 07:54:39 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c401ae26-1410-49e4-a37f-a2d41270201f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223] added
Nov 22 07:54:39 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9329844d-b741-48a3-a68e-8fcc3518125b]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3dfffd-a9a7-400b-9ef1-98fb89a4a096]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WZYfOwLR {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WZYfOwLR" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a315772-0c4f-4a5c-ad6b-7ce15df2570f]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WZYfOwLR'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[258de8c4-73a7-49b9-9ed1-1f2387ac3ca8]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f89140-0bf4-49f3-a24f-7ed6dd5998b9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:54:39 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:54:39 user nova-compute[74348]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)
Nov 22 07:54:39 user nova-compute[74348]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)
Nov 22 07:54:39 user nova-compute[74348]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)
Nov 22 07:54:39 user nova-compute[74348]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)
Nov 22 07:54:39 user nova-compute[74348]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)
Nov 22 07:54:39 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:54:39 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:54:39 user nova-compute[74348]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)
Nov 22 07:54:39 user nova-compute[74348]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)
Nov 22 07:54:39 user nova-compute[74348]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)
Nov 22 07:54:39 user nova-compute[74348]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)
Nov 22 07:54:39 user nova-compute[74348]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)
Nov 22 07:54:39 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[65cb4156-bc4a-4a28-8d37-192827b4906b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223, portal: 172.16.0.220,3260]
Nov 22 07:54:39 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223, portal: 172.16.0.220,3260] successful.
Nov 22 07:54:39 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece6d499-7122-43f4-8876-cedf53fecb1b]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb26d48-6ec6-4813-98e2-bf48be60ad72]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:54:39 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:54:39 user nova-compute[74348]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)
Nov 22 07:54:39 user nova-compute[74348]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)
Nov 22 07:54:39 user nova-compute[74348]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)
Nov 22 07:54:39 user nova-compute[74348]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)
Nov 22 07:54:39 user nova-compute[74348]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)
Nov 22 07:54:39 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:54:39 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:54:39 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:54:39 user nova-compute[74348]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)
Nov 22 07:54:39 user nova-compute[74348]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)
Nov 22 07:54:39 user nova-compute[74348]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)
Nov 22 07:54:39 user nova-compute[74348]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)
Nov 22 07:54:39 user nova-compute[74348]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)
Nov 22 07:54:39 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:54:39 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.375s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da0dbca-a92c-4afe-8fca-13a03897f7e5]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 07:54:39 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WZYfOwLR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 07:54:40 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-a360b420-cbaa-42b6-9306-3e9334a6fb70 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Snapshot image upload complete
Nov 22 07:54:40 user nova-compute[74348]: INFO nova.compute.manager [None req-a360b420-cbaa-42b6-9306-3e9334a6fb70 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Took 6.83 seconds to snapshot the instance on the hypervisor.
Nov 22 07:54:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-98be5f88-9534-4582-863b-c3ec27b76b7f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquiring lock "5f3bbae3-babf-44d2-96da-c459fb77d9c7" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-98be5f88-9534-4582-863b-c3ec27b76b7f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "5f3bbae3-babf-44d2-96da-c459fb77d9c7" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:40 user nova-compute[74348]: INFO nova.compute.manager [None req-98be5f88-9534-4582-863b-c3ec27b76b7f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Shelving
Nov 22 07:54:40 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:40 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:40 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:40 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:40 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:40 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.426s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:54:40 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] <== connect_volume: return (1428ms) {'type': 'block', 'scsi_wwn': '23834333331383365', 'path': '/dev/sdi'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:54:40 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834333331383365', 'path': '/dev/sdi'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 07:54:40 user nova-compute[74348]: DEBUG nova.objects.instance [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lazy-loading 'flavor' on Instance uuid 522f5959-4874-4c61-888d-6fb1cc4d72e6 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:54:40 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 07:54:40 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 07:54:40 user nova-compute[74348]:   <source dev="/dev/sdi"/>
Nov 22 07:54:40 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 07:54:40 user nova-compute[74348]:   <serial>0c375792-1e67-4f49-81d8-fb2d11c2e223</serial>
Nov 22 07:54:40 user nova-compute[74348]: </disk>
Nov 22 07:54:40 user nova-compute[74348]:  {{(pid=74348) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 07:54:40 user nova-compute[74348]: DEBUG nova.compute.manager [req-2a33e65d-760e-42f0-95a5-2fc9774bff0e req-5dc879e9-4aba-4148-af86-619ef92b091f service nova] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Received event network-vif-unplugged-094232d9-8ec1-401f-8908-2a698a5385bb {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:54:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2a33e65d-760e-42f0-95a5-2fc9774bff0e req-5dc879e9-4aba-4148-af86-619ef92b091f service nova] Acquiring lock "5f3bbae3-babf-44d2-96da-c459fb77d9c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2a33e65d-760e-42f0-95a5-2fc9774bff0e req-5dc879e9-4aba-4148-af86-619ef92b091f service nova] Lock "5f3bbae3-babf-44d2-96da-c459fb77d9c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2a33e65d-760e-42f0-95a5-2fc9774bff0e req-5dc879e9-4aba-4148-af86-619ef92b091f service nova] Lock "5f3bbae3-babf-44d2-96da-c459fb77d9c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:40 user nova-compute[74348]: DEBUG nova.compute.manager [req-2a33e65d-760e-42f0-95a5-2fc9774bff0e req-5dc879e9-4aba-4148-af86-619ef92b091f service nova] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] No waiting events found dispatching network-vif-unplugged-094232d9-8ec1-401f-8908-2a698a5385bb {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:54:40 user nova-compute[74348]: WARNING nova.compute.manager [req-2a33e65d-760e-42f0-95a5-2fc9774bff0e req-5dc879e9-4aba-4148-af86-619ef92b091f service nova] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Received unexpected event network-vif-unplugged-094232d9-8ec1-401f-8908-2a698a5385bb for instance with vm_state active and task_state shelving.
Nov 22 07:54:41 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Instance destroyed successfully.
Nov 22 07:54:41 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-98be5f88-9534-4582-863b-c3ec27b76b7f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Beginning cold snapshot process
Nov 22 07:54:41 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:54:41 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:54:41 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] No VIF found with MAC fa:16:3e:1e:82:7c, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 07:54:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-16ae981a-73a9-4cb1-b6ad-87759c26f3d8 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "522f5959-4874-4c61-888d-6fb1cc4d72e6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.049s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:41 user nova-compute[74348]: DEBUG nova.privsep.utils [None req-98be5f88-9534-4582-863b-c3ec27b76b7f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74348) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 07:54:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-98be5f88-9534-4582-863b-c3ec27b76b7f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/5f3bbae3-babf-44d2-96da-c459fb77d9c7/disk /opt/stack/data/nova/instances/snapshots/tmp2eov2ej3/7ccc0dd175b9462cba3e1432b2617b68 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-98be5f88-9534-4582-863b-c3ec27b76b7f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/5f3bbae3-babf-44d2-96da-c459fb77d9c7/disk /opt/stack/data/nova/instances/snapshots/tmp2eov2ej3/7ccc0dd175b9462cba3e1432b2617b68" returned: 0 in 0.794s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:42 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-98be5f88-9534-4582-863b-c3ec27b76b7f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Snapshot extracted, beginning image upload
Nov 22 07:54:42 user nova-compute[74348]: DEBUG nova.compute.manager [req-f5e82425-5cc4-48b2-8f54-0ab01c0f4e16 req-dc8b1c3c-dd76-45a8-a771-da2d94d6b958 service nova] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Received event network-vif-plugged-094232d9-8ec1-401f-8908-2a698a5385bb {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:54:42 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f5e82425-5cc4-48b2-8f54-0ab01c0f4e16 req-dc8b1c3c-dd76-45a8-a771-da2d94d6b958 service nova] Acquiring lock "5f3bbae3-babf-44d2-96da-c459fb77d9c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:42 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f5e82425-5cc4-48b2-8f54-0ab01c0f4e16 req-dc8b1c3c-dd76-45a8-a771-da2d94d6b958 service nova] Lock "5f3bbae3-babf-44d2-96da-c459fb77d9c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:42 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f5e82425-5cc4-48b2-8f54-0ab01c0f4e16 req-dc8b1c3c-dd76-45a8-a771-da2d94d6b958 service nova] Lock "5f3bbae3-babf-44d2-96da-c459fb77d9c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:42 user nova-compute[74348]: DEBUG nova.compute.manager [req-f5e82425-5cc4-48b2-8f54-0ab01c0f4e16 req-dc8b1c3c-dd76-45a8-a771-da2d94d6b958 service nova] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] No waiting events found dispatching network-vif-plugged-094232d9-8ec1-401f-8908-2a698a5385bb {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:54:42 user nova-compute[74348]: WARNING nova.compute.manager [req-f5e82425-5cc4-48b2-8f54-0ab01c0f4e16 req-dc8b1c3c-dd76-45a8-a771-da2d94d6b958 service nova] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Received unexpected event network-vif-plugged-094232d9-8ec1-401f-8908-2a698a5385bb for instance with vm_state active and task_state shelving_image_uploading.
Nov 22 07:54:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:44 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-98be5f88-9534-4582-863b-c3ec27b76b7f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Snapshot image upload complete
Nov 22 07:54:44 user nova-compute[74348]: DEBUG nova.compute.manager [None req-98be5f88-9534-4582-863b-c3ec27b76b7f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 07:54:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "ecbabf54-d2b4-47e0-9e50-60ba8e7e9094" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "ecbabf54-d2b4-47e0-9e50-60ba8e7e9094" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:44 user nova-compute[74348]: DEBUG nova.compute.manager [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 07:54:45 user nova-compute[74348]: INFO nova.compute.manager [None req-98be5f88-9534-4582-863b-c3ec27b76b7f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Shelve offloading
Nov 22 07:54:45 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Instance destroyed successfully.
Nov 22 07:54:45 user nova-compute[74348]: DEBUG nova.compute.manager [None req-98be5f88-9534-4582-863b-c3ec27b76b7f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 07:54:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-98be5f88-9534-4582-863b-c3ec27b76b7f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquiring lock "refresh_cache-5f3bbae3-babf-44d2-96da-c459fb77d9c7" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:54:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-98be5f88-9534-4582-863b-c3ec27b76b7f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquired lock "refresh_cache-5f3bbae3-babf-44d2-96da-c459fb77d9c7" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:54:45 user nova-compute[74348]: DEBUG nova.network.neutron [None req-98be5f88-9534-4582-863b-c3ec27b76b7f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 07:54:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:45 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 07:54:45 user nova-compute[74348]: INFO nova.compute.claims [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Claim successful on node user
Nov 22 07:54:45 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:54:45 user nova-compute[74348]: DEBUG nova.network.neutron [None req-98be5f88-9534-4582-863b-c3ec27b76b7f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Updating instance_info_cache with network_info: [{"id": "094232d9-8ec1-401f-8908-2a698a5385bb", "address": "fa:16:3e:db:2f:02", "network": {"id": "4ef640bb-4a2f-4f98-8b01-b5df87fcb35a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1216437312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444367658c0241d0b5b377a73fedb52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap094232d9-8e", "ovs_interfaceid": "094232d9-8ec1-401f-8908-2a698a5385bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:54:45 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:54:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-98be5f88-9534-4582-863b-c3ec27b76b7f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Releasing lock "refresh_cache-5f3bbae3-babf-44d2-96da-c459fb77d9c7" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:54:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.490s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:45 user nova-compute[74348]: DEBUG nova.compute.manager [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 07:54:45 user nova-compute[74348]: DEBUG nova.compute.manager [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 07:54:45 user nova-compute[74348]: DEBUG nova.network.neutron [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 07:54:45 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 07:54:45 user nova-compute[74348]: DEBUG nova.compute.manager [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 07:54:45 user nova-compute[74348]: DEBUG nova.policy [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f8eca17e3a564220b3b07af4eddadaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569146bb9b04838ad8044260da6ad58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 07:54:45 user nova-compute[74348]: DEBUG nova.compute.manager [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 07:54:45 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 07:54:45 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Creating image(s)
Nov 22 07:54:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "/opt/stack/data/nova/instances/ecbabf54-d2b4-47e0-9e50-60ba8e7e9094/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "/opt/stack/data/nova/instances/ecbabf54-d2b4-47e0-9e50-60ba8e7e9094/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "/opt/stack/data/nova/instances/ecbabf54-d2b4-47e0-9e50-60ba8e7e9094/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.164s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.163s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/ecbabf54-d2b4-47e0-9e50-60ba8e7e9094/disk 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/ecbabf54-d2b4-47e0-9e50-60ba8e7e9094/disk 1073741824" returned: 0 in 0.060s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.166s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:46 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ecbabf54-d2b4-47e0-9e50-60ba8e7e9094/disk. size=1073741824 {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 07:54:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecbabf54-d2b4-47e0-9e50-60ba8e7e9094/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:46 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Instance destroyed successfully.
Nov 22 07:54:46 user nova-compute[74348]: DEBUG nova.objects.instance [None req-98be5f88-9534-4582-863b-c3ec27b76b7f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lazy-loading 'resources' on Instance uuid 5f3bbae3-babf-44d2-96da-c459fb77d9c7 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:54:46 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-98be5f88-9534-4582-863b-c3ec27b76b7f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1450258036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1450258036',id=5,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1mtconRFrvBaGaD9CZoZHOYetItLhh+X0u+WBLx8FOzUxBxl1z1yZwHXr7/IGky0lzZ93nU+B2OiX2u0QzHbm4aEnwCi0/69yJ8ttWXpalWyUQuVbL5dlCSEydwFRPsA==',key_name='tempest-keypair-784392895',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:52:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='444367658c0241d0b5b377a73fedb52b',ramdisk_id='',reservation_id='r-7t8ojxyu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1610098589',owner_user_name='tempest-AttachVolumeShelveTestJSON-1610098589-project-member',shelved_at='2023-11-22T07:54:44.973019',shelved_host='user',shelved_image_id='1e96f0a9-e42f-4190-8221-7914c6953262'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T07:54:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e8ce0d767724228bfd6cf3a4afad00d',uuid=5f3bbae3-babf-44d2-96da-c459fb77d9c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "094232d9-8ec1-401f-8908-2a698a5385bb", "address": "fa:16:3e:db:2f:02", "network": {"id": "4ef640bb-4a2f-4f98-8b01-b5df87fcb35a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1216437312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444367658c0241d0b5b377a73fedb52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap094232d9-8e", "ovs_interfaceid": "094232d9-8ec1-401f-8908-2a698a5385bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 07:54:46 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-98be5f88-9534-4582-863b-c3ec27b76b7f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Converting VIF {"id": "094232d9-8ec1-401f-8908-2a698a5385bb", "address": "fa:16:3e:db:2f:02", "network": {"id": "4ef640bb-4a2f-4f98-8b01-b5df87fcb35a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1216437312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444367658c0241d0b5b377a73fedb52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap094232d9-8e", "ovs_interfaceid": "094232d9-8ec1-401f-8908-2a698a5385bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:54:46 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-98be5f88-9534-4582-863b-c3ec27b76b7f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:2f:02,bridge_name='br-int',has_traffic_filtering=True,id=094232d9-8ec1-401f-8908-2a698a5385bb,network=Network(4ef640bb-4a2f-4f98-8b01-b5df87fcb35a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap094232d9-8e') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:54:46 user nova-compute[74348]: DEBUG os_vif [None req-98be5f88-9534-4582-863b-c3ec27b76b7f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:2f:02,bridge_name='br-int',has_traffic_filtering=True,id=094232d9-8ec1-401f-8908-2a698a5385bb,network=Network(4ef640bb-4a2f-4f98-8b01-b5df87fcb35a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap094232d9-8e') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 07:54:46 user nova-compute[74348]: DEBUG nova.compute.manager [req-947bcb4f-7aa5-4409-8e4f-3880c1646ae9 req-f7af04b3-15f2-4d10-b2d5-dfbaafb83169 service nova] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Received event network-changed-094232d9-8ec1-401f-8908-2a698a5385bb {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:54:46 user nova-compute[74348]: DEBUG nova.compute.manager [req-947bcb4f-7aa5-4409-8e4f-3880c1646ae9 req-f7af04b3-15f2-4d10-b2d5-dfbaafb83169 service nova] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Refreshing instance network info cache due to event network-changed-094232d9-8ec1-401f-8908-2a698a5385bb. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:54:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-947bcb4f-7aa5-4409-8e4f-3880c1646ae9 req-f7af04b3-15f2-4d10-b2d5-dfbaafb83169 service nova] Acquiring lock "refresh_cache-5f3bbae3-babf-44d2-96da-c459fb77d9c7" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:54:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-947bcb4f-7aa5-4409-8e4f-3880c1646ae9 req-f7af04b3-15f2-4d10-b2d5-dfbaafb83169 service nova] Acquired lock "refresh_cache-5f3bbae3-babf-44d2-96da-c459fb77d9c7" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:54:46 user nova-compute[74348]: DEBUG nova.network.neutron [req-947bcb4f-7aa5-4409-8e4f-3880c1646ae9 req-f7af04b3-15f2-4d10-b2d5-dfbaafb83169 service nova] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Refreshing network info cache for port 094232d9-8ec1-401f-8908-2a698a5385bb {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:54:46 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:46 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap094232d9-8e, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:46 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:46 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:54:46 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:46 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=88b511a4-f697-4e8b-b16e-48dda1c2eade) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:46 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:54:46 user nova-compute[74348]: INFO os_vif [None req-98be5f88-9534-4582-863b-c3ec27b76b7f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:2f:02,bridge_name='br-int',has_traffic_filtering=True,id=094232d9-8ec1-401f-8908-2a698a5385bb,network=Network(4ef640bb-4a2f-4f98-8b01-b5df87fcb35a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap094232d9-8e')
Nov 22 07:54:46 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-98be5f88-9534-4582-863b-c3ec27b76b7f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Deleting instance files /opt/stack/data/nova/instances/5f3bbae3-babf-44d2-96da-c459fb77d9c7_del
Nov 22 07:54:46 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-98be5f88-9534-4582-863b-c3ec27b76b7f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Deletion of /opt/stack/data/nova/instances/5f3bbae3-babf-44d2-96da-c459fb77d9c7_del complete
Nov 22 07:54:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecbabf54-d2b4-47e0-9e50-60ba8e7e9094/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:46 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Cannot resize image /opt/stack/data/nova/instances/ecbabf54-d2b4-47e0-9e50-60ba8e7e9094/disk to a smaller size. {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 07:54:46 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 07:54:46 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Ensure instance console log exists: /opt/stack/data/nova/instances/ecbabf54-d2b4-47e0-9e50-60ba8e7e9094/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 07:54:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:46 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-98be5f88-9534-4582-863b-c3ec27b76b7f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Deleted allocations for instance 5f3bbae3-babf-44d2-96da-c459fb77d9c7
Nov 22 07:54:46 user nova-compute[74348]: DEBUG nova.network.neutron [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Successfully created port: 419fb32b-d220-42f3-98f1-acfeb9e531fd {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 07:54:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-98be5f88-9534-4582-863b-c3ec27b76b7f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-98be5f88-9534-4582-863b-c3ec27b76b7f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:46 user nova-compute[74348]: DEBUG nova.objects.instance [None req-98be5f88-9534-4582-863b-c3ec27b76b7f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lazy-loading 'numa_topology' on Instance uuid 5f3bbae3-babf-44d2-96da-c459fb77d9c7 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:54:46 user nova-compute[74348]: DEBUG nova.objects.base [None req-98be5f88-9534-4582-863b-c3ec27b76b7f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Object Instance<5f3bbae3-babf-44d2-96da-c459fb77d9c7> lazy-loaded attributes: resources,numa_topology {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG nova.network.neutron [req-947bcb4f-7aa5-4409-8e4f-3880c1646ae9 req-f7af04b3-15f2-4d10-b2d5-dfbaafb83169 service nova] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Updated VIF entry in instance network info cache for port 094232d9-8ec1-401f-8908-2a698a5385bb. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG nova.network.neutron [req-947bcb4f-7aa5-4409-8e4f-3880c1646ae9 req-f7af04b3-15f2-4d10-b2d5-dfbaafb83169 service nova] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Updating instance_info_cache with network_info: [{"id": "094232d9-8ec1-401f-8908-2a698a5385bb", "address": "fa:16:3e:db:2f:02", "network": {"id": "4ef640bb-4a2f-4f98-8b01-b5df87fcb35a", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1216437312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444367658c0241d0b5b377a73fedb52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap094232d9-8e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-98be5f88-9534-4582-863b-c3ec27b76b7f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-947bcb4f-7aa5-4409-8e4f-3880c1646ae9 req-f7af04b3-15f2-4d10-b2d5-dfbaafb83169 service nova] Releasing lock "refresh_cache-5f3bbae3-babf-44d2-96da-c459fb77d9c7" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-98be5f88-9534-4582-863b-c3ec27b76b7f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-98be5f88-9534-4582-863b-c3ec27b76b7f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.443s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-98be5f88-9534-4582-863b-c3ec27b76b7f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "5f3bbae3-babf-44d2-96da-c459fb77d9c7" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.989s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG nova.network.neutron [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Successfully updated port: 419fb32b-d220-42f3-98f1-acfeb9e531fd {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "refresh_cache-ecbabf54-d2b4-47e0-9e50-60ba8e7e9094" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquired lock "refresh_cache-ecbabf54-d2b4-47e0-9e50-60ba8e7e9094" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG nova.network.neutron [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG nova.network.neutron [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG nova.network.neutron [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Updating instance_info_cache with network_info: [{"id": "419fb32b-d220-42f3-98f1-acfeb9e531fd", "address": "fa:16:3e:1b:3f:49", "network": {"id": "5c50496a-0882-415b-8115-ddf7b65516a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-531638472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f569146bb9b04838ad8044260da6ad58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419fb32b-d2", "ovs_interfaceid": "419fb32b-d220-42f3-98f1-acfeb9e531fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Releasing lock "refresh_cache-ecbabf54-d2b4-47e0-9e50-60ba8e7e9094" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG nova.compute.manager [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Instance network_info: |[{"id": "419fb32b-d220-42f3-98f1-acfeb9e531fd", "address": "fa:16:3e:1b:3f:49", "network": {"id": "5c50496a-0882-415b-8115-ddf7b65516a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-531638472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f569146bb9b04838ad8044260da6ad58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419fb32b-d2", "ovs_interfaceid": "419fb32b-d220-42f3-98f1-acfeb9e531fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Start _get_guest_xml network_info=[{"id": "419fb32b-d220-42f3-98f1-acfeb9e531fd", "address": "fa:16:3e:1b:3f:49", "network": {"id": "5c50496a-0882-415b-8115-ddf7b65516a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-531638472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f569146bb9b04838ad8044260da6ad58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419fb32b-d2", "ovs_interfaceid": "419fb32b-d220-42f3-98f1-acfeb9e531fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 07:54:47 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:54:47 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:54:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:54:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1925396109',display_name='tempest-AttachVolumeNegativeTest-server-1925396109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1925396109',id=14,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjBXou7DEpKskNgQP5/T2/Hu4xm0pbvOYhHijfTcJjUn9lmgeBoLKll0lqjqxbm6sAWB151QSyvAd0KQuHUmPxJL1VCTgq+AFfmuRZCaiNo9S9VminI5VXmkaZgwHNcFQ==',key_name='tempest-keypair-2025050509',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f569146bb9b04838ad8044260da6ad58',ramdisk_id='',reservation_id='r-401i13x6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1606364171',owner_user_name='tempest-AttachVolumeNegativeTest-1606364171-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:54:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8eca17e3a564220b3b07af4eddadaca',uuid=ecbabf54-d2b4-47e0-9e50-60ba8e7e9094,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "419fb32b-d220-42f3-98f1-acfeb9e531fd", "address": "fa:16:3e:1b:3f:49", "network": {"id": "5c50496a-0882-415b-8115-ddf7b65516a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-531638472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f569146bb9b04838ad8044260da6ad58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419fb32b-d2", "ovs_interfaceid": "419fb32b-d220-42f3-98f1-acfeb9e531fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Converting VIF {"id": "419fb32b-d220-42f3-98f1-acfeb9e531fd", "address": "fa:16:3e:1b:3f:49", "network": {"id": "5c50496a-0882-415b-8115-ddf7b65516a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-531638472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f569146bb9b04838ad8044260da6ad58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419fb32b-d2", "ovs_interfaceid": "419fb32b-d220-42f3-98f1-acfeb9e531fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:3f:49,bridge_name='br-int',has_traffic_filtering=True,id=419fb32b-d220-42f3-98f1-acfeb9e531fd,network=Network(5c50496a-0882-415b-8115-ddf7b65516a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap419fb32b-d2') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG nova.objects.instance [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lazy-loading 'pci_devices' on Instance uuid ecbabf54-d2b4-47e0-9e50-60ba8e7e9094 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] End _get_guest_xml xml=<domain type="kvm">
Nov 22 07:54:47 user nova-compute[74348]:   <uuid>ecbabf54-d2b4-47e0-9e50-60ba8e7e9094</uuid>
Nov 22 07:54:47 user nova-compute[74348]:   <name>instance-0000000e</name>
Nov 22 07:54:47 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 07:54:47 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 07:54:47 user nova-compute[74348]:   <metadata>
Nov 22 07:54:47 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 07:54:47 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 07:54:47 user nova-compute[74348]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1925396109</nova:name>
Nov 22 07:54:47 user nova-compute[74348]:       <nova:creationTime>2023-11-22 07:54:47</nova:creationTime>
Nov 22 07:54:47 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 07:54:47 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 07:54:47 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 07:54:47 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 07:54:47 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 07:54:47 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 07:54:47 user nova-compute[74348]:       </nova:flavor>
Nov 22 07:54:47 user nova-compute[74348]:       <nova:owner>
Nov 22 07:54:47 user nova-compute[74348]:         <nova:user uuid="f8eca17e3a564220b3b07af4eddadaca">tempest-AttachVolumeNegativeTest-1606364171-project-member</nova:user>
Nov 22 07:54:47 user nova-compute[74348]:         <nova:project uuid="f569146bb9b04838ad8044260da6ad58">tempest-AttachVolumeNegativeTest-1606364171</nova:project>
Nov 22 07:54:47 user nova-compute[74348]:       </nova:owner>
Nov 22 07:54:47 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 07:54:47 user nova-compute[74348]:       <nova:ports>
Nov 22 07:54:47 user nova-compute[74348]:         <nova:port uuid="419fb32b-d220-42f3-98f1-acfeb9e531fd">
Nov 22 07:54:47 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 22 07:54:47 user nova-compute[74348]:         </nova:port>
Nov 22 07:54:47 user nova-compute[74348]:       </nova:ports>
Nov 22 07:54:47 user nova-compute[74348]:     </nova:instance>
Nov 22 07:54:47 user nova-compute[74348]:   </metadata>
Nov 22 07:54:47 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 07:54:47 user nova-compute[74348]:     <system>
Nov 22 07:54:47 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 07:54:47 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 07:54:47 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 07:54:47 user nova-compute[74348]:       <entry name="serial">ecbabf54-d2b4-47e0-9e50-60ba8e7e9094</entry>
Nov 22 07:54:47 user nova-compute[74348]:       <entry name="uuid">ecbabf54-d2b4-47e0-9e50-60ba8e7e9094</entry>
Nov 22 07:54:47 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 07:54:47 user nova-compute[74348]:     </system>
Nov 22 07:54:47 user nova-compute[74348]:   </sysinfo>
Nov 22 07:54:47 user nova-compute[74348]:   <os>
Nov 22 07:54:47 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 07:54:47 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 07:54:47 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 07:54:47 user nova-compute[74348]:   </os>
Nov 22 07:54:47 user nova-compute[74348]:   <features>
Nov 22 07:54:47 user nova-compute[74348]:     <acpi/>
Nov 22 07:54:47 user nova-compute[74348]:     <apic/>
Nov 22 07:54:47 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 07:54:47 user nova-compute[74348]:   </features>
Nov 22 07:54:47 user nova-compute[74348]:   <clock offset="utc">
Nov 22 07:54:47 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 07:54:47 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 07:54:47 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 07:54:47 user nova-compute[74348]:   </clock>
Nov 22 07:54:47 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 07:54:47 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 07:54:47 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 07:54:47 user nova-compute[74348]:   </cpu>
Nov 22 07:54:47 user nova-compute[74348]:   <devices>
Nov 22 07:54:47 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 07:54:47 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 07:54:47 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/ecbabf54-d2b4-47e0-9e50-60ba8e7e9094/disk"/>
Nov 22 07:54:47 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 07:54:47 user nova-compute[74348]:     </disk>
Nov 22 07:54:47 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 07:54:47 user nova-compute[74348]:       <mac address="fa:16:3e:1b:3f:49"/>
Nov 22 07:54:47 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:54:47 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 07:54:47 user nova-compute[74348]:       <target dev="tap419fb32b-d2"/>
Nov 22 07:54:47 user nova-compute[74348]:     </interface>
Nov 22 07:54:47 user nova-compute[74348]:     <serial type="pty">
Nov 22 07:54:47 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/ecbabf54-d2b4-47e0-9e50-60ba8e7e9094/console.log" append="off"/>
Nov 22 07:54:47 user nova-compute[74348]:     </serial>
Nov 22 07:54:47 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 07:54:47 user nova-compute[74348]:     <video>
Nov 22 07:54:47 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:54:47 user nova-compute[74348]:     </video>
Nov 22 07:54:47 user nova-compute[74348]:     <rng model="virtio">
Nov 22 07:54:47 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 07:54:47 user nova-compute[74348]:     </rng>
Nov 22 07:54:47 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 07:54:47 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 07:54:47 user nova-compute[74348]:       <stats period="10"/>
Nov 22 07:54:47 user nova-compute[74348]:     </memballoon>
Nov 22 07:54:47 user nova-compute[74348]:   </devices>
Nov 22 07:54:47 user nova-compute[74348]: </domain>
Nov 22 07:54:47 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:54:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1925396109',display_name='tempest-AttachVolumeNegativeTest-server-1925396109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1925396109',id=14,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjBXou7DEpKskNgQP5/T2/Hu4xm0pbvOYhHijfTcJjUn9lmgeBoLKll0lqjqxbm6sAWB151QSyvAd0KQuHUmPxJL1VCTgq+AFfmuRZCaiNo9S9VminI5VXmkaZgwHNcFQ==',key_name='tempest-keypair-2025050509',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f569146bb9b04838ad8044260da6ad58',ramdisk_id='',reservation_id='r-401i13x6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1606364171',owner_user_name='tempest-AttachVolumeNegativeTest-1606364171-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:54:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8eca17e3a564220b3b07af4eddadaca',uuid=ecbabf54-d2b4-47e0-9e50-60ba8e7e9094,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "419fb32b-d220-42f3-98f1-acfeb9e531fd", "address": "fa:16:3e:1b:3f:49", "network": {"id": "5c50496a-0882-415b-8115-ddf7b65516a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-531638472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f569146bb9b04838ad8044260da6ad58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419fb32b-d2", "ovs_interfaceid": "419fb32b-d220-42f3-98f1-acfeb9e531fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Converting VIF {"id": "419fb32b-d220-42f3-98f1-acfeb9e531fd", "address": "fa:16:3e:1b:3f:49", "network": {"id": "5c50496a-0882-415b-8115-ddf7b65516a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-531638472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f569146bb9b04838ad8044260da6ad58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419fb32b-d2", "ovs_interfaceid": "419fb32b-d220-42f3-98f1-acfeb9e531fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:3f:49,bridge_name='br-int',has_traffic_filtering=True,id=419fb32b-d220-42f3-98f1-acfeb9e531fd,network=Network(5c50496a-0882-415b-8115-ddf7b65516a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap419fb32b-d2') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG os_vif [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:3f:49,bridge_name='br-int',has_traffic_filtering=True,id=419fb32b-d220-42f3-98f1-acfeb9e531fd,network=Network(5c50496a-0882-415b-8115-ddf7b65516a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap419fb32b-d2') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '94d4cdb0-04c7-574c-8cdb-4cb6bc5f7e04', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap419fb32b-d2, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap419fb32b-d2, col_values=(('qos', UUID('cbd48fce-3614-4b52-8c20-afaf9518e803')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap419fb32b-d2, col_values=(('external_ids', {'iface-id': '419fb32b-d220-42f3-98f1-acfeb9e531fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:3f:49', 'vm-uuid': 'ecbabf54-d2b4-47e0-9e50-60ba8e7e9094'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:54:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:47 user nova-compute[74348]: INFO os_vif [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:3f:49,bridge_name='br-int',has_traffic_filtering=True,id=419fb32b-d220-42f3-98f1-acfeb9e531fd,network=Network(5c50496a-0882-415b-8115-ddf7b65516a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap419fb32b-d2')
Nov 22 07:54:48 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:54:48 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] No VIF found with MAC fa:16:3e:1b:3f:49, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 07:54:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:48 user nova-compute[74348]: DEBUG nova.compute.manager [req-5481a7e2-0f10-494a-bf70-c4337bed3405 req-1a34a806-c484-4af7-b942-8252bcd7ec26 service nova] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Received event network-changed-419fb32b-d220-42f3-98f1-acfeb9e531fd {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:54:48 user nova-compute[74348]: DEBUG nova.compute.manager [req-5481a7e2-0f10-494a-bf70-c4337bed3405 req-1a34a806-c484-4af7-b942-8252bcd7ec26 service nova] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Refreshing instance network info cache due to event network-changed-419fb32b-d220-42f3-98f1-acfeb9e531fd. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:54:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-5481a7e2-0f10-494a-bf70-c4337bed3405 req-1a34a806-c484-4af7-b942-8252bcd7ec26 service nova] Acquiring lock "refresh_cache-ecbabf54-d2b4-47e0-9e50-60ba8e7e9094" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:54:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-5481a7e2-0f10-494a-bf70-c4337bed3405 req-1a34a806-c484-4af7-b942-8252bcd7ec26 service nova] Acquired lock "refresh_cache-ecbabf54-d2b4-47e0-9e50-60ba8e7e9094" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:54:48 user nova-compute[74348]: DEBUG nova.network.neutron [req-5481a7e2-0f10-494a-bf70-c4337bed3405 req-1a34a806-c484-4af7-b942-8252bcd7ec26 service nova] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Refreshing network info cache for port 419fb32b-d220-42f3-98f1-acfeb9e531fd {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:54:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:49 user nova-compute[74348]: DEBUG nova.network.neutron [req-5481a7e2-0f10-494a-bf70-c4337bed3405 req-1a34a806-c484-4af7-b942-8252bcd7ec26 service nova] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Updated VIF entry in instance network info cache for port 419fb32b-d220-42f3-98f1-acfeb9e531fd. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 07:54:49 user nova-compute[74348]: DEBUG nova.network.neutron [req-5481a7e2-0f10-494a-bf70-c4337bed3405 req-1a34a806-c484-4af7-b942-8252bcd7ec26 service nova] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Updating instance_info_cache with network_info: [{"id": "419fb32b-d220-42f3-98f1-acfeb9e531fd", "address": "fa:16:3e:1b:3f:49", "network": {"id": "5c50496a-0882-415b-8115-ddf7b65516a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-531638472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f569146bb9b04838ad8044260da6ad58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419fb32b-d2", "ovs_interfaceid": "419fb32b-d220-42f3-98f1-acfeb9e531fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:54:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-5481a7e2-0f10-494a-bf70-c4337bed3405 req-1a34a806-c484-4af7-b942-8252bcd7ec26 service nova] Releasing lock "refresh_cache-ecbabf54-d2b4-47e0-9e50-60ba8e7e9094" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:54:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:49 user nova-compute[74348]: DEBUG nova.compute.manager [req-5dba6c97-6eaa-4cd1-a51f-02b35a7e27a7 req-8c121f39-3166-4a80-9c98-6885517db70b service nova] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Received event network-vif-plugged-419fb32b-d220-42f3-98f1-acfeb9e531fd {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:54:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-5dba6c97-6eaa-4cd1-a51f-02b35a7e27a7 req-8c121f39-3166-4a80-9c98-6885517db70b service nova] Acquiring lock "ecbabf54-d2b4-47e0-9e50-60ba8e7e9094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-5dba6c97-6eaa-4cd1-a51f-02b35a7e27a7 req-8c121f39-3166-4a80-9c98-6885517db70b service nova] Lock "ecbabf54-d2b4-47e0-9e50-60ba8e7e9094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-5dba6c97-6eaa-4cd1-a51f-02b35a7e27a7 req-8c121f39-3166-4a80-9c98-6885517db70b service nova] Lock "ecbabf54-d2b4-47e0-9e50-60ba8e7e9094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:49 user nova-compute[74348]: DEBUG nova.compute.manager [req-5dba6c97-6eaa-4cd1-a51f-02b35a7e27a7 req-8c121f39-3166-4a80-9c98-6885517db70b service nova] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] No waiting events found dispatching network-vif-plugged-419fb32b-d220-42f3-98f1-acfeb9e531fd {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:54:49 user nova-compute[74348]: WARNING nova.compute.manager [req-5dba6c97-6eaa-4cd1-a51f-02b35a7e27a7 req-8c121f39-3166-4a80-9c98-6885517db70b service nova] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Received unexpected event network-vif-plugged-419fb32b-d220-42f3-98f1-acfeb9e531fd for instance with vm_state building and task_state spawning.
Nov 22 07:54:50 user nova-compute[74348]: DEBUG nova.compute.manager [req-3224b62c-3f7c-49df-a0b3-5a3134e50306 req-0cbb1029-42ce-4fc3-b033-89830721efa8 service nova] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Received event network-changed-c870c926-d416-4c0c-8fcc-873ce1c3b14e {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:54:50 user nova-compute[74348]: DEBUG nova.compute.manager [req-3224b62c-3f7c-49df-a0b3-5a3134e50306 req-0cbb1029-42ce-4fc3-b033-89830721efa8 service nova] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Refreshing instance network info cache due to event network-changed-c870c926-d416-4c0c-8fcc-873ce1c3b14e. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:54:50 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3224b62c-3f7c-49df-a0b3-5a3134e50306 req-0cbb1029-42ce-4fc3-b033-89830721efa8 service nova] Acquiring lock "refresh_cache-da6aa6c0-2b77-49a5-9942-d6596ac4bd3f" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:54:50 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3224b62c-3f7c-49df-a0b3-5a3134e50306 req-0cbb1029-42ce-4fc3-b033-89830721efa8 service nova] Acquired lock "refresh_cache-da6aa6c0-2b77-49a5-9942-d6596ac4bd3f" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:54:50 user nova-compute[74348]: DEBUG nova.network.neutron [req-3224b62c-3f7c-49df-a0b3-5a3134e50306 req-0cbb1029-42ce-4fc3-b033-89830721efa8 service nova] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Refreshing network info cache for port c870c926-d416-4c0c-8fcc-873ce1c3b14e {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:54:51 user nova-compute[74348]: DEBUG nova.network.neutron [req-3224b62c-3f7c-49df-a0b3-5a3134e50306 req-0cbb1029-42ce-4fc3-b033-89830721efa8 service nova] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Updated VIF entry in instance network info cache for port c870c926-d416-4c0c-8fcc-873ce1c3b14e. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 07:54:51 user nova-compute[74348]: DEBUG nova.network.neutron [req-3224b62c-3f7c-49df-a0b3-5a3134e50306 req-0cbb1029-42ce-4fc3-b033-89830721efa8 service nova] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Updating instance_info_cache with network_info: [{"id": "c870c926-d416-4c0c-8fcc-873ce1c3b14e", "address": "fa:16:3e:06:64:68", "network": {"id": "e3c8d160-d362-47c0-9373-7b90d08587d1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1245990371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ebae3234a914be89750e24861ca1166", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc870c926-d4", "ovs_interfaceid": "c870c926-d416-4c0c-8fcc-873ce1c3b14e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:54:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3224b62c-3f7c-49df-a0b3-5a3134e50306 req-0cbb1029-42ce-4fc3-b033-89830721efa8 service nova] Releasing lock "refresh_cache-da6aa6c0-2b77-49a5-9942-d6596ac4bd3f" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:54:51 user nova-compute[74348]: DEBUG nova.compute.manager [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 07:54:51 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 07:54:51 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Instance spawned successfully.
Nov 22 07:54:51 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 07:54:51 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:54:51 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:54:51 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:54:51 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:54:51 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:54:51 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:54:51 user nova-compute[74348]: DEBUG nova.compute.manager [req-dc6a9df7-8297-44d9-bb56-493d5456977c req-8632a50b-2e75-48cb-9f74-6c476bd171f3 service nova] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Received event network-vif-plugged-419fb32b-d220-42f3-98f1-acfeb9e531fd {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:54:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-dc6a9df7-8297-44d9-bb56-493d5456977c req-8632a50b-2e75-48cb-9f74-6c476bd171f3 service nova] Acquiring lock "ecbabf54-d2b4-47e0-9e50-60ba8e7e9094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-dc6a9df7-8297-44d9-bb56-493d5456977c req-8632a50b-2e75-48cb-9f74-6c476bd171f3 service nova] Lock "ecbabf54-d2b4-47e0-9e50-60ba8e7e9094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-dc6a9df7-8297-44d9-bb56-493d5456977c req-8632a50b-2e75-48cb-9f74-6c476bd171f3 service nova] Lock "ecbabf54-d2b4-47e0-9e50-60ba8e7e9094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:51 user nova-compute[74348]: DEBUG nova.compute.manager [req-dc6a9df7-8297-44d9-bb56-493d5456977c req-8632a50b-2e75-48cb-9f74-6c476bd171f3 service nova] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] No waiting events found dispatching network-vif-plugged-419fb32b-d220-42f3-98f1-acfeb9e531fd {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:54:51 user nova-compute[74348]: WARNING nova.compute.manager [req-dc6a9df7-8297-44d9-bb56-493d5456977c req-8632a50b-2e75-48cb-9f74-6c476bd171f3 service nova] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Received unexpected event network-vif-plugged-419fb32b-d220-42f3-98f1-acfeb9e531fd for instance with vm_state building and task_state spawning.
Nov 22 07:54:51 user nova-compute[74348]: INFO nova.compute.manager [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Took 5.81 seconds to spawn the instance on the hypervisor.
Nov 22 07:54:51 user nova-compute[74348]: DEBUG nova.compute.manager [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 07:54:51 user nova-compute[74348]: INFO nova.compute.manager [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Took 6.61 seconds to build instance.
Nov 22 07:54:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-58ccdb67-f3f1-42f6-a29a-2e27c00ca622 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "ecbabf54-d2b4-47e0-9e50-60ba8e7e9094" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.725s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:52 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Acquiring lock "da6aa6c0-2b77-49a5-9942-d6596ac4bd3f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:52 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Lock "da6aa6c0-2b77-49a5-9942-d6596ac4bd3f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:52 user nova-compute[74348]: DEBUG nova.objects.instance [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Lazy-loading 'flavor' on Instance uuid da6aa6c0-2b77-49a5-9942-d6596ac4bd3f {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:54:52 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Lock "da6aa6c0-2b77-49a5-9942-d6596ac4bd3f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.047s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:52 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Acquiring lock "da6aa6c0-2b77-49a5-9942-d6596ac4bd3f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:52 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Lock "da6aa6c0-2b77-49a5-9942-d6596ac4bd3f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:52 user nova-compute[74348]: INFO nova.compute.manager [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Attaching volume 24c1a275-27a0-4ffd-8cb8-83b9a76a3968 to /dev/sdc
Nov 22 07:54:52 user nova-compute[74348]: DEBUG os_brick.utils [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:54:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:52 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[38634e68-0ebc-4960-bc9b-4b32dbf60b44]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:52 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[17437e51-7826-491a-9189-653276e1ae41]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:52 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7419df-e208-492a-9940-70495a329c28]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:52 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ba500a-38a3-4a89-b380-c4fb7efc39a4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 07:54:52 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 07:54:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 07:54:52 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 07:54:52 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b207b7a-da68-4329-9d4c-d610eb1f00ed]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:52 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 07:54:52 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 07:54:52 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 07:54:52 user nova-compute[74348]: DEBUG os_brick.utils [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:54:52 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Updating existing volume attachment record: 397bec07-01ac-4664-8e5e-a3bd9519f3ad {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 07:54:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:56 user nova-compute[74348]: DEBUG nova.compute.manager [req-c40f9623-e1e4-493f-b795-145343503b99 req-1ce35e5f-0697-4779-b33e-c795b5716be0 service nova] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Received event network-changed-8ddcc793-e3ca-4db4-aff2-40d8121797a7 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:54:56 user nova-compute[74348]: DEBUG nova.compute.manager [req-c40f9623-e1e4-493f-b795-145343503b99 req-1ce35e5f-0697-4779-b33e-c795b5716be0 service nova] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Refreshing instance network info cache due to event network-changed-8ddcc793-e3ca-4db4-aff2-40d8121797a7. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:54:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c40f9623-e1e4-493f-b795-145343503b99 req-1ce35e5f-0697-4779-b33e-c795b5716be0 service nova] Acquiring lock "refresh_cache-e93032ee-56bd-48be-8121-b0fd5273345e" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:54:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c40f9623-e1e4-493f-b795-145343503b99 req-1ce35e5f-0697-4779-b33e-c795b5716be0 service nova] Acquired lock "refresh_cache-e93032ee-56bd-48be-8121-b0fd5273345e" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:54:56 user nova-compute[74348]: DEBUG nova.network.neutron [req-c40f9623-e1e4-493f-b795-145343503b99 req-1ce35e5f-0697-4779-b33e-c795b5716be0 service nova] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Refreshing network info cache for port 8ddcc793-e3ca-4db4-aff2-40d8121797a7 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:54:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Acquiring lock "e93032ee-56bd-48be-8121-b0fd5273345e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Lock "e93032ee-56bd-48be-8121-b0fd5273345e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:56 user nova-compute[74348]: DEBUG nova.objects.instance [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Lazy-loading 'flavor' on Instance uuid e93032ee-56bd-48be-8121-b0fd5273345e {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:54:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Lock "e93032ee-56bd-48be-8121-b0fd5273345e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.126s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:54:57 user nova-compute[74348]: DEBUG nova.network.neutron [req-c40f9623-e1e4-493f-b795-145343503b99 req-1ce35e5f-0697-4779-b33e-c795b5716be0 service nova] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Updated VIF entry in instance network info cache for port 8ddcc793-e3ca-4db4-aff2-40d8121797a7. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 07:54:57 user nova-compute[74348]: DEBUG nova.network.neutron [req-c40f9623-e1e4-493f-b795-145343503b99 req-1ce35e5f-0697-4779-b33e-c795b5716be0 service nova] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Updating instance_info_cache with network_info: [{"id": "8ddcc793-e3ca-4db4-aff2-40d8121797a7", "address": "fa:16:3e:52:83:64", "network": {"id": "9cd1842b-a00c-4bcf-9fe4-1bfd8209bbd4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-186126001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d3b860b77e438c8961b6b6919c6b0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ddcc793-e3", "ovs_interfaceid": "8ddcc793-e3ca-4db4-aff2-40d8121797a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:54:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c40f9623-e1e4-493f-b795-145343503b99 req-1ce35e5f-0697-4779-b33e-c795b5716be0 service nova] Releasing lock "refresh_cache-e93032ee-56bd-48be-8121-b0fd5273345e" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:54:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Acquiring lock "e93032ee-56bd-48be-8121-b0fd5273345e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:54:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Lock "e93032ee-56bd-48be-8121-b0fd5273345e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:54:57 user nova-compute[74348]: INFO nova.compute.manager [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Attaching volume c75e240f-f04a-4750-ac8d-81122d651471 to /dev/vdb
Nov 22 07:54:57 user nova-compute[74348]: DEBUG os_brick.utils [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:54:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07622fc-2e65-499b-8b50-763ece8d91a9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ab5ed6-8dda-4331-a1fa-7b2262d06f2f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:54:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50dd992-53b2-4b87-89e8-234303a77434]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0e805b-b35e-4cb6-b6c1-028d0df374fb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 07:54:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 07:54:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:54:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 07:54:57 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 07:54:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b077453-1e82-4ab8-ab00-00bd06ded7f4]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:54:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 07:54:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 07:54:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 07:54:57 user nova-compute[74348]: DEBUG os_brick.utils [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:54:57 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Updating existing volume attachment record: 83ec1a33-cc0c-44b2-ac8f-743ba2430c4f {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 07:54:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:54:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:00 user nova-compute[74348]: DEBUG nova.compute.manager [req-c33d668b-5253-4e34-bf1f-b9ee0ecd720c req-feffbbf1-760e-4a5b-972a-b2361ab4d404 service nova] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Received event network-changed-f47b39b9-31a2-4f9b-a5e5-ec139067b6d4 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:00 user nova-compute[74348]: DEBUG nova.compute.manager [req-c33d668b-5253-4e34-bf1f-b9ee0ecd720c req-feffbbf1-760e-4a5b-972a-b2361ab4d404 service nova] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Refreshing instance network info cache due to event network-changed-f47b39b9-31a2-4f9b-a5e5-ec139067b6d4. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:55:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c33d668b-5253-4e34-bf1f-b9ee0ecd720c req-feffbbf1-760e-4a5b-972a-b2361ab4d404 service nova] Acquiring lock "refresh_cache-bdad025e-8f6c-419a-99ea-bf277f6c5577" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:55:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c33d668b-5253-4e34-bf1f-b9ee0ecd720c req-feffbbf1-760e-4a5b-972a-b2361ab4d404 service nova] Acquired lock "refresh_cache-bdad025e-8f6c-419a-99ea-bf277f6c5577" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:55:00 user nova-compute[74348]: DEBUG nova.network.neutron [req-c33d668b-5253-4e34-bf1f-b9ee0ecd720c req-feffbbf1-760e-4a5b-972a-b2361ab4d404 service nova] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Refreshing network info cache for port f47b39b9-31a2-4f9b-a5e5-ec139067b6d4 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:55:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-fa7986bc-4fc3-4aa3-b65e-bbfdda9c74f9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Acquiring lock "interface-bdad025e-8f6c-419a-99ea-bf277f6c5577-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-fa7986bc-4fc3-4aa3-b65e-bbfdda9c74f9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Lock "interface-bdad025e-8f6c-419a-99ea-bf277f6c5577-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.003s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:01 user nova-compute[74348]: DEBUG nova.objects.instance [None req-fa7986bc-4fc3-4aa3-b65e-bbfdda9c74f9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Lazy-loading 'flavor' on Instance uuid bdad025e-8f6c-419a-99ea-bf277f6c5577 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:55:01 user nova-compute[74348]: DEBUG nova.network.neutron [req-c33d668b-5253-4e34-bf1f-b9ee0ecd720c req-feffbbf1-760e-4a5b-972a-b2361ab4d404 service nova] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Updated VIF entry in instance network info cache for port f47b39b9-31a2-4f9b-a5e5-ec139067b6d4. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 07:55:01 user nova-compute[74348]: DEBUG nova.network.neutron [req-c33d668b-5253-4e34-bf1f-b9ee0ecd720c req-feffbbf1-760e-4a5b-972a-b2361ab4d404 service nova] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Updating instance_info_cache with network_info: [{"id": "f47b39b9-31a2-4f9b-a5e5-ec139067b6d4", "address": "fa:16:3e:36:02:a6", "network": {"id": "e0159f32-e7c5-41b9-b652-8e2ca87f9018", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1248845008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f078468965946f6aed352374702843c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47b39b9-31", "ovs_interfaceid": "f47b39b9-31a2-4f9b-a5e5-ec139067b6d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:55:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c33d668b-5253-4e34-bf1f-b9ee0ecd720c req-feffbbf1-760e-4a5b-972a-b2361ab4d404 service nova] Releasing lock "refresh_cache-bdad025e-8f6c-419a-99ea-bf277f6c5577" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:55:01 user nova-compute[74348]: DEBUG nova.objects.instance [None req-fa7986bc-4fc3-4aa3-b65e-bbfdda9c74f9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Lazy-loading 'pci_requests' on Instance uuid bdad025e-8f6c-419a-99ea-bf277f6c5577 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:55:01 user nova-compute[74348]: DEBUG nova.objects.base [None req-fa7986bc-4fc3-4aa3-b65e-bbfdda9c74f9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Object Instance<bdad025e-8f6c-419a-99ea-bf277f6c5577> lazy-loaded attributes: flavor,pci_requests {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 07:55:01 user nova-compute[74348]: DEBUG nova.network.neutron [None req-fa7986bc-4fc3-4aa3-b65e-bbfdda9c74f9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 07:55:01 user nova-compute[74348]: DEBUG nova.policy [None req-fa7986bc-4fc3-4aa3-b65e-bbfdda9c74f9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'df4cae77b03e4395887815058f3a8a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f078468965946f6aed352374702843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 07:55:02 user nova-compute[74348]: DEBUG nova.compute.manager [req-b48a7a62-b575-4be2-817c-18a1717a928a req-48eefb70-460f-4799-9df7-83f9a25f48f9 service nova] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Received event network-changed-6a071188-e54b-4bb7-b4dc-e2fce0291c7e {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:02 user nova-compute[74348]: DEBUG nova.compute.manager [req-b48a7a62-b575-4be2-817c-18a1717a928a req-48eefb70-460f-4799-9df7-83f9a25f48f9 service nova] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Refreshing instance network info cache due to event network-changed-6a071188-e54b-4bb7-b4dc-e2fce0291c7e. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:55:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b48a7a62-b575-4be2-817c-18a1717a928a req-48eefb70-460f-4799-9df7-83f9a25f48f9 service nova] Acquiring lock "refresh_cache-88730c14-fd2a-4f63-bc10-96cea0b057eb" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:55:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b48a7a62-b575-4be2-817c-18a1717a928a req-48eefb70-460f-4799-9df7-83f9a25f48f9 service nova] Acquired lock "refresh_cache-88730c14-fd2a-4f63-bc10-96cea0b057eb" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:55:02 user nova-compute[74348]: DEBUG nova.network.neutron [req-b48a7a62-b575-4be2-817c-18a1717a928a req-48eefb70-460f-4799-9df7-83f9a25f48f9 service nova] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Refreshing network info cache for port 6a071188-e54b-4bb7-b4dc-e2fce0291c7e {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:55:02 user nova-compute[74348]: DEBUG nova.network.neutron [None req-fa7986bc-4fc3-4aa3-b65e-bbfdda9c74f9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Successfully created port: 1f80afa8-d693-44a8-86ff-0fec89d2e510 {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 07:55:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] Acquiring lock "88730c14-fd2a-4f63-bc10-96cea0b057eb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] Lock "88730c14-fd2a-4f63-bc10-96cea0b057eb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:02 user nova-compute[74348]: DEBUG nova.objects.instance [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] Lazy-loading 'flavor' on Instance uuid 88730c14-fd2a-4f63-bc10-96cea0b057eb {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:55:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] Lock "88730c14-fd2a-4f63-bc10-96cea0b057eb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] Acquiring lock "88730c14-fd2a-4f63-bc10-96cea0b057eb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] Lock "88730c14-fd2a-4f63-bc10-96cea0b057eb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:03 user nova-compute[74348]: INFO nova.compute.manager [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Attaching volume 64bf9397-6276-4a77-ba6e-1a0a52ea70fa to /dev/vdb
Nov 22 07:55:03 user nova-compute[74348]: DEBUG os_brick.utils [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:55:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:03 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4dcad3-ec84-4418-aecb-2231bd442d0d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:03 user nova-compute[74348]: DEBUG nova.network.neutron [req-b48a7a62-b575-4be2-817c-18a1717a928a req-48eefb70-460f-4799-9df7-83f9a25f48f9 service nova] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Updated VIF entry in instance network info cache for port 6a071188-e54b-4bb7-b4dc-e2fce0291c7e. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 07:55:03 user nova-compute[74348]: DEBUG nova.network.neutron [req-b48a7a62-b575-4be2-817c-18a1717a928a req-48eefb70-460f-4799-9df7-83f9a25f48f9 service nova] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Updating instance_info_cache with network_info: [{"id": "6a071188-e54b-4bb7-b4dc-e2fce0291c7e", "address": "fa:16:3e:ac:c1:ef", "network": {"id": "47fbdc54-3fce-4cf3-970c-4dbd738b71a6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2128185295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d2d0075b4a4ee7980d9a0b2cb9a220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a071188-e5", "ovs_interfaceid": "6a071188-e54b-4bb7-b4dc-e2fce0291c7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:55:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:03 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8ab460-d45a-4903-a00a-f46e578505fd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b48a7a62-b575-4be2-817c-18a1717a928a req-48eefb70-460f-4799-9df7-83f9a25f48f9 service nova] Releasing lock "refresh_cache-88730c14-fd2a-4f63-bc10-96cea0b057eb" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:55:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:03 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ad3416-16e8-43ef-8201-d9b8e1c82055]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:03 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b734399-b887-4826-9cd3-b303279018c1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 07:55:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 07:55:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 07:55:03 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 07:55:03 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c57e72-3c95-49f0-90c2-00e8e37a088e]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 07:55:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 07:55:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 07:55:03 user nova-compute[74348]: DEBUG os_brick.utils [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:55:03 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Updating existing volume attachment record: 7370361b-33c0-4d93-9037-7c72160f9342 {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 07:55:03 user nova-compute[74348]: DEBUG nova.network.neutron [None req-fa7986bc-4fc3-4aa3-b65e-bbfdda9c74f9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Successfully updated port: 1f80afa8-d693-44a8-86ff-0fec89d2e510 {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 07:55:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-fa7986bc-4fc3-4aa3-b65e-bbfdda9c74f9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Acquiring lock "refresh_cache-bdad025e-8f6c-419a-99ea-bf277f6c5577" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:55:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-fa7986bc-4fc3-4aa3-b65e-bbfdda9c74f9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Acquired lock "refresh_cache-bdad025e-8f6c-419a-99ea-bf277f6c5577" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:55:03 user nova-compute[74348]: DEBUG nova.network.neutron [None req-fa7986bc-4fc3-4aa3-b65e-bbfdda9c74f9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 07:55:03 user nova-compute[74348]: DEBUG nova.compute.manager [req-e6c288d1-c829-44b6-b715-20bdfd26baf7 req-f4a69785-1a0b-4469-97af-ecf5740b5fae service nova] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Received event network-changed-1f80afa8-d693-44a8-86ff-0fec89d2e510 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:03 user nova-compute[74348]: DEBUG nova.compute.manager [req-e6c288d1-c829-44b6-b715-20bdfd26baf7 req-f4a69785-1a0b-4469-97af-ecf5740b5fae service nova] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Refreshing instance network info cache due to event network-changed-1f80afa8-d693-44a8-86ff-0fec89d2e510. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:55:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e6c288d1-c829-44b6-b715-20bdfd26baf7 req-f4a69785-1a0b-4469-97af-ecf5740b5fae service nova] Acquiring lock "refresh_cache-bdad025e-8f6c-419a-99ea-bf277f6c5577" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:55:04 user nova-compute[74348]: DEBUG nova.network.neutron [None req-fa7986bc-4fc3-4aa3-b65e-bbfdda9c74f9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Updating instance_info_cache with network_info: [{"id": "f47b39b9-31a2-4f9b-a5e5-ec139067b6d4", "address": "fa:16:3e:36:02:a6", "network": {"id": "e0159f32-e7c5-41b9-b652-8e2ca87f9018", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1248845008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f078468965946f6aed352374702843c", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47b39b9-31", "ovs_interfaceid": "f47b39b9-31a2-4f9b-a5e5-ec139067b6d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f80afa8-d693-44a8-86ff-0fec89d2e510", "address": "fa:16:3e:c2:25:c9", "network": {"id": "11db4075-7b75-40bf-b506-4f4ea3f9631c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2016258335", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2f078468965946f6aed352374702843c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f80afa8-d6", "ovs_interfaceid": "1f80afa8-d693-44a8-86ff-0fec89d2e510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:55:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-fa7986bc-4fc3-4aa3-b65e-bbfdda9c74f9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Releasing lock "refresh_cache-bdad025e-8f6c-419a-99ea-bf277f6c5577" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:55:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e6c288d1-c829-44b6-b715-20bdfd26baf7 req-f4a69785-1a0b-4469-97af-ecf5740b5fae service nova] Acquired lock "refresh_cache-bdad025e-8f6c-419a-99ea-bf277f6c5577" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:55:04 user nova-compute[74348]: DEBUG nova.network.neutron [req-e6c288d1-c829-44b6-b715-20bdfd26baf7 req-f4a69785-1a0b-4469-97af-ecf5740b5fae service nova] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Refreshing network info cache for port 1f80afa8-d693-44a8-86ff-0fec89d2e510 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:55:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-fa7986bc-4fc3-4aa3-b65e-bbfdda9c74f9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-726810190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-726810190',id=8,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2d2AMx5MTcXajy6b7uPsq3+jYxxbAAyYP5uwFXUURVQR6N2+iGSyaCZAQVBr0xq/5GZlgBfcRmwRXF9ZovM3nD3R4hcY3OcZ/S/sjuTSQBqYHlzsArXECyBywfXW3yNw==',key_name='tempest-keypair-266871328',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:53:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2f078468965946f6aed352374702843c',ramdisk_id='',reservation_id='r-nuqss0no',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-659854772',owner_user_name='tempest-TaggedAttachmentsTest-659854772-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T07:53:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df4cae77b03e4395887815058f3a8a42',uuid=bdad025e-8f6c-419a-99ea-bf277f6c5577,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f80afa8-d693-44a8-86ff-0fec89d2e510", "address": "fa:16:3e:c2:25:c9", "network": {"id": "11db4075-7b75-40bf-b506-4f4ea3f9631c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2016258335", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2f078468965946f6aed352374702843c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f80afa8-d6", "ovs_interfaceid": "1f80afa8-d693-44a8-86ff-0fec89d2e510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 07:55:04 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-fa7986bc-4fc3-4aa3-b65e-bbfdda9c74f9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Converting VIF {"id": "1f80afa8-d693-44a8-86ff-0fec89d2e510", "address": "fa:16:3e:c2:25:c9", "network": {"id": "11db4075-7b75-40bf-b506-4f4ea3f9631c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2016258335", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2f078468965946f6aed352374702843c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f80afa8-d6", "ovs_interfaceid": "1f80afa8-d693-44a8-86ff-0fec89d2e510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:55:04 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-fa7986bc-4fc3-4aa3-b65e-bbfdda9c74f9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:25:c9,bridge_name='br-int',has_traffic_filtering=True,id=1f80afa8-d693-44a8-86ff-0fec89d2e510,network=Network(11db4075-7b75-40bf-b506-4f4ea3f9631c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f80afa8-d6') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:55:04 user nova-compute[74348]: DEBUG os_vif [None req-fa7986bc-4fc3-4aa3-b65e-bbfdda9c74f9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:25:c9,bridge_name='br-int',has_traffic_filtering=True,id=1f80afa8-d693-44a8-86ff-0fec89d2e510,network=Network(11db4075-7b75-40bf-b506-4f4ea3f9631c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f80afa8-d6') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 07:55:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:55:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 07:55:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f5d20dea-18c2-5ba3-b276-14092bba4813', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:55:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:55:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f80afa8-d6, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:55:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1f80afa8-d6, col_values=(('qos', UUID('bd228c6e-d75f-4008-be05-e12d909b428c')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:55:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1f80afa8-d6, col_values=(('external_ids', {'iface-id': '1f80afa8-d693-44a8-86ff-0fec89d2e510', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:25:c9', 'vm-uuid': 'bdad025e-8f6c-419a-99ea-bf277f6c5577'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:55:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:55:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:04 user nova-compute[74348]: INFO os_vif [None req-fa7986bc-4fc3-4aa3-b65e-bbfdda9c74f9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:25:c9,bridge_name='br-int',has_traffic_filtering=True,id=1f80afa8-d693-44a8-86ff-0fec89d2e510,network=Network(11db4075-7b75-40bf-b506-4f4ea3f9631c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f80afa8-d6')
Nov 22 07:55:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-fa7986bc-4fc3-4aa3-b65e-bbfdda9c74f9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-726810190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-726810190',id=8,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2d2AMx5MTcXajy6b7uPsq3+jYxxbAAyYP5uwFXUURVQR6N2+iGSyaCZAQVBr0xq/5GZlgBfcRmwRXF9ZovM3nD3R4hcY3OcZ/S/sjuTSQBqYHlzsArXECyBywfXW3yNw==',key_name='tempest-keypair-266871328',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:53:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2f078468965946f6aed352374702843c',ramdisk_id='',reservation_id='r-nuqss0no',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-659854772',owner_user_name='tempest-TaggedAttachmentsTest-659854772-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T07:53:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df4cae77b03e4395887815058f3a8a42',uuid=bdad025e-8f6c-419a-99ea-bf277f6c5577,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f80afa8-d693-44a8-86ff-0fec89d2e510", "address": "fa:16:3e:c2:25:c9", "network": {"id": "11db4075-7b75-40bf-b506-4f4ea3f9631c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2016258335", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2f078468965946f6aed352374702843c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f80afa8-d6", "ovs_interfaceid": "1f80afa8-d693-44a8-86ff-0fec89d2e510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 07:55:04 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-fa7986bc-4fc3-4aa3-b65e-bbfdda9c74f9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Converting VIF {"id": "1f80afa8-d693-44a8-86ff-0fec89d2e510", "address": "fa:16:3e:c2:25:c9", "network": {"id": "11db4075-7b75-40bf-b506-4f4ea3f9631c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2016258335", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2f078468965946f6aed352374702843c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f80afa8-d6", "ovs_interfaceid": "1f80afa8-d693-44a8-86ff-0fec89d2e510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:55:04 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-fa7986bc-4fc3-4aa3-b65e-bbfdda9c74f9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:25:c9,bridge_name='br-int',has_traffic_filtering=True,id=1f80afa8-d693-44a8-86ff-0fec89d2e510,network=Network(11db4075-7b75-40bf-b506-4f4ea3f9631c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f80afa8-d6') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:55:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-fa7986bc-4fc3-4aa3-b65e-bbfdda9c74f9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] attach device xml: <interface type="ethernet">
Nov 22 07:55:04 user nova-compute[74348]:   <mac address="fa:16:3e:c2:25:c9"/>
Nov 22 07:55:04 user nova-compute[74348]:   <model type="virtio"/>
Nov 22 07:55:04 user nova-compute[74348]:   <mtu size="1442"/>
Nov 22 07:55:04 user nova-compute[74348]:   <target dev="tap1f80afa8-d6"/>
Nov 22 07:55:04 user nova-compute[74348]: </interface>
Nov 22 07:55:04 user nova-compute[74348]:  {{(pid=74348) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 07:55:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-fa7986bc-4fc3-4aa3-b65e-bbfdda9c74f9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:55:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-fa7986bc-4fc3-4aa3-b65e-bbfdda9c74f9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] No BDM found with device name hda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:55:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-fa7986bc-4fc3-4aa3-b65e-bbfdda9c74f9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] No VIF found with MAC fa:16:3e:36:02:a6, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 07:55:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-fa7986bc-4fc3-4aa3-b65e-bbfdda9c74f9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 07:55:04 user nova-compute[74348]:   <nova:package version="0.0.0"/>
Nov 22 07:55:04 user nova-compute[74348]:   <nova:name>tempest-device-tagging-server-726810190</nova:name>
Nov 22 07:55:04 user nova-compute[74348]:   <nova:creationTime>2023-11-22 07:55:04</nova:creationTime>
Nov 22 07:55:04 user nova-compute[74348]:   <nova:flavor name="m1.tiny">
Nov 22 07:55:04 user nova-compute[74348]:     <nova:memory>512</nova:memory>
Nov 22 07:55:04 user nova-compute[74348]:     <nova:disk>1</nova:disk>
Nov 22 07:55:04 user nova-compute[74348]:     <nova:swap>0</nova:swap>
Nov 22 07:55:04 user nova-compute[74348]:     <nova:ephemeral>0</nova:ephemeral>
Nov 22 07:55:04 user nova-compute[74348]:     <nova:vcpus>1</nova:vcpus>
Nov 22 07:55:04 user nova-compute[74348]:   </nova:flavor>
Nov 22 07:55:04 user nova-compute[74348]:   <nova:owner>
Nov 22 07:55:04 user nova-compute[74348]:     <nova:user uuid="df4cae77b03e4395887815058f3a8a42">tempest-TaggedAttachmentsTest-659854772-project-member</nova:user>
Nov 22 07:55:04 user nova-compute[74348]:     <nova:project uuid="2f078468965946f6aed352374702843c">tempest-TaggedAttachmentsTest-659854772</nova:project>
Nov 22 07:55:04 user nova-compute[74348]:   </nova:owner>
Nov 22 07:55:04 user nova-compute[74348]:   <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 07:55:04 user nova-compute[74348]:   <nova:ports>
Nov 22 07:55:04 user nova-compute[74348]:     <nova:port uuid="f47b39b9-31a2-4f9b-a5e5-ec139067b6d4">
Nov 22 07:55:04 user nova-compute[74348]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 22 07:55:04 user nova-compute[74348]:     </nova:port>
Nov 22 07:55:04 user nova-compute[74348]:     <nova:port uuid="1f80afa8-d693-44a8-86ff-0fec89d2e510">
Nov 22 07:55:04 user nova-compute[74348]:       <nova:ip type="fixed" address="10.10.10.170" ipVersion="4"/>
Nov 22 07:55:04 user nova-compute[74348]:     </nova:port>
Nov 22 07:55:04 user nova-compute[74348]:   </nova:ports>
Nov 22 07:55:04 user nova-compute[74348]: </nova:instance>
Nov 22 07:55:04 user nova-compute[74348]:  {{(pid=74348) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 22 07:55:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-fa7986bc-4fc3-4aa3-b65e-bbfdda9c74f9 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Lock "interface-bdad025e-8f6c-419a-99ea-bf277f6c5577-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.479s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:04 user nova-compute[74348]: DEBUG nova.network.neutron [req-e6c288d1-c829-44b6-b715-20bdfd26baf7 req-f4a69785-1a0b-4469-97af-ecf5740b5fae service nova] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Updated VIF entry in instance network info cache for port 1f80afa8-d693-44a8-86ff-0fec89d2e510. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 07:55:04 user nova-compute[74348]: DEBUG nova.network.neutron [req-e6c288d1-c829-44b6-b715-20bdfd26baf7 req-f4a69785-1a0b-4469-97af-ecf5740b5fae service nova] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Updating instance_info_cache with network_info: [{"id": "f47b39b9-31a2-4f9b-a5e5-ec139067b6d4", "address": "fa:16:3e:36:02:a6", "network": {"id": "e0159f32-e7c5-41b9-b652-8e2ca87f9018", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1248845008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f078468965946f6aed352374702843c", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47b39b9-31", "ovs_interfaceid": "f47b39b9-31a2-4f9b-a5e5-ec139067b6d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f80afa8-d693-44a8-86ff-0fec89d2e510", "address": "fa:16:3e:c2:25:c9", "network": {"id": "11db4075-7b75-40bf-b506-4f4ea3f9631c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2016258335", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2f078468965946f6aed352374702843c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f80afa8-d6", "ovs_interfaceid": "1f80afa8-d693-44a8-86ff-0fec89d2e510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:55:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e6c288d1-c829-44b6-b715-20bdfd26baf7 req-f4a69785-1a0b-4469-97af-ecf5740b5fae service nova] Releasing lock "refresh_cache-bdad025e-8f6c-419a-99ea-bf277f6c5577" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:55:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:05 user nova-compute[74348]: DEBUG nova.compute.manager [req-fbc63486-c83c-4f1c-8a37-26a045155aab req-dbad0b6c-26a6-4194-a48f-000e667a4009 service nova] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Received event network-vif-plugged-1f80afa8-d693-44a8-86ff-0fec89d2e510 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-fbc63486-c83c-4f1c-8a37-26a045155aab req-dbad0b6c-26a6-4194-a48f-000e667a4009 service nova] Acquiring lock "bdad025e-8f6c-419a-99ea-bf277f6c5577-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-fbc63486-c83c-4f1c-8a37-26a045155aab req-dbad0b6c-26a6-4194-a48f-000e667a4009 service nova] Lock "bdad025e-8f6c-419a-99ea-bf277f6c5577-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-fbc63486-c83c-4f1c-8a37-26a045155aab req-dbad0b6c-26a6-4194-a48f-000e667a4009 service nova] Lock "bdad025e-8f6c-419a-99ea-bf277f6c5577-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:05 user nova-compute[74348]: DEBUG nova.compute.manager [req-fbc63486-c83c-4f1c-8a37-26a045155aab req-dbad0b6c-26a6-4194-a48f-000e667a4009 service nova] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] No waiting events found dispatching network-vif-plugged-1f80afa8-d693-44a8-86ff-0fec89d2e510 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:55:05 user nova-compute[74348]: WARNING nova.compute.manager [req-fbc63486-c83c-4f1c-8a37-26a045155aab req-dbad0b6c-26a6-4194-a48f-000e667a4009 service nova] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Received unexpected event network-vif-plugged-1f80afa8-d693-44a8-86ff-0fec89d2e510 for instance with vm_state active and task_state None.
Nov 22 07:55:05 user nova-compute[74348]: DEBUG nova.compute.manager [req-fbc63486-c83c-4f1c-8a37-26a045155aab req-dbad0b6c-26a6-4194-a48f-000e667a4009 service nova] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Received event network-vif-plugged-1f80afa8-d693-44a8-86ff-0fec89d2e510 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-fbc63486-c83c-4f1c-8a37-26a045155aab req-dbad0b6c-26a6-4194-a48f-000e667a4009 service nova] Acquiring lock "bdad025e-8f6c-419a-99ea-bf277f6c5577-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-fbc63486-c83c-4f1c-8a37-26a045155aab req-dbad0b6c-26a6-4194-a48f-000e667a4009 service nova] Lock "bdad025e-8f6c-419a-99ea-bf277f6c5577-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-fbc63486-c83c-4f1c-8a37-26a045155aab req-dbad0b6c-26a6-4194-a48f-000e667a4009 service nova] Lock "bdad025e-8f6c-419a-99ea-bf277f6c5577-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:05 user nova-compute[74348]: DEBUG nova.compute.manager [req-fbc63486-c83c-4f1c-8a37-26a045155aab req-dbad0b6c-26a6-4194-a48f-000e667a4009 service nova] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] No waiting events found dispatching network-vif-plugged-1f80afa8-d693-44a8-86ff-0fec89d2e510 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:55:05 user nova-compute[74348]: WARNING nova.compute.manager [req-fbc63486-c83c-4f1c-8a37-26a045155aab req-dbad0b6c-26a6-4194-a48f-000e667a4009 service nova] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Received unexpected event network-vif-plugged-1f80afa8-d693-44a8-86ff-0fec89d2e510 for instance with vm_state active and task_state None.
Nov 22 07:55:06 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RJgzOPEi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:55:06 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:55:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:55:06 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:55:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:55:06 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf6d003-eddd-49a4-96c0-3cefa572116c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 07:55:06 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0298b04c-e8e3-4a9d-bef4-a220e98e928c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968] added
Nov 22 07:55:06 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ad4e20-6695-403d-ba59-1147bc202865]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[aecdfe01-a8a1-44f7-8852-ba35e4636078]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RJgzOPEi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RJgzOPEi" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d92c18-d9b2-4ca4-9d2b-aec6324e2f1a]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RJgzOPEi'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf8ac50-5c26-4116-bd82-a33534d32f80]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Acquiring lock "bdad025e-8f6c-419a-99ea-bf277f6c5577" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Lock "bdad025e-8f6c-419a-99ea-bf277f6c5577" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG nova.objects.instance [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Lazy-loading 'flavor' on Instance uuid bdad025e-8f6c-419a-99ea-bf277f6c5577 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6b31cf-fc79-4d7b-a841-12f6d18ccd16]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:55:06 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:55:06 user nova-compute[74348]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)
Nov 22 07:55:06 user nova-compute[74348]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)
Nov 22 07:55:06 user nova-compute[74348]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)
Nov 22 07:55:06 user nova-compute[74348]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)
Nov 22 07:55:06 user nova-compute[74348]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)
Nov 22 07:55:06 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:55:06 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:55:06 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:55:06 user nova-compute[74348]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)
Nov 22 07:55:06 user nova-compute[74348]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)
Nov 22 07:55:06 user nova-compute[74348]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)
Nov 22 07:55:06 user nova-compute[74348]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)
Nov 22 07:55:06 user nova-compute[74348]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)
Nov 22 07:55:06 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:55:06 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Lock "bdad025e-8f6c-419a-99ea-bf277f6c5577" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 -p 172.16.0.220:3260 --login" returned: 0 in 0.104s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e105291-7130-4531-80ad-b2d43746e2f9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968, portal: 172.16.0.220,3260]
Nov 22 07:55:06 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968, portal: 172.16.0.220,3260] successful.
Nov 22 07:55:06 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[933ce065-b2b5-4524-b5ef-38c3b573e4cd]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7412acaa-f0d7-44ab-a07e-fda4bf34bf1d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)
Nov 22 07:55:06 user nova-compute[74348]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:55:06 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:55:06 user nova-compute[74348]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)
Nov 22 07:55:06 user nova-compute[74348]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)
Nov 22 07:55:06 user nova-compute[74348]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)
Nov 22 07:55:06 user nova-compute[74348]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)
Nov 22 07:55:06 user nova-compute[74348]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)
Nov 22 07:55:06 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:55:06 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)
Nov 22 07:55:06 user nova-compute[74348]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:55:06 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:55:06 user nova-compute[74348]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)
Nov 22 07:55:06 user nova-compute[74348]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)
Nov 22 07:55:06 user nova-compute[74348]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)
Nov 22 07:55:06 user nova-compute[74348]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)
Nov 22 07:55:06 user nova-compute[74348]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)
Nov 22 07:55:06 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:55:06 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.365s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] HCTL ('41', '-', '-', 0) found on session 10 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a08284-7d29-43f3-ae51-0da532c5d5aa]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Searching for a device in session 10 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RJgzOPEi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Acquiring lock "bdad025e-8f6c-419a-99ea-bf277f6c5577" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Lock "bdad025e-8f6c-419a-99ea-bf277f6c5577" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:06 user nova-compute[74348]: INFO nova.compute.manager [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Attaching volume 31c45577-a290-406b-8e3e-a7852977edce to /dev/vdb
Nov 22 07:55:06 user nova-compute[74348]: DEBUG os_brick.utils [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b201ec3-1d42-48c0-8a43-69264076209d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d937e4-f3d9-438c-8b2a-8d2a8c9ef657]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5858f041-376d-4114-9538-bbb8331e8987]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa238d4-9c91-45e3-ae26-621a0112558e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 07:55:06 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 07:55:06 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36d5f2d-6c70-41c8-8b6b-4ac20d154a82]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG os_brick.utils [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:55:06 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Updating existing volume attachment record: 08210491-25da-4ec1-8141-48d17b59c18e {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 07:55:07 user nova-compute[74348]: DEBUG nova.compute.manager [req-67c69f27-330c-4f07-b3b3-9260ff001c7c req-b2e4b033-c980-4bb0-82f6-a23417804ea6 service nova] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Received event network-changed-c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:07 user nova-compute[74348]: DEBUG nova.compute.manager [req-67c69f27-330c-4f07-b3b3-9260ff001c7c req-b2e4b033-c980-4bb0-82f6-a23417804ea6 service nova] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Refreshing instance network info cache due to event network-changed-c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:55:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-67c69f27-330c-4f07-b3b3-9260ff001c7c req-b2e4b033-c980-4bb0-82f6-a23417804ea6 service nova] Acquiring lock "refresh_cache-abd7f2ed-b0c4-4e05-8161-b141a611f125" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:55:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-67c69f27-330c-4f07-b3b3-9260ff001c7c req-b2e4b033-c980-4bb0-82f6-a23417804ea6 service nova] Acquired lock "refresh_cache-abd7f2ed-b0c4-4e05-8161-b141a611f125" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:55:07 user nova-compute[74348]: DEBUG nova.network.neutron [req-67c69f27-330c-4f07-b3b3-9260ff001c7c req-b2e4b033-c980-4bb0-82f6-a23417804ea6 service nova] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Refreshing network info cache for port c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:55:07 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.407s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:55:07 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] <== connect_volume: return (1408ms) {'type': 'block', 'scsi_wwn': '26536623537653635', 'path': '/dev/sdj'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:55:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536623537653635', 'path': '/dev/sdj'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 07:55:07 user nova-compute[74348]: DEBUG nova.objects.instance [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Lazy-loading 'flavor' on Instance uuid da6aa6c0-2b77-49a5-9942-d6596ac4bd3f {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:55:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 07:55:07 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 07:55:07 user nova-compute[74348]:   <source dev="/dev/sdj"/>
Nov 22 07:55:07 user nova-compute[74348]:   <target dev="sdc" bus="scsi"/>
Nov 22 07:55:07 user nova-compute[74348]:   <serial>24c1a275-27a0-4ffd-8cb8-83b9a76a3968</serial>
Nov 22 07:55:07 user nova-compute[74348]:   <address type="drive" controller="0" unit="2"/>
Nov 22 07:55:07 user nova-compute[74348]: </disk>
Nov 22 07:55:07 user nova-compute[74348]:  {{(pid=74348) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 07:55:08 user nova-compute[74348]: DEBUG nova.network.neutron [req-67c69f27-330c-4f07-b3b3-9260ff001c7c req-b2e4b033-c980-4bb0-82f6-a23417804ea6 service nova] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Updated VIF entry in instance network info cache for port c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 07:55:08 user nova-compute[74348]: DEBUG nova.network.neutron [req-67c69f27-330c-4f07-b3b3-9260ff001c7c req-b2e4b033-c980-4bb0-82f6-a23417804ea6 service nova] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Updating instance_info_cache with network_info: [{"id": "c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3", "address": "fa:16:3e:d1:85:73", "network": {"id": "5826faef-2095-4993-a655-a168237a5018", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1612032334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac4a9f365081417e81c935755cb6ddb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f3237e-bc", "ovs_interfaceid": "c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:55:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-67c69f27-330c-4f07-b3b3-9260ff001c7c req-b2e4b033-c980-4bb0-82f6-a23417804ea6 service nova] Releasing lock "refresh_cache-abd7f2ed-b0c4-4e05-8161-b141a611f125" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:55:08 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] No BDM found with device name sda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:55:08 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:55:08 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:55:08 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] No VIF found with MAC fa:16:3e:06:64:68, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 07:55:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:12 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 07:55:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mJansYWS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:55:12 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:55:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:55:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:55:12 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:55:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:55:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:55:12 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 07:55:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:12 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4b1b17-ca25-4845-8a33-8a097cdb568b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 07:55:12 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:12 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[dddd55ab-5ac1-4538-8af4-e7ce6ae1deee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471] added
Nov 22 07:55:12 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:12 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[38545100-566d-4161-b753-ffe5a132c0c8]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:12 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[60fbf75e-f67e-4cf6-a6ea-414905e7199e]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mJansYWS {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mJansYWS" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:12 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb24cc4-aeed-4908-9a36-e72aadc80a10]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mJansYWS'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:12 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ed4c32-6f02-462f-8306-4aafcf00c93b]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:12 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[233bb8de-2a5f-46ab-b83a-beae75750ed4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)
Nov 22 07:55:12 user nova-compute[74348]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:55:12 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:55:12 user nova-compute[74348]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)
Nov 22 07:55:12 user nova-compute[74348]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)
Nov 22 07:55:12 user nova-compute[74348]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)
Nov 22 07:55:12 user nova-compute[74348]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)
Nov 22 07:55:12 user nova-compute[74348]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)
Nov 22 07:55:12 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:55:12 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:55:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)
Nov 22 07:55:12 user nova-compute[74348]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:55:12 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:55:12 user nova-compute[74348]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)
Nov 22 07:55:12 user nova-compute[74348]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)
Nov 22 07:55:12 user nova-compute[74348]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)
Nov 22 07:55:12 user nova-compute[74348]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)
Nov 22 07:55:12 user nova-compute[74348]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)
Nov 22 07:55:12 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:55:12 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:55:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-dbae31f8-57e0-40fc-8fbf-f3cbf6743fab tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Lock "da6aa6c0-2b77-49a5-9942-d6596ac4bd3f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.705s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:13 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 -p 172.16.0.220:3260 --login" returned: 0 in 0.108s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:13 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3481fc28-99ed-4a53-866a-483b81be0f2e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:13 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471, portal: 172.16.0.220,3260]
Nov 22 07:55:13 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471, portal: 172.16.0.220,3260] successful.
Nov 22 07:55:13 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:13 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:13 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:13 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa23aaaf-7d80-46f3-acbd-5e4434a1baad]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:13 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:13 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:13 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:13 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2173a7c6-4a5c-4f97-bad0-090b85401422]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:13 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)
Nov 22 07:55:13 user nova-compute[74348]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)
Nov 22 07:55:13 user nova-compute[74348]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:55:13 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:55:13 user nova-compute[74348]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)
Nov 22 07:55:13 user nova-compute[74348]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)
Nov 22 07:55:13 user nova-compute[74348]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)
Nov 22 07:55:13 user nova-compute[74348]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)
Nov 22 07:55:13 user nova-compute[74348]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)
Nov 22 07:55:13 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:55:13 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:55:13 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)
Nov 22 07:55:13 user nova-compute[74348]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)
Nov 22 07:55:13 user nova-compute[74348]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:55:13 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:55:13 user nova-compute[74348]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)
Nov 22 07:55:13 user nova-compute[74348]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)
Nov 22 07:55:13 user nova-compute[74348]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)
Nov 22 07:55:13 user nova-compute[74348]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)
Nov 22 07:55:13 user nova-compute[74348]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)
Nov 22 07:55:13 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:55:13 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:55:13 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:55:13 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 07:55:13 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] HCTL ('42', '-', '-', 0) found on session 11 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 07:55:13 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 07:55:13 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:13 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:13 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d068d8db-e525-4d7d-8272-f37ab98ff459]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:13 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Searching for a device in session 11 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 07:55:13 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mJansYWS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 07:55:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:13 user nova-compute[74348]: INFO nova.compute.manager [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Rebuilding instance
Nov 22 07:55:13 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 07:55:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:14 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:55:14 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] <== connect_volume: return (1394ms) {'type': 'block', 'scsi_wwn': '26135383236336332', 'path': '/dev/sdk'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:55:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135383236336332', 'path': '/dev/sdk'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 07:55:14 user nova-compute[74348]: DEBUG nova.objects.instance [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Lazy-loading 'flavor' on Instance uuid e93032ee-56bd-48be-8121-b0fd5273345e {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:55:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 07:55:14 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 07:55:14 user nova-compute[74348]:   <source dev="/dev/sdk"/>
Nov 22 07:55:14 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 07:55:14 user nova-compute[74348]:   <serial>c75e240f-f04a-4750-ac8d-81122d651471</serial>
Nov 22 07:55:14 user nova-compute[74348]: </disk>
Nov 22 07:55:14 user nova-compute[74348]:  {{(pid=74348) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 07:55:14 user nova-compute[74348]: DEBUG nova.compute.manager [req-a99b1861-4316-43d2-91d6-37ea47e20e59 req-337ea7ff-2bcf-4e08-97b7-44ff0300f3a0 service nova] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Received event network-vif-unplugged-c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a99b1861-4316-43d2-91d6-37ea47e20e59 req-337ea7ff-2bcf-4e08-97b7-44ff0300f3a0 service nova] Acquiring lock "abd7f2ed-b0c4-4e05-8161-b141a611f125-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a99b1861-4316-43d2-91d6-37ea47e20e59 req-337ea7ff-2bcf-4e08-97b7-44ff0300f3a0 service nova] Lock "abd7f2ed-b0c4-4e05-8161-b141a611f125-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a99b1861-4316-43d2-91d6-37ea47e20e59 req-337ea7ff-2bcf-4e08-97b7-44ff0300f3a0 service nova] Lock "abd7f2ed-b0c4-4e05-8161-b141a611f125-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:14 user nova-compute[74348]: DEBUG nova.compute.manager [req-a99b1861-4316-43d2-91d6-37ea47e20e59 req-337ea7ff-2bcf-4e08-97b7-44ff0300f3a0 service nova] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] No waiting events found dispatching network-vif-unplugged-c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:55:14 user nova-compute[74348]: WARNING nova.compute.manager [req-a99b1861-4316-43d2-91d6-37ea47e20e59 req-337ea7ff-2bcf-4e08-97b7-44ff0300f3a0 service nova] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Received unexpected event network-vif-unplugged-c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3 for instance with vm_state active and task_state rebuilding.
Nov 22 07:55:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-57b89f4f-dd17-4178-b754-469b198e76f1 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Acquiring lock "da6aa6c0-2b77-49a5-9942-d6596ac4bd3f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-57b89f4f-dd17-4178-b754-469b198e76f1 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Lock "da6aa6c0-2b77-49a5-9942-d6596ac4bd3f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:14 user nova-compute[74348]: INFO nova.compute.manager [None req-57b89f4f-dd17-4178-b754-469b198e76f1 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Detaching volume 24c1a275-27a0-4ffd-8cb8-83b9a76a3968
Nov 22 07:55:14 user nova-compute[74348]: INFO nova.virt.block_device [None req-57b89f4f-dd17-4178-b754-469b198e76f1 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Attempting to driver detach volume 24c1a275-27a0-4ffd-8cb8-83b9a76a3968 from mountpoint /dev/sdc
Nov 22 07:55:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-57b89f4f-dd17-4178-b754-469b198e76f1 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Attempting to detach device sdc from instance da6aa6c0-2b77-49a5-9942-d6596ac4bd3f from the persistent domain config. {{(pid=74348) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 07:55:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-57b89f4f-dd17-4178-b754-469b198e76f1 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 07:55:14 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 07:55:14 user nova-compute[74348]:   <source dev="/dev/sdj"/>
Nov 22 07:55:14 user nova-compute[74348]:   <target dev="sdc" bus="scsi"/>
Nov 22 07:55:14 user nova-compute[74348]:   <serial>24c1a275-27a0-4ffd-8cb8-83b9a76a3968</serial>
Nov 22 07:55:14 user nova-compute[74348]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 22 07:55:14 user nova-compute[74348]: </disk>
Nov 22 07:55:14 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 07:55:14 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-57b89f4f-dd17-4178-b754-469b198e76f1 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Successfully detached device sdc from instance da6aa6c0-2b77-49a5-9942-d6596ac4bd3f from the persistent domain config.
Nov 22 07:55:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-57b89f4f-dd17-4178-b754-469b198e76f1 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance da6aa6c0-2b77-49a5-9942-d6596ac4bd3f from the live domain config. {{(pid=74348) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 07:55:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-57b89f4f-dd17-4178-b754-469b198e76f1 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 07:55:14 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 07:55:14 user nova-compute[74348]:   <source dev="/dev/sdj"/>
Nov 22 07:55:14 user nova-compute[74348]:   <target dev="sdc" bus="scsi"/>
Nov 22 07:55:14 user nova-compute[74348]:   <serial>24c1a275-27a0-4ffd-8cb8-83b9a76a3968</serial>
Nov 22 07:55:14 user nova-compute[74348]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 22 07:55:14 user nova-compute[74348]: </disk>
Nov 22 07:55:14 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 07:55:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:55:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:55:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] No VIF found with MAC fa:16:3e:52:83:64, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 07:55:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-536192aa-f742-4efb-96bf-a22cb7521b4c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Lock "e93032ee-56bd-48be-8121-b0fd5273345e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.480s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-57b89f4f-dd17-4178-b754-469b198e76f1 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance da6aa6c0-2b77-49a5-9942-d6596ac4bd3f {{(pid=74348) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 07:55:15 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Instance destroyed successfully.
Nov 22 07:55:15 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Instance destroyed successfully.
Nov 22 07:55:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:53:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-478037569',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1680569585',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO27qptUwzzdqwLnhCZkr2apu987NWn6IIEhHr7PT4GpTS02zQZcCrEc7XvQW2xsPa1rEu/bPT5i3T2uHMpmNx2zLdQ2Q19AVu91BBTgcbEZQzR0OotNI2TgNid7aWNdEg==',key_name='tempest-keypair-2082604002',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:53:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ac4a9f365081417e81c935755cb6ddb7',ramdisk_id='',reservation_id='r-2h02xod7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-628585113',owner_user_name='tempest-ServerActionsV293TestJSON-628585113-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:55:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad47d30fba8048b99bf017fc43335532',uuid=abd7f2ed-b0c4-4e05-8161-b141a611f125,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3", "address": "fa:16:3e:d1:85:73", "network": {"id": "5826faef-2095-4993-a655-a168237a5018", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1612032334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac4a9f365081417e81c935755cb6ddb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f3237e-bc", "ovs_interfaceid": "c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Converting VIF {"id": "c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3", "address": "fa:16:3e:d1:85:73", "network": {"id": "5826faef-2095-4993-a655-a168237a5018", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1612032334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac4a9f365081417e81c935755cb6ddb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f3237e-bc", "ovs_interfaceid": "c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:85:73,bridge_name='br-int',has_traffic_filtering=True,id=c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3,network=Network(5826faef-2095-4993-a655-a168237a5018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f3237e-bc') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG os_vif [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:85:73,bridge_name='br-int',has_traffic_filtering=True,id=c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3,network=Network(5826faef-2095-4993-a655-a168237a5018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f3237e-bc') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc6f3237e-bc, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=64591310-425f-4946-ac0f-adeb733ddd2d) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:15 user nova-compute[74348]: INFO os_vif [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:85:73,bridge_name='br-int',has_traffic_filtering=True,id=c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3,network=Network(5826faef-2095-4993-a655-a168237a5018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f3237e-bc')
Nov 22 07:55:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UHWXwBSk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:55:15 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 22 07:55:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[797b561a-48c8-40ef-a440-678ea59df43e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 07:55:15 user nova-compute[74348]: No targets found.
Nov 22 07:55:15 user nova-compute[74348]: iSNS:
Nov 22 07:55:15 user nova-compute[74348]: No targets found.
Nov 22 07:55:15 user nova-compute[74348]: STATIC:
Nov 22 07:55:15 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223
Nov 22 07:55:15 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:15 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:15 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471
Nov 22 07:55:15 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:15 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:15 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7
Nov 22 07:55:15 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:15 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:15 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5
Nov 22 07:55:15 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:15 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:15 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c
Nov 22 07:55:15 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:15 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:15 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea
Nov 22 07:55:15 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:15 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:15 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af
Nov 22 07:55:15 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:15 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:15 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968
Nov 22 07:55:15 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:15 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:15 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054
Nov 22 07:55:15 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:15 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:15 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799
Nov 22 07:55:15 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:15 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:15 user nova-compute[74348]: FIRMWARE:
Nov 22 07:55:15 user nova-compute[74348]: No targets found.
Nov 22 07:55:15 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 07:55:15 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 07:55:15 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[64af8b37-710b-4704-bd85-ecef14660fea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f360bf-a527-42c2-8012-2af82efd8aa9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)
Nov 22 07:55:15 user nova-compute[74348]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)
Nov 22 07:55:15 user nova-compute[74348]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:55:15 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:55:15 user nova-compute[74348]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)
Nov 22 07:55:15 user nova-compute[74348]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)
Nov 22 07:55:15 user nova-compute[74348]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)
Nov 22 07:55:15 user nova-compute[74348]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)
Nov 22 07:55:15 user nova-compute[74348]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)
Nov 22 07:55:15 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:55:15 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)
Nov 22 07:55:15 user nova-compute[74348]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)
Nov 22 07:55:15 user nova-compute[74348]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:55:15 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:55:15 user nova-compute[74348]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)
Nov 22 07:55:15 user nova-compute[74348]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)
Nov 22 07:55:15 user nova-compute[74348]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)
Nov 22 07:55:15 user nova-compute[74348]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)
Nov 22 07:55:15 user nova-compute[74348]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)
Nov 22 07:55:15 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:55:15 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f224c45b400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af'): ({'sdb'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Removing single pathed devices sdb {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c534fb7-f087-4cb3-a1d8-7e42a2ba2158]: (4, ('path checker states:\nup                  9\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3ad261-6470-4455-8e0c-1f5cc779e499]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Flushing IO for device /dev/sdb {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[564b90bc-541f-4930-9c14-b1cd1c2733bb]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[98886c78-a826-4f38-bffc-79f98fe59e48]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] SCSI volumes sdb have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2063ed0-0707-4303-a99d-2d3dc1290062]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08a9959-22d8-4251-bf44-183dce106319]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af, portal: 172.16.0.220,3260]
Nov 22 07:55:15 user nova-compute[74348]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af, portal: 172.16.0.220,3260] successful.
Nov 22 07:55:15 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Acquiring lock "e93032ee-56bd-48be-8121-b0fd5273345e" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Lock "e93032ee-56bd-48be-8121-b0fd5273345e" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG os_brick.utils [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e722aff4-d89f-4f5b-8a6a-db428e50f039]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] <== disconnect_volume: return (378ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 07:55:15 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Deleting instance files /opt/stack/data/nova/instances/abd7f2ed-b0c4-4e05-8161-b141a611f125_del
Nov 22 07:55:15 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Deletion of /opt/stack/data/nova/instances/abd7f2ed-b0c4-4e05-8161-b141a611f125_del complete
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ad9a60-bb7d-404d-bcc4-8f1d35b649bb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33360a1-463e-4a6e-8234-4e16bda94a0b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d11b3a-1830-478d-b50c-a746987c32f6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[646ef678-bd38-4178-99fa-74587ac1c73f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 07:55:15 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a063a2ff-edb9-4550-abbe-05505c4d5c8e]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG os_brick.utils [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:55:15 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance abd7f2ed-b0c4-4e05-8161-b141a611f125 could not be found.
Nov 22 07:55:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UHWXwBSk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:55:15 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 22 07:55:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:55:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:15 user nova-compute[74348]: INFO nova.compute.manager [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Swapping volume c75e240f-f04a-4750-ac8d-81122d651471 for deb39549-5f77-4381-9e9c-134511b33ced
Nov 22 07:55:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8969b63-3211-4bea-b3ed-9419a209ee74]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 07:55:16 user nova-compute[74348]: No targets found.
Nov 22 07:55:16 user nova-compute[74348]: iSNS:
Nov 22 07:55:16 user nova-compute[74348]: No targets found.
Nov 22 07:55:16 user nova-compute[74348]: STATIC:
Nov 22 07:55:16 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223
Nov 22 07:55:16 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:16 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:16 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471
Nov 22 07:55:16 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:16 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:16 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7
Nov 22 07:55:16 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:16 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:16 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5
Nov 22 07:55:16 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:16 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:16 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c
Nov 22 07:55:16 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:16 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:16 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea
Nov 22 07:55:16 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:16 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:16 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968
Nov 22 07:55:16 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:16 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:16 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054
Nov 22 07:55:16 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:16 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:16 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799
Nov 22 07:55:16 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:16 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:16 user nova-compute[74348]: FIRMWARE:
Nov 22 07:55:16 user nova-compute[74348]: No targets found.
Nov 22 07:55:16 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:55:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 07:55:16 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 07:55:16 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 07:55:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 07:55:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[aface74d-1506-4e0d-8fb7-3f7693ae8978]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a3c620-ada2-41b3-beed-6fd977363dc4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)
Nov 22 07:55:16 user nova-compute[74348]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)
Nov 22 07:55:16 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:55:16 user nova-compute[74348]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)
Nov 22 07:55:16 user nova-compute[74348]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)
Nov 22 07:55:16 user nova-compute[74348]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)
Nov 22 07:55:16 user nova-compute[74348]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)
Nov 22 07:55:16 user nova-compute[74348]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)
Nov 22 07:55:16 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:55:16 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:55:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)
Nov 22 07:55:16 user nova-compute[74348]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)
Nov 22 07:55:16 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:55:16 user nova-compute[74348]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)
Nov 22 07:55:16 user nova-compute[74348]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)
Nov 22 07:55:16 user nova-compute[74348]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)
Nov 22 07:55:16 user nova-compute[74348]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)
Nov 22 07:55:16 user nova-compute[74348]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)
Nov 22 07:55:16 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:55:16 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:55:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f224c7be830>, {}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 07:55:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Disconnecting from: [] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 07:55:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.089s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:55:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] <== disconnect_volume: return (90ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:55:16 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 07:55:16 user nova-compute[74348]: DEBUG nova.compute.manager [req-18639b0e-e94a-4795-b473-7a3d0a3689ec req-5e027a67-00ac-4c99-8348-9d0c51b2f72c service nova] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Received event network-vif-plugged-c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-18639b0e-e94a-4795-b473-7a3d0a3689ec req-5e027a67-00ac-4c99-8348-9d0c51b2f72c service nova] Acquiring lock "abd7f2ed-b0c4-4e05-8161-b141a611f125-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-18639b0e-e94a-4795-b473-7a3d0a3689ec req-5e027a67-00ac-4c99-8348-9d0c51b2f72c service nova] Lock "abd7f2ed-b0c4-4e05-8161-b141a611f125-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-18639b0e-e94a-4795-b473-7a3d0a3689ec req-5e027a67-00ac-4c99-8348-9d0c51b2f72c service nova] Lock "abd7f2ed-b0c4-4e05-8161-b141a611f125-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:16 user nova-compute[74348]: DEBUG nova.compute.manager [req-18639b0e-e94a-4795-b473-7a3d0a3689ec req-5e027a67-00ac-4c99-8348-9d0c51b2f72c service nova] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] No waiting events found dispatching network-vif-plugged-c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:55:16 user nova-compute[74348]: WARNING nova.compute.manager [req-18639b0e-e94a-4795-b473-7a3d0a3689ec req-5e027a67-00ac-4c99-8348-9d0c51b2f72c service nova] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Received unexpected event network-vif-plugged-c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3 for instance with vm_state active and task_state rebuilding.
Nov 22 07:55:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yBcKglFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:55:19 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:55:19 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:55:19 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:55:19 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:55:19 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 07:55:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d0c3df-9adc-43cf-942a-ff3226e126a6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 07:55:19 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2383e6cb-b0a8-4f9a-96de-de4bb005f85c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa] added
Nov 22 07:55:19 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1f9369-ad8d-441c-897c-3d575bd2f522]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9085947-9e52-40e9-a909-b3530f9fee7e]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yBcKglFp {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yBcKglFp" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40d7756-2d5b-4ac5-b031-69d7d29aa3e9]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yBcKglFp'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cce3a9-fd12-4c01-87e3-f36118aeb663]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[537c4cbe-6dd8-4134-a2a4-33b819b0c07f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)
Nov 22 07:55:19 user nova-compute[74348]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)
Nov 22 07:55:19 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:55:19 user nova-compute[74348]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)
Nov 22 07:55:19 user nova-compute[74348]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)
Nov 22 07:55:19 user nova-compute[74348]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)
Nov 22 07:55:19 user nova-compute[74348]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)
Nov 22 07:55:19 user nova-compute[74348]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)
Nov 22 07:55:19 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:55:19 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)
Nov 22 07:55:19 user nova-compute[74348]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)
Nov 22 07:55:19 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:55:19 user nova-compute[74348]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)
Nov 22 07:55:19 user nova-compute[74348]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)
Nov 22 07:55:19 user nova-compute[74348]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)
Nov 22 07:55:19 user nova-compute[74348]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)
Nov 22 07:55:19 user nova-compute[74348]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)
Nov 22 07:55:19 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:55:19 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[196c6d19-9438-40f5-90af-920440843c30]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa, portal: 172.16.0.220,3260]
Nov 22 07:55:19 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa, portal: 172.16.0.220,3260] successful.
Nov 22 07:55:19 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e968c3-dba8-4d6d-bbd5-944a3b690306]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb89dbc-7b9e-4069-abec-1c486a813b12]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)
Nov 22 07:55:19 user nova-compute[74348]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)
Nov 22 07:55:19 user nova-compute[74348]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa (non-flash)
Nov 22 07:55:19 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:55:19 user nova-compute[74348]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)
Nov 22 07:55:19 user nova-compute[74348]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)
Nov 22 07:55:19 user nova-compute[74348]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)
Nov 22 07:55:19 user nova-compute[74348]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)
Nov 22 07:55:19 user nova-compute[74348]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)
Nov 22 07:55:19 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:55:19 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)
Nov 22 07:55:19 user nova-compute[74348]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)
Nov 22 07:55:19 user nova-compute[74348]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa (non-flash)
Nov 22 07:55:19 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:55:19 user nova-compute[74348]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)
Nov 22 07:55:19 user nova-compute[74348]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)
Nov 22 07:55:19 user nova-compute[74348]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)
Nov 22 07:55:19 user nova-compute[74348]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)
Nov 22 07:55:19 user nova-compute[74348]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)
Nov 22 07:55:19 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:55:19 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b44fa07-2929-4ccd-8304-0cb239ab2b00]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:19 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: None {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 07:55:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:20 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 07:55:20 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yBcKglFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 07:55:20 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:55:20 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '26233316535633031', 'path': '/dev/sdb'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:55:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233316535633031', 'path': '/dev/sdb'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 07:55:20 user nova-compute[74348]: DEBUG nova.objects.instance [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] Lazy-loading 'flavor' on Instance uuid 88730c14-fd2a-4f63-bc10-96cea0b057eb {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:55:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] attach device xml: <disk type="block" device="disk">
Nov 22 07:55:20 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 07:55:20 user nova-compute[74348]:   <source dev="/dev/sdb"/>
Nov 22 07:55:20 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 07:55:20 user nova-compute[74348]:   <serial>64bf9397-6276-4a77-ba6e-1a0a52ea70fa</serial>
Nov 22 07:55:20 user nova-compute[74348]: </disk>
Nov 22 07:55:20 user nova-compute[74348]:  {{(pid=74348) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 07:55:21 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:55:21 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:55:21 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] No VIF found with MAC fa:16:3e:ac:c1:ef, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 07:55:23 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Preparing to wait for external event volume-reimaged-bf17ece2-1f33-4fa3-af81-8534b3fe79af {{(pid=74348) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 22 07:55:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Acquiring lock "abd7f2ed-b0c4-4e05-8161-b141a611f125-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Lock "abd7f2ed-b0c4-4e05-8161-b141a611f125-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Lock "abd7f2ed-b0c4-4e05-8161-b141a611f125-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-942296db-4999-42c0-bde6-4ac2d9ec924b tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] Lock "88730c14-fd2a-4f63-bc10-96cea0b057eb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.251s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e69db1ef-cebc-4b7b-90a9-85ae35cf8bce tempest-VolumesAssistedSnapshotsTest-1771225260 tempest-VolumesAssistedSnapshotsTest-1771225260-project] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] volume_snapshot_create: create_info: {'snapshot_id': '0bc35491-8f36-45c8-9a37-e12f9f1cf163', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74348) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 22 07:55:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e69db1ef-cebc-4b7b-90a9-85ae35cf8bce tempest-VolumesAssistedSnapshotsTest-1771225260 tempest-VolumesAssistedSnapshotsTest-1771225260-project] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] snap xml: <domainsnapshot>
Nov 22 07:55:24 user nova-compute[74348]:   <disks>
Nov 22 07:55:24 user nova-compute[74348]:     <disk name="/dev/sdb" snapshot="external" type="file">
Nov 22 07:55:24 user nova-compute[74348]:       <source file="/dev/new_file"/>
Nov 22 07:55:24 user nova-compute[74348]:     </disk>
Nov 22 07:55:24 user nova-compute[74348]:     <disk name="vda" snapshot="no"/>
Nov 22 07:55:24 user nova-compute[74348]:   </disks>
Nov 22 07:55:24 user nova-compute[74348]: </domainsnapshot>
Nov 22 07:55:24 user nova-compute[74348]:  {{(pid=74348) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 22 07:55:24 user nova-compute[74348]: DEBUG nova.objects.instance [None req-e69db1ef-cebc-4b7b-90a9-85ae35cf8bce tempest-VolumesAssistedSnapshotsTest-1771225260 tempest-VolumesAssistedSnapshotsTest-1771225260-project] Lazy-loading 'system_metadata' on Instance uuid 88730c14-fd2a-4f63-bc10-96cea0b057eb {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:55:24 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-e69db1ef-cebc-4b7b-90a9-85ae35cf8bce tempest-VolumesAssistedSnapshotsTest-1771225260 tempest-VolumesAssistedSnapshotsTest-1771225260-project] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [None req-e69db1ef-cebc-4b7b-90a9-85ae35cf8bce tempest-VolumesAssistedSnapshotsTest-1771225260 tempest-VolumesAssistedSnapshotsTest-1771225260-project] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Traceback (most recent call last):
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb]     rv = execute(f, *args, **kwargs)
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb]     six.reraise(c, e, tb)
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb]     raise value
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb]     rv = meth(*args, **kwargs)
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] 
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [None req-e69db1ef-cebc-4b7b-90a9-85ae35cf8bce tempest-VolumesAssistedSnapshotsTest-1771225260 tempest-VolumesAssistedSnapshotsTest-1771225260-project] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Traceback (most recent call last):
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb]     self._volume_snapshot_create(context, instance, guest,
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb]     rv = execute(f, *args, **kwargs)
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb]     six.reraise(c, e, tb)
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb]     raise value
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb]     rv = meth(*args, **kwargs)
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] 
Nov 22 07:55:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-2abfeb4e-a347-4226-8f9f-4d930301ee21 tempest-VolumesAssistedSnapshotsTest-1771225260 tempest-VolumesAssistedSnapshotsTest-1771225260-project] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] volume_snapshot_delete: delete_info: {'volume_id': '64bf9397-6276-4a77-ba6e-1a0a52ea70fa'} {{(pid=74348) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [None req-2abfeb4e-a347-4226-8f9f-4d930301ee21 tempest-VolumesAssistedSnapshotsTest-1771225260 tempest-VolumesAssistedSnapshotsTest-1771225260-project] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Traceback (most recent call last):
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb]     if delete_info['type'] != 'qcow2':
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] KeyError: 'type'
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] 
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [None req-e69db1ef-cebc-4b7b-90a9-85ae35cf8bce tempest-VolumesAssistedSnapshotsTest-1771225260 tempest-VolumesAssistedSnapshotsTest-1771225260-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 0bc35491-8f36-45c8-9a37-e12f9f1cf163 could not be found.
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     raise value
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver 
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver 
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 0bc35491-8f36-45c8-9a37-e12f9f1cf163 could not be found. (HTTP 404) (Request-ID: req-2dbb08fc-8386-40d1-986f-2d8d546a0395)
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver 
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver 
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 0bc35491-8f36-45c8-9a37-e12f9f1cf163 could not be found.
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver 
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server [None req-e69db1ef-cebc-4b7b-90a9-85ae35cf8bce tempest-VolumesAssistedSnapshotsTest-1771225260 tempest-VolumesAssistedSnapshotsTest-1771225260-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server     raise value
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server 
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver [None req-2abfeb4e-a347-4226-8f9f-4d930301ee21 tempest-VolumesAssistedSnapshotsTest-1771225260 tempest-VolumesAssistedSnapshotsTest-1771225260-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver 
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver 
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-9380e06f-a5d5-475b-a16a-e64d25429237)
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver 
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver 
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 22 07:55:24 user nova-compute[74348]: ERROR nova.virt.libvirt.driver 
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server [None req-2abfeb4e-a347-4226-8f9f-4d930301ee21 tempest-VolumesAssistedSnapshotsTest-1771225260 tempest-VolumesAssistedSnapshotsTest-1771225260-project] Exception during message handling: KeyError: 'type'
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 22 07:55:24 user nova-compute[74348]: ERROR oslo_messaging.rpc.server 
Nov 22 07:55:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c3a5c5f8-b5fa-4edb-bb07-71e482faec70 tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] Acquiring lock "88730c14-fd2a-4f63-bc10-96cea0b057eb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c3a5c5f8-b5fa-4edb-bb07-71e482faec70 tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] Lock "88730c14-fd2a-4f63-bc10-96cea0b057eb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:25 user nova-compute[74348]: INFO nova.compute.manager [None req-c3a5c5f8-b5fa-4edb-bb07-71e482faec70 tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Detaching volume 64bf9397-6276-4a77-ba6e-1a0a52ea70fa
Nov 22 07:55:25 user nova-compute[74348]: INFO nova.virt.block_device [None req-c3a5c5f8-b5fa-4edb-bb07-71e482faec70 tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Attempting to driver detach volume 64bf9397-6276-4a77-ba6e-1a0a52ea70fa from mountpoint /dev/vdb
Nov 22 07:55:25 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-c3a5c5f8-b5fa-4edb-bb07-71e482faec70 tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] Attempting to detach device vdb from instance 88730c14-fd2a-4f63-bc10-96cea0b057eb from the persistent domain config. {{(pid=74348) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 07:55:25 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-c3a5c5f8-b5fa-4edb-bb07-71e482faec70 tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] detach device xml: <disk type="block" device="disk">
Nov 22 07:55:25 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 07:55:25 user nova-compute[74348]:   <source dev="/dev/sdb"/>
Nov 22 07:55:25 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 07:55:25 user nova-compute[74348]:   <serial>64bf9397-6276-4a77-ba6e-1a0a52ea70fa</serial>
Nov 22 07:55:25 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 07:55:25 user nova-compute[74348]: </disk>
Nov 22 07:55:25 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 07:55:25 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-c3a5c5f8-b5fa-4edb-bb07-71e482faec70 tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] Successfully detached device vdb from instance 88730c14-fd2a-4f63-bc10-96cea0b057eb from the persistent domain config.
Nov 22 07:55:25 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-c3a5c5f8-b5fa-4edb-bb07-71e482faec70 tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 88730c14-fd2a-4f63-bc10-96cea0b057eb from the live domain config. {{(pid=74348) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 07:55:25 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-c3a5c5f8-b5fa-4edb-bb07-71e482faec70 tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] detach device xml: <disk type="block" device="disk">
Nov 22 07:55:25 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 07:55:25 user nova-compute[74348]:   <source dev="/dev/sdb"/>
Nov 22 07:55:25 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 07:55:25 user nova-compute[74348]:   <serial>64bf9397-6276-4a77-ba6e-1a0a52ea70fa</serial>
Nov 22 07:55:25 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 07:55:25 user nova-compute[74348]: </disk>
Nov 22 07:55:25 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 07:55:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:25 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-c3a5c5f8-b5fa-4edb-bb07-71e482faec70 tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 88730c14-fd2a-4f63-bc10-96cea0b057eb {{(pid=74348) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 07:55:26 user nova-compute[74348]: DEBUG nova.compute.manager [req-2978b98d-d56f-4619-a4b4-fa23407e8b01 req-28db207f-4ab2-4b18-b909-64619d7a893d service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-changed-4a8ea7e1-9e80-4686-a3a9-4142b9de0049 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:26 user nova-compute[74348]: DEBUG nova.compute.manager [req-2978b98d-d56f-4619-a4b4-fa23407e8b01 req-28db207f-4ab2-4b18-b909-64619d7a893d service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Refreshing instance network info cache due to event network-changed-4a8ea7e1-9e80-4686-a3a9-4142b9de0049. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:55:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2978b98d-d56f-4619-a4b4-fa23407e8b01 req-28db207f-4ab2-4b18-b909-64619d7a893d service nova] Acquiring lock "refresh_cache-9e2f3a3e-ee9b-4250-8744-5eb7982285f2" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:55:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2978b98d-d56f-4619-a4b4-fa23407e8b01 req-28db207f-4ab2-4b18-b909-64619d7a893d service nova] Acquired lock "refresh_cache-9e2f3a3e-ee9b-4250-8744-5eb7982285f2" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:55:26 user nova-compute[74348]: DEBUG nova.network.neutron [req-2978b98d-d56f-4619-a4b4-fa23407e8b01 req-28db207f-4ab2-4b18-b909-64619d7a893d service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Refreshing network info cache for port 4a8ea7e1-9e80-4686-a3a9-4142b9de0049 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:55:26 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:55:26 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 07:55:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-bcedb385-b72a-49c2-b363-cf6da5804b60" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:55:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-bcedb385-b72a-49c2-b363-cf6da5804b60" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:55:26 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 07:55:27 user nova-compute[74348]: DEBUG nova.network.neutron [req-2978b98d-d56f-4619-a4b4-fa23407e8b01 req-28db207f-4ab2-4b18-b909-64619d7a893d service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Updated VIF entry in instance network info cache for port 4a8ea7e1-9e80-4686-a3a9-4142b9de0049. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 07:55:27 user nova-compute[74348]: DEBUG nova.network.neutron [req-2978b98d-d56f-4619-a4b4-fa23407e8b01 req-28db207f-4ab2-4b18-b909-64619d7a893d service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Updating instance_info_cache with network_info: [{"id": "4a8ea7e1-9e80-4686-a3a9-4142b9de0049", "address": "fa:16:3e:7e:13:ad", "network": {"id": "c9f2b2b7-e34f-4891-b68c-786534d7ed95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-766683782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8ea7e1-9e", "ovs_interfaceid": "4a8ea7e1-9e80-4686-a3a9-4142b9de0049", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e30deaf5-1258-4909-bc71-044c88f2995f", "address": "fa:16:3e:c8:34:fc", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30deaf5-12", "ovs_interfaceid": "e30deaf5-1258-4909-bc71-044c88f2995f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "298ce71b-894a-4e29-904e-1ba5d4495fcb", "address": "fa:16:3e:b3:83:8f", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298ce71b-89", "ovs_interfaceid": "298ce71b-894a-4e29-904e-1ba5d4495fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f0f55187-e53f-468d-83a8-cca33ff1380e", "address": "fa:16:3e:8d:36:2e", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f55187-e5", "ovs_interfaceid": "f0f55187-e53f-468d-83a8-cca33ff1380e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5a68d2be-be4c-462b-9dd4-15e222160557", "address": "fa:16:3e:ea:a3:83", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a68d2be-be", "ovs_interfaceid": "5a68d2be-be4c-462b-9dd4-15e222160557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9aa74044-d952-47e5-9cc1-948615a01eb3", "address": "fa:16:3e:6d:8e:f9", "network": {"id": "7f9b7b76-9f0d-4fbd-90c9-6ceee5e0c50e", "bridge": "br-int", "label": "tempest-device-tagging-net2-487890789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aa74044-d9", "ovs_interfaceid": "9aa74044-d952-47e5-9cc1-948615a01eb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "579fb42b-b8b6-4122-8ec3-8817c9e0881a", "address": "fa:16:3e:06:8e:e5", "network": {"id": "7f9b7b76-9f0d-4fbd-90c9-6ceee5e0c50e", "bridge": "br-int", "label": "tempest-device-tagging-net2-487890789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap579fb42b-b8", "ovs_interfaceid": "579fb42b-b8b6-4122-8ec3-8817c9e0881a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:55:27 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2978b98d-d56f-4619-a4b4-fa23407e8b01 req-28db207f-4ab2-4b18-b909-64619d7a893d service nova] Releasing lock "refresh_cache-9e2f3a3e-ee9b-4250-8744-5eb7982285f2" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:55:27 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Updating instance_info_cache with network_info: [{"id": "07295502-d217-400f-8b56-9ff1ccd600cf", "address": "fa:16:3e:50:0c:08", "network": {"id": "fd2e1dc2-9099-48b4-b56d-bc5d09c892fe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1689843295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52a21c1ef18473aa64c139de7b920ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07295502-d2", "ovs_interfaceid": "07295502-d217-400f-8b56-9ff1ccd600cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:55:27 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-bcedb385-b72a-49c2-b363-cf6da5804b60" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:55:27 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 07:55:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:28 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:55:28 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:55:28 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG nova.compute.manager [req-14efd446-eadd-4852-9f2c-7e97f27f37ae req-ff6107d4-d0e5-4068-8434-25ee75678994 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-changed-6221165b-f588-475c-a3b1-afdf5c60c113 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG nova.compute.manager [req-14efd446-eadd-4852-9f2c-7e97f27f37ae req-ff6107d4-d0e5-4068-8434-25ee75678994 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Refreshing instance network info cache due to event network-changed-6221165b-f588-475c-a3b1-afdf5c60c113. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-14efd446-eadd-4852-9f2c-7e97f27f37ae req-ff6107d4-d0e5-4068-8434-25ee75678994 service nova] Acquiring lock "refresh_cache-8527ae47-a025-492d-9820-b9c5ee309d81" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-14efd446-eadd-4852-9f2c-7e97f27f37ae req-ff6107d4-d0e5-4068-8434-25ee75678994 service nova] Acquired lock "refresh_cache-8527ae47-a025-492d-9820-b9c5ee309d81" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG nova.network.neutron [req-14efd446-eadd-4852-9f2c-7e97f27f37ae req-ff6107d4-d0e5-4068-8434-25ee75678994 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Refreshing network info cache for port 6221165b-f588-475c-a3b1-afdf5c60c113 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Acquiring lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Acquiring lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:29 user nova-compute[74348]: INFO nova.compute.manager [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Terminating instance
Nov 22 07:55:29 user nova-compute[74348]: DEBUG nova.compute.manager [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JLOhGjeQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:55:29 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:55:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:55:29 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:55:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:55:29 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 07:55:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f43994e-a618-493b-97ba-b3d8acc10895]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 07:55:29 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec17cff-9913-4bac-907d-1321532b3f94]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce] added
Nov 22 07:55:29 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[849e98bd-f752-4c1c-87f4-fd63c98b3ef8]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bca11b-4511-49a3-8fb4-422b020e6094]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JLOhGjeQ {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JLOhGjeQ" returned: 0 in 0.026s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac65e71-eb77-4f47-877e-66545b0f94c6]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JLOhGjeQ'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0518fb-8640-4feb-8959-a2a0ecf6cc89]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG nova.compute.manager [req-e213d335-fb7c-4b0f-be96-65b815d7c8eb req-db0ebf52-cbfb-4e85-80f5-4276e75c1acf service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-vif-unplugged-4a8ea7e1-9e80-4686-a3a9-4142b9de0049 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e213d335-fb7c-4b0f-be96-65b815d7c8eb req-db0ebf52-cbfb-4e85-80f5-4276e75c1acf service nova] Acquiring lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e213d335-fb7c-4b0f-be96-65b815d7c8eb req-db0ebf52-cbfb-4e85-80f5-4276e75c1acf service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e213d335-fb7c-4b0f-be96-65b815d7c8eb req-db0ebf52-cbfb-4e85-80f5-4276e75c1acf service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG nova.compute.manager [req-e213d335-fb7c-4b0f-be96-65b815d7c8eb req-db0ebf52-cbfb-4e85-80f5-4276e75c1acf service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] No waiting events found dispatching network-vif-unplugged-4a8ea7e1-9e80-4686-a3a9-4142b9de0049 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG nova.compute.manager [req-e213d335-fb7c-4b0f-be96-65b815d7c8eb req-db0ebf52-cbfb-4e85-80f5-4276e75c1acf service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-vif-unplugged-4a8ea7e1-9e80-4686-a3a9-4142b9de0049 for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0a529e-dd13-4246-9ba7-ec8ac587eb07]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)
Nov 22 07:55:29 user nova-compute[74348]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)
Nov 22 07:55:29 user nova-compute[74348]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa (non-flash)
Nov 22 07:55:29 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:55:29 user nova-compute[74348]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)
Nov 22 07:55:29 user nova-compute[74348]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)
Nov 22 07:55:29 user nova-compute[74348]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)
Nov 22 07:55:29 user nova-compute[74348]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)
Nov 22 07:55:29 user nova-compute[74348]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)
Nov 22 07:55:29 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:55:29 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)
Nov 22 07:55:29 user nova-compute[74348]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)
Nov 22 07:55:29 user nova-compute[74348]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa (non-flash)
Nov 22 07:55:29 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:55:29 user nova-compute[74348]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)
Nov 22 07:55:29 user nova-compute[74348]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)
Nov 22 07:55:29 user nova-compute[74348]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)
Nov 22 07:55:29 user nova-compute[74348]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)
Nov 22 07:55:29 user nova-compute[74348]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)
Nov 22 07:55:29 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:55:29 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce -p 172.16.0.220:3260 --login" returned: 0 in 0.148s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:30 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[435458a3-1bb4-49b3-8a7b-056f53590d2b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce, portal: 172.16.0.220,3260]
Nov 22 07:55:30 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce, portal: 172.16.0.220,3260] successful.
Nov 22 07:55:30 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:30 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[138db636-7d47-44cc-98ab-e433ce2b3022]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:30 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[653acded-e889-4ecc-bde1-96fa605ff530]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)
Nov 22 07:55:30 user nova-compute[74348]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)
Nov 22 07:55:30 user nova-compute[74348]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa (non-flash)
Nov 22 07:55:30 user nova-compute[74348]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce (non-flash)
Nov 22 07:55:30 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:55:30 user nova-compute[74348]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)
Nov 22 07:55:30 user nova-compute[74348]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)
Nov 22 07:55:30 user nova-compute[74348]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)
Nov 22 07:55:30 user nova-compute[74348]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)
Nov 22 07:55:30 user nova-compute[74348]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)
Nov 22 07:55:30 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:55:30 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:55:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)
Nov 22 07:55:30 user nova-compute[74348]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)
Nov 22 07:55:30 user nova-compute[74348]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa (non-flash)
Nov 22 07:55:30 user nova-compute[74348]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce (non-flash)
Nov 22 07:55:30 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:55:30 user nova-compute[74348]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)
Nov 22 07:55:30 user nova-compute[74348]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)
Nov 22 07:55:30 user nova-compute[74348]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)
Nov 22 07:55:30 user nova-compute[74348]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)
Nov 22 07:55:30 user nova-compute[74348]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)
Nov 22 07:55:30 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:55:30 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:55:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.457s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:55:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 07:55:30 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] HCTL ('43', '-', '-', 0) found on session 13 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 07:55:30 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Scanning host 43 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 07:55:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:30 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f39c45-783b-4099-b960-a91ecb6866db]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:30 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Searching for a device in session 13 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 07:55:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JLOhGjeQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 07:55:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:30 user nova-compute[74348]: DEBUG nova.compute.manager [req-458da078-cbf3-48f8-a377-5942d15bc489 req-760b3297-8e20-4a26-b9e9-6d415a717d83 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-vif-unplugged-e30deaf5-1258-4909-bc71-044c88f2995f {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-458da078-cbf3-48f8-a377-5942d15bc489 req-760b3297-8e20-4a26-b9e9-6d415a717d83 service nova] Acquiring lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-458da078-cbf3-48f8-a377-5942d15bc489 req-760b3297-8e20-4a26-b9e9-6d415a717d83 service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-458da078-cbf3-48f8-a377-5942d15bc489 req-760b3297-8e20-4a26-b9e9-6d415a717d83 service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:30 user nova-compute[74348]: DEBUG nova.compute.manager [req-458da078-cbf3-48f8-a377-5942d15bc489 req-760b3297-8e20-4a26-b9e9-6d415a717d83 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] No waiting events found dispatching network-vif-unplugged-e30deaf5-1258-4909-bc71-044c88f2995f {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:55:30 user nova-compute[74348]: DEBUG nova.compute.manager [req-458da078-cbf3-48f8-a377-5942d15bc489 req-760b3297-8e20-4a26-b9e9-6d415a717d83 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-vif-unplugged-e30deaf5-1258-4909-bc71-044c88f2995f for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 07:55:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:30 user nova-compute[74348]: DEBUG nova.network.neutron [req-14efd446-eadd-4852-9f2c-7e97f27f37ae req-ff6107d4-d0e5-4068-8434-25ee75678994 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Updated VIF entry in instance network info cache for port 6221165b-f588-475c-a3b1-afdf5c60c113. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 07:55:30 user nova-compute[74348]: DEBUG nova.network.neutron [req-14efd446-eadd-4852-9f2c-7e97f27f37ae req-ff6107d4-d0e5-4068-8434-25ee75678994 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Updating instance_info_cache with network_info: [{"id": "6221165b-f588-475c-a3b1-afdf5c60c113", "address": "fa:16:3e:6a:1c:a3", "network": {"id": "414e020d-3fcc-4afd-9fee-be68687a0418", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-184417969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6221165b-f5", "ovs_interfaceid": "6221165b-f588-475c-a3b1-afdf5c60c113", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "62ed8403-ebcd-4e41-ac81-0056cf71738c", "address": "fa:16:3e:9a:78:38", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62ed8403-eb", "ovs_interfaceid": "62ed8403-ebcd-4e41-ac81-0056cf71738c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "63fc17ce-ef08-4f7e-ab83-b1040733d228", "address": "fa:16:3e:92:70:d1", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fc17ce-ef", "ovs_interfaceid": "63fc17ce-ef08-4f7e-ab83-b1040733d228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "969790c1-f8a4-4d98-86d9-1ed932c83daa", "address": "fa:16:3e:6d:21:36", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969790c1-f8", "ovs_interfaceid": "969790c1-f8a4-4d98-86d9-1ed932c83daa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "748e5281-27d7-43b4-ba47-2f0daed1181e", "address": "fa:16:3e:f9:d2:8f", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap748e5281-27", "ovs_interfaceid": "748e5281-27d7-43b4-ba47-2f0daed1181e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d77c2a03-a402-4288-8a40-2f88200a8f22", "address": "fa:16:3e:b2:36:f8", "network": {"id": "f39bd97a-26ce-4373-bf3b-ceb5c8dc21ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-224466528", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd77c2a03-a4", "ovs_interfaceid": "d77c2a03-a402-4288-8a40-2f88200a8f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a64b4a32-73f1-4a48-8b80-86d353d1d40b", "address": "fa:16:3e:be:1c:23", "network": {"id": "f39bd97a-26ce-4373-bf3b-ceb5c8dc21ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-224466528", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64b4a32-73", "ovs_interfaceid": "a64b4a32-73f1-4a48-8b80-86d353d1d40b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:55:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-14efd446-eadd-4852-9f2c-7e97f27f37ae req-ff6107d4-d0e5-4068-8434-25ee75678994 service nova] Releasing lock "refresh_cache-8527ae47-a025-492d-9820-b9c5ee309d81" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:55:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.502s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] <== connect_volume: return (1504ms) {'type': 'block', 'scsi_wwn': '23061393165393863', 'path': '/dev/sdl'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061393165393863', 'path': '/dev/sdl'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG nova.objects.instance [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Lazy-loading 'flavor' on Instance uuid bdad025e-8f6c-419a-99ea-bf277f6c5577 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 07:55:31 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 07:55:31 user nova-compute[74348]:   <source dev="/dev/sdl"/>
Nov 22 07:55:31 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 07:55:31 user nova-compute[74348]:   <serial>31c45577-a290-406b-8e3e-a7852977edce</serial>
Nov 22 07:55:31 user nova-compute[74348]: </disk>
Nov 22 07:55:31 user nova-compute[74348]:  {{(pid=74348) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG nova.compute.manager [req-a8313f00-66c2-4af8-b7ad-bd6ce133227d req-d2203a7b-cba8-41ac-b44b-1f436c7245e7 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-vif-unplugged-298ce71b-894a-4e29-904e-1ba5d4495fcb {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a8313f00-66c2-4af8-b7ad-bd6ce133227d req-d2203a7b-cba8-41ac-b44b-1f436c7245e7 service nova] Acquiring lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a8313f00-66c2-4af8-b7ad-bd6ce133227d req-d2203a7b-cba8-41ac-b44b-1f436c7245e7 service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a8313f00-66c2-4af8-b7ad-bd6ce133227d req-d2203a7b-cba8-41ac-b44b-1f436c7245e7 service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG nova.compute.manager [req-a8313f00-66c2-4af8-b7ad-bd6ce133227d req-d2203a7b-cba8-41ac-b44b-1f436c7245e7 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] No waiting events found dispatching network-vif-unplugged-298ce71b-894a-4e29-904e-1ba5d4495fcb {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG nova.compute.manager [req-a8313f00-66c2-4af8-b7ad-bd6ce133227d req-d2203a7b-cba8-41ac-b44b-1f436c7245e7 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-vif-unplugged-298ce71b-894a-4e29-904e-1ba5d4495fcb for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG nova.compute.manager [req-a8313f00-66c2-4af8-b7ad-bd6ce133227d req-d2203a7b-cba8-41ac-b44b-1f436c7245e7 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-vif-plugged-298ce71b-894a-4e29-904e-1ba5d4495fcb {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a8313f00-66c2-4af8-b7ad-bd6ce133227d req-d2203a7b-cba8-41ac-b44b-1f436c7245e7 service nova] Acquiring lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a8313f00-66c2-4af8-b7ad-bd6ce133227d req-d2203a7b-cba8-41ac-b44b-1f436c7245e7 service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a8313f00-66c2-4af8-b7ad-bd6ce133227d req-d2203a7b-cba8-41ac-b44b-1f436c7245e7 service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG nova.compute.manager [req-a8313f00-66c2-4af8-b7ad-bd6ce133227d req-d2203a7b-cba8-41ac-b44b-1f436c7245e7 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] No waiting events found dispatching network-vif-plugged-298ce71b-894a-4e29-904e-1ba5d4495fcb {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:55:31 user nova-compute[74348]: WARNING nova.compute.manager [req-a8313f00-66c2-4af8-b7ad-bd6ce133227d req-d2203a7b-cba8-41ac-b44b-1f436c7245e7 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received unexpected event network-vif-plugged-298ce71b-894a-4e29-904e-1ba5d4495fcb for instance with vm_state active and task_state deleting.
Nov 22 07:55:31 user nova-compute[74348]: DEBUG nova.compute.manager [req-a8313f00-66c2-4af8-b7ad-bd6ce133227d req-d2203a7b-cba8-41ac-b44b-1f436c7245e7 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-vif-unplugged-579fb42b-b8b6-4122-8ec3-8817c9e0881a {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a8313f00-66c2-4af8-b7ad-bd6ce133227d req-d2203a7b-cba8-41ac-b44b-1f436c7245e7 service nova] Acquiring lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a8313f00-66c2-4af8-b7ad-bd6ce133227d req-d2203a7b-cba8-41ac-b44b-1f436c7245e7 service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a8313f00-66c2-4af8-b7ad-bd6ce133227d req-d2203a7b-cba8-41ac-b44b-1f436c7245e7 service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG nova.compute.manager [req-a8313f00-66c2-4af8-b7ad-bd6ce133227d req-d2203a7b-cba8-41ac-b44b-1f436c7245e7 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] No waiting events found dispatching network-vif-unplugged-579fb42b-b8b6-4122-8ec3-8817c9e0881a {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG nova.compute.manager [req-a8313f00-66c2-4af8-b7ad-bd6ce133227d req-d2203a7b-cba8-41ac-b44b-1f436c7245e7 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-vif-unplugged-579fb42b-b8b6-4122-8ec3-8817c9e0881a for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG nova.compute.manager [req-a8313f00-66c2-4af8-b7ad-bd6ce133227d req-d2203a7b-cba8-41ac-b44b-1f436c7245e7 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-vif-plugged-579fb42b-b8b6-4122-8ec3-8817c9e0881a {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a8313f00-66c2-4af8-b7ad-bd6ce133227d req-d2203a7b-cba8-41ac-b44b-1f436c7245e7 service nova] Acquiring lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a8313f00-66c2-4af8-b7ad-bd6ce133227d req-d2203a7b-cba8-41ac-b44b-1f436c7245e7 service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a8313f00-66c2-4af8-b7ad-bd6ce133227d req-d2203a7b-cba8-41ac-b44b-1f436c7245e7 service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG nova.compute.manager [req-a8313f00-66c2-4af8-b7ad-bd6ce133227d req-d2203a7b-cba8-41ac-b44b-1f436c7245e7 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] No waiting events found dispatching network-vif-plugged-579fb42b-b8b6-4122-8ec3-8817c9e0881a {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:55:31 user nova-compute[74348]: WARNING nova.compute.manager [req-a8313f00-66c2-4af8-b7ad-bd6ce133227d req-d2203a7b-cba8-41ac-b44b-1f436c7245e7 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received unexpected event network-vif-plugged-579fb42b-b8b6-4122-8ec3-8817c9e0881a for instance with vm_state active and task_state deleting.
Nov 22 07:55:31 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Instance destroyed successfully.
Nov 22 07:55:31 user nova-compute[74348]: DEBUG nova.objects.instance [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Lazy-loading 'resources' on Instance uuid 9e2f3a3e-ee9b-4250-8744-5eb7982285f2 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2036316503',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2036316503',id=11,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnzYYP3Ptdmty3Rvwlh9fqssqqfrkRsWiJRiTKv6iY6VU5FnFmpw0lxwm8OKyeaQHOy3kJ8p8VF2y7jVGbQU/CO6Efmk0az16dQ9hu0FyN5s6f1p9PgD9PdzeRpGGp4hw==',key_name='tempest-keypair-342579863',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:54:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c8d9889b4c704e2c9370420262898383',ramdisk_id='',reservation_id='r-8fge7g0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1369728832',owner_user_name='tempest-TaggedBootDevicesTest_v242-1369728832-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T07:54:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd846d2c399e47db9dbd74e4beaeb0f4',uuid=9e2f3a3e-ee9b-4250-8744-5eb7982285f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a8ea7e1-9e80-4686-a3a9-4142b9de0049", "address": "fa:16:3e:7e:13:ad", "network": {"id": "c9f2b2b7-e34f-4891-b68c-786534d7ed95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-766683782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8ea7e1-9e", "ovs_interfaceid": "4a8ea7e1-9e80-4686-a3a9-4142b9de0049", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Converting VIF {"id": "4a8ea7e1-9e80-4686-a3a9-4142b9de0049", "address": "fa:16:3e:7e:13:ad", "network": {"id": "c9f2b2b7-e34f-4891-b68c-786534d7ed95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-766683782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8ea7e1-9e", "ovs_interfaceid": "4a8ea7e1-9e80-4686-a3a9-4142b9de0049", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:13:ad,bridge_name='br-int',has_traffic_filtering=True,id=4a8ea7e1-9e80-4686-a3a9-4142b9de0049,network=Network(c9f2b2b7-e34f-4891-b68c-786534d7ed95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a8ea7e1-9e') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG os_vif [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:13:ad,bridge_name='br-int',has_traffic_filtering=True,id=4a8ea7e1-9e80-4686-a3a9-4142b9de0049,network=Network(c9f2b2b7-e34f-4891-b68c-786534d7ed95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a8ea7e1-9e') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a8ea7e1-9e, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] No BDM found with device name hda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] No VIF found with MAC fa:16:3e:36:02:a6, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6680b596-ef2c-4eb2-a2e8-c7b2f2caf8af) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88730c14-fd2a-4f63-bc10-96cea0b057eb/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:31 user nova-compute[74348]: INFO os_vif [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:13:ad,bridge_name='br-int',has_traffic_filtering=True,id=4a8ea7e1-9e80-4686-a3a9-4142b9de0049,network=Network(c9f2b2b7-e34f-4891-b68c-786534d7ed95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a8ea7e1-9e')
Nov 22 07:55:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2036316503',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2036316503',id=11,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnzYYP3Ptdmty3Rvwlh9fqssqqfrkRsWiJRiTKv6iY6VU5FnFmpw0lxwm8OKyeaQHOy3kJ8p8VF2y7jVGbQU/CO6Efmk0az16dQ9hu0FyN5s6f1p9PgD9PdzeRpGGp4hw==',key_name='tempest-keypair-342579863',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:54:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c8d9889b4c704e2c9370420262898383',ramdisk_id='',reservation_id='r-8fge7g0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1369728832',owner_user_name='tempest-TaggedBootDevicesTest_v242-1369728832-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T07:54:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd846d2c399e47db9dbd74e4beaeb0f4',uuid=9e2f3a3e-ee9b-4250-8744-5eb7982285f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e30deaf5-1258-4909-bc71-044c88f2995f", "address": "fa:16:3e:c8:34:fc", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30deaf5-12", "ovs_interfaceid": "e30deaf5-1258-4909-bc71-044c88f2995f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Converting VIF {"id": "e30deaf5-1258-4909-bc71-044c88f2995f", "address": "fa:16:3e:c8:34:fc", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30deaf5-12", "ovs_interfaceid": "e30deaf5-1258-4909-bc71-044c88f2995f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:34:fc,bridge_name='br-int',has_traffic_filtering=True,id=e30deaf5-1258-4909-bc71-044c88f2995f,network=Network(fc6897f6-ca20-4f4e-9e55-a61241ccd39f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape30deaf5-12') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG os_vif [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:34:fc,bridge_name='br-int',has_traffic_filtering=True,id=e30deaf5-1258-4909-bc71-044c88f2995f,network=Network(fc6897f6-ca20-4f4e-9e55-a61241ccd39f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape30deaf5-12') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape30deaf5-12, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7fe9a998-99fd-4006-b7b6-24f1ba1de2da tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Lock "bdad025e-8f6c-419a-99ea-bf277f6c5577" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.239s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e2156d69-e9e8-494a-aed4-2f106750db66) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG nova.compute.manager [req-650695c6-648b-4b72-82fc-24fcfc1652c0 req-e20881eb-2a3c-4b81-acd7-b956432529a0 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-vif-plugged-4a8ea7e1-9e80-4686-a3a9-4142b9de0049 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-650695c6-648b-4b72-82fc-24fcfc1652c0 req-e20881eb-2a3c-4b81-acd7-b956432529a0 service nova] Acquiring lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-650695c6-648b-4b72-82fc-24fcfc1652c0 req-e20881eb-2a3c-4b81-acd7-b956432529a0 service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-650695c6-648b-4b72-82fc-24fcfc1652c0 req-e20881eb-2a3c-4b81-acd7-b956432529a0 service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG nova.compute.manager [req-650695c6-648b-4b72-82fc-24fcfc1652c0 req-e20881eb-2a3c-4b81-acd7-b956432529a0 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] No waiting events found dispatching network-vif-plugged-4a8ea7e1-9e80-4686-a3a9-4142b9de0049 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:55:31 user nova-compute[74348]: WARNING nova.compute.manager [req-650695c6-648b-4b72-82fc-24fcfc1652c0 req-e20881eb-2a3c-4b81-acd7-b956432529a0 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received unexpected event network-vif-plugged-4a8ea7e1-9e80-4686-a3a9-4142b9de0049 for instance with vm_state active and task_state deleting.
Nov 22 07:55:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88730c14-fd2a-4f63-bc10-96cea0b057eb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88730c14-fd2a-4f63-bc10-96cea0b057eb/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:32 user nova-compute[74348]: INFO os_vif [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:34:fc,bridge_name='br-int',has_traffic_filtering=True,id=e30deaf5-1258-4909-bc71-044c88f2995f,network=Network(fc6897f6-ca20-4f4e-9e55-a61241ccd39f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape30deaf5-12')
Nov 22 07:55:32 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2036316503',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2036316503',id=11,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnzYYP3Ptdmty3Rvwlh9fqssqqfrkRsWiJRiTKv6iY6VU5FnFmpw0lxwm8OKyeaQHOy3kJ8p8VF2y7jVGbQU/CO6Efmk0az16dQ9hu0FyN5s6f1p9PgD9PdzeRpGGp4hw==',key_name='tempest-keypair-342579863',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:54:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c8d9889b4c704e2c9370420262898383',ramdisk_id='',reservation_id='r-8fge7g0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1369728832',owner_user_name='tempest-TaggedBootDevicesTest_v242-1369728832-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T07:54:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd846d2c399e47db9dbd74e4beaeb0f4',uuid=9e2f3a3e-ee9b-4250-8744-5eb7982285f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "298ce71b-894a-4e29-904e-1ba5d4495fcb", "address": "fa:16:3e:b3:83:8f", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298ce71b-89", "ovs_interfaceid": "298ce71b-894a-4e29-904e-1ba5d4495fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Converting VIF {"id": "298ce71b-894a-4e29-904e-1ba5d4495fcb", "address": "fa:16:3e:b3:83:8f", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298ce71b-89", "ovs_interfaceid": "298ce71b-894a-4e29-904e-1ba5d4495fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:83:8f,bridge_name='br-int',has_traffic_filtering=True,id=298ce71b-894a-4e29-904e-1ba5d4495fcb,network=Network(fc6897f6-ca20-4f4e-9e55-a61241ccd39f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap298ce71b-89') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG os_vif [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:83:8f,bridge_name='br-int',has_traffic_filtering=True,id=298ce71b-894a-4e29-904e-1ba5d4495fcb,network=Network(fc6897f6-ca20-4f4e-9e55-a61241ccd39f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap298ce71b-89') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap298ce71b-89, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1a291e94-1a95-4751-93f5-cfac113260ab) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:32 user nova-compute[74348]: INFO os_vif [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:83:8f,bridge_name='br-int',has_traffic_filtering=True,id=298ce71b-894a-4e29-904e-1ba5d4495fcb,network=Network(fc6897f6-ca20-4f4e-9e55-a61241ccd39f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap298ce71b-89')
Nov 22 07:55:32 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2036316503',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2036316503',id=11,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnzYYP3Ptdmty3Rvwlh9fqssqqfrkRsWiJRiTKv6iY6VU5FnFmpw0lxwm8OKyeaQHOy3kJ8p8VF2y7jVGbQU/CO6Efmk0az16dQ9hu0FyN5s6f1p9PgD9PdzeRpGGp4hw==',key_name='tempest-keypair-342579863',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:54:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c8d9889b4c704e2c9370420262898383',ramdisk_id='',reservation_id='r-8fge7g0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1369728832',owner_user_name='tempest-TaggedBootDevicesTest_v242-1369728832-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T07:54:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd846d2c399e47db9dbd74e4beaeb0f4',uuid=9e2f3a3e-ee9b-4250-8744-5eb7982285f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0f55187-e53f-468d-83a8-cca33ff1380e", "address": "fa:16:3e:8d:36:2e", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f55187-e5", "ovs_interfaceid": "f0f55187-e53f-468d-83a8-cca33ff1380e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Converting VIF {"id": "f0f55187-e53f-468d-83a8-cca33ff1380e", "address": "fa:16:3e:8d:36:2e", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f55187-e5", "ovs_interfaceid": "f0f55187-e53f-468d-83a8-cca33ff1380e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:36:2e,bridge_name='br-int',has_traffic_filtering=True,id=f0f55187-e53f-468d-83a8-cca33ff1380e,network=Network(fc6897f6-ca20-4f4e-9e55-a61241ccd39f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0f55187-e5') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG os_vif [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:36:2e,bridge_name='br-int',has_traffic_filtering=True,id=f0f55187-e53f-468d-83a8-cca33ff1380e,network=Network(fc6897f6-ca20-4f4e-9e55-a61241ccd39f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0f55187-e5') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0f55187-e5, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Acquiring lock "8527ae47-a025-492d-9820-b9c5ee309d81" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Lock "8527ae47-a025-492d-9820-b9c5ee309d81" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Acquiring lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88730c14-fd2a-4f63-bc10-96cea0b057eb/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:32 user nova-compute[74348]: INFO nova.compute.manager [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Terminating instance
Nov 22 07:55:32 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1d888a13-e8c2-4e37-8d19-8731d8c00401) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6aa6c0-2b77-49a5-9942-d6596ac4bd3f/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:32 user nova-compute[74348]: INFO os_vif [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:36:2e,bridge_name='br-int',has_traffic_filtering=True,id=f0f55187-e53f-468d-83a8-cca33ff1380e,network=Network(fc6897f6-ca20-4f4e-9e55-a61241ccd39f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0f55187-e5')
Nov 22 07:55:32 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2036316503',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2036316503',id=11,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnzYYP3Ptdmty3Rvwlh9fqssqqfrkRsWiJRiTKv6iY6VU5FnFmpw0lxwm8OKyeaQHOy3kJ8p8VF2y7jVGbQU/CO6Efmk0az16dQ9hu0FyN5s6f1p9PgD9PdzeRpGGp4hw==',key_name='tempest-keypair-342579863',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:54:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c8d9889b4c704e2c9370420262898383',ramdisk_id='',reservation_id='r-8fge7g0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1369728832',owner_user_name='tempest-TaggedBootDevicesTest_v242-1369728832-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T07:54:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd846d2c399e47db9dbd74e4beaeb0f4',uuid=9e2f3a3e-ee9b-4250-8744-5eb7982285f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a68d2be-be4c-462b-9dd4-15e222160557", "address": "fa:16:3e:ea:a3:83", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a68d2be-be", "ovs_interfaceid": "5a68d2be-be4c-462b-9dd4-15e222160557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Converting VIF {"id": "5a68d2be-be4c-462b-9dd4-15e222160557", "address": "fa:16:3e:ea:a3:83", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a68d2be-be", "ovs_interfaceid": "5a68d2be-be4c-462b-9dd4-15e222160557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a3:83,bridge_name='br-int',has_traffic_filtering=True,id=5a68d2be-be4c-462b-9dd4-15e222160557,network=Network(fc6897f6-ca20-4f4e-9e55-a61241ccd39f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a68d2be-be') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG os_vif [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a3:83,bridge_name='br-int',has_traffic_filtering=True,id=5a68d2be-be4c-462b-9dd4-15e222160557,network=Network(fc6897f6-ca20-4f4e-9e55-a61241ccd39f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a68d2be-be') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a68d2be-be, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=94151df4-e159-4c8c-b27c-5ca9e8bd2c50) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6aa6c0-2b77-49a5-9942-d6596ac4bd3f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6aa6c0-2b77-49a5-9942-d6596ac4bd3f/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:32 user nova-compute[74348]: INFO os_vif [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a3:83,bridge_name='br-int',has_traffic_filtering=True,id=5a68d2be-be4c-462b-9dd4-15e222160557,network=Network(fc6897f6-ca20-4f4e-9e55-a61241ccd39f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a68d2be-be')
Nov 22 07:55:32 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2036316503',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2036316503',id=11,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnzYYP3Ptdmty3Rvwlh9fqssqqfrkRsWiJRiTKv6iY6VU5FnFmpw0lxwm8OKyeaQHOy3kJ8p8VF2y7jVGbQU/CO6Efmk0az16dQ9hu0FyN5s6f1p9PgD9PdzeRpGGp4hw==',key_name='tempest-keypair-342579863',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:54:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c8d9889b4c704e2c9370420262898383',ramdisk_id='',reservation_id='r-8fge7g0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1369728832',owner_user_name='tempest-TaggedBootDevicesTest_v242-1369728832-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T07:54:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd846d2c399e47db9dbd74e4beaeb0f4',uuid=9e2f3a3e-ee9b-4250-8744-5eb7982285f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9aa74044-d952-47e5-9cc1-948615a01eb3", "address": "fa:16:3e:6d:8e:f9", "network": {"id": "7f9b7b76-9f0d-4fbd-90c9-6ceee5e0c50e", "bridge": "br-int", "label": "tempest-device-tagging-net2-487890789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aa74044-d9", "ovs_interfaceid": "9aa74044-d952-47e5-9cc1-948615a01eb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Converting VIF {"id": "9aa74044-d952-47e5-9cc1-948615a01eb3", "address": "fa:16:3e:6d:8e:f9", "network": {"id": "7f9b7b76-9f0d-4fbd-90c9-6ceee5e0c50e", "bridge": "br-int", "label": "tempest-device-tagging-net2-487890789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aa74044-d9", "ovs_interfaceid": "9aa74044-d952-47e5-9cc1-948615a01eb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:8e:f9,bridge_name='br-int',has_traffic_filtering=True,id=9aa74044-d952-47e5-9cc1-948615a01eb3,network=Network(7f9b7b76-9f0d-4fbd-90c9-6ceee5e0c50e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aa74044-d9') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG os_vif [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:8e:f9,bridge_name='br-int',has_traffic_filtering=True,id=9aa74044-d952-47e5-9cc1-948615a01eb3,network=Network(7f9b7b76-9f0d-4fbd-90c9-6ceee5e0c50e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aa74044-d9') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9aa74044-d9, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6aa6c0-2b77-49a5-9942-d6596ac4bd3f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/522f5959-4874-4c61-888d-6fb1cc4d72e6/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG nova.compute.manager [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-vif-plugged-e30deaf5-1258-4909-bc71-044c88f2995f {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] Acquiring lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG nova.compute.manager [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] No waiting events found dispatching network-vif-plugged-e30deaf5-1258-4909-bc71-044c88f2995f {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:55:32 user nova-compute[74348]: WARNING nova.compute.manager [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received unexpected event network-vif-plugged-e30deaf5-1258-4909-bc71-044c88f2995f for instance with vm_state active and task_state deleting.
Nov 22 07:55:32 user nova-compute[74348]: DEBUG nova.compute.manager [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-vif-unplugged-f0f55187-e53f-468d-83a8-cca33ff1380e {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] Acquiring lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG nova.compute.manager [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] No waiting events found dispatching network-vif-unplugged-f0f55187-e53f-468d-83a8-cca33ff1380e {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG nova.compute.manager [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-vif-unplugged-f0f55187-e53f-468d-83a8-cca33ff1380e for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG nova.compute.manager [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-vif-plugged-f0f55187-e53f-468d-83a8-cca33ff1380e {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] Acquiring lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG nova.compute.manager [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] No waiting events found dispatching network-vif-plugged-f0f55187-e53f-468d-83a8-cca33ff1380e {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:55:32 user nova-compute[74348]: WARNING nova.compute.manager [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received unexpected event network-vif-plugged-f0f55187-e53f-468d-83a8-cca33ff1380e for instance with vm_state active and task_state deleting.
Nov 22 07:55:32 user nova-compute[74348]: DEBUG nova.compute.manager [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-vif-unplugged-5a68d2be-be4c-462b-9dd4-15e222160557 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] Acquiring lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG nova.compute.manager [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] No waiting events found dispatching network-vif-unplugged-5a68d2be-be4c-462b-9dd4-15e222160557 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG nova.compute.manager [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-vif-unplugged-5a68d2be-be4c-462b-9dd4-15e222160557 for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG nova.compute.manager [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-vif-plugged-5a68d2be-be4c-462b-9dd4-15e222160557 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] Acquiring lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG nova.compute.manager [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] No waiting events found dispatching network-vif-plugged-5a68d2be-be4c-462b-9dd4-15e222160557 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:55:32 user nova-compute[74348]: WARNING nova.compute.manager [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received unexpected event network-vif-plugged-5a68d2be-be4c-462b-9dd4-15e222160557 for instance with vm_state active and task_state deleting.
Nov 22 07:55:32 user nova-compute[74348]: DEBUG nova.compute.manager [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-vif-unplugged-9aa74044-d952-47e5-9cc1-948615a01eb3 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] Acquiring lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG nova.compute.manager [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] No waiting events found dispatching network-vif-unplugged-9aa74044-d952-47e5-9cc1-948615a01eb3 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG nova.compute.manager [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-vif-unplugged-9aa74044-d952-47e5-9cc1-948615a01eb3 for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG nova.compute.manager [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-vif-plugged-9aa74044-d952-47e5-9cc1-948615a01eb3 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] Acquiring lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG nova.compute.manager [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] No waiting events found dispatching network-vif-plugged-9aa74044-d952-47e5-9cc1-948615a01eb3 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:55:32 user nova-compute[74348]: WARNING nova.compute.manager [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received unexpected event network-vif-plugged-9aa74044-d952-47e5-9cc1-948615a01eb3 for instance with vm_state active and task_state deleting.
Nov 22 07:55:32 user nova-compute[74348]: DEBUG nova.compute.manager [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-vif-unplugged-6221165b-f588-475c-a3b1-afdf5c60c113 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] Acquiring lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG nova.compute.manager [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] No waiting events found dispatching network-vif-unplugged-6221165b-f588-475c-a3b1-afdf5c60c113 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG nova.compute.manager [req-9e40b10a-9d53-4a82-948f-39c69ebe38b5 req-b4299ac0-90a7-48de-b49f-970245c5e40d service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-vif-unplugged-6221165b-f588-475c-a3b1-afdf5c60c113 for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=93309b90-3148-4eb7-952c-cc1e15f79a35) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/522f5959-4874-4c61-888d-6fb1cc4d72e6/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/522f5959-4874-4c61-888d-6fb1cc4d72e6/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:32 user nova-compute[74348]: INFO os_vif [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:8e:f9,bridge_name='br-int',has_traffic_filtering=True,id=9aa74044-d952-47e5-9cc1-948615a01eb3,network=Network(7f9b7b76-9f0d-4fbd-90c9-6ceee5e0c50e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aa74044-d9')
Nov 22 07:55:32 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2036316503',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2036316503',id=11,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnzYYP3Ptdmty3Rvwlh9fqssqqfrkRsWiJRiTKv6iY6VU5FnFmpw0lxwm8OKyeaQHOy3kJ8p8VF2y7jVGbQU/CO6Efmk0az16dQ9hu0FyN5s6f1p9PgD9PdzeRpGGp4hw==',key_name='tempest-keypair-342579863',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:54:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c8d9889b4c704e2c9370420262898383',ramdisk_id='',reservation_id='r-8fge7g0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1369728832',owner_user_name='tempest-TaggedBootDevicesTest_v242-1369728832-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T07:54:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd846d2c399e47db9dbd74e4beaeb0f4',uuid=9e2f3a3e-ee9b-4250-8744-5eb7982285f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "579fb42b-b8b6-4122-8ec3-8817c9e0881a", "address": "fa:16:3e:06:8e:e5", "network": {"id": "7f9b7b76-9f0d-4fbd-90c9-6ceee5e0c50e", "bridge": "br-int", "label": "tempest-device-tagging-net2-487890789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap579fb42b-b8", "ovs_interfaceid": "579fb42b-b8b6-4122-8ec3-8817c9e0881a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Converting VIF {"id": "579fb42b-b8b6-4122-8ec3-8817c9e0881a", "address": "fa:16:3e:06:8e:e5", "network": {"id": "7f9b7b76-9f0d-4fbd-90c9-6ceee5e0c50e", "bridge": "br-int", "label": "tempest-device-tagging-net2-487890789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap579fb42b-b8", "ovs_interfaceid": "579fb42b-b8b6-4122-8ec3-8817c9e0881a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:8e:e5,bridge_name='br-int',has_traffic_filtering=True,id=579fb42b-b8b6-4122-8ec3-8817c9e0881a,network=Network(7f9b7b76-9f0d-4fbd-90c9-6ceee5e0c50e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap579fb42b-b8') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG os_vif [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:8e:e5,bridge_name='br-int',has_traffic_filtering=True,id=579fb42b-b8b6-4122-8ec3-8817c9e0881a,network=Network(7f9b7b76-9f0d-4fbd-90c9-6ceee5e0c50e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap579fb42b-b8') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap579fb42b-b8, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/522f5959-4874-4c61-888d-6fb1cc4d72e6/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059bde4a-c5c9-45ab-9b4a-c969c74a6083/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eccf51fa-9c08-4c28-99fb-2d688bb99878) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059bde4a-c5c9-45ab-9b4a-c969c74a6083/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059bde4a-c5c9-45ab-9b4a-c969c74a6083/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:33 user nova-compute[74348]: INFO os_vif [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:8e:e5,bridge_name='br-int',has_traffic_filtering=True,id=579fb42b-b8b6-4122-8ec3-8817c9e0881a,network=Network(7f9b7b76-9f0d-4fbd-90c9-6ceee5e0c50e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap579fb42b-b8')
Nov 22 07:55:33 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gAqQkbdw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:55:33 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:55:33 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[483dbfad-c2ed-4b6c-a8e7-44380da48379]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 07:55:33 user nova-compute[74348]: No targets found.
Nov 22 07:55:33 user nova-compute[74348]: iSNS:
Nov 22 07:55:33 user nova-compute[74348]: No targets found.
Nov 22 07:55:33 user nova-compute[74348]: STATIC:
Nov 22 07:55:33 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa
Nov 22 07:55:33 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:33 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:33 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223
Nov 22 07:55:33 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:33 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:33 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471
Nov 22 07:55:33 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:33 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:33 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce
Nov 22 07:55:33 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:33 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:33 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7
Nov 22 07:55:33 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:33 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:33 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5
Nov 22 07:55:33 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:33 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:33 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c
Nov 22 07:55:33 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:33 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:33 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea
Nov 22 07:55:33 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:33 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:33 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968
Nov 22 07:55:33 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:33 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:33 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054
Nov 22 07:55:33 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:33 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:33 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799
Nov 22 07:55:33 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:33 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:33 user nova-compute[74348]: FIRMWARE:
Nov 22 07:55:33 user nova-compute[74348]: No targets found.
Nov 22 07:55:33 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 07:55:33 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 07:55:33 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[03fec9db-7bb0-4a77-8138-f6bcc4592e0e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[664f8431-293b-4c6a-8639-cf1f6be59231]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)
Nov 22 07:55:33 user nova-compute[74348]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)
Nov 22 07:55:33 user nova-compute[74348]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa (non-flash)
Nov 22 07:55:33 user nova-compute[74348]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce (non-flash)
Nov 22 07:55:33 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:55:33 user nova-compute[74348]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)
Nov 22 07:55:33 user nova-compute[74348]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)
Nov 22 07:55:33 user nova-compute[74348]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)
Nov 22 07:55:33 user nova-compute[74348]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)
Nov 22 07:55:33 user nova-compute[74348]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)
Nov 22 07:55:33 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:55:33 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)
Nov 22 07:55:33 user nova-compute[74348]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)
Nov 22 07:55:33 user nova-compute[74348]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa (non-flash)
Nov 22 07:55:33 user nova-compute[74348]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce (non-flash)
Nov 22 07:55:33 user nova-compute[74348]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea (non-flash)
Nov 22 07:55:33 user nova-compute[74348]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)
Nov 22 07:55:33 user nova-compute[74348]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)
Nov 22 07:55:33 user nova-compute[74348]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)
Nov 22 07:55:33 user nova-compute[74348]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)
Nov 22 07:55:33 user nova-compute[74348]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)
Nov 22 07:55:33 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:55:33 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f224c7bd090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea'): ({'sdc'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Removing single pathed devices sdc {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059bde4a-c5c9-45ab-9b4a-c969c74a6083/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e042fd98-eb22-4c6e-9eec-4bb0908fd5ce/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[07beccda-00f8-4f4c-87a0-5f53dccff3ec]: (4, ('path checker states:\nup                  10\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG nova.compute.manager [req-dcc8ff38-36fe-40c6-bf7c-b9d031c52554 req-386ad6f9-205c-496d-bbcc-d600befb3097 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-vif-unplugged-63fc17ce-ef08-4f7e-ab83-b1040733d228 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-dcc8ff38-36fe-40c6-bf7c-b9d031c52554 req-386ad6f9-205c-496d-bbcc-d600befb3097 service nova] Acquiring lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-dcc8ff38-36fe-40c6-bf7c-b9d031c52554 req-386ad6f9-205c-496d-bbcc-d600befb3097 service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-dcc8ff38-36fe-40c6-bf7c-b9d031c52554 req-386ad6f9-205c-496d-bbcc-d600befb3097 service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG nova.compute.manager [req-dcc8ff38-36fe-40c6-bf7c-b9d031c52554 req-386ad6f9-205c-496d-bbcc-d600befb3097 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] No waiting events found dispatching network-vif-unplugged-63fc17ce-ef08-4f7e-ab83-b1040733d228 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG nova.compute.manager [req-dcc8ff38-36fe-40c6-bf7c-b9d031c52554 req-386ad6f9-205c-496d-bbcc-d600befb3097 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-vif-unplugged-63fc17ce-ef08-4f7e-ab83-b1040733d228 for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7ea693-19cd-4d19-8eda-34f39bab5105]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Flushing IO for device /dev/sdc {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c6adc8-d3b2-4413-bd3d-e94d45dae33d]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7e1033-c6b2-4bfc-8628-bbdb702617c6]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] SCSI volumes sdc have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO2559ee7f-a00ab6f245ecd359', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_2559ee7f', '/dev/disk/by-id/scsi-26130306162366632') {{(pid=85159) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51ae0c2-ecd2-436b-ae9f-e9bff0cfee93]: (4, None) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a835756-4ee2-4f08-a156-e8916b67daf1]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e042fd98-eb22-4c6e-9eec-4bb0908fd5ce/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e042fd98-eb22-4c6e-9eec-4bb0908fd5ce/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-5da36d5d-bec3-4344-9708-b9798065e5b1 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Acquiring lock "bdad025e-8f6c-419a-99ea-bf277f6c5577" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-5da36d5d-bec3-4344-9708-b9798065e5b1 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Lock "bdad025e-8f6c-419a-99ea-bf277f6c5577" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea -p 172.16.0.220:3260 --logout" returned: 0 in 0.145s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2912b83b-2d67-423c-b4de-b778864d60e9]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea, portal: 172.16.0.220,3260]
Nov 22 07:55:33 user nova-compute[74348]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea, portal: 172.16.0.220,3260] successful.
Nov 22 07:55:33 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:33 user nova-compute[74348]: INFO nova.compute.manager [None req-5da36d5d-bec3-4344-9708-b9798065e5b1 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Detaching volume 31c45577-a290-406b-8e3e-a7852977edce
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b19fd726-3664-469a-b6fe-7269b9235cea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f5f973-c61b-4fd4-b537-2edcc96595a8]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.552s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] <== disconnect_volume: return (554ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'grUfbqtL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:55:33 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:55:33 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.034s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1bf33e-f331-46ec-91f4-78b39e51f44b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 07:55:33 user nova-compute[74348]: No targets found.
Nov 22 07:55:33 user nova-compute[74348]: iSNS:
Nov 22 07:55:33 user nova-compute[74348]: No targets found.
Nov 22 07:55:33 user nova-compute[74348]: STATIC:
Nov 22 07:55:33 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa
Nov 22 07:55:33 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:33 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:33 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223
Nov 22 07:55:33 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:33 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:33 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471
Nov 22 07:55:33 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:33 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:33 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce
Nov 22 07:55:33 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:33 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:33 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7
Nov 22 07:55:33 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:33 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:33 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5
Nov 22 07:55:33 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:33 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:33 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c
Nov 22 07:55:33 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:33 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:33 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968
Nov 22 07:55:33 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:33 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:33 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054
Nov 22 07:55:33 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:33 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:33 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799
Nov 22 07:55:33 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:33 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:33 user nova-compute[74348]: FIRMWARE:
Nov 22 07:55:33 user nova-compute[74348]: No targets found.
Nov 22 07:55:33 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 07:55:33 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 07:55:33 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 07:55:33 user nova-compute[74348]: INFO nova.virt.block_device [None req-5da36d5d-bec3-4344-9708-b9798065e5b1 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Attempting to driver detach volume 31c45577-a290-406b-8e3e-a7852977edce from mountpoint /dev/vdb
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e042fd98-eb22-4c6e-9eec-4bb0908fd5ce/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08c8037-a72a-4264-9304-38fb3180f7e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:34 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Instance destroyed successfully.
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.objects.instance [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Lazy-loading 'resources' on Instance uuid 8527ae47-a025-492d-9820-b9c5ee309d81 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-5da36d5d-bec3-4344-9708-b9798065e5b1 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Attempting to detach device vdb from instance bdad025e-8f6c-419a-99ea-bf277f6c5577 from the persistent domain config. {{(pid=74348) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-5da36d5d-bec3-4344-9708-b9798065e5b1 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 07:55:34 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 07:55:34 user nova-compute[74348]:   <source dev="/dev/sdl"/>
Nov 22 07:55:34 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 07:55:34 user nova-compute[74348]:   <serial>31c45577-a290-406b-8e3e-a7852977edce</serial>
Nov 22 07:55:34 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 22 07:55:34 user nova-compute[74348]: </disk>
Nov 22 07:55:34 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 07:55:34 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-5da36d5d-bec3-4344-9708-b9798065e5b1 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Successfully detached device vdb from instance bdad025e-8f6c-419a-99ea-bf277f6c5577 from the persistent domain config.
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-5da36d5d-bec3-4344-9708-b9798065e5b1 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bdad025e-8f6c-419a-99ea-bf277f6c5577 from the live domain config. {{(pid=74348) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-5da36d5d-bec3-4344-9708-b9798065e5b1 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 07:55:34 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 07:55:34 user nova-compute[74348]:   <source dev="/dev/sdl"/>
Nov 22 07:55:34 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 07:55:34 user nova-compute[74348]:   <serial>31c45577-a290-406b-8e3e-a7852977edce</serial>
Nov 22 07:55:34 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 22 07:55:34 user nova-compute[74348]: </disk>
Nov 22 07:55:34 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.054s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7584e870-b285-4eec-a44f-45b37f234e59]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)
Nov 22 07:55:34 user nova-compute[74348]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)
Nov 22 07:55:34 user nova-compute[74348]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa (non-flash)
Nov 22 07:55:34 user nova-compute[74348]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce (non-flash)
Nov 22 07:55:34 user nova-compute[74348]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)
Nov 22 07:55:34 user nova-compute[74348]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)
Nov 22 07:55:34 user nova-compute[74348]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)
Nov 22 07:55:34 user nova-compute[74348]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)
Nov 22 07:55:34 user nova-compute[74348]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)
Nov 22 07:55:34 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:55:34 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)
Nov 22 07:55:34 user nova-compute[74348]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)
Nov 22 07:55:34 user nova-compute[74348]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa (non-flash)
Nov 22 07:55:34 user nova-compute[74348]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce (non-flash)
Nov 22 07:55:34 user nova-compute[74348]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c (non-flash)
Nov 22 07:55:34 user nova-compute[74348]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)
Nov 22 07:55:34 user nova-compute[74348]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)
Nov 22 07:55:34 user nova-compute[74348]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)
Nov 22 07:55:34 user nova-compute[74348]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)
Nov 22 07:55:34 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:55:34 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f22285ac430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c'): ({'sdd'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Removing single pathed devices sdd {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-574357068',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-574357068',id=12,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPh8WrgN05Udth7XNATbD0Z+g0hoWMflQ1e+XdiOuBd1xLNGVHWp/bZGSnlbVFto/38wc6mSlPbrRK9XwiDx6Yn5HNC2pFZ8C7kB6aRkT1jiYcW2IxcpgmJM/7ZZJUwqcw==',key_name='tempest-keypair-436025460',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:54:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a08625e4d04478297484c875ac9a5c3',ramdisk_id='',reservation_id='r-7l9plp3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1955894791',owner_user_name='tempest-TaggedBootDevicesTest-1955894791-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T07:54:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d026e5b011144beb9340e6ceb58583f3',uuid=8527ae47-a025-492d-9820-b9c5ee309d81,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6221165b-f588-475c-a3b1-afdf5c60c113", "address": "fa:16:3e:6a:1c:a3", "network": {"id": "414e020d-3fcc-4afd-9fee-be68687a0418", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-184417969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6221165b-f5", "ovs_interfaceid": "6221165b-f588-475c-a3b1-afdf5c60c113", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Converting VIF {"id": "6221165b-f588-475c-a3b1-afdf5c60c113", "address": "fa:16:3e:6a:1c:a3", "network": {"id": "414e020d-3fcc-4afd-9fee-be68687a0418", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-184417969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6221165b-f5", "ovs_interfaceid": "6221165b-f588-475c-a3b1-afdf5c60c113", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:1c:a3,bridge_name='br-int',has_traffic_filtering=True,id=6221165b-f588-475c-a3b1-afdf5c60c113,network=Network(414e020d-3fcc-4afd-9fee-be68687a0418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6221165b-f5') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_vif [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:1c:a3,bridge_name='br-int',has_traffic_filtering=True,id=6221165b-f588-475c-a3b1-afdf5c60c113,network=Network(414e020d-3fcc-4afd-9fee-be68687a0418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6221165b-f5') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6221165b-f5, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.compute.manager [req-dce27818-9f38-417f-94d0-14462bee6125 req-42526fa4-6c26-4fab-8cd5-edc4c893412d service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-vif-unplugged-62ed8403-ebcd-4e41-ac81-0056cf71738c {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-dce27818-9f38-417f-94d0-14462bee6125 req-42526fa4-6c26-4fab-8cd5-edc4c893412d service nova] Acquiring lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-dce27818-9f38-417f-94d0-14462bee6125 req-42526fa4-6c26-4fab-8cd5-edc4c893412d service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-dce27818-9f38-417f-94d0-14462bee6125 req-42526fa4-6c26-4fab-8cd5-edc4c893412d service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.compute.manager [req-dce27818-9f38-417f-94d0-14462bee6125 req-42526fa4-6c26-4fab-8cd5-edc4c893412d service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] No waiting events found dispatching network-vif-unplugged-62ed8403-ebcd-4e41-ac81-0056cf71738c {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.compute.manager [req-dce27818-9f38-417f-94d0-14462bee6125 req-42526fa4-6c26-4fab-8cd5-edc4c893412d service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-vif-unplugged-62ed8403-ebcd-4e41-ac81-0056cf71738c for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.compute.manager [req-dce27818-9f38-417f-94d0-14462bee6125 req-42526fa4-6c26-4fab-8cd5-edc4c893412d service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-vif-plugged-62ed8403-ebcd-4e41-ac81-0056cf71738c {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-dce27818-9f38-417f-94d0-14462bee6125 req-42526fa4-6c26-4fab-8cd5-edc4c893412d service nova] Acquiring lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-dce27818-9f38-417f-94d0-14462bee6125 req-42526fa4-6c26-4fab-8cd5-edc4c893412d service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-dce27818-9f38-417f-94d0-14462bee6125 req-42526fa4-6c26-4fab-8cd5-edc4c893412d service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.compute.manager [req-dce27818-9f38-417f-94d0-14462bee6125 req-42526fa4-6c26-4fab-8cd5-edc4c893412d service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] No waiting events found dispatching network-vif-plugged-62ed8403-ebcd-4e41-ac81-0056cf71738c {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:55:34 user nova-compute[74348]: WARNING nova.compute.manager [req-dce27818-9f38-417f-94d0-14462bee6125 req-42526fa4-6c26-4fab-8cd5-edc4c893412d service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received unexpected event network-vif-plugged-62ed8403-ebcd-4e41-ac81-0056cf71738c for instance with vm_state active and task_state deleting.
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.compute.manager [req-dce27818-9f38-417f-94d0-14462bee6125 req-42526fa4-6c26-4fab-8cd5-edc4c893412d service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-vif-unplugged-748e5281-27d7-43b4-ba47-2f0daed1181e {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-dce27818-9f38-417f-94d0-14462bee6125 req-42526fa4-6c26-4fab-8cd5-edc4c893412d service nova] Acquiring lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-dce27818-9f38-417f-94d0-14462bee6125 req-42526fa4-6c26-4fab-8cd5-edc4c893412d service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-dce27818-9f38-417f-94d0-14462bee6125 req-42526fa4-6c26-4fab-8cd5-edc4c893412d service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.compute.manager [req-dce27818-9f38-417f-94d0-14462bee6125 req-42526fa4-6c26-4fab-8cd5-edc4c893412d service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] No waiting events found dispatching network-vif-unplugged-748e5281-27d7-43b4-ba47-2f0daed1181e {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.compute.manager [req-dce27818-9f38-417f-94d0-14462bee6125 req-42526fa4-6c26-4fab-8cd5-edc4c893412d service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-vif-unplugged-748e5281-27d7-43b4-ba47-2f0daed1181e for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.compute.manager [req-dce27818-9f38-417f-94d0-14462bee6125 req-42526fa4-6c26-4fab-8cd5-edc4c893412d service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-vif-plugged-748e5281-27d7-43b4-ba47-2f0daed1181e {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-dce27818-9f38-417f-94d0-14462bee6125 req-42526fa4-6c26-4fab-8cd5-edc4c893412d service nova] Acquiring lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-dce27818-9f38-417f-94d0-14462bee6125 req-42526fa4-6c26-4fab-8cd5-edc4c893412d service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-dce27818-9f38-417f-94d0-14462bee6125 req-42526fa4-6c26-4fab-8cd5-edc4c893412d service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.compute.manager [req-dce27818-9f38-417f-94d0-14462bee6125 req-42526fa4-6c26-4fab-8cd5-edc4c893412d service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] No waiting events found dispatching network-vif-plugged-748e5281-27d7-43b4-ba47-2f0daed1181e {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:55:34 user nova-compute[74348]: WARNING nova.compute.manager [req-dce27818-9f38-417f-94d0-14462bee6125 req-42526fa4-6c26-4fab-8cd5-edc4c893412d service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received unexpected event network-vif-plugged-748e5281-27d7-43b4-ba47-2f0daed1181e for instance with vm_state active and task_state deleting.
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.compute.manager [req-dce27818-9f38-417f-94d0-14462bee6125 req-42526fa4-6c26-4fab-8cd5-edc4c893412d service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-vif-unplugged-a64b4a32-73f1-4a48-8b80-86d353d1d40b {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-dce27818-9f38-417f-94d0-14462bee6125 req-42526fa4-6c26-4fab-8cd5-edc4c893412d service nova] Acquiring lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-dce27818-9f38-417f-94d0-14462bee6125 req-42526fa4-6c26-4fab-8cd5-edc4c893412d service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-dce27818-9f38-417f-94d0-14462bee6125 req-42526fa4-6c26-4fab-8cd5-edc4c893412d service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.compute.manager [req-dce27818-9f38-417f-94d0-14462bee6125 req-42526fa4-6c26-4fab-8cd5-edc4c893412d service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] No waiting events found dispatching network-vif-unplugged-a64b4a32-73f1-4a48-8b80-86d353d1d40b {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.compute.manager [req-dce27818-9f38-417f-94d0-14462bee6125 req-42526fa4-6c26-4fab-8cd5-edc4c893412d service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-vif-unplugged-a64b4a32-73f1-4a48-8b80-86d353d1d40b for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.compute.manager [req-dce27818-9f38-417f-94d0-14462bee6125 req-42526fa4-6c26-4fab-8cd5-edc4c893412d service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-vif-plugged-a64b4a32-73f1-4a48-8b80-86d353d1d40b {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-dce27818-9f38-417f-94d0-14462bee6125 req-42526fa4-6c26-4fab-8cd5-edc4c893412d service nova] Acquiring lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-dce27818-9f38-417f-94d0-14462bee6125 req-42526fa4-6c26-4fab-8cd5-edc4c893412d service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-dce27818-9f38-417f-94d0-14462bee6125 req-42526fa4-6c26-4fab-8cd5-edc4c893412d service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.compute.manager [req-dce27818-9f38-417f-94d0-14462bee6125 req-42526fa4-6c26-4fab-8cd5-edc4c893412d service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] No waiting events found dispatching network-vif-plugged-a64b4a32-73f1-4a48-8b80-86d353d1d40b {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:55:34 user nova-compute[74348]: WARNING nova.compute.manager [req-dce27818-9f38-417f-94d0-14462bee6125 req-42526fa4-6c26-4fab-8cd5-edc4c893412d service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received unexpected event network-vif-plugged-a64b4a32-73f1-4a48-8b80-86d353d1d40b for instance with vm_state active and task_state deleting.
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf78cbc-98d6-4ab2-ac26-6b010693ea5d]: (4, ('path checker states:\nup                  9\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e954fcf-c99d-44d0-9faa-d6e934b79da5]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Flushing IO for device /dev/sdd {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b23dd8-7f9a-4f0c-90b0-6b519e39b902]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6782184d-2c83-4911-8c7e-0095e6ee65a3]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] SCSI volumes sdd have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=25a63f79-9974-4fab-8a7e-f77d22100262) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c066a444-ae24-4bf3-9a85-0623be084b6a]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:34 user nova-compute[74348]: INFO os_vif [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:1c:a3,bridge_name='br-int',has_traffic_filtering=True,id=6221165b-f588-475c-a3b1-afdf5c60c113,network=Network(414e020d-3fcc-4afd-9fee-be68687a0418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6221165b-f5')
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-574357068',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-574357068',id=12,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPh8WrgN05Udth7XNATbD0Z+g0hoWMflQ1e+XdiOuBd1xLNGVHWp/bZGSnlbVFto/38wc6mSlPbrRK9XwiDx6Yn5HNC2pFZ8C7kB6aRkT1jiYcW2IxcpgmJM/7ZZJUwqcw==',key_name='tempest-keypair-436025460',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:54:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a08625e4d04478297484c875ac9a5c3',ramdisk_id='',reservation_id='r-7l9plp3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1955894791',owner_user_name='tempest-TaggedBootDevicesTest-1955894791-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T07:54:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d026e5b011144beb9340e6ceb58583f3',uuid=8527ae47-a025-492d-9820-b9c5ee309d81,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62ed8403-ebcd-4e41-ac81-0056cf71738c", "address": "fa:16:3e:9a:78:38", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62ed8403-eb", "ovs_interfaceid": "62ed8403-ebcd-4e41-ac81-0056cf71738c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Converting VIF {"id": "62ed8403-ebcd-4e41-ac81-0056cf71738c", "address": "fa:16:3e:9a:78:38", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62ed8403-eb", "ovs_interfaceid": "62ed8403-ebcd-4e41-ac81-0056cf71738c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:78:38,bridge_name='br-int',has_traffic_filtering=True,id=62ed8403-ebcd-4e41-ac81-0056cf71738c,network=Network(3f843b34-4601-4294-93d6-36cfbbf94a95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap62ed8403-eb') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_vif [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:78:38,bridge_name='br-int',has_traffic_filtering=True,id=62ed8403-ebcd-4e41-ac81-0056cf71738c,network=Network(3f843b34-4601-4294-93d6-36cfbbf94a95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap62ed8403-eb') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62ed8403-eb, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aaecd13-e018-42e6-b880-ce1bf16e338f]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c, portal: 172.16.0.220,3260]
Nov 22 07:55:34 user nova-compute[74348]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c, portal: 172.16.0.220,3260] successful.
Nov 22 07:55:34 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8c35741c-aa2f-4fa6-bb96-2d342b35159a) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f28856c9-75f8-44e9-b622-fab2df90d65c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00ecb47-d7b5-433d-936a-e3e91a5312bc]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.507s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] <== disconnect_volume: return (509ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e93032ee-56bd-48be-8121-b0fd5273345e/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lnWwiSfY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:55:34 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:34 user nova-compute[74348]: INFO os_vif [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:78:38,bridge_name='br-int',has_traffic_filtering=True,id=62ed8403-ebcd-4e41-ac81-0056cf71738c,network=Network(3f843b34-4601-4294-93d6-36cfbbf94a95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap62ed8403-eb')
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-574357068',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-574357068',id=12,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPh8WrgN05Udth7XNATbD0Z+g0hoWMflQ1e+XdiOuBd1xLNGVHWp/bZGSnlbVFto/38wc6mSlPbrRK9XwiDx6Yn5HNC2pFZ8C7kB6aRkT1jiYcW2IxcpgmJM/7ZZJUwqcw==',key_name='tempest-keypair-436025460',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:54:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a08625e4d04478297484c875ac9a5c3',ramdisk_id='',reservation_id='r-7l9plp3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1955894791',owner_user_name='tempest-TaggedBootDevicesTest-1955894791-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T07:54:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d026e5b011144beb9340e6ceb58583f3',uuid=8527ae47-a025-492d-9820-b9c5ee309d81,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63fc17ce-ef08-4f7e-ab83-b1040733d228", "address": "fa:16:3e:92:70:d1", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fc17ce-ef", "ovs_interfaceid": "63fc17ce-ef08-4f7e-ab83-b1040733d228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Converting VIF {"id": "63fc17ce-ef08-4f7e-ab83-b1040733d228", "address": "fa:16:3e:92:70:d1", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fc17ce-ef", "ovs_interfaceid": "63fc17ce-ef08-4f7e-ab83-b1040733d228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:70:d1,bridge_name='br-int',has_traffic_filtering=True,id=63fc17ce-ef08-4f7e-ab83-b1040733d228,network=Network(3f843b34-4601-4294-93d6-36cfbbf94a95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap63fc17ce-ef') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_vif [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:70:d1,bridge_name='br-int',has_traffic_filtering=True,id=63fc17ce-ef08-4f7e-ab83-b1040733d228,network=Network(3f843b34-4601-4294-93d6-36cfbbf94a95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap63fc17ce-ef') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63fc17ce-ef, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29c61ee-8846-485d-b608-f547b76f7f84]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 07:55:34 user nova-compute[74348]: No targets found.
Nov 22 07:55:34 user nova-compute[74348]: iSNS:
Nov 22 07:55:34 user nova-compute[74348]: No targets found.
Nov 22 07:55:34 user nova-compute[74348]: STATIC:
Nov 22 07:55:34 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa
Nov 22 07:55:34 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:34 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:34 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223
Nov 22 07:55:34 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:34 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:34 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471
Nov 22 07:55:34 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:34 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:34 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce
Nov 22 07:55:34 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:34 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:34 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7
Nov 22 07:55:34 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:34 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:34 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5
Nov 22 07:55:34 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:34 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:34 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968
Nov 22 07:55:34 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:34 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:34 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054
Nov 22 07:55:34 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:34 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:34 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799
Nov 22 07:55:34 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:34 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:34 user nova-compute[74348]: FIRMWARE:
Nov 22 07:55:34 user nova-compute[74348]: No targets found.
Nov 22 07:55:34 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 07:55:34 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 07:55:34 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e16fc0-1bc2-4494-a417-e738d36f6003]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-5da36d5d-bec3-4344-9708-b9798065e5b1 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bdad025e-8f6c-419a-99ea-bf277f6c5577 {{(pid=74348) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a465de26-f5b5-4f4a-8796-196c3f368983) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[573b6720-a1f3-4a11-a42c-cef106951bbb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)
Nov 22 07:55:34 user nova-compute[74348]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)
Nov 22 07:55:34 user nova-compute[74348]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa (non-flash)
Nov 22 07:55:34 user nova-compute[74348]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce (non-flash)
Nov 22 07:55:34 user nova-compute[74348]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)
Nov 22 07:55:34 user nova-compute[74348]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)
Nov 22 07:55:34 user nova-compute[74348]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)
Nov 22 07:55:34 user nova-compute[74348]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)
Nov 22 07:55:34 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:55:34 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)
Nov 22 07:55:34 user nova-compute[74348]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)
Nov 22 07:55:34 user nova-compute[74348]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa (non-flash)
Nov 22 07:55:34 user nova-compute[74348]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce (non-flash)
Nov 22 07:55:34 user nova-compute[74348]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)
Nov 22 07:55:34 user nova-compute[74348]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 (non-flash)
Nov 22 07:55:34 user nova-compute[74348]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)
Nov 22 07:55:34 user nova-compute[74348]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)
Nov 22 07:55:34 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:55:34 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f22550c2290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7'): ({'sdf'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Removing single pathed devices sdf {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:34 user nova-compute[74348]: INFO os_vif [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:70:d1,bridge_name='br-int',has_traffic_filtering=True,id=63fc17ce-ef08-4f7e-ab83-b1040733d228,network=Network(3f843b34-4601-4294-93d6-36cfbbf94a95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap63fc17ce-ef')
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-574357068',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-574357068',id=12,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPh8WrgN05Udth7XNATbD0Z+g0hoWMflQ1e+XdiOuBd1xLNGVHWp/bZGSnlbVFto/38wc6mSlPbrRK9XwiDx6Yn5HNC2pFZ8C7kB6aRkT1jiYcW2IxcpgmJM/7ZZJUwqcw==',key_name='tempest-keypair-436025460',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:54:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a08625e4d04478297484c875ac9a5c3',ramdisk_id='',reservation_id='r-7l9plp3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1955894791',owner_user_name='tempest-TaggedBootDevicesTest-1955894791-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T07:54:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d026e5b011144beb9340e6ceb58583f3',uuid=8527ae47-a025-492d-9820-b9c5ee309d81,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "969790c1-f8a4-4d98-86d9-1ed932c83daa", "address": "fa:16:3e:6d:21:36", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969790c1-f8", "ovs_interfaceid": "969790c1-f8a4-4d98-86d9-1ed932c83daa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Converting VIF {"id": "969790c1-f8a4-4d98-86d9-1ed932c83daa", "address": "fa:16:3e:6d:21:36", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969790c1-f8", "ovs_interfaceid": "969790c1-f8a4-4d98-86d9-1ed932c83daa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:21:36,bridge_name='br-int',has_traffic_filtering=True,id=969790c1-f8a4-4d98-86d9-1ed932c83daa,network=Network(3f843b34-4601-4294-93d6-36cfbbf94a95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap969790c1-f8') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_vif [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:21:36,bridge_name='br-int',has_traffic_filtering=True,id=969790c1-f8a4-4d98-86d9-1ed932c83daa,network=Network(3f843b34-4601-4294-93d6-36cfbbf94a95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap969790c1-f8') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap969790c1-f8, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d89d864-4a0d-4e1a-a39d-9feccb022422]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e93032ee-56bd-48be-8121-b0fd5273345e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e93032ee-56bd-48be-8121-b0fd5273345e/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7d43f2-3929-413f-8467-1e7e9ffcccef]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Flushing IO for device /dev/sdf {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f25ff883-8013-4c44-b4f5-b4e7dd03279c) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd5e38b-b23f-4c99-aaba-87489fc95c29]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:34 user nova-compute[74348]: INFO os_vif [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:21:36,bridge_name='br-int',has_traffic_filtering=True,id=969790c1-f8a4-4d98-86d9-1ed932c83daa,network=Network(3f843b34-4601-4294-93d6-36cfbbf94a95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap969790c1-f8')
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-574357068',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-574357068',id=12,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPh8WrgN05Udth7XNATbD0Z+g0hoWMflQ1e+XdiOuBd1xLNGVHWp/bZGSnlbVFto/38wc6mSlPbrRK9XwiDx6Yn5HNC2pFZ8C7kB6aRkT1jiYcW2IxcpgmJM/7ZZJUwqcw==',key_name='tempest-keypair-436025460',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:54:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a08625e4d04478297484c875ac9a5c3',ramdisk_id='',reservation_id='r-7l9plp3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1955894791',owner_user_name='tempest-TaggedBootDevicesTest-1955894791-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T07:54:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d026e5b011144beb9340e6ceb58583f3',uuid=8527ae47-a025-492d-9820-b9c5ee309d81,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "748e5281-27d7-43b4-ba47-2f0daed1181e", "address": "fa:16:3e:f9:d2:8f", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap748e5281-27", "ovs_interfaceid": "748e5281-27d7-43b4-ba47-2f0daed1181e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Converting VIF {"id": "748e5281-27d7-43b4-ba47-2f0daed1181e", "address": "fa:16:3e:f9:d2:8f", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap748e5281-27", "ovs_interfaceid": "748e5281-27d7-43b4-ba47-2f0daed1181e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:d2:8f,bridge_name='br-int',has_traffic_filtering=True,id=748e5281-27d7-43b4-ba47-2f0daed1181e,network=Network(3f843b34-4601-4294-93d6-36cfbbf94a95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap748e5281-27') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_vif [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:d2:8f,bridge_name='br-int',has_traffic_filtering=True,id=748e5281-27d7-43b4-ba47-2f0daed1181e,network=Network(3f843b34-4601-4294-93d6-36cfbbf94a95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap748e5281-27') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.compute.manager [req-e58efad3-a420-45fc-916e-3fa7bded04ad req-5d8cead0-6d8f-4d0f-88b1-41219b01b51e service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-vif-plugged-6221165b-f588-475c-a3b1-afdf5c60c113 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e58efad3-a420-45fc-916e-3fa7bded04ad req-5d8cead0-6d8f-4d0f-88b1-41219b01b51e service nova] Acquiring lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e58efad3-a420-45fc-916e-3fa7bded04ad req-5d8cead0-6d8f-4d0f-88b1-41219b01b51e service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e58efad3-a420-45fc-916e-3fa7bded04ad req-5d8cead0-6d8f-4d0f-88b1-41219b01b51e service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.compute.manager [req-e58efad3-a420-45fc-916e-3fa7bded04ad req-5d8cead0-6d8f-4d0f-88b1-41219b01b51e service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] No waiting events found dispatching network-vif-plugged-6221165b-f588-475c-a3b1-afdf5c60c113 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:55:34 user nova-compute[74348]: WARNING nova.compute.manager [req-e58efad3-a420-45fc-916e-3fa7bded04ad req-5d8cead0-6d8f-4d0f-88b1-41219b01b51e service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received unexpected event network-vif-plugged-6221165b-f588-475c-a3b1-afdf5c60c113 for instance with vm_state active and task_state deleting.
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.compute.manager [req-e58efad3-a420-45fc-916e-3fa7bded04ad req-5d8cead0-6d8f-4d0f-88b1-41219b01b51e service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-vif-unplugged-969790c1-f8a4-4d98-86d9-1ed932c83daa {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e58efad3-a420-45fc-916e-3fa7bded04ad req-5d8cead0-6d8f-4d0f-88b1-41219b01b51e service nova] Acquiring lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e58efad3-a420-45fc-916e-3fa7bded04ad req-5d8cead0-6d8f-4d0f-88b1-41219b01b51e service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e58efad3-a420-45fc-916e-3fa7bded04ad req-5d8cead0-6d8f-4d0f-88b1-41219b01b51e service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.compute.manager [req-e58efad3-a420-45fc-916e-3fa7bded04ad req-5d8cead0-6d8f-4d0f-88b1-41219b01b51e service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] No waiting events found dispatching network-vif-unplugged-969790c1-f8a4-4d98-86d9-1ed932c83daa {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.compute.manager [req-e58efad3-a420-45fc-916e-3fa7bded04ad req-5d8cead0-6d8f-4d0f-88b1-41219b01b51e service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-vif-unplugged-969790c1-f8a4-4d98-86d9-1ed932c83daa for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.compute.manager [req-e58efad3-a420-45fc-916e-3fa7bded04ad req-5d8cead0-6d8f-4d0f-88b1-41219b01b51e service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-vif-plugged-969790c1-f8a4-4d98-86d9-1ed932c83daa {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e58efad3-a420-45fc-916e-3fa7bded04ad req-5d8cead0-6d8f-4d0f-88b1-41219b01b51e service nova] Acquiring lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e58efad3-a420-45fc-916e-3fa7bded04ad req-5d8cead0-6d8f-4d0f-88b1-41219b01b51e service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e58efad3-a420-45fc-916e-3fa7bded04ad req-5d8cead0-6d8f-4d0f-88b1-41219b01b51e service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.compute.manager [req-e58efad3-a420-45fc-916e-3fa7bded04ad req-5d8cead0-6d8f-4d0f-88b1-41219b01b51e service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] No waiting events found dispatching network-vif-plugged-969790c1-f8a4-4d98-86d9-1ed932c83daa {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:55:34 user nova-compute[74348]: WARNING nova.compute.manager [req-e58efad3-a420-45fc-916e-3fa7bded04ad req-5d8cead0-6d8f-4d0f-88b1-41219b01b51e service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received unexpected event network-vif-plugged-969790c1-f8a4-4d98-86d9-1ed932c83daa for instance with vm_state active and task_state deleting.
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap748e5281-27, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.062s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2359a69-b168-4b8c-bf32-897adbbcdd27]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] SCSI volumes sdf have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a2500caf-1bea-41f9-bb0f-0c6c281abca3) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49f60f9-aa71-4bbd-8909-f3333f1f464f]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:34 user nova-compute[74348]: INFO os_vif [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:d2:8f,bridge_name='br-int',has_traffic_filtering=True,id=748e5281-27d7-43b4-ba47-2f0daed1181e,network=Network(3f843b34-4601-4294-93d6-36cfbbf94a95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap748e5281-27')
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-574357068',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-574357068',id=12,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPh8WrgN05Udth7XNATbD0Z+g0hoWMflQ1e+XdiOuBd1xLNGVHWp/bZGSnlbVFto/38wc6mSlPbrRK9XwiDx6Yn5HNC2pFZ8C7kB6aRkT1jiYcW2IxcpgmJM/7ZZJUwqcw==',key_name='tempest-keypair-436025460',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:54:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a08625e4d04478297484c875ac9a5c3',ramdisk_id='',reservation_id='r-7l9plp3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1955894791',owner_user_name='tempest-TaggedBootDevicesTest-1955894791-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T07:54:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d026e5b011144beb9340e6ceb58583f3',uuid=8527ae47-a025-492d-9820-b9c5ee309d81,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d77c2a03-a402-4288-8a40-2f88200a8f22", "address": "fa:16:3e:b2:36:f8", "network": {"id": "f39bd97a-26ce-4373-bf3b-ceb5c8dc21ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-224466528", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd77c2a03-a4", "ovs_interfaceid": "d77c2a03-a402-4288-8a40-2f88200a8f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Converting VIF {"id": "d77c2a03-a402-4288-8a40-2f88200a8f22", "address": "fa:16:3e:b2:36:f8", "network": {"id": "f39bd97a-26ce-4373-bf3b-ceb5c8dc21ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-224466528", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd77c2a03-a4", "ovs_interfaceid": "d77c2a03-a402-4288-8a40-2f88200a8f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:36:f8,bridge_name='br-int',has_traffic_filtering=True,id=d77c2a03-a402-4288-8a40-2f88200a8f22,network=Network(f39bd97a-26ce-4373-bf3b-ceb5c8dc21ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd77c2a03-a4') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_vif [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:36:f8,bridge_name='br-int',has_traffic_filtering=True,id=d77c2a03-a402-4288-8a40-2f88200a8f22,network=Network(f39bd97a-26ce-4373-bf3b-ceb5c8dc21ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd77c2a03-a4') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd77c2a03-a4, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=810312be-6602-4a14-98e7-d4b80644531b) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e93032ee-56bd-48be-8121-b0fd5273345e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdk (vdb) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:34 user nova-compute[74348]: INFO os_vif [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:36:f8,bridge_name='br-int',has_traffic_filtering=True,id=d77c2a03-a402-4288-8a40-2f88200a8f22,network=Network(f39bd97a-26ce-4373-bf3b-ceb5c8dc21ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd77c2a03-a4')
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-574357068',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-574357068',id=12,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPh8WrgN05Udth7XNATbD0Z+g0hoWMflQ1e+XdiOuBd1xLNGVHWp/bZGSnlbVFto/38wc6mSlPbrRK9XwiDx6Yn5HNC2pFZ8C7kB6aRkT1jiYcW2IxcpgmJM/7ZZJUwqcw==',key_name='tempest-keypair-436025460',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:54:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a08625e4d04478297484c875ac9a5c3',ramdisk_id='',reservation_id='r-7l9plp3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1955894791',owner_user_name='tempest-TaggedBootDevicesTest-1955894791-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T07:54:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d026e5b011144beb9340e6ceb58583f3',uuid=8527ae47-a025-492d-9820-b9c5ee309d81,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a64b4a32-73f1-4a48-8b80-86d353d1d40b", "address": "fa:16:3e:be:1c:23", "network": {"id": "f39bd97a-26ce-4373-bf3b-ceb5c8dc21ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-224466528", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64b4a32-73", "ovs_interfaceid": "a64b4a32-73f1-4a48-8b80-86d353d1d40b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Converting VIF {"id": "a64b4a32-73f1-4a48-8b80-86d353d1d40b", "address": "fa:16:3e:be:1c:23", "network": {"id": "f39bd97a-26ce-4373-bf3b-ceb5c8dc21ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-224466528", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64b4a32-73", "ovs_interfaceid": "a64b4a32-73f1-4a48-8b80-86d353d1d40b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:1c:23,bridge_name='br-int',has_traffic_filtering=True,id=a64b4a32-73f1-4a48-8b80-86d353d1d40b,network=Network(f39bd97a-26ce-4373-bf3b-ceb5c8dc21ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa64b4a32-73') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_vif [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:1c:23,bridge_name='br-int',has_traffic_filtering=True,id=a64b4a32-73f1-4a48-8b80-86d353d1d40b,network=Network(f39bd97a-26ce-4373-bf3b-ceb5c8dc21ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa64b4a32-73') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa64b4a32-73, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecbabf54-d2b4-47e0-9e50-60ba8e7e9094/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[300916a5-27c4-407c-8a4e-709086054982]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7, portal: 172.16.0.220,3260]
Nov 22 07:55:34 user nova-compute[74348]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7, portal: 172.16.0.220,3260] successful.
Nov 22 07:55:34 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=12bb5241-d61d-4e10-98f9-ae8f3cc7c2f9) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:34 user nova-compute[74348]: INFO os_vif [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:1c:23,bridge_name='br-int',has_traffic_filtering=True,id=a64b4a32-73f1-4a48-8b80-86d353d1d40b,network=Network(f39bd97a-26ce-4373-bf3b-ceb5c8dc21ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa64b4a32-73')
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sNkymoHE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:55:34 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a27ac02b-fae8-438b-a31e-8683997015c7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fea91ff-e651-4315-b743-44156fb9d0a7]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.430s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] <== disconnect_volume: return (432ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 07:55:34 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Deleting instance files /opt/stack/data/nova/instances/9e2f3a3e-ee9b-4250-8744-5eb7982285f2_del
Nov 22 07:55:34 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Deletion of /opt/stack/data/nova/instances/9e2f3a3e-ee9b-4250-8744-5eb7982285f2_del complete
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.032s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[68db2e9c-1a33-4601-91ad-3d89862efb74]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 07:55:34 user nova-compute[74348]: No targets found.
Nov 22 07:55:34 user nova-compute[74348]: iSNS:
Nov 22 07:55:34 user nova-compute[74348]: No targets found.
Nov 22 07:55:34 user nova-compute[74348]: STATIC:
Nov 22 07:55:34 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa
Nov 22 07:55:34 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:34 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:34 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223
Nov 22 07:55:34 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:34 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:34 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471
Nov 22 07:55:34 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:34 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:34 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce
Nov 22 07:55:34 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:34 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:34 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5
Nov 22 07:55:34 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:34 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:34 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968
Nov 22 07:55:34 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:34 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:34 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054
Nov 22 07:55:34 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:34 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:34 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799
Nov 22 07:55:34 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:34 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:34 user nova-compute[74348]: FIRMWARE:
Nov 22 07:55:34 user nova-compute[74348]: No targets found.
Nov 22 07:55:34 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 07:55:34 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 07:55:34 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4f36f5-9d96-48a3-a31a-8fd88bba5d40]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.compute.manager [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UDuTBVGO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e93032ee-56bd-48be-8121-b0fd5273345e', 'attached_at': '', 'detached_at': '', 'volume_id': 'deb39549-5f77-4381-9e9c-134511b33ced', 'serial': 'deb39549-5f77-4381-9e9c-134511b33ced'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mJansYWS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': 'e93032ee-56bd-48be-8121-b0fd5273345e', 'attached_at': '', 'detached_at': '', 'volume_id': 'c75e240f-f04a-4750-ac8d-81122d651471', 'serial'} {{(pid=74348) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 22 07:55:34 user nova-compute[74348]: INFO nova.compute.manager [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Took 5.35 seconds to destroy the instance on the hypervisor.
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecbabf54-d2b4-47e0-9e50-60ba8e7e9094/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecbabf54-d2b4-47e0-9e50-60ba8e7e9094/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2192afb-2a00-4b1f-870c-3bf7cd50b0eb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 07:55:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UDuTBVGO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:55:35 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:55:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)
Nov 22 07:55:35 user nova-compute[74348]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)
Nov 22 07:55:35 user nova-compute[74348]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa (non-flash)
Nov 22 07:55:35 user nova-compute[74348]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce (non-flash)
Nov 22 07:55:35 user nova-compute[74348]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)
Nov 22 07:55:35 user nova-compute[74348]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)
Nov 22 07:55:35 user nova-compute[74348]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)
Nov 22 07:55:35 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:55:35 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)
Nov 22 07:55:35 user nova-compute[74348]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)
Nov 22 07:55:35 user nova-compute[74348]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa (non-flash)
Nov 22 07:55:35 user nova-compute[74348]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce (non-flash)
Nov 22 07:55:35 user nova-compute[74348]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 (non-flash)
Nov 22 07:55:35 user nova-compute[74348]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)
Nov 22 07:55:35 user nova-compute[74348]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)
Nov 22 07:55:35 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:55:35 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f22285adc60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5'): ({'sde'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Removing single pathed devices sde {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f50b5b-9974-494b-9518-002a37bfa12d]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[012f6803-a45f-4904-a707-7ae603706f9b]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Flushing IO for device /dev/sde {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b051c11a-0762-40f8-a264-27f880cbdcff]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81623f0-d947-4e7c-953e-9cc04bcabb79]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] SCSI volumes sde have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[516b7329-5d0f-49f7-99c5-2dc43cc33f44]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecbabf54-d2b4-47e0-9e50-60ba8e7e9094/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e48a62-7037-4dfe-942d-3f472eea8fe9]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5, portal: 172.16.0.220,3260]
Nov 22 07:55:35 user nova-compute[74348]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5, portal: 172.16.0.220,3260] successful.
Nov 22 07:55:35 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7d26d2e-5794-43e8-b642-76b54ab2e6f5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[646e74ab-7a55-45ee-88e5-066aaf6602a7]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] <== disconnect_volume: return (427ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.262s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:55:35 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:55:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:55:35 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WPGKRcyT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:55:35 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:55:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:55:35 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-57b89f4f-dd17-4178-b754-469b198e76f1 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance da6aa6c0-2b77-49a5-9942-d6596ac4bd3f is timed out.
Nov 22 07:55:35 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-57b89f4f-dd17-4178-b754-469b198e76f1 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Successfully detached device sdc from instance da6aa6c0-2b77-49a5-9942-d6596ac4bd3f from the live domain config.
Nov 22 07:55:35 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57b89f4f-dd17-4178-b754-469b198e76f1 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-57b89f4f-dd17-4178-b754-469b198e76f1 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RJgzOPEi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:55:35 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-57b89f4f-dd17-4178-b754-469b198e76f1 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:55:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-57b89f4f-dd17-4178-b754-469b198e76f1 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bb3dcf-8256-475c-8594-8a6e496fd5af]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 07:55:35 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[442a3165-c2a8-4a97-aea2-563b0014b455]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced] added
Nov 22 07:55:35 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3ccd41-98e5-4801-aa52-744a06cc145f]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ff8c34-2d5e-4129-8780-2da32b26f522]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UDuTBVGO {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UDuTBVGO" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7b8afe-5082-4452-81e6-8521fb4693b7]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UDuTBVGO'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98908fb-58ac-404b-be6f-a738602676db]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd2c35f-e6bf-4313-ac59-81b036e3551f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)
Nov 22 07:55:35 user nova-compute[74348]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)
Nov 22 07:55:35 user nova-compute[74348]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa (non-flash)
Nov 22 07:55:35 user nova-compute[74348]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce (non-flash)
Nov 22 07:55:35 user nova-compute[74348]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:55:35 user nova-compute[74348]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)
Nov 22 07:55:35 user nova-compute[74348]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)
Nov 22 07:55:35 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:55:35 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)
Nov 22 07:55:35 user nova-compute[74348]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)
Nov 22 07:55:35 user nova-compute[74348]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa (non-flash)
Nov 22 07:55:35 user nova-compute[74348]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce (non-flash)
Nov 22 07:55:35 user nova-compute[74348]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:55:35 user nova-compute[74348]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)
Nov 22 07:55:35 user nova-compute[74348]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)
Nov 22 07:55:35 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:55:35 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG nova.compute.manager [req-d2e7c6c6-1441-4a61-a168-342858c4950f req-889b2b45-a981-4263-a205-0ac5226c4704 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-vif-plugged-63fc17ce-ef08-4f7e-ab83-b1040733d228 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d2e7c6c6-1441-4a61-a168-342858c4950f req-889b2b45-a981-4263-a205-0ac5226c4704 service nova] Acquiring lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d2e7c6c6-1441-4a61-a168-342858c4950f req-889b2b45-a981-4263-a205-0ac5226c4704 service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d2e7c6c6-1441-4a61-a168-342858c4950f req-889b2b45-a981-4263-a205-0ac5226c4704 service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG nova.compute.manager [req-d2e7c6c6-1441-4a61-a168-342858c4950f req-889b2b45-a981-4263-a205-0ac5226c4704 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] No waiting events found dispatching network-vif-plugged-63fc17ce-ef08-4f7e-ab83-b1040733d228 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:55:35 user nova-compute[74348]: WARNING nova.compute.manager [req-d2e7c6c6-1441-4a61-a168-342858c4950f req-889b2b45-a981-4263-a205-0ac5226c4704 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received unexpected event network-vif-plugged-63fc17ce-ef08-4f7e-ab83-b1040733d228 for instance with vm_state active and task_state deleting.
Nov 22 07:55:35 user nova-compute[74348]: DEBUG nova.compute.manager [req-d2e7c6c6-1441-4a61-a168-342858c4950f req-889b2b45-a981-4263-a205-0ac5226c4704 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-vif-unplugged-d77c2a03-a402-4288-8a40-2f88200a8f22 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d2e7c6c6-1441-4a61-a168-342858c4950f req-889b2b45-a981-4263-a205-0ac5226c4704 service nova] Acquiring lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d2e7c6c6-1441-4a61-a168-342858c4950f req-889b2b45-a981-4263-a205-0ac5226c4704 service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d2e7c6c6-1441-4a61-a168-342858c4950f req-889b2b45-a981-4263-a205-0ac5226c4704 service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG nova.compute.manager [req-d2e7c6c6-1441-4a61-a168-342858c4950f req-889b2b45-a981-4263-a205-0ac5226c4704 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] No waiting events found dispatching network-vif-unplugged-d77c2a03-a402-4288-8a40-2f88200a8f22 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG nova.compute.manager [req-d2e7c6c6-1441-4a61-a168-342858c4950f req-889b2b45-a981-4263-a205-0ac5226c4704 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-vif-unplugged-d77c2a03-a402-4288-8a40-2f88200a8f22 for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG nova.compute.manager [req-d2e7c6c6-1441-4a61-a168-342858c4950f req-889b2b45-a981-4263-a205-0ac5226c4704 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-vif-plugged-d77c2a03-a402-4288-8a40-2f88200a8f22 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d2e7c6c6-1441-4a61-a168-342858c4950f req-889b2b45-a981-4263-a205-0ac5226c4704 service nova] Acquiring lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d2e7c6c6-1441-4a61-a168-342858c4950f req-889b2b45-a981-4263-a205-0ac5226c4704 service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d2e7c6c6-1441-4a61-a168-342858c4950f req-889b2b45-a981-4263-a205-0ac5226c4704 service nova] Lock "8527ae47-a025-492d-9820-b9c5ee309d81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG nova.compute.manager [req-d2e7c6c6-1441-4a61-a168-342858c4950f req-889b2b45-a981-4263-a205-0ac5226c4704 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] No waiting events found dispatching network-vif-plugged-d77c2a03-a402-4288-8a40-2f88200a8f22 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:55:35 user nova-compute[74348]: WARNING nova.compute.manager [req-d2e7c6c6-1441-4a61-a168-342858c4950f req-889b2b45-a981-4263-a205-0ac5226c4704 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received unexpected event network-vif-plugged-d77c2a03-a402-4288-8a40-2f88200a8f22 for instance with vm_state active and task_state deleting.
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced -p 172.16.0.220:3260 --login" returned: 0 in 0.110s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[22594619-c834-4376-9c39-5cd21aceb76b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced, portal: 172.16.0.220,3260]
Nov 22 07:55:35 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced, portal: 172.16.0.220,3260] successful.
Nov 22 07:55:35 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.147s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[67fc41e7-a551-45a5-add9-9c3db3e597c9]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec7eea9-216f-407a-9a22-20c9862e210c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)
Nov 22 07:55:35 user nova-compute[74348]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)
Nov 22 07:55:35 user nova-compute[74348]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa (non-flash)
Nov 22 07:55:35 user nova-compute[74348]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce (non-flash)
Nov 22 07:55:35 user nova-compute[74348]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:55:35 user nova-compute[74348]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced (non-flash)
Nov 22 07:55:35 user nova-compute[74348]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)
Nov 22 07:55:35 user nova-compute[74348]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)
Nov 22 07:55:35 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:55:35 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)
Nov 22 07:55:35 user nova-compute[74348]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)
Nov 22 07:55:35 user nova-compute[74348]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa (non-flash)
Nov 22 07:55:35 user nova-compute[74348]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce (non-flash)
Nov 22 07:55:35 user nova-compute[74348]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:55:35 user nova-compute[74348]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced (non-flash)
Nov 22 07:55:35 user nova-compute[74348]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)
Nov 22 07:55:35 user nova-compute[74348]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)
Nov 22 07:55:35 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:55:35 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.573s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] HCTL ('35', '-', '-', 0) found on session 15 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c9cb1c-e7bc-4263-bc45-b92f39ad8602]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UDuTBVGO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 07:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:35 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Error from libvirt while getting description of instance-0000000b: [Error Code 42] Domain not found: no domain with matching uuid '9e2f3a3e-ee9b-4250-8744-5eb7982285f2' (instance-0000000b): libvirt.libvirtError: Domain not found: no domain with matching uuid '9e2f3a3e-ee9b-4250-8744-5eb7982285f2' (instance-0000000b)
Nov 22 07:55:36 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:55:36 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:55:36 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=6940MB free_disk=25.181686401367188GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 07:55:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:36 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 059bde4a-c5c9-45ab-9b4a-c969c74a6083 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:55:36 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 522f5959-4874-4c61-888d-6fb1cc4d72e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:55:36 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance bcedb385-b72a-49c2-b363-cf6da5804b60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:55:36 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance e36789b1-45e6-40f7-ba97-8962cb116a39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:55:36 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance da6aa6c0-2b77-49a5-9942-d6596ac4bd3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:55:36 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance e93032ee-56bd-48be-8121-b0fd5273345e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:55:36 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance bdad025e-8f6c-419a-99ea-bf277f6c5577 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:55:36 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 88730c14-fd2a-4f63-bc10-96cea0b057eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:55:36 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance abd7f2ed-b0c4-4e05-8161-b141a611f125 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:55:36 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 9e2f3a3e-ee9b-4250-8744-5eb7982285f2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:55:36 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 8527ae47-a025-492d-9820-b9c5ee309d81 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:55:36 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance e042fd98-eb22-4c6e-9eec-4bb0908fd5ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:55:36 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance ecbabf54-d2b4-47e0-9e50-60ba8e7e9094 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:55:36 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 07:55:36 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 07:55:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.633s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:55:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] <== connect_volume: return (1895ms) {'type': 'block', 'scsi_wwn': '23935356431323238', 'path': '/dev/sdd'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:55:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935356431323238', 'path': '/dev/sdd'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 07:55:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.625s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:55:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:36 user nova-compute[74348]: DEBUG nova.objects.instance [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Lazy-loading 'flavor' on Instance uuid e93032ee-56bd-48be-8121-b0fd5273345e {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:55:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:36 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[614ad403-5019-4c4c-b7c8-5a1fb6b10a54]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 07:55:36 user nova-compute[74348]: No targets found.
Nov 22 07:55:36 user nova-compute[74348]: iSNS:
Nov 22 07:55:36 user nova-compute[74348]: No targets found.
Nov 22 07:55:36 user nova-compute[74348]: STATIC:
Nov 22 07:55:36 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa
Nov 22 07:55:36 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:36 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:36 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223
Nov 22 07:55:36 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:36 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:36 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471
Nov 22 07:55:36 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:36 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:36 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce
Nov 22 07:55:36 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:36 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:36 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced
Nov 22 07:55:36 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:36 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:36 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af
Nov 22 07:55:36 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:36 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:36 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968
Nov 22 07:55:36 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:36 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:36 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054
Nov 22 07:55:36 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:36 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:36 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799
Nov 22 07:55:36 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:36 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:36 user nova-compute[74348]: FIRMWARE:
Nov 22 07:55:36 user nova-compute[74348]: No targets found.
Nov 22 07:55:36 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:55:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 07:55:36 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 07:55:36 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 07:55:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 07:55:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:36 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b540ba-7fa8-44b7-8392-93ce9c9b095e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:36 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac4ab7b-252a-4d30-a6ce-07205bc1c448]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)
Nov 22 07:55:36 user nova-compute[74348]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)
Nov 22 07:55:36 user nova-compute[74348]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa (non-flash)
Nov 22 07:55:36 user nova-compute[74348]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce (non-flash)
Nov 22 07:55:36 user nova-compute[74348]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:55:36 user nova-compute[74348]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced (non-flash)
Nov 22 07:55:36 user nova-compute[74348]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)
Nov 22 07:55:36 user nova-compute[74348]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)
Nov 22 07:55:36 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:55:36 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:55:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)
Nov 22 07:55:36 user nova-compute[74348]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)
Nov 22 07:55:36 user nova-compute[74348]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa (non-flash)
Nov 22 07:55:36 user nova-compute[74348]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce (non-flash)
Nov 22 07:55:36 user nova-compute[74348]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:55:36 user nova-compute[74348]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced (non-flash)
Nov 22 07:55:36 user nova-compute[74348]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 (non-flash)
Nov 22 07:55:36 user nova-compute[74348]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)
Nov 22 07:55:36 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:55:36 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f224c4f2c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054'): ({'sdg'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Removing single pathed devices sdg {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8f4532-8714-4ef6-abce-3419a3d3e176]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d483409a-6b86-45e1-aa45-77c53e4d003d]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Flushing IO for device /dev/sdg {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa86f36c-0384-418b-9851-a63dc0f69fd7]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.045s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cfe852e-8412-46db-995a-a40bf71e0dcf]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] SCSI volumes sdg have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6823084-17fa-4913-a769-b0e64b9e83ed]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG nova.compute.manager [req-4892993f-e3c0-470f-acfa-eb7ea683f4e9 req-ac4e990e-ec8b-4829-a610-fe83a4753ed6 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-vif-deleted-5a68d2be-be4c-462b-9dd4-15e222160557 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:37 user nova-compute[74348]: INFO nova.compute.manager [req-4892993f-e3c0-470f-acfa-eb7ea683f4e9 req-ac4e990e-ec8b-4829-a610-fe83a4753ed6 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Neutron deleted interface 5a68d2be-be4c-462b-9dd4-15e222160557; detaching it from the instance and deleting it from the info cache
Nov 22 07:55:37 user nova-compute[74348]: DEBUG nova.network.neutron [req-4892993f-e3c0-470f-acfa-eb7ea683f4e9 req-ac4e990e-ec8b-4829-a610-fe83a4753ed6 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Updating instance_info_cache with network_info: [{"id": "4a8ea7e1-9e80-4686-a3a9-4142b9de0049", "address": "fa:16:3e:7e:13:ad", "network": {"id": "c9f2b2b7-e34f-4891-b68c-786534d7ed95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-766683782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8ea7e1-9e", "ovs_interfaceid": "4a8ea7e1-9e80-4686-a3a9-4142b9de0049", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e30deaf5-1258-4909-bc71-044c88f2995f", "address": "fa:16:3e:c8:34:fc", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30deaf5-12", "ovs_interfaceid": "e30deaf5-1258-4909-bc71-044c88f2995f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "298ce71b-894a-4e29-904e-1ba5d4495fcb", "address": "fa:16:3e:b3:83:8f", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298ce71b-89", "ovs_interfaceid": "298ce71b-894a-4e29-904e-1ba5d4495fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f0f55187-e53f-468d-83a8-cca33ff1380e", "address": "fa:16:3e:8d:36:2e", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f55187-e5", "ovs_interfaceid": "f0f55187-e53f-468d-83a8-cca33ff1380e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9aa74044-d952-47e5-9cc1-948615a01eb3", "address": "fa:16:3e:6d:8e:f9", "network": {"id": "7f9b7b76-9f0d-4fbd-90c9-6ceee5e0c50e", "bridge": "br-int", "label": "tempest-device-tagging-net2-487890789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aa74044-d9", "ovs_interfaceid": "9aa74044-d952-47e5-9cc1-948615a01eb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "579fb42b-b8b6-4122-8ec3-8817c9e0881a", "address": "fa:16:3e:06:8e:e5", "network": {"id": "7f9b7b76-9f0d-4fbd-90c9-6ceee5e0c50e", "bridge": "br-int", "label": "tempest-device-tagging-net2-487890789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap579fb42b-b8", "ovs_interfaceid": "579fb42b-b8b6-4122-8ec3-8817c9e0881a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG nova.compute.manager [req-4892993f-e3c0-470f-acfa-eb7ea683f4e9 req-ac4e990e-ec8b-4829-a610-fe83a4753ed6 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Detach interface failed, port_id=5a68d2be-be4c-462b-9dd4-15e222160557, reason: Instance 9e2f3a3e-ee9b-4250-8744-5eb7982285f2 could not be found. {{(pid=74348) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[39926823-e65b-47b2-b8ab-df3b395a756e]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054, portal: 172.16.0.220,3260]
Nov 22 07:55:37 user nova-compute[74348]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054, portal: 172.16.0.220,3260] successful.
Nov 22 07:55:37 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5f5253-e3b6-4ba1-b9e7-df518d4ad054 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3efe658-7b7a-4c23-8902-6c802a2c5281]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.414s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] <== disconnect_volume: return (2039ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-57b89f4f-dd17-4178-b754-469b198e76f1 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.020s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ptBeJEUv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:55:37 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:55:37 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.628s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[521807ba-1770-40b9-a586-86a92016afaf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-57b89f4f-dd17-4178-b754-469b198e76f1 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 07:55:37 user nova-compute[74348]: No targets found.
Nov 22 07:55:37 user nova-compute[74348]: iSNS:
Nov 22 07:55:37 user nova-compute[74348]: No targets found.
Nov 22 07:55:37 user nova-compute[74348]: STATIC:
Nov 22 07:55:37 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa
Nov 22 07:55:37 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:37 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:37 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223
Nov 22 07:55:37 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:37 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:37 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471
Nov 22 07:55:37 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:37 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:37 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce
Nov 22 07:55:37 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:37 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:37 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced
Nov 22 07:55:37 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:37 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:37 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af
Nov 22 07:55:37 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:37 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:37 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968
Nov 22 07:55:37 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:37 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:37 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799
Nov 22 07:55:37 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:37 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:37 user nova-compute[74348]: FIRMWARE:
Nov 22 07:55:37 user nova-compute[74348]: No targets found.
Nov 22 07:55:37 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-57b89f4f-dd17-4178-b754-469b198e76f1 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 07:55:37 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 07:55:37 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-57b89f4f-dd17-4178-b754-469b198e76f1 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] COPY block job progress, current cursor: 9437184 final cursor: 1073741824 {{(pid=74348) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5f385d-de0b-486f-90b9-d35c64a6d46a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5919c8-0a73-4fce-b6e4-2815ba4bd55f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-57b89f4f-dd17-4178-b754-469b198e76f1 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)
Nov 22 07:55:37 user nova-compute[74348]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)
Nov 22 07:55:37 user nova-compute[74348]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa (non-flash)
Nov 22 07:55:37 user nova-compute[74348]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce (non-flash)
Nov 22 07:55:37 user nova-compute[74348]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:55:37 user nova-compute[74348]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced (non-flash)
Nov 22 07:55:37 user nova-compute[74348]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)
Nov 22 07:55:37 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:55:37 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-57b89f4f-dd17-4178-b754-469b198e76f1 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 (non-flash)
Nov 22 07:55:37 user nova-compute[74348]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)
Nov 22 07:55:37 user nova-compute[74348]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa (non-flash)
Nov 22 07:55:37 user nova-compute[74348]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce (non-flash)
Nov 22 07:55:37 user nova-compute[74348]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:55:37 user nova-compute[74348]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced (non-flash)
Nov 22 07:55:37 user nova-compute[74348]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)
Nov 22 07:55:37 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:55:37 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-57b89f4f-dd17-4178-b754-469b198e76f1 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f224c2c9750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968'): ({'sdj'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-57b89f4f-dd17-4178-b754-469b198e76f1 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Removing single pathed devices sdj {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1ae467-f8fd-453f-80b7-4998d9e696e3]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f39d07-58ab-438b-9cf8-9196f720c9bc]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-57b89f4f-dd17-4178-b754-469b198e76f1 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Flushing IO for device /dev/sdj {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[71aad6fd-9066-49a5-88ca-f916b1f2eee1]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-57b89f4f-dd17-4178-b754-469b198e76f1 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.055s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd120a55-eb7a-451c-8dee-6226137b4b2d]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-57b89f4f-dd17-4178-b754-469b198e76f1 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-57b89f4f-dd17-4178-b754-469b198e76f1 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] SCSI volumes sdj have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-57b89f4f-dd17-4178-b754-469b198e76f1 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7d5b3a-370c-45c0-8991-2306368bdc31]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-57b89f4f-dd17-4178-b754-469b198e76f1 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 -p 172.16.0.220:3260 --logout" returned: 0 in 0.102s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d035c411-78c5-4657-8b93-8b2dfc90514a]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-57b89f4f-dd17-4178-b754-469b198e76f1 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968, portal: 172.16.0.220,3260]
Nov 22 07:55:37 user nova-compute[74348]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968, portal: 172.16.0.220,3260] successful.
Nov 22 07:55:37 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24c1a275-27a0-4ffd-8cb8-83b9a76a3968 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.049s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b19307e-556c-4a97-a170-8a256c4f5638]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-57b89f4f-dd17-4178-b754-469b198e76f1 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-57b89f4f-dd17-4178-b754-469b198e76f1 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.460s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-57b89f4f-dd17-4178-b754-469b198e76f1 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] <== disconnect_volume: return (2479ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57b89f4f-dd17-4178-b754-469b198e76f1 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.461s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f32625-4ca0-4c7f-8f16-15cd7e436a68]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 07:55:37 user nova-compute[74348]: No targets found.
Nov 22 07:55:37 user nova-compute[74348]: iSNS:
Nov 22 07:55:37 user nova-compute[74348]: No targets found.
Nov 22 07:55:37 user nova-compute[74348]: STATIC:
Nov 22 07:55:37 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa
Nov 22 07:55:37 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:37 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:37 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223
Nov 22 07:55:37 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:37 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:37 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471
Nov 22 07:55:37 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:37 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:37 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce
Nov 22 07:55:37 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:37 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:37 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced
Nov 22 07:55:37 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:37 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:37 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af
Nov 22 07:55:37 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:37 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:37 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799
Nov 22 07:55:37 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:37 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:37 user nova-compute[74348]: FIRMWARE:
Nov 22 07:55:37 user nova-compute[74348]: No targets found.
Nov 22 07:55:37 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 07:55:37 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 07:55:37 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[44cb0c33-d4f6-44b1-a21c-946126c222ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a12e3c0-8bee-4f3d-aaee-9f44665fe82b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)
Nov 22 07:55:37 user nova-compute[74348]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa (non-flash)
Nov 22 07:55:37 user nova-compute[74348]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce (non-flash)
Nov 22 07:55:37 user nova-compute[74348]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:55:37 user nova-compute[74348]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced (non-flash)
Nov 22 07:55:37 user nova-compute[74348]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)
Nov 22 07:55:37 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:55:37 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)
Nov 22 07:55:37 user nova-compute[74348]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa (non-flash)
Nov 22 07:55:37 user nova-compute[74348]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce (non-flash)
Nov 22 07:55:37 user nova-compute[74348]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:55:37 user nova-compute[74348]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced (non-flash)
Nov 22 07:55:37 user nova-compute[74348]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 (non-flash)
Nov 22 07:55:37 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:55:37 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f22285bc5e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799'): ({'sdh'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Removing single pathed devices sdh {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] COPY block job progress, current cursor: 177209344 final cursor: 1073741824 {{(pid=74348) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c74bbc-59f9-47c1-a98f-80215057ba7c]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8dd018-50ec-40a2-ad95-3af41884fd11]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Flushing IO for device /dev/sdh {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[583adec8-aa15-4e84-888e-8806c4edce23]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 07:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.042s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:38 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4052a0c8-f7cd-452d-adfe-1261e2874a29]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:38 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 07:55:38 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] SCSI volumes sdh have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 07:55:38 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 07:55:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:38 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ec5a22-40d0-4190-80ea-62a1adfc880e]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:38 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 -p 172.16.0.220:3260 --logout" returned: 0 in 0.197s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:38 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ed1e97-0d27-4b8e-91fe-5739996523a4]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:38 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799, portal: 172.16.0.220,3260]
Nov 22 07:55:38 user nova-compute[74348]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799, portal: 172.16.0.220,3260] successful.
Nov 22 07:55:38 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe1c9310-8a44-4188-8500-088ec8cd7799 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:38 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f39947-f967-482e-8f79-74e53ab3f2e6]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:38 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:38 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.529s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:55:38 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] <== disconnect_volume: return (990ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:55:38 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 07:55:38 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Deleting instance files /opt/stack/data/nova/instances/8527ae47-a025-492d-9820-b9c5ee309d81_del
Nov 22 07:55:38 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Deletion of /opt/stack/data/nova/instances/8527ae47-a025-492d-9820-b9c5ee309d81_del complete
Nov 22 07:55:38 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:55:38 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:55:38 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:55:38 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:55:38 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 07:55:38 user nova-compute[74348]: INFO nova.compute.manager [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Took 6.21 seconds to destroy the instance on the hypervisor.
Nov 22 07:55:38 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 07:55:38 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 07:55:38 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 07:55:38 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] COPY block job progress, current cursor: 230686720 final cursor: 1073741824 {{(pid=74348) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 07:55:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:38 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] COPY block job progress, current cursor: 413138944 final cursor: 1073741824 {{(pid=74348) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 07:55:39 user nova-compute[74348]: DEBUG nova.compute.manager [req-02aaa6c4-a4de-4791-bbcf-cfa57a6c16ec req-4f000442-058c-4447-b836-7b556ac13ec6 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-vif-deleted-4a8ea7e1-9e80-4686-a3a9-4142b9de0049 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:39 user nova-compute[74348]: INFO nova.compute.manager [req-02aaa6c4-a4de-4791-bbcf-cfa57a6c16ec req-4f000442-058c-4447-b836-7b556ac13ec6 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Neutron deleted interface 4a8ea7e1-9e80-4686-a3a9-4142b9de0049; detaching it from the instance and deleting it from the info cache
Nov 22 07:55:39 user nova-compute[74348]: DEBUG nova.network.neutron [req-02aaa6c4-a4de-4791-bbcf-cfa57a6c16ec req-4f000442-058c-4447-b836-7b556ac13ec6 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Updating instance_info_cache with network_info: [{"id": "e30deaf5-1258-4909-bc71-044c88f2995f", "address": "fa:16:3e:c8:34:fc", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30deaf5-12", "ovs_interfaceid": "e30deaf5-1258-4909-bc71-044c88f2995f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "298ce71b-894a-4e29-904e-1ba5d4495fcb", "address": "fa:16:3e:b3:83:8f", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298ce71b-89", "ovs_interfaceid": "298ce71b-894a-4e29-904e-1ba5d4495fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f0f55187-e53f-468d-83a8-cca33ff1380e", "address": "fa:16:3e:8d:36:2e", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f55187-e5", "ovs_interfaceid": "f0f55187-e53f-468d-83a8-cca33ff1380e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9aa74044-d952-47e5-9cc1-948615a01eb3", "address": "fa:16:3e:6d:8e:f9", "network": {"id": "7f9b7b76-9f0d-4fbd-90c9-6ceee5e0c50e", "bridge": "br-int", "label": "tempest-device-tagging-net2-487890789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aa74044-d9", "ovs_interfaceid": "9aa74044-d952-47e5-9cc1-948615a01eb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "579fb42b-b8b6-4122-8ec3-8817c9e0881a", "address": "fa:16:3e:06:8e:e5", "network": {"id": "7f9b7b76-9f0d-4fbd-90c9-6ceee5e0c50e", "bridge": "br-int", "label": "tempest-device-tagging-net2-487890789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap579fb42b-b8", "ovs_interfaceid": "579fb42b-b8b6-4122-8ec3-8817c9e0881a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:55:39 user nova-compute[74348]: DEBUG nova.compute.manager [req-02aaa6c4-a4de-4791-bbcf-cfa57a6c16ec req-4f000442-058c-4447-b836-7b556ac13ec6 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Detach interface failed, port_id=4a8ea7e1-9e80-4686-a3a9-4142b9de0049, reason: Instance 9e2f3a3e-ee9b-4250-8744-5eb7982285f2 could not be found. {{(pid=74348) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 07:55:39 user nova-compute[74348]: DEBUG nova.compute.manager [req-02aaa6c4-a4de-4791-bbcf-cfa57a6c16ec req-4f000442-058c-4447-b836-7b556ac13ec6 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-vif-deleted-9aa74044-d952-47e5-9cc1-948615a01eb3 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:39 user nova-compute[74348]: INFO nova.compute.manager [req-02aaa6c4-a4de-4791-bbcf-cfa57a6c16ec req-4f000442-058c-4447-b836-7b556ac13ec6 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Neutron deleted interface 9aa74044-d952-47e5-9cc1-948615a01eb3; detaching it from the instance and deleting it from the info cache
Nov 22 07:55:39 user nova-compute[74348]: DEBUG nova.network.neutron [req-02aaa6c4-a4de-4791-bbcf-cfa57a6c16ec req-4f000442-058c-4447-b836-7b556ac13ec6 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Updating instance_info_cache with network_info: [{"id": "e30deaf5-1258-4909-bc71-044c88f2995f", "address": "fa:16:3e:c8:34:fc", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30deaf5-12", "ovs_interfaceid": "e30deaf5-1258-4909-bc71-044c88f2995f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "298ce71b-894a-4e29-904e-1ba5d4495fcb", "address": "fa:16:3e:b3:83:8f", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298ce71b-89", "ovs_interfaceid": "298ce71b-894a-4e29-904e-1ba5d4495fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f0f55187-e53f-468d-83a8-cca33ff1380e", "address": "fa:16:3e:8d:36:2e", "network": {"id": "fc6897f6-ca20-4f4e-9e55-a61241ccd39f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1496206093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f55187-e5", "ovs_interfaceid": "f0f55187-e53f-468d-83a8-cca33ff1380e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "579fb42b-b8b6-4122-8ec3-8817c9e0881a", "address": "fa:16:3e:06:8e:e5", "network": {"id": "7f9b7b76-9f0d-4fbd-90c9-6ceee5e0c50e", "bridge": "br-int", "label": "tempest-device-tagging-net2-487890789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c8d9889b4c704e2c9370420262898383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap579fb42b-b8", "ovs_interfaceid": "579fb42b-b8b6-4122-8ec3-8817c9e0881a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:55:39 user nova-compute[74348]: DEBUG nova.objects.instance [None req-57b89f4f-dd17-4178-b754-469b198e76f1 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Lazy-loading 'flavor' on Instance uuid da6aa6c0-2b77-49a5-9942-d6596ac4bd3f {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:55:39 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] COPY block job progress, current cursor: 571473920 final cursor: 1073741824 {{(pid=74348) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 07:55:39 user nova-compute[74348]: DEBUG nova.compute.manager [req-02aaa6c4-a4de-4791-bbcf-cfa57a6c16ec req-4f000442-058c-4447-b836-7b556ac13ec6 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Detach interface failed, port_id=9aa74044-d952-47e5-9cc1-948615a01eb3, reason: Instance 9e2f3a3e-ee9b-4250-8744-5eb7982285f2 could not be found. {{(pid=74348) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 07:55:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-57b89f4f-dd17-4178-b754-469b198e76f1 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Lock "da6aa6c0-2b77-49a5-9942-d6596ac4bd3f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.015s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:39 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:39 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] COPY block job progress, current cursor: 725614592 final cursor: 1073741824 {{(pid=74348) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 07:55:40 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] COPY block job progress, current cursor: 887095296 final cursor: 1073741824 {{(pid=74348) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 07:55:40 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] COPY block job progress, current cursor: 952107008 final cursor: 1073741824 {{(pid=74348) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 07:55:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b028bbec-80a9-4988-873b-b86d617a25c2 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Acquiring lock "da6aa6c0-2b77-49a5-9942-d6596ac4bd3f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b028bbec-80a9-4988-873b-b86d617a25c2 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Lock "da6aa6c0-2b77-49a5-9942-d6596ac4bd3f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b028bbec-80a9-4988-873b-b86d617a25c2 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Acquiring lock "da6aa6c0-2b77-49a5-9942-d6596ac4bd3f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b028bbec-80a9-4988-873b-b86d617a25c2 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Lock "da6aa6c0-2b77-49a5-9942-d6596ac4bd3f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b028bbec-80a9-4988-873b-b86d617a25c2 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Lock "da6aa6c0-2b77-49a5-9942-d6596ac4bd3f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:41 user nova-compute[74348]: INFO nova.compute.manager [None req-b028bbec-80a9-4988-873b-b86d617a25c2 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Terminating instance
Nov 22 07:55:41 user nova-compute[74348]: DEBUG nova.compute.manager [None req-b028bbec-80a9-4988-873b-b86d617a25c2 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 07:55:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:41 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:55:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:41 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Took 6.44 seconds to deallocate network for instance.
Nov 22 07:55:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:41 user nova-compute[74348]: DEBUG nova.compute.manager [req-65b31522-7f50-43b9-8639-389010e84dd9 req-15520ae2-57c5-4d9b-bafc-f0e464b71145 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-vif-deleted-f0f55187-e53f-468d-83a8-cca33ff1380e {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:41 user nova-compute[74348]: DEBUG nova.compute.manager [req-65b31522-7f50-43b9-8639-389010e84dd9 req-15520ae2-57c5-4d9b-bafc-f0e464b71145 service nova] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Received event network-vif-deleted-579fb42b-b8b6-4122-8ec3-8817c9e0881a {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:41 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] COPY block job progress, current cursor: 995098624 final cursor: 1073741824 {{(pid=74348) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 07:55:41 user nova-compute[74348]: DEBUG nova.compute.manager [req-e7393e4c-7efd-48bf-ba72-0b9453dfb867 req-307795b3-f8d4-49be-b0f2-ee3d8003b7b0 service nova] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Received event network-vif-unplugged-c870c926-d416-4c0c-8fcc-873ce1c3b14e {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e7393e4c-7efd-48bf-ba72-0b9453dfb867 req-307795b3-f8d4-49be-b0f2-ee3d8003b7b0 service nova] Acquiring lock "da6aa6c0-2b77-49a5-9942-d6596ac4bd3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e7393e4c-7efd-48bf-ba72-0b9453dfb867 req-307795b3-f8d4-49be-b0f2-ee3d8003b7b0 service nova] Lock "da6aa6c0-2b77-49a5-9942-d6596ac4bd3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e7393e4c-7efd-48bf-ba72-0b9453dfb867 req-307795b3-f8d4-49be-b0f2-ee3d8003b7b0 service nova] Lock "da6aa6c0-2b77-49a5-9942-d6596ac4bd3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:41 user nova-compute[74348]: DEBUG nova.compute.manager [req-e7393e4c-7efd-48bf-ba72-0b9453dfb867 req-307795b3-f8d4-49be-b0f2-ee3d8003b7b0 service nova] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] No waiting events found dispatching network-vif-unplugged-c870c926-d416-4c0c-8fcc-873ce1c3b14e {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:55:41 user nova-compute[74348]: DEBUG nova.compute.manager [req-e7393e4c-7efd-48bf-ba72-0b9453dfb867 req-307795b3-f8d4-49be-b0f2-ee3d8003b7b0 service nova] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Received event network-vif-unplugged-c870c926-d416-4c0c-8fcc-873ce1c3b14e for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 07:55:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:41 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Instance destroyed successfully.
Nov 22 07:55:41 user nova-compute[74348]: DEBUG nova.objects.instance [None req-b028bbec-80a9-4988-873b-b86d617a25c2 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Lazy-loading 'resources' on Instance uuid da6aa6c0-2b77-49a5-9942-d6596ac4bd3f {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:55:41 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] COPY block job progress, current cursor: 995098624 final cursor: 1073741824 {{(pid=74348) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 07:55:41 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-b028bbec-80a9-4988-873b-b86d617a25c2 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:52:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1123505270',display_name='tempest-AttachSCSIVolumeTestJSON-server-1123505270',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1123505270',id=6,image_ref='1be7b361-9f4d-4af0-958c-ab6c87e0a8b5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtih7HZpvV+FMcBBM8F22aAkTErmhOyjqz9PaNsThpRcocRH2o3aFn4nQVw2aESc0yTlKXAOt60y02JARrEp+w+xh/OUBybCM6VugB3NIx5yH1cGOrE05w6tw5kqwYV5g==',key_name='tempest-keypair-1731144104',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:53:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ebae3234a914be89750e24861ca1166',ramdisk_id='',reservation_id='r-h8izt0dx',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1be7b361-9f4d-4af0-958c-ab6c87e0a8b5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1796317290',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1796317290-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T07:53:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a4ce1cfe834401b8447059330f357fa',uuid=da6aa6c0-2b77-49a5-9942-d6596ac4bd3f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c870c926-d416-4c0c-8fcc-873ce1c3b14e", "address": "fa:16:3e:06:64:68", "network": {"id": "e3c8d160-d362-47c0-9373-7b90d08587d1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1245990371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ebae3234a914be89750e24861ca1166", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc870c926-d4", "ovs_interfaceid": "c870c926-d416-4c0c-8fcc-873ce1c3b14e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 07:55:41 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-b028bbec-80a9-4988-873b-b86d617a25c2 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Converting VIF {"id": "c870c926-d416-4c0c-8fcc-873ce1c3b14e", "address": "fa:16:3e:06:64:68", "network": {"id": "e3c8d160-d362-47c0-9373-7b90d08587d1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1245990371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ebae3234a914be89750e24861ca1166", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc870c926-d4", "ovs_interfaceid": "c870c926-d416-4c0c-8fcc-873ce1c3b14e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:55:41 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-b028bbec-80a9-4988-873b-b86d617a25c2 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:64:68,bridge_name='br-int',has_traffic_filtering=True,id=c870c926-d416-4c0c-8fcc-873ce1c3b14e,network=Network(e3c8d160-d362-47c0-9373-7b90d08587d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc870c926-d4') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:55:41 user nova-compute[74348]: DEBUG os_vif [None req-b028bbec-80a9-4988-873b-b86d617a25c2 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:64:68,bridge_name='br-int',has_traffic_filtering=True,id=c870c926-d416-4c0c-8fcc-873ce1c3b14e,network=Network(e3c8d160-d362-47c0-9373-7b90d08587d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc870c926-d4') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 07:55:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc870c926-d4, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:55:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=42f9cf1f-b226-4610-bb4e-c6e78b13a32a) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:55:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:42 user nova-compute[74348]: INFO os_vif [None req-b028bbec-80a9-4988-873b-b86d617a25c2 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:64:68,bridge_name='br-int',has_traffic_filtering=True,id=c870c926-d416-4c0c-8fcc-873ce1c3b14e,network=Network(e3c8d160-d362-47c0-9373-7b90d08587d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc870c926-d4')
Nov 22 07:55:42 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-b028bbec-80a9-4988-873b-b86d617a25c2 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Deleting instance files /opt/stack/data/nova/instances/da6aa6c0-2b77-49a5-9942-d6596ac4bd3f_del
Nov 22 07:55:42 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-b028bbec-80a9-4988-873b-b86d617a25c2 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Deletion of /opt/stack/data/nova/instances/da6aa6c0-2b77-49a5-9942-d6596ac4bd3f_del complete
Nov 22 07:55:42 user nova-compute[74348]: INFO nova.compute.manager [None req-b028bbec-80a9-4988-873b-b86d617a25c2 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Took 1.04 seconds to destroy the instance on the hypervisor.
Nov 22 07:55:42 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-b028bbec-80a9-4988-873b-b86d617a25c2 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74348) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mJansYWS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:55:42 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:55:42 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d031d6-05e5-443d-9144-f4afd0e31e7c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 07:55:42 user nova-compute[74348]: No targets found.
Nov 22 07:55:42 user nova-compute[74348]: iSNS:
Nov 22 07:55:42 user nova-compute[74348]: No targets found.
Nov 22 07:55:42 user nova-compute[74348]: STATIC:
Nov 22 07:55:42 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa
Nov 22 07:55:42 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:42 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:42 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223
Nov 22 07:55:42 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:42 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:42 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471
Nov 22 07:55:42 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:42 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:42 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce
Nov 22 07:55:42 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:42 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:42 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced
Nov 22 07:55:42 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:42 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:42 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af
Nov 22 07:55:42 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:42 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:42 user nova-compute[74348]: FIRMWARE:
Nov 22 07:55:42 user nova-compute[74348]: No targets found.
Nov 22 07:55:42 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 07:55:42 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 07:55:42 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90fe8d7-943c-4f1b-8d38-994c06dbbd56]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7fc9cc-831f-4659-bde3-2245d9ed76ef]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)
Nov 22 07:55:42 user nova-compute[74348]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa (non-flash)
Nov 22 07:55:42 user nova-compute[74348]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce (non-flash)
Nov 22 07:55:42 user nova-compute[74348]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:55:42 user nova-compute[74348]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced (non-flash)
Nov 22 07:55:42 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:55:42 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)
Nov 22 07:55:42 user nova-compute[74348]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa (non-flash)
Nov 22 07:55:42 user nova-compute[74348]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce (non-flash)
Nov 22 07:55:42 user nova-compute[74348]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:55:42 user nova-compute[74348]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced (non-flash)
Nov 22 07:55:42 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:55:42 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f224c39fac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471'): ({'sdk'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Removing single pathed devices sdk {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f23fae-bb29-4d11-9fb6-752b223afe99]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[af73f303-165a-4bfd-ba60-97da26c321fb]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Flushing IO for device /dev/sdk {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.013s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73df9c3-72fd-42ab-8417-4af8c30e3c9a]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.051s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8132d2b8-172a-4bb0-872c-5d6c4a7a7704]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] SCSI volumes sdk have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[435acbe4-6e24-4cde-812b-7939b0e78084]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[236083e2-0d87-4c61-a4a5-8ff7ba4bce4b]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471, portal: 172.16.0.220,3260]
Nov 22 07:55:42 user nova-compute[74348]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471, portal: 172.16.0.220,3260] successful.
Nov 22 07:55:42 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53941af-a7e2-4802-b5a4-aba0f6f9f024]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] <== disconnect_volume: return (341ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:55:42 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 07:55:43 user nova-compute[74348]: DEBUG nova.compute.manager [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UDuTBVGO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'e93032ee-56bd-48be-8121-b0fd5273345e', 'attached_at': '', 'detached_at': '', 'volume_id': 'deb39549-5f77-4381-9e9c-134511b33ced', 'serial'} {{(pid=74348) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 22 07:55:43 user nova-compute[74348]: DEBUG nova.compute.manager [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] swap_volume: removing Cinder connection for volume c75e240f-f04a-4750-ac8d-81122d651471 {{(pid=74348) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 22 07:55:43 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:55:43 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Took 1.34 seconds to deallocate network for instance.
Nov 22 07:55:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b028bbec-80a9-4988-873b-b86d617a25c2 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b028bbec-80a9-4988-873b-b86d617a25c2 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:43 user nova-compute[74348]: DEBUG nova.compute.manager [req-f0a88b61-c743-4b5a-8a53-32e9c74af6e2 req-c5e232cb-69d0-41ba-beeb-8030f7927591 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-vif-deleted-a64b4a32-73f1-4a48-8b80-86d353d1d40b {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:43 user nova-compute[74348]: INFO nova.compute.manager [req-f0a88b61-c743-4b5a-8a53-32e9c74af6e2 req-c5e232cb-69d0-41ba-beeb-8030f7927591 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Neutron deleted interface a64b4a32-73f1-4a48-8b80-86d353d1d40b; detaching it from the instance and deleting it from the info cache
Nov 22 07:55:43 user nova-compute[74348]: DEBUG nova.network.neutron [req-f0a88b61-c743-4b5a-8a53-32e9c74af6e2 req-c5e232cb-69d0-41ba-beeb-8030f7927591 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Updating instance_info_cache with network_info: [{"id": "6221165b-f588-475c-a3b1-afdf5c60c113", "address": "fa:16:3e:6a:1c:a3", "network": {"id": "414e020d-3fcc-4afd-9fee-be68687a0418", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-184417969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6221165b-f5", "ovs_interfaceid": "6221165b-f588-475c-a3b1-afdf5c60c113", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "62ed8403-ebcd-4e41-ac81-0056cf71738c", "address": "fa:16:3e:9a:78:38", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62ed8403-eb", "ovs_interfaceid": "62ed8403-ebcd-4e41-ac81-0056cf71738c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "63fc17ce-ef08-4f7e-ab83-b1040733d228", "address": "fa:16:3e:92:70:d1", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fc17ce-ef", "ovs_interfaceid": "63fc17ce-ef08-4f7e-ab83-b1040733d228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "969790c1-f8a4-4d98-86d9-1ed932c83daa", "address": "fa:16:3e:6d:21:36", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969790c1-f8", "ovs_interfaceid": "969790c1-f8a4-4d98-86d9-1ed932c83daa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "748e5281-27d7-43b4-ba47-2f0daed1181e", "address": "fa:16:3e:f9:d2:8f", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap748e5281-27", "ovs_interfaceid": "748e5281-27d7-43b4-ba47-2f0daed1181e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d77c2a03-a402-4288-8a40-2f88200a8f22", "address": "fa:16:3e:b2:36:f8", "network": {"id": "f39bd97a-26ce-4373-bf3b-ceb5c8dc21ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-224466528", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd77c2a03-a4", "ovs_interfaceid": "d77c2a03-a402-4288-8a40-2f88200a8f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:55:43 user nova-compute[74348]: DEBUG nova.compute.manager [req-f0a88b61-c743-4b5a-8a53-32e9c74af6e2 req-c5e232cb-69d0-41ba-beeb-8030f7927591 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Detach interface failed, port_id=a64b4a32-73f1-4a48-8b80-86d353d1d40b, reason: Instance 8527ae47-a025-492d-9820-b9c5ee309d81 could not be found. {{(pid=74348) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 07:55:43 user nova-compute[74348]: DEBUG nova.compute.manager [req-f0a88b61-c743-4b5a-8a53-32e9c74af6e2 req-c5e232cb-69d0-41ba-beeb-8030f7927591 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-vif-deleted-d77c2a03-a402-4288-8a40-2f88200a8f22 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:43 user nova-compute[74348]: INFO nova.compute.manager [req-f0a88b61-c743-4b5a-8a53-32e9c74af6e2 req-c5e232cb-69d0-41ba-beeb-8030f7927591 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Neutron deleted interface d77c2a03-a402-4288-8a40-2f88200a8f22; detaching it from the instance and deleting it from the info cache
Nov 22 07:55:43 user nova-compute[74348]: DEBUG nova.network.neutron [req-f0a88b61-c743-4b5a-8a53-32e9c74af6e2 req-c5e232cb-69d0-41ba-beeb-8030f7927591 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Updating instance_info_cache with network_info: [{"id": "6221165b-f588-475c-a3b1-afdf5c60c113", "address": "fa:16:3e:6a:1c:a3", "network": {"id": "414e020d-3fcc-4afd-9fee-be68687a0418", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-184417969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6221165b-f5", "ovs_interfaceid": "6221165b-f588-475c-a3b1-afdf5c60c113", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "62ed8403-ebcd-4e41-ac81-0056cf71738c", "address": "fa:16:3e:9a:78:38", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62ed8403-eb", "ovs_interfaceid": "62ed8403-ebcd-4e41-ac81-0056cf71738c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "63fc17ce-ef08-4f7e-ab83-b1040733d228", "address": "fa:16:3e:92:70:d1", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fc17ce-ef", "ovs_interfaceid": "63fc17ce-ef08-4f7e-ab83-b1040733d228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "969790c1-f8a4-4d98-86d9-1ed932c83daa", "address": "fa:16:3e:6d:21:36", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969790c1-f8", "ovs_interfaceid": "969790c1-f8a4-4d98-86d9-1ed932c83daa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "748e5281-27d7-43b4-ba47-2f0daed1181e", "address": "fa:16:3e:f9:d2:8f", "network": {"id": "3f843b34-4601-4294-93d6-36cfbbf94a95", "bridge": "br-int", "label": "tempest-device-tagging-net1-832475835", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a08625e4d04478297484c875ac9a5c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap748e5281-27", "ovs_interfaceid": "748e5281-27d7-43b4-ba47-2f0daed1181e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:55:43 user nova-compute[74348]: DEBUG nova.compute.manager [req-f0a88b61-c743-4b5a-8a53-32e9c74af6e2 req-c5e232cb-69d0-41ba-beeb-8030f7927591 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Detach interface failed, port_id=d77c2a03-a402-4288-8a40-2f88200a8f22, reason: Instance 8527ae47-a025-492d-9820-b9c5ee309d81 could not be found. {{(pid=74348) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 07:55:43 user nova-compute[74348]: DEBUG nova.compute.manager [req-f0a88b61-c743-4b5a-8a53-32e9c74af6e2 req-c5e232cb-69d0-41ba-beeb-8030f7927591 service nova] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Received event network-vif-deleted-c870c926-d416-4c0c-8fcc-873ce1c3b14e {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:43 user nova-compute[74348]: DEBUG nova.compute.manager [req-c583a367-b66a-45a8-a0e7-8206989144f0 req-85982260-1684-4c0e-9dab-6057e1df98d2 service nova] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Received event network-vif-plugged-c870c926-d416-4c0c-8fcc-873ce1c3b14e {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c583a367-b66a-45a8-a0e7-8206989144f0 req-85982260-1684-4c0e-9dab-6057e1df98d2 service nova] Acquiring lock "da6aa6c0-2b77-49a5-9942-d6596ac4bd3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c583a367-b66a-45a8-a0e7-8206989144f0 req-85982260-1684-4c0e-9dab-6057e1df98d2 service nova] Lock "da6aa6c0-2b77-49a5-9942-d6596ac4bd3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c583a367-b66a-45a8-a0e7-8206989144f0 req-85982260-1684-4c0e-9dab-6057e1df98d2 service nova] Lock "da6aa6c0-2b77-49a5-9942-d6596ac4bd3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:43 user nova-compute[74348]: DEBUG nova.compute.manager [req-c583a367-b66a-45a8-a0e7-8206989144f0 req-85982260-1684-4c0e-9dab-6057e1df98d2 service nova] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] No waiting events found dispatching network-vif-plugged-c870c926-d416-4c0c-8fcc-873ce1c3b14e {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:55:43 user nova-compute[74348]: WARNING nova.compute.manager [req-c583a367-b66a-45a8-a0e7-8206989144f0 req-85982260-1684-4c0e-9dab-6057e1df98d2 service nova] [instance: da6aa6c0-2b77-49a5-9942-d6596ac4bd3f] Received unexpected event network-vif-plugged-c870c926-d416-4c0c-8fcc-873ce1c3b14e for instance with vm_state deleted and task_state None.
Nov 22 07:55:43 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-b028bbec-80a9-4988-873b-b86d617a25c2 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:55:43 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-b028bbec-80a9-4988-873b-b86d617a25c2 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:55:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b028bbec-80a9-4988-873b-b86d617a25c2 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.488s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:44 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-b028bbec-80a9-4988-873b-b86d617a25c2 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Deleted allocations for instance da6aa6c0-2b77-49a5-9942-d6596ac4bd3f
Nov 22 07:55:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b028bbec-80a9-4988-873b-b86d617a25c2 tempest-AttachSCSIVolumeTestJSON-1796317290 tempest-AttachSCSIVolumeTestJSON-1796317290-project-member] Lock "da6aa6c0-2b77-49a5-9942-d6596ac4bd3f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.089s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:55:45 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Took 6.83 seconds to deallocate network for instance.
Nov 22 07:55:45 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-c3a5c5f8-b5fa-4edb-bb07-71e482faec70 tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 88730c14-fd2a-4f63-bc10-96cea0b057eb is timed out.
Nov 22 07:55:45 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-c3a5c5f8-b5fa-4edb-bb07-71e482faec70 tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] Successfully detached device vdb from instance 88730c14-fd2a-4f63-bc10-96cea0b057eb from the live domain config.
Nov 22 07:55:45 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3a5c5f8-b5fa-4edb-bb07-71e482faec70 tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a5c5f8-b5fa-4edb-bb07-71e482faec70 tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yBcKglFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:55:45 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-c3a5c5f8-b5fa-4edb-bb07-71e482faec70 tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:55:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-c3a5c5f8-b5fa-4edb-bb07-71e482faec70 tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-c3a5c5f8-b5fa-4edb-bb07-71e482faec70 tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a181a2-419a-4ab0-8ef1-4bde49dd8581]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a5c5f8-b5fa-4edb-bb07-71e482faec70 tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 07:55:45 user nova-compute[74348]: No targets found.
Nov 22 07:55:45 user nova-compute[74348]: iSNS:
Nov 22 07:55:45 user nova-compute[74348]: No targets found.
Nov 22 07:55:45 user nova-compute[74348]: STATIC:
Nov 22 07:55:45 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa
Nov 22 07:55:45 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:45 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:45 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223
Nov 22 07:55:45 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:45 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:45 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce
Nov 22 07:55:45 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:45 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:45 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced
Nov 22 07:55:45 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:45 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:45 user nova-compute[74348]: FIRMWARE:
Nov 22 07:55:45 user nova-compute[74348]: No targets found.
Nov 22 07:55:45 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a5c5f8-b5fa-4edb-bb07-71e482faec70 tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 07:55:45 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 07:55:45 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a5c5f8-b5fa-4edb-bb07-71e482faec70 tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG nova.compute.manager [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] swap_volume: Updating volume c75e240f-f04a-4750-ac8d-81122d651471 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "UDuTBVGO", "auth_password": "8GW03xh7o51wnN", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdd", "volume_id": "deb39549-5f77-4381-9e9c-134511b33ced"}, "status": "reserved", "instance": "e93032ee-56bd-48be-8121-b0fd5273345e", "attached_at": "", "detached_at": "", "volume_id": "deb39549-5f77-4381-9e9c-134511b33ced", "serial": "deb39549-5f77-4381-9e9c-134511b33ced"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'deb39549-5f77-4381-9e9c-134511b33ced', 'no_device': None, 'attachment_id': 'b367809d-6f2f-4b2d-a938-2d5001cb298a'} {{(pid=74348) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[53dc0444-701a-4fa2-ad7e-cb6ed7012349]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG nova.compute.manager [req-3e954561-0182-48ff-a997-f86c0ae40d84 req-f49b6a52-398f-4992-987e-db3c6aa932d6 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-vif-deleted-6221165b-f588-475c-a3b1-afdf5c60c113 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG nova.compute.manager [req-3e954561-0182-48ff-a997-f86c0ae40d84 req-f49b6a52-398f-4992-987e-db3c6aa932d6 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-vif-deleted-748e5281-27d7-43b4-ba47-2f0daed1181e {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG nova.compute.manager [req-3e954561-0182-48ff-a997-f86c0ae40d84 req-f49b6a52-398f-4992-987e-db3c6aa932d6 service nova] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Received event network-vif-deleted-969790c1-f8a4-4d98-86d9-1ed932c83daa {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f1050c18-76f7-418d-b654-bbeaeaa9cc13 tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Lock "e93032ee-56bd-48be-8121-b0fd5273345e" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 29.918s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aff8de6-033c-4202-9496-4078581782f4]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a5c5f8-b5fa-4edb-bb07-71e482faec70 tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa (non-flash)
Nov 22 07:55:45 user nova-compute[74348]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce (non-flash)
Nov 22 07:55:45 user nova-compute[74348]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced (non-flash)
Nov 22 07:55:45 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:55:45 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a5c5f8-b5fa-4edb-bb07-71e482faec70 tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa (non-flash)
Nov 22 07:55:45 user nova-compute[74348]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce (non-flash)
Nov 22 07:55:45 user nova-compute[74348]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced (non-flash)
Nov 22 07:55:45 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:55:45 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a5c5f8-b5fa-4edb-bb07-71e482faec70 tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f22285af640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa'): ({'sdb'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-c3a5c5f8-b5fa-4edb-bb07-71e482faec70 tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] Removing single pathed devices sdb {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[143ce0f8-12ab-4872-9627-e80a2c92afc9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef3dd99-a7b2-4a32-a5e8-925d60a460c8]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-c3a5c5f8-b5fa-4edb-bb07-71e482faec70 tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] Flushing IO for device /dev/sdb {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[544e760d-51b9-4ab5-ae1f-0aa1f6f07830]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-c3a5c5f8-b5fa-4edb-bb07-71e482faec70 tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ddcc824-72ec-434b-b73b-2e6f13c88efb]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-c3a5c5f8-b5fa-4edb-bb07-71e482faec70 tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-c3a5c5f8-b5fa-4edb-bb07-71e482faec70 tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] SCSI volumes sdb have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a5c5f8-b5fa-4edb-bb07-71e482faec70 tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f91518b-babc-421a-9071-b471a8f8c3fb]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a5c5f8-b5fa-4edb-bb07-71e482faec70 tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d77259-52f3-4f39-8ead-462d875d8064]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a5c5f8-b5fa-4edb-bb07-71e482faec70 tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa, portal: 172.16.0.220,3260]
Nov 22 07:55:45 user nova-compute[74348]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa, portal: 172.16.0.220,3260] successful.
Nov 22 07:55:45 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64bf9397-6276-4a77-ba6e-1a0a52ea70fa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8770c3f-10c0-4b9f-8046-ed33ebdcc86e]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a5c5f8-b5fa-4edb-bb07-71e482faec70 tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-c3a5c5f8-b5fa-4edb-bb07-71e482faec70 tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a5c5f8-b5fa-4edb-bb07-71e482faec70 tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] <== disconnect_volume: return (308ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:55:45 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3a5c5f8-b5fa-4edb-bb07-71e482faec70 tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 07:55:46 user nova-compute[74348]: INFO nova.compute.manager [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] [instance: 9e2f3a3e-ee9b-4250-8744-5eb7982285f2] Took 5.45 seconds to detach 3 volumes for instance.
Nov 22 07:55:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:46 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Acquiring lock "e93032ee-56bd-48be-8121-b0fd5273345e" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Lock "e93032ee-56bd-48be-8121-b0fd5273345e" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:47 user nova-compute[74348]: DEBUG os_brick.utils [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:55:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:47 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2551d559-2d4c-4b28-aa40-982291d79b79]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:47 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[542bf93b-a2ad-4530-8a20-f26c339932ad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:47 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:55:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:47 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4044281-7474-4f74-9a78-61fa679bf9e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:47 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6543d4b-d5b2-4c8f-be1c-babe26ec76da]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 07:55:47 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 07:55:47 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:55:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 07:55:47 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 07:55:47 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f075733-deca-4db5-86f8-622295bfc091]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:47 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 07:55:47 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 07:55:47 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 07:55:47 user nova-compute[74348]: DEBUG os_brick.utils [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:55:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.431s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:47 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Deleted allocations for instance 9e2f3a3e-ee9b-4250-8744-5eb7982285f2
Nov 22 07:55:47 user nova-compute[74348]: INFO nova.compute.manager [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Swapping volume deb39549-5f77-4381-9e9c-134511b33ced for c75e240f-f04a-4750-ac8d-81122d651471
Nov 22 07:55:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-22519de8-9973-4bb3-b0b4-f15d6729d0d9 tempest-TaggedBootDevicesTest_v242-1369728832 tempest-TaggedBootDevicesTest_v242-1369728832-project-member] Lock "9e2f3a3e-ee9b-4250-8744-5eb7982285f2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 17.856s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:47 user nova-compute[74348]: DEBUG nova.compute.manager [req-ad905b85-3058-4567-8269-e073071bb070 req-a2a6fa48-662b-48b9-a790-7f47ccf04ed7 service nova] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Received event volume-reimaged-bf17ece2-1f33-4fa3-af81-8534b3fe79af {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:55:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-ad905b85-3058-4567-8269-e073071bb070 req-a2a6fa48-662b-48b9-a790-7f47ccf04ed7 service nova] Acquiring lock "abd7f2ed-b0c4-4e05-8161-b141a611f125-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-ad905b85-3058-4567-8269-e073071bb070 req-a2a6fa48-662b-48b9-a790-7f47ccf04ed7 service nova] Lock "abd7f2ed-b0c4-4e05-8161-b141a611f125-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-ad905b85-3058-4567-8269-e073071bb070 req-a2a6fa48-662b-48b9-a790-7f47ccf04ed7 service nova] Lock "abd7f2ed-b0c4-4e05-8161-b141a611f125-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:47 user nova-compute[74348]: DEBUG nova.compute.manager [req-ad905b85-3058-4567-8269-e073071bb070 req-a2a6fa48-662b-48b9-a790-7f47ccf04ed7 service nova] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Processing event volume-reimaged-bf17ece2-1f33-4fa3-af81-8534b3fe79af {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 22 07:55:47 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Instance event wait completed in 24 seconds for volume-reimaged {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 07:55:47 user nova-compute[74348]: INFO nova.virt.block_device [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Booting with volume bf17ece2-1f33-4fa3-af81-8534b3fe79af at /dev/vda
Nov 22 07:55:48 user nova-compute[74348]: DEBUG nova.objects.instance [None req-c3a5c5f8-b5fa-4edb-bb07-71e482faec70 tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] Lazy-loading 'flavor' on Instance uuid 88730c14-fd2a-4f63-bc10-96cea0b057eb {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:55:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c3a5c5f8-b5fa-4edb-bb07-71e482faec70 tempest-VolumesAssistedSnapshotsTest-1222140086 tempest-VolumesAssistedSnapshotsTest-1222140086-project-admin] Lock "88730c14-fd2a-4f63-bc10-96cea0b057eb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.214s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:48 user nova-compute[74348]: DEBUG os_brick.utils [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:55:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9627f780-efcc-401a-8a82-24f1866e2d26]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e191b3-0998-4fa2-ac40-09c1b8f829bd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[732da9d8-1364-4ba5-ae6c-463160902932]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[28efa5e0-6d9e-434a-bff2-7abdaab6cf70]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 07:55:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 07:55:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 07:55:48 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 07:55:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99bd900-c596-4d76-a136-4ca422a11980]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 07:55:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 07:55:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 07:55:48 user nova-compute[74348]: DEBUG os_brick.utils [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:55:48 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Updating existing volume attachment record: 186e25d8-2043-4b87-af24-31d2580d2bf6 {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 07:55:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:55:54 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-5da36d5d-bec3-4344-9708-b9798065e5b1 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bdad025e-8f6c-419a-99ea-bf277f6c5577 is timed out.
Nov 22 07:55:54 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-5da36d5d-bec3-4344-9708-b9798065e5b1 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Successfully detached device vdb from instance bdad025e-8f6c-419a-99ea-bf277f6c5577 from the live domain config.
Nov 22 07:55:54 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5da36d5d-bec3-4344-9708-b9798065e5b1 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da36d5d-bec3-4344-9708-b9798065e5b1 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JLOhGjeQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, None), 'kwargs': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:55:54 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-5da36d5d-bec3-4344-9708-b9798065e5b1 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:55:54 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-5da36d5d-bec3-4344-9708-b9798065e5b1 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-5da36d5d-bec3-4344-9708-b9798065e5b1 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf04de4d-b0cc-4064-b1f1-928b31eea95f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da36d5d-bec3-4344-9708-b9798065e5b1 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 07:55:54 user nova-compute[74348]: No targets found.
Nov 22 07:55:54 user nova-compute[74348]: iSNS:
Nov 22 07:55:54 user nova-compute[74348]: No targets found.
Nov 22 07:55:54 user nova-compute[74348]: STATIC:
Nov 22 07:55:54 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223
Nov 22 07:55:54 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:54 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:54 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce
Nov 22 07:55:54 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:54 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:54 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced
Nov 22 07:55:54 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:55:54 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:55:54 user nova-compute[74348]: FIRMWARE:
Nov 22 07:55:54 user nova-compute[74348]: No targets found.
Nov 22 07:55:54 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da36d5d-bec3-4344-9708-b9798065e5b1 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 07:55:54 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 07:55:54 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da36d5d-bec3-4344-9708-b9798065e5b1 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfefa2f1-760c-47aa-bdc8-5597f6231855]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[15507398-f8cc-496d-b4d0-11831d8b58bc]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da36d5d-bec3-4344-9708-b9798065e5b1 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce (non-flash)
Nov 22 07:55:54 user nova-compute[74348]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced (non-flash)
Nov 22 07:55:54 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:55:54 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da36d5d-bec3-4344-9708-b9798065e5b1 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce (non-flash)
Nov 22 07:55:54 user nova-compute[74348]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced (non-flash)
Nov 22 07:55:54 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:55:54 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da36d5d-bec3-4344-9708-b9798065e5b1 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f222834dc60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce'): ({'sdl'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-5da36d5d-bec3-4344-9708-b9798065e5b1 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Removing single pathed devices sdl {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d88b74b-4858-45c7-ac86-7858d02ded23]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f212b4f3-a010-441f-81f0-85f2737ebe60]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-5da36d5d-bec3-4344-9708-b9798065e5b1 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Flushing IO for device /dev/sdl {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c701dffe-a9ba-4f33-9896-86f49dbe84dc]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-5da36d5d-bec3-4344-9708-b9798065e5b1 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.039s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acaf9cb-791e-488b-bb2b-6bc4f0b64bd3]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-5da36d5d-bec3-4344-9708-b9798065e5b1 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Checking to see if SCSI volumes sdl have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-5da36d5d-bec3-4344-9708-b9798065e5b1 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] SCSI volumes sdl have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da36d5d-bec3-4344-9708-b9798065e5b1 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd71489-b1e4-42ea-91cf-619b1ae0a077]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da36d5d-bec3-4344-9708-b9798065e5b1 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65400e9-5b09-4ed9-896f-5731cdd98133]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da36d5d-bec3-4344-9708-b9798065e5b1 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce, portal: 172.16.0.220,3260]
Nov 22 07:55:54 user nova-compute[74348]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce, portal: 172.16.0.220,3260] successful.
Nov 22 07:55:54 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31c45577-a290-406b-8e3e-a7852977edce -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de315f3-2789-4483-8465-5ab6452601b6]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da36d5d-bec3-4344-9708-b9798065e5b1 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-5da36d5d-bec3-4344-9708-b9798065e5b1 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da36d5d-bec3-4344-9708-b9798065e5b1 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] <== disconnect_volume: return (313ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:55:54 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5da36d5d-bec3-4344-9708-b9798065e5b1 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 07:55:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:55:58 user nova-compute[74348]: INFO nova.compute.manager [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] [instance: 8527ae47-a025-492d-9820-b9c5ee309d81] Took 12.97 seconds to detach 3 volumes for instance.
Nov 22 07:55:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:55:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:55:58 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:55:58 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:55:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:55:58 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Deleted allocations for instance 8527ae47-a025-492d-9820-b9c5ee309d81
Nov 22 07:55:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ef3f9806-8c73-4016-be66-53fc4af21873 tempest-TaggedBootDevicesTest-1955894791 tempest-TaggedBootDevicesTest-1955894791-project-member] Lock "8527ae47-a025-492d-9820-b9c5ee309d81" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 26.611s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:01 user nova-compute[74348]: DEBUG nova.compute.manager [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mJansYWS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e93032ee-56bd-48be-8121-b0fd5273345e', 'attached_at': '', 'detached_at': '', 'volume_id': 'c75e240f-f04a-4750-ac8d-81122d651471', 'serial': 'c75e240f-f04a-4750-ac8d-81122d651471'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UDuTBVGO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': 'deb39549-5f77-4381-9e9c-134511b33ced'}, 'status': 'reserved', 'instance': 'e93032ee-56bd-48be-8121-b0fd5273345e', 'attached_at': '', 'detached_at': '', 'volume_id': 'deb39549-5f77-4381-9e9c-134511b33ced', 'serial'} {{(pid=74348) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 22 07:56:01 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 07:56:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mJansYWS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:56:01 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:56:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:56:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:56:01 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:56:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:56:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:56:01 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 07:56:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:01 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[258968ab-e071-4048-889a-905ec4f48602]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 07:56:01 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:01 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5230ed6-4394-4259-940e-93db4bb648d2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471] added
Nov 22 07:56:01 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:01 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ffcf34-62d8-418f-8155-28bd2e7f6985]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:01 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[90192b00-4c55-4ac4-b1af-cc2d2ddf38fe]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mJansYWS {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mJansYWS" returned: 0 in 0.026s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[219c309d-5610-4fd1-afc7-62914776faae]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mJansYWS'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[46177da7-90fc-4a96-90d0-e469b755d265]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddecfb8-686e-4338-ab25-061412c07b77]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced (non-flash)
Nov 22 07:56:02 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:56:02 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced (non-flash)
Nov 22 07:56:02 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:56:02 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG nova.objects.instance [None req-5da36d5d-bec3-4344-9708-b9798065e5b1 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Lazy-loading 'flavor' on Instance uuid bdad025e-8f6c-419a-99ea-bf277f6c5577 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7f5a34-09eb-48f8-920f-1a2ae625377c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471, portal: 172.16.0.220,3260]
Nov 22 07:56:02 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471, portal: 172.16.0.220,3260] successful.
Nov 22 07:56:02 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f3bdc3-7b16-4852-9c10-96b1b54c7402]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-5da36d5d-bec3-4344-9708-b9798065e5b1 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Lock "bdad025e-8f6c-419a-99ea-bf277f6c5577" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 28.399s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[de64ef25-2bc4-4bf7-93ca-7b720873ee40]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced (non-flash)
Nov 22 07:56:02 user nova-compute[74348]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)
Nov 22 07:56:02 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:56:02 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced (non-flash)
Nov 22 07:56:02 user nova-compute[74348]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)
Nov 22 07:56:02 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:56:02 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdca278-2607-44de-9edf-ce065d01b665]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mJansYWS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 07:56:02 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Creating image(s)
Nov 22 07:56:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Did not create local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Ensure instance console log exists: /opt/stack/data/nova/instances/abd7f2ed-b0c4-4e05-8161-b141a611f125/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Start _get_guest_xml network_info=[{"id": "c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3", "address": "fa:16:3e:d1:85:73", "network": {"id": "5826faef-2095-4993-a655-a168237a5018", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1612032334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac4a9f365081417e81c935755cb6ddb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f3237e-bc", "ovs_interfaceid": "c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UHWXwBSk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'abd7f2ed-b0c4-4e05-8161-b141a611f125', 'attached_at': '', 'detached_at': '', 'volume_id': 'bf17ece2-1f33-4fa3-af81-8534b3fe79af', 'serial': 'bf17ece2-1f33-4fa3-af81-8534b3fe79af'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '186e25d8-2043-4b87-af24-31d2580d2bf6', 'volume_type': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 07:56:02 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 22 07:56:02 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 22 07:56:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG nova.objects.instance [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Lazy-loading 'vcpu_model' on Instance uuid abd7f2ed-b0c4-4e05-8161-b141a611f125 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 07:56:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UHWXwBSk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:56:02 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 22 07:56:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-00f877b9-705d-4c50-9597-016d5ccbc72c tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Acquiring lock "interface-bdad025e-8f6c-419a-99ea-bf277f6c5577-1f80afa8-d693-44a8-86ff-0fec89d2e510" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-00f877b9-705d-4c50-9597-016d5ccbc72c tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Lock "interface-bdad025e-8f6c-419a-99ea-bf277f6c5577-1f80afa8-d693-44a8-86ff-0fec89d2e510" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG nova.objects.instance [None req-00f877b9-705d-4c50-9597-016d5ccbc72c tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Lazy-loading 'flavor' on Instance uuid bdad025e-8f6c-419a-99ea-bf277f6c5577 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-00f877b9-705d-4c50-9597-016d5ccbc72c tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-726810190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-726810190',id=8,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2d2AMx5MTcXajy6b7uPsq3+jYxxbAAyYP5uwFXUURVQR6N2+iGSyaCZAQVBr0xq/5GZlgBfcRmwRXF9ZovM3nD3R4hcY3OcZ/S/sjuTSQBqYHlzsArXECyBywfXW3yNw==',key_name='tempest-keypair-266871328',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:53:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f078468965946f6aed352374702843c',ramdisk_id='',reservation_id='r-nuqss0no',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-659854772',owner_user_name='tempest-TaggedAttachmentsTest-659854772-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T07:53:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df4cae77b03e4395887815058f3a8a42',uuid=bdad025e-8f6c-419a-99ea-bf277f6c5577,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f80afa8-d693-44a8-86ff-0fec89d2e510", "address": "fa:16:3e:c2:25:c9", "network": {"id": "11db4075-7b75-40bf-b506-4f4ea3f9631c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2016258335", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2f078468965946f6aed352374702843c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f80afa8-d6", "ovs_interfaceid": "1f80afa8-d693-44a8-86ff-0fec89d2e510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-00f877b9-705d-4c50-9597-016d5ccbc72c tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Converting VIF {"id": "1f80afa8-d693-44a8-86ff-0fec89d2e510", "address": "fa:16:3e:c2:25:c9", "network": {"id": "11db4075-7b75-40bf-b506-4f4ea3f9631c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2016258335", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2f078468965946f6aed352374702843c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f80afa8-d6", "ovs_interfaceid": "1f80afa8-d693-44a8-86ff-0fec89d2e510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-00f877b9-705d-4c50-9597-016d5ccbc72c tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:25:c9,bridge_name='br-int',has_traffic_filtering=True,id=1f80afa8-d693-44a8-86ff-0fec89d2e510,network=Network(11db4075-7b75-40bf-b506-4f4ea3f9631c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f80afa8-d6') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-00f877b9-705d-4c50-9597-016d5ccbc72c tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c2:25:c9"/><model type="virtio"/><mtu size="1442"/><target dev="tap1f80afa8-d6"/></interface> {{(pid=74348) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-00f877b9-705d-4c50-9597-016d5ccbc72c tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c2:25:c9"/><model type="virtio"/><mtu size="1442"/><target dev="tap1f80afa8-d6"/></interface> {{(pid=74348) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-00f877b9-705d-4c50-9597-016d5ccbc72c tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Attempting to detach device tap1f80afa8-d6 from instance bdad025e-8f6c-419a-99ea-bf277f6c5577 from the persistent domain config. {{(pid=74348) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-00f877b9-705d-4c50-9597-016d5ccbc72c tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] detach device xml: <interface type="ethernet">
Nov 22 07:56:03 user nova-compute[74348]:   <mac address="fa:16:3e:c2:25:c9"/>
Nov 22 07:56:03 user nova-compute[74348]:   <model type="virtio"/>
Nov 22 07:56:03 user nova-compute[74348]:   <mtu size="1442"/>
Nov 22 07:56:03 user nova-compute[74348]:   <target dev="tap1f80afa8-d6"/>
Nov 22 07:56:03 user nova-compute[74348]: </interface>
Nov 22 07:56:03 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-00f877b9-705d-4c50-9597-016d5ccbc72c tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c2:25:c9"/><model type="virtio"/><mtu size="1442"/><target dev="tap1f80afa8-d6"/></interface> {{(pid=74348) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-00f877b9-705d-4c50-9597-016d5ccbc72c tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c2:25:c9"/><model type="virtio"/><mtu size="1442"/><target dev="tap1f80afa8-d6"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 22 07:56:03 user nova-compute[74348]:   <name>instance-00000008</name>
Nov 22 07:56:03 user nova-compute[74348]:   <uuid>bdad025e-8f6c-419a-99ea-bf277f6c5577</uuid>
Nov 22 07:56:03 user nova-compute[74348]:   <metadata>
Nov 22 07:56:03 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 07:56:03 user nova-compute[74348]:   <nova:package version="0.0.0"/>
Nov 22 07:56:03 user nova-compute[74348]:   <nova:name>tempest-device-tagging-server-726810190</nova:name>
Nov 22 07:56:03 user nova-compute[74348]:   <nova:creationTime>2023-11-22 07:55:04</nova:creationTime>
Nov 22 07:56:03 user nova-compute[74348]:   <nova:flavor name="m1.tiny">
Nov 22 07:56:03 user nova-compute[74348]:     <nova:memory>512</nova:memory>
Nov 22 07:56:03 user nova-compute[74348]:     <nova:disk>1</nova:disk>
Nov 22 07:56:03 user nova-compute[74348]:     <nova:swap>0</nova:swap>
Nov 22 07:56:03 user nova-compute[74348]:     <nova:ephemeral>0</nova:ephemeral>
Nov 22 07:56:03 user nova-compute[74348]:     <nova:vcpus>1</nova:vcpus>
Nov 22 07:56:03 user nova-compute[74348]:   </nova:flavor>
Nov 22 07:56:03 user nova-compute[74348]:   <nova:owner>
Nov 22 07:56:03 user nova-compute[74348]:     <nova:user uuid="df4cae77b03e4395887815058f3a8a42">tempest-TaggedAttachmentsTest-659854772-project-member</nova:user>
Nov 22 07:56:03 user nova-compute[74348]:     <nova:project uuid="2f078468965946f6aed352374702843c">tempest-TaggedAttachmentsTest-659854772</nova:project>
Nov 22 07:56:03 user nova-compute[74348]:   </nova:owner>
Nov 22 07:56:03 user nova-compute[74348]:   <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 07:56:03 user nova-compute[74348]:   <nova:ports>
Nov 22 07:56:03 user nova-compute[74348]:     <nova:port uuid="f47b39b9-31a2-4f9b-a5e5-ec139067b6d4">
Nov 22 07:56:03 user nova-compute[74348]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 22 07:56:03 user nova-compute[74348]:     </nova:port>
Nov 22 07:56:03 user nova-compute[74348]:     <nova:port uuid="1f80afa8-d693-44a8-86ff-0fec89d2e510">
Nov 22 07:56:03 user nova-compute[74348]:       <nova:ip type="fixed" address="10.10.10.170" ipVersion="4"/>
Nov 22 07:56:03 user nova-compute[74348]:     </nova:port>
Nov 22 07:56:03 user nova-compute[74348]:   </nova:ports>
Nov 22 07:56:03 user nova-compute[74348]: </nova:instance>
Nov 22 07:56:03 user nova-compute[74348]:   </metadata>
Nov 22 07:56:03 user nova-compute[74348]:   <memory unit='KiB'>524288</memory>
Nov 22 07:56:03 user nova-compute[74348]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 22 07:56:03 user nova-compute[74348]:   <vcpu placement='static'>1</vcpu>
Nov 22 07:56:03 user nova-compute[74348]:   <resource>
Nov 22 07:56:03 user nova-compute[74348]:     <partition>/machine</partition>
Nov 22 07:56:03 user nova-compute[74348]:   </resource>
Nov 22 07:56:03 user nova-compute[74348]:   <sysinfo type='smbios'>
Nov 22 07:56:03 user nova-compute[74348]:     <system>
Nov 22 07:56:03 user nova-compute[74348]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 22 07:56:03 user nova-compute[74348]:       <entry name='product'>OpenStack Nova</entry>
Nov 22 07:56:03 user nova-compute[74348]:       <entry name='version'>0.0.0</entry>
Nov 22 07:56:03 user nova-compute[74348]:       <entry name='serial'>bdad025e-8f6c-419a-99ea-bf277f6c5577</entry>
Nov 22 07:56:03 user nova-compute[74348]:       <entry name='uuid'>bdad025e-8f6c-419a-99ea-bf277f6c5577</entry>
Nov 22 07:56:03 user nova-compute[74348]:       <entry name='family'>Virtual Machine</entry>
Nov 22 07:56:03 user nova-compute[74348]:     </system>
Nov 22 07:56:03 user nova-compute[74348]:   </sysinfo>
Nov 22 07:56:03 user nova-compute[74348]:   <os>
Nov 22 07:56:03 user nova-compute[74348]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 22 07:56:03 user nova-compute[74348]:     <boot dev='hd'/>
Nov 22 07:56:03 user nova-compute[74348]:     <smbios mode='sysinfo'/>
Nov 22 07:56:03 user nova-compute[74348]:   </os>
Nov 22 07:56:03 user nova-compute[74348]:   <features>
Nov 22 07:56:03 user nova-compute[74348]:     <acpi/>
Nov 22 07:56:03 user nova-compute[74348]:     <apic/>
Nov 22 07:56:03 user nova-compute[74348]:     <vmcoreinfo state='on'/>
Nov 22 07:56:03 user nova-compute[74348]:   </features>
Nov 22 07:56:03 user nova-compute[74348]:   <cpu mode='custom' match='exact' check='full'>
Nov 22 07:56:03 user nova-compute[74348]:     <model fallback='forbid'>Nehalem</model>
Nov 22 07:56:03 user nova-compute[74348]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 22 07:56:03 user nova-compute[74348]:     <feature policy='require' name='vme'/>
Nov 22 07:56:03 user nova-compute[74348]:     <feature policy='require' name='x2apic'/>
Nov 22 07:56:03 user nova-compute[74348]:     <feature policy='require' name='hypervisor'/>
Nov 22 07:56:03 user nova-compute[74348]:   </cpu>
Nov 22 07:56:03 user nova-compute[74348]:   <clock offset='utc'>
Nov 22 07:56:03 user nova-compute[74348]:     <timer name='pit' tickpolicy='delay'/>
Nov 22 07:56:03 user nova-compute[74348]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 22 07:56:03 user nova-compute[74348]:     <timer name='hpet' present='no'/>
Nov 22 07:56:03 user nova-compute[74348]:   </clock>
Nov 22 07:56:03 user nova-compute[74348]:   <on_poweroff>destroy</on_poweroff>
Nov 22 07:56:03 user nova-compute[74348]:   <on_reboot>restart</on_reboot>
Nov 22 07:56:03 user nova-compute[74348]:   <on_crash>destroy</on_crash>
Nov 22 07:56:03 user nova-compute[74348]:   <devices>
Nov 22 07:56:03 user nova-compute[74348]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 22 07:56:03 user nova-compute[74348]:     <disk type='file' device='disk'>
Nov 22 07:56:03 user nova-compute[74348]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 22 07:56:03 user nova-compute[74348]:       <source file='/opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/disk' index='2'/>
Nov 22 07:56:03 user nova-compute[74348]:       <backingStore type='file' index='3'>
Nov 22 07:56:03 user nova-compute[74348]:         <format type='raw'/>
Nov 22 07:56:03 user nova-compute[74348]:         <source file='/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263'/>
Nov 22 07:56:03 user nova-compute[74348]:         <backingStore/>
Nov 22 07:56:03 user nova-compute[74348]:       </backingStore>
Nov 22 07:56:03 user nova-compute[74348]:       <target dev='vda' bus='virtio'/>
Nov 22 07:56:03 user nova-compute[74348]:       <alias name='virtio-disk0'/>
Nov 22 07:56:03 user nova-compute[74348]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 22 07:56:03 user nova-compute[74348]:     </disk>
Nov 22 07:56:03 user nova-compute[74348]:     <disk type='file' device='cdrom'>
Nov 22 07:56:03 user nova-compute[74348]:       <driver name='qemu' type='raw' cache='none'/>
Nov 22 07:56:03 user nova-compute[74348]:       <source file='/opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/disk.config' index='1'/>
Nov 22 07:56:03 user nova-compute[74348]:       <backingStore/>
Nov 22 07:56:03 user nova-compute[74348]:       <target dev='hda' bus='ide'/>
Nov 22 07:56:03 user nova-compute[74348]:       <readonly/>
Nov 22 07:56:03 user nova-compute[74348]:       <alias name='ide0-0-0'/>
Nov 22 07:56:03 user nova-compute[74348]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 22 07:56:03 user nova-compute[74348]:     </disk>
Nov 22 07:56:03 user nova-compute[74348]:     <controller type='usb' index='0' model='none'>
Nov 22 07:56:03 user nova-compute[74348]:       <alias name='usb'/>
Nov 22 07:56:03 user nova-compute[74348]:     </controller>
Nov 22 07:56:03 user nova-compute[74348]:     <controller type='pci' index='0' model='pci-root'>
Nov 22 07:56:03 user nova-compute[74348]:       <alias name='pci.0'/>
Nov 22 07:56:03 user nova-compute[74348]:     </controller>
Nov 22 07:56:03 user nova-compute[74348]:     <controller type='ide' index='0'>
Nov 22 07:56:03 user nova-compute[74348]:       <alias name='ide'/>
Nov 22 07:56:03 user nova-compute[74348]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 22 07:56:03 user nova-compute[74348]:     </controller>
Nov 22 07:56:03 user nova-compute[74348]:     <interface type='ethernet'>
Nov 22 07:56:03 user nova-compute[74348]:       <mac address='fa:16:3e:36:02:a6'/>
Nov 22 07:56:03 user nova-compute[74348]:       <target dev='tapf47b39b9-31'/>
Nov 22 07:56:03 user nova-compute[74348]:       <model type='virtio'/>
Nov 22 07:56:03 user nova-compute[74348]:       <mtu size='1442'/>
Nov 22 07:56:03 user nova-compute[74348]:       <alias name='net0'/>
Nov 22 07:56:03 user nova-compute[74348]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 22 07:56:03 user nova-compute[74348]:     </interface>
Nov 22 07:56:03 user nova-compute[74348]:     <interface type='ethernet'>
Nov 22 07:56:03 user nova-compute[74348]:       <mac address='fa:16:3e:c2:25:c9'/>
Nov 22 07:56:03 user nova-compute[74348]:       <target dev='tap1f80afa8-d6'/>
Nov 22 07:56:03 user nova-compute[74348]:       <model type='virtio'/>
Nov 22 07:56:03 user nova-compute[74348]:       <mtu size='1442'/>
Nov 22 07:56:03 user nova-compute[74348]:       <alias name='net1'/>
Nov 22 07:56:03 user nova-compute[74348]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 22 07:56:03 user nova-compute[74348]:     </interface>
Nov 22 07:56:03 user nova-compute[74348]:     <serial type='pty'>
Nov 22 07:56:03 user nova-compute[74348]:       <source path='/dev/pts/7'/>
Nov 22 07:56:03 user nova-compute[74348]:       <log file='/opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/console.log' append='off'/>
Nov 22 07:56:03 user nova-compute[74348]:       <target type='isa-serial' port='0'>
Nov 22 07:56:03 user nova-compute[74348]:         <model name='isa-serial'/>
Nov 22 07:56:03 user nova-compute[74348]:       </target>
Nov 22 07:56:03 user nova-compute[74348]:       <alias name='serial0'/>
Nov 22 07:56:03 user nova-compute[74348]:     </serial>
Nov 22 07:56:03 user nova-compute[74348]:     <console type='pty' tty='/dev/pts/7'>
Nov 22 07:56:03 user nova-compute[74348]:       <source path='/dev/pts/7'/>
Nov 22 07:56:03 user nova-compute[74348]:       <log file='/opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/console.log' append='off'/>
Nov 22 07:56:03 user nova-compute[74348]:       <target type='serial' port='0'/>
Nov 22 07:56:03 user nova-compute[74348]:       <alias name='serial0'/>
Nov 22 07:56:03 user nova-compute[74348]:     </console>
Nov 22 07:56:03 user nova-compute[74348]:     <input type='mouse' bus='ps2'>
Nov 22 07:56:03 user nova-compute[74348]:       <alias name='input0'/>
Nov 22 07:56:03 user nova-compute[74348]:     </input>
Nov 22 07:56:03 user nova-compute[74348]:     <input type='keyboard' bus='ps2'>
Nov 22 07:56:03 user nova-compute[74348]:       <alias name='input1'/>
Nov 22 07:56:03 user nova-compute[74348]:     </input>
Nov 22 07:56:03 user nova-compute[74348]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 22 07:56:03 user nova-compute[74348]:       <listen type='address' address='0.0.0.0'/>
Nov 22 07:56:03 user nova-compute[74348]:     </graphics>
Nov 22 07:56:03 user nova-compute[74348]:     <audio id='1' type='none'/>
Nov 22 07:56:03 user nova-compute[74348]:     <video>
Nov 22 07:56:03 user nova-compute[74348]:       <model type='virtio' heads='1' primary='yes'/>
Nov 22 07:56:03 user nova-compute[74348]:       <alias name='video0'/>
Nov 22 07:56:03 user nova-compute[74348]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 22 07:56:03 user nova-compute[74348]:     </video>
Nov 22 07:56:03 user nova-compute[74348]:     <memballoon model='virtio'>
Nov 22 07:56:03 user nova-compute[74348]:       <stats period='10'/>
Nov 22 07:56:03 user nova-compute[74348]:       <alias name='balloon0'/>
Nov 22 07:56:03 user nova-compute[74348]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 22 07:56:03 user nova-compute[74348]:     </memballoon>
Nov 22 07:56:03 user nova-compute[74348]:     <rng model='virtio'>
Nov 22 07:56:03 user nova-compute[74348]:       <backend model='random'>/dev/urandom</backend>
Nov 22 07:56:03 user nova-compute[74348]:       <alias name='rng0'/>
Nov 22 07:56:03 user nova-compute[74348]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 22 07:56:03 user nova-compute[74348]:     </rng>
Nov 22 07:56:03 user nova-compute[74348]:   </devices>
Nov 22 07:56:03 user nova-compute[74348]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 22 07:56:03 user nova-compute[74348]:     <label>libvirt-bdad025e-8f6c-419a-99ea-bf277f6c5577</label>
Nov 22 07:56:03 user nova-compute[74348]:     <imagelabel>libvirt-bdad025e-8f6c-419a-99ea-bf277f6c5577</imagelabel>
Nov 22 07:56:03 user nova-compute[74348]:   </seclabel>
Nov 22 07:56:03 user nova-compute[74348]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 22 07:56:03 user nova-compute[74348]:     <label>+64055:+108</label>
Nov 22 07:56:03 user nova-compute[74348]:     <imagelabel>+64055:+108</imagelabel>
Nov 22 07:56:03 user nova-compute[74348]:   </seclabel>
Nov 22 07:56:03 user nova-compute[74348]: </domain>
Nov 22 07:56:03 user nova-compute[74348]:  {{(pid=74348) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 22 07:56:03 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-00f877b9-705d-4c50-9597-016d5ccbc72c tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Successfully detached device tap1f80afa8-d6 from instance bdad025e-8f6c-419a-99ea-bf277f6c5577 from the persistent domain config.
Nov 22 07:56:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-00f877b9-705d-4c50-9597-016d5ccbc72c tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] (1/8): Attempting to detach device tap1f80afa8-d6 with device alias net1 from instance bdad025e-8f6c-419a-99ea-bf277f6c5577 from the live domain config. {{(pid=74348) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-00f877b9-705d-4c50-9597-016d5ccbc72c tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] detach device xml: <interface type="ethernet">
Nov 22 07:56:03 user nova-compute[74348]:   <mac address="fa:16:3e:c2:25:c9"/>
Nov 22 07:56:03 user nova-compute[74348]:   <model type="virtio"/>
Nov 22 07:56:03 user nova-compute[74348]:   <mtu size="1442"/>
Nov 22 07:56:03 user nova-compute[74348]:   <target dev="tap1f80afa8-d6"/>
Nov 22 07:56:03 user nova-compute[74348]: </interface>
Nov 22 07:56:03 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '26135383236336332', 'path': '/dev/sdb'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135383236336332', 'path': '/dev/sdb'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.782s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:56:03 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 22 07:56:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:56:03 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 07:56:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG nova.objects.instance [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Lazy-loading 'flavor' on Instance uuid e93032ee-56bd-48be-8121-b0fd5273345e {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d79cfd-8124-4b97-aa48-304dfe86fbc7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 07:56:03 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eba26a5-0bf6-4067-b2c5-d88ad3485663]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af] added
Nov 22 07:56:03 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a24ba8-a43d-483a-94e6-4c77a8e484b9]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0d24c5-a382-49bf-8678-d33aa385c400]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UHWXwBSk {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UHWXwBSk" returned: 0 in 0.027s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf32242-b3fd-4d35-af74-ac8835ecfd0a]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UHWXwBSk'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf85752-caf6-4149-851e-5b957f69fbfc]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-00f877b9-705d-4c50-9597-016d5ccbc72c tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Start waiting for the detach event from libvirt for device tap1f80afa8-d6 with device alias net1 for instance bdad025e-8f6c-419a-99ea-bf277f6c5577 {{(pid=74348) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef07c351-aa1f-4cb4-afd3-db19eeb4e9c4]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced (non-flash)
Nov 22 07:56:03 user nova-compute[74348]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)
Nov 22 07:56:03 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:56:03 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced (non-flash)
Nov 22 07:56:03 user nova-compute[74348]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)
Nov 22 07:56:03 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:56:03 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd32922-b9d8-4143-9dc9-771d24e677ce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af, portal: 172.16.0.220,3260]
Nov 22 07:56:03 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af, portal: 172.16.0.220,3260] successful.
Nov 22 07:56:03 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2e64a0-d28d-481b-8625-f67906093481]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff53ce8-0184-4d9a-8de2-6cf7a04c5306]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced (non-flash)
Nov 22 07:56:03 user nova-compute[74348]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)
Nov 22 07:56:03 user nova-compute[74348]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:56:03 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:56:03 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced (non-flash)
Nov 22 07:56:03 user nova-compute[74348]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)
Nov 22 07:56:03 user nova-compute[74348]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:56:03 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:56:03 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG nova.compute.manager [req-a7baa38a-6aec-49f5-b5a2-ef366ea63fda req-abdd86a9-3eaf-4998-a5f9-0b20e720a578 service nova] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Received event network-vif-unplugged-1f80afa8-d693-44a8-86ff-0fec89d2e510 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a7baa38a-6aec-49f5-b5a2-ef366ea63fda req-abdd86a9-3eaf-4998-a5f9-0b20e720a578 service nova] Acquiring lock "bdad025e-8f6c-419a-99ea-bf277f6c5577-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a7baa38a-6aec-49f5-b5a2-ef366ea63fda req-abdd86a9-3eaf-4998-a5f9-0b20e720a578 service nova] Lock "bdad025e-8f6c-419a-99ea-bf277f6c5577-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a7baa38a-6aec-49f5-b5a2-ef366ea63fda req-abdd86a9-3eaf-4998-a5f9-0b20e720a578 service nova] Lock "bdad025e-8f6c-419a-99ea-bf277f6c5577-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG nova.compute.manager [req-a7baa38a-6aec-49f5-b5a2-ef366ea63fda req-abdd86a9-3eaf-4998-a5f9-0b20e720a578 service nova] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] No waiting events found dispatching network-vif-unplugged-1f80afa8-d693-44a8-86ff-0fec89d2e510 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:56:03 user nova-compute[74348]: WARNING nova.compute.manager [req-a7baa38a-6aec-49f5-b5a2-ef366ea63fda req-abdd86a9-3eaf-4998-a5f9-0b20e720a578 service nova] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Received unexpected event network-vif-unplugged-1f80afa8-d693-44a8-86ff-0fec89d2e510 for instance with vm_state active and task_state None.
Nov 22 07:56:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ccaeb8-98aa-49a5-8eac-f8b03984a934]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UHWXwBSk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 07:56:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74348) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 07:56:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] COPY block job progress, current cursor: 147849216 final cursor: 1073741824 {{(pid=74348) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 07:56:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:56:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] <== connect_volume: return (2119ms) {'type': 'block', 'scsi_wwn': '23336393336653864', 'path': '/dev/sdc'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:56:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336393336653864', 'path': '/dev/sdc'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 07:56:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-22T07:53:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-478037569',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1680569585',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO27qptUwzzdqwLnhCZkr2apu987NWn6IIEhHr7PT4GpTS02zQZcCrEc7XvQW2xsPa1rEu/bPT5i3T2uHMpmNx2zLdQ2Q19AVu91BBTgcbEZQzR0OotNI2TgNid7aWNdEg==',key_name='tempest-keypair-2082604002',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:53:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ac4a9f365081417e81c935755cb6ddb7',ramdisk_id='',reservation_id='r-2h02xod7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-628585113',owner_user_name='tempest-ServerActionsV293TestJSON-628585113-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:55:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad47d30fba8048b99bf017fc43335532',uuid=abd7f2ed-b0c4-4e05-8161-b141a611f125,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3", "address": "fa:16:3e:d1:85:73", "network": {"id": "5826faef-2095-4993-a655-a168237a5018", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1612032334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac4a9f365081417e81c935755cb6ddb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f3237e-bc", "ovs_interfaceid": "c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 07:56:04 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Converting VIF {"id": "c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3", "address": "fa:16:3e:d1:85:73", "network": {"id": "5826faef-2095-4993-a655-a168237a5018", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1612032334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac4a9f365081417e81c935755cb6ddb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f3237e-bc", "ovs_interfaceid": "c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:56:04 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:85:73,bridge_name='br-int',has_traffic_filtering=True,id=c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3,network=Network(5826faef-2095-4993-a655-a168237a5018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f3237e-bc') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:56:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] End _get_guest_xml xml=<domain type="kvm">
Nov 22 07:56:04 user nova-compute[74348]:   <uuid>abd7f2ed-b0c4-4e05-8161-b141a611f125</uuid>
Nov 22 07:56:04 user nova-compute[74348]:   <name>instance-0000000a</name>
Nov 22 07:56:04 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 07:56:04 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 07:56:04 user nova-compute[74348]:   <metadata>
Nov 22 07:56:04 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 07:56:04 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 07:56:04 user nova-compute[74348]:       <nova:name>tempest-ServerActionsV293TestJSON-server-478037569</nova:name>
Nov 22 07:56:04 user nova-compute[74348]:       <nova:creationTime>2023-11-22 07:56:02</nova:creationTime>
Nov 22 07:56:04 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 07:56:04 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 07:56:04 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 07:56:04 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 07:56:04 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 07:56:04 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 07:56:04 user nova-compute[74348]:       </nova:flavor>
Nov 22 07:56:04 user nova-compute[74348]:       <nova:owner>
Nov 22 07:56:04 user nova-compute[74348]:         <nova:user uuid="ad47d30fba8048b99bf017fc43335532">tempest-ServerActionsV293TestJSON-628585113-project-member</nova:user>
Nov 22 07:56:04 user nova-compute[74348]:         <nova:project uuid="ac4a9f365081417e81c935755cb6ddb7">tempest-ServerActionsV293TestJSON-628585113</nova:project>
Nov 22 07:56:04 user nova-compute[74348]:       </nova:owner>
Nov 22 07:56:04 user nova-compute[74348]:       <nova:ports>
Nov 22 07:56:04 user nova-compute[74348]:         <nova:port uuid="c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3">
Nov 22 07:56:04 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 22 07:56:04 user nova-compute[74348]:         </nova:port>
Nov 22 07:56:04 user nova-compute[74348]:       </nova:ports>
Nov 22 07:56:04 user nova-compute[74348]:     </nova:instance>
Nov 22 07:56:04 user nova-compute[74348]:   </metadata>
Nov 22 07:56:04 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 07:56:04 user nova-compute[74348]:     <system>
Nov 22 07:56:04 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 07:56:04 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 07:56:04 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 07:56:04 user nova-compute[74348]:       <entry name="serial">abd7f2ed-b0c4-4e05-8161-b141a611f125</entry>
Nov 22 07:56:04 user nova-compute[74348]:       <entry name="uuid">abd7f2ed-b0c4-4e05-8161-b141a611f125</entry>
Nov 22 07:56:04 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 07:56:04 user nova-compute[74348]:     </system>
Nov 22 07:56:04 user nova-compute[74348]:   </sysinfo>
Nov 22 07:56:04 user nova-compute[74348]:   <os>
Nov 22 07:56:04 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 07:56:04 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 07:56:04 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 07:56:04 user nova-compute[74348]:   </os>
Nov 22 07:56:04 user nova-compute[74348]:   <features>
Nov 22 07:56:04 user nova-compute[74348]:     <acpi/>
Nov 22 07:56:04 user nova-compute[74348]:     <apic/>
Nov 22 07:56:04 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 07:56:04 user nova-compute[74348]:   </features>
Nov 22 07:56:04 user nova-compute[74348]:   <clock offset="utc">
Nov 22 07:56:04 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 07:56:04 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 07:56:04 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 07:56:04 user nova-compute[74348]:   </clock>
Nov 22 07:56:04 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 07:56:04 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 07:56:04 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 07:56:04 user nova-compute[74348]:   </cpu>
Nov 22 07:56:04 user nova-compute[74348]:   <devices>
Nov 22 07:56:04 user nova-compute[74348]:     <disk type="block" device="disk">
Nov 22 07:56:04 user nova-compute[74348]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 07:56:04 user nova-compute[74348]:       <source dev="/dev/sdc"/>
Nov 22 07:56:04 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 07:56:04 user nova-compute[74348]:       <serial>bf17ece2-1f33-4fa3-af81-8534b3fe79af</serial>
Nov 22 07:56:04 user nova-compute[74348]:     </disk>
Nov 22 07:56:04 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 07:56:04 user nova-compute[74348]:       <mac address="fa:16:3e:d1:85:73"/>
Nov 22 07:56:04 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:56:04 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 07:56:04 user nova-compute[74348]:       <target dev="tapc6f3237e-bc"/>
Nov 22 07:56:04 user nova-compute[74348]:     </interface>
Nov 22 07:56:04 user nova-compute[74348]:     <serial type="pty">
Nov 22 07:56:04 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/abd7f2ed-b0c4-4e05-8161-b141a611f125/console.log" append="off"/>
Nov 22 07:56:04 user nova-compute[74348]:     </serial>
Nov 22 07:56:04 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 07:56:04 user nova-compute[74348]:     <video>
Nov 22 07:56:04 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:56:04 user nova-compute[74348]:     </video>
Nov 22 07:56:04 user nova-compute[74348]:     <rng model="virtio">
Nov 22 07:56:04 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 07:56:04 user nova-compute[74348]:     </rng>
Nov 22 07:56:04 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 07:56:04 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 07:56:04 user nova-compute[74348]:       <stats period="10"/>
Nov 22 07:56:04 user nova-compute[74348]:     </memballoon>
Nov 22 07:56:04 user nova-compute[74348]:   </devices>
Nov 22 07:56:04 user nova-compute[74348]: </domain>
Nov 22 07:56:04 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 07:56:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-22T07:53:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-478037569',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1680569585',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO27qptUwzzdqwLnhCZkr2apu987NWn6IIEhHr7PT4GpTS02zQZcCrEc7XvQW2xsPa1rEu/bPT5i3T2uHMpmNx2zLdQ2Q19AVu91BBTgcbEZQzR0OotNI2TgNid7aWNdEg==',key_name='tempest-keypair-2082604002',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:53:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ac4a9f365081417e81c935755cb6ddb7',ramdisk_id='',reservation_id='r-2h02xod7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-628585113',owner_user_name='tempest-ServerActionsV293TestJSON-628585113-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:55:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad47d30fba8048b99bf017fc43335532',uuid=abd7f2ed-b0c4-4e05-8161-b141a611f125,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3", "address": "fa:16:3e:d1:85:73", "network": {"id": "5826faef-2095-4993-a655-a168237a5018", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1612032334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac4a9f365081417e81c935755cb6ddb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f3237e-bc", "ovs_interfaceid": "c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 07:56:04 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Converting VIF {"id": "c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3", "address": "fa:16:3e:d1:85:73", "network": {"id": "5826faef-2095-4993-a655-a168237a5018", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1612032334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac4a9f365081417e81c935755cb6ddb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f3237e-bc", "ovs_interfaceid": "c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:56:04 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:85:73,bridge_name='br-int',has_traffic_filtering=True,id=c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3,network=Network(5826faef-2095-4993-a655-a168237a5018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f3237e-bc') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:56:04 user nova-compute[74348]: DEBUG os_vif [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:85:73,bridge_name='br-int',has_traffic_filtering=True,id=c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3,network=Network(5826faef-2095-4993-a655-a168237a5018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f3237e-bc') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 07:56:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:56:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 07:56:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b49a116a-9c13-5575-ba24-81f54d8b46f7', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:56:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:56:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc6f3237e-bc, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:56:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc6f3237e-bc, col_values=(('qos', UUID('8b2ec1fe-d2e4-422f-afb1-99803c2693e4')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:56:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc6f3237e-bc, col_values=(('external_ids', {'iface-id': 'c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:85:73', 'vm-uuid': 'abd7f2ed-b0c4-4e05-8161-b141a611f125'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:56:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:56:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:04 user nova-compute[74348]: INFO os_vif [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:85:73,bridge_name='br-int',has_traffic_filtering=True,id=c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3,network=Network(5826faef-2095-4993-a655-a168237a5018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f3237e-bc')
Nov 22 07:56:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:56:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] No VIF found with MAC fa:16:3e:d1:85:73, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 07:56:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] COPY block job progress, current cursor: 328204288 final cursor: 1073741824 {{(pid=74348) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 07:56:05 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] COPY block job progress, current cursor: 458227712 final cursor: 1073741824 {{(pid=74348) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 07:56:05 user nova-compute[74348]: DEBUG nova.compute.manager [req-df9db545-a8ac-4731-83b4-efd23528e771 req-b36ec03f-be27-4fe6-bd34-297ba6db7d23 service nova] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Received event network-vif-plugged-1f80afa8-d693-44a8-86ff-0fec89d2e510 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:56:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-df9db545-a8ac-4731-83b4-efd23528e771 req-b36ec03f-be27-4fe6-bd34-297ba6db7d23 service nova] Acquiring lock "bdad025e-8f6c-419a-99ea-bf277f6c5577-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-df9db545-a8ac-4731-83b4-efd23528e771 req-b36ec03f-be27-4fe6-bd34-297ba6db7d23 service nova] Lock "bdad025e-8f6c-419a-99ea-bf277f6c5577-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-df9db545-a8ac-4731-83b4-efd23528e771 req-b36ec03f-be27-4fe6-bd34-297ba6db7d23 service nova] Lock "bdad025e-8f6c-419a-99ea-bf277f6c5577-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:05 user nova-compute[74348]: DEBUG nova.compute.manager [req-df9db545-a8ac-4731-83b4-efd23528e771 req-b36ec03f-be27-4fe6-bd34-297ba6db7d23 service nova] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] No waiting events found dispatching network-vif-plugged-1f80afa8-d693-44a8-86ff-0fec89d2e510 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:56:05 user nova-compute[74348]: WARNING nova.compute.manager [req-df9db545-a8ac-4731-83b4-efd23528e771 req-b36ec03f-be27-4fe6-bd34-297ba6db7d23 service nova] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Received unexpected event network-vif-plugged-1f80afa8-d693-44a8-86ff-0fec89d2e510 for instance with vm_state active and task_state None.
Nov 22 07:56:05 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] COPY block job progress, current cursor: 595591168 final cursor: 1073741824 {{(pid=74348) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 07:56:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:06 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] COPY block job progress, current cursor: 706740224 final cursor: 1073741824 {{(pid=74348) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 07:56:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:06 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] COPY block job progress, current cursor: 843055104 final cursor: 1073741824 {{(pid=74348) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 07:56:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] COPY block job progress, current cursor: 1020264448 final cursor: 1073741824 {{(pid=74348) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 07:56:07 user nova-compute[74348]: DEBUG nova.compute.manager [req-d8a920eb-3614-4012-95d8-286400c53e8a req-72f12ab0-3d7d-49a7-ac26-78dc1d1fca2e service nova] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Received event network-vif-plugged-c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:56:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d8a920eb-3614-4012-95d8-286400c53e8a req-72f12ab0-3d7d-49a7-ac26-78dc1d1fca2e service nova] Acquiring lock "abd7f2ed-b0c4-4e05-8161-b141a611f125-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d8a920eb-3614-4012-95d8-286400c53e8a req-72f12ab0-3d7d-49a7-ac26-78dc1d1fca2e service nova] Lock "abd7f2ed-b0c4-4e05-8161-b141a611f125-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d8a920eb-3614-4012-95d8-286400c53e8a req-72f12ab0-3d7d-49a7-ac26-78dc1d1fca2e service nova] Lock "abd7f2ed-b0c4-4e05-8161-b141a611f125-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:07 user nova-compute[74348]: DEBUG nova.compute.manager [req-d8a920eb-3614-4012-95d8-286400c53e8a req-72f12ab0-3d7d-49a7-ac26-78dc1d1fca2e service nova] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] No waiting events found dispatching network-vif-plugged-c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:56:07 user nova-compute[74348]: WARNING nova.compute.manager [req-d8a920eb-3614-4012-95d8-286400c53e8a req-72f12ab0-3d7d-49a7-ac26-78dc1d1fca2e service nova] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Received unexpected event network-vif-plugged-c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3 for instance with vm_state active and task_state rebuild_spawning.
Nov 22 07:56:07 user nova-compute[74348]: DEBUG nova.compute.manager [req-d8a920eb-3614-4012-95d8-286400c53e8a req-72f12ab0-3d7d-49a7-ac26-78dc1d1fca2e service nova] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Received event network-vif-plugged-c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:56:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d8a920eb-3614-4012-95d8-286400c53e8a req-72f12ab0-3d7d-49a7-ac26-78dc1d1fca2e service nova] Acquiring lock "abd7f2ed-b0c4-4e05-8161-b141a611f125-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d8a920eb-3614-4012-95d8-286400c53e8a req-72f12ab0-3d7d-49a7-ac26-78dc1d1fca2e service nova] Lock "abd7f2ed-b0c4-4e05-8161-b141a611f125-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d8a920eb-3614-4012-95d8-286400c53e8a req-72f12ab0-3d7d-49a7-ac26-78dc1d1fca2e service nova] Lock "abd7f2ed-b0c4-4e05-8161-b141a611f125-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:07 user nova-compute[74348]: DEBUG nova.compute.manager [req-d8a920eb-3614-4012-95d8-286400c53e8a req-72f12ab0-3d7d-49a7-ac26-78dc1d1fca2e service nova] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] No waiting events found dispatching network-vif-plugged-c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:56:07 user nova-compute[74348]: WARNING nova.compute.manager [req-d8a920eb-3614-4012-95d8-286400c53e8a req-72f12ab0-3d7d-49a7-ac26-78dc1d1fca2e service nova] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Received unexpected event network-vif-plugged-c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3 for instance with vm_state active and task_state rebuild_spawning.
Nov 22 07:56:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74348) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UDuTBVGO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': 'deb39549-5f77-4381-9e9c-134511b33ced'}, None), 'kwargs': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:56:08 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:56:08 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3424eb6c-5eb3-40b8-8bfe-8680e9c1d88e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 07:56:08 user nova-compute[74348]: No targets found.
Nov 22 07:56:08 user nova-compute[74348]: iSNS:
Nov 22 07:56:08 user nova-compute[74348]: No targets found.
Nov 22 07:56:08 user nova-compute[74348]: STATIC:
Nov 22 07:56:08 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223
Nov 22 07:56:08 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:56:08 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:56:08 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471
Nov 22 07:56:08 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:56:08 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:56:08 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced
Nov 22 07:56:08 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:56:08 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:56:08 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af
Nov 22 07:56:08 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:56:08 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:56:08 user nova-compute[74348]: FIRMWARE:
Nov 22 07:56:08 user nova-compute[74348]: No targets found.
Nov 22 07:56:08 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 07:56:08 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 07:56:08 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8990503-2024-490b-83d7-7b38e6814ad8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[901d3c9a-bc96-4337-922b-dee0995614df]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced (non-flash)
Nov 22 07:56:08 user nova-compute[74348]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)
Nov 22 07:56:08 user nova-compute[74348]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:56:08 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:56:08 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced (non-flash)
Nov 22 07:56:08 user nova-compute[74348]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)
Nov 22 07:56:08 user nova-compute[74348]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:56:08 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:56:08 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f224c4f3b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced'): ({'sdd'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Removing single pathed devices sdd {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0fdf1a-939c-4d40-b1b8-04d613ae99ab]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[53816f3c-13fb-4e87-ae99-63c75caf87a3]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Flushing IO for device /dev/sdd {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f296954-1fb9-41ba-a97b-ac7ca31cdfcc]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb953e8c-1fa7-459d-b0a8-fe73cc8595ad]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] SCSI volumes sdd have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[439c9305-a486-4be9-831b-6e5bb4f03d2c]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2679066-baf8-4efa-a26c-12fc2c7519fd]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced, portal: 172.16.0.220,3260]
Nov 22 07:56:08 user nova-compute[74348]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced, portal: 172.16.0.220,3260] successful.
Nov 22 07:56:08 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deb39549-5f77-4381-9e9c-134511b33ced -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d03df7-f9cb-4f51-92ee-eb5295f414fa]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] <== disconnect_volume: return (293ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 07:56:08 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Instance spawned successfully.
Nov 22 07:56:08 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG nova.compute.manager [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mJansYWS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'e93032ee-56bd-48be-8121-b0fd5273345e', 'attached_at': '', 'detached_at': '', 'volume_id': 'c75e240f-f04a-4750-ac8d-81122d651471', 'serial'} {{(pid=74348) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG nova.compute.manager [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] swap_volume: removing Cinder connection for volume deb39549-5f77-4381-9e9c-134511b33ced {{(pid=74348) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG nova.objects.instance [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74348) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 22 07:56:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ad905b85-3058-4567-8269-e073071bb070 tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.072s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:09 user nova-compute[74348]: DEBUG nova.compute.manager [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] swap_volume: Updating volume deb39549-5f77-4381-9e9c-134511b33ced BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "mJansYWS", "auth_password": "yv3810fdzcIwhW", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "c75e240f-f04a-4750-ac8d-81122d651471"}, "status": "reserved", "instance": "e93032ee-56bd-48be-8121-b0fd5273345e", "attached_at": "", "detached_at": "", "volume_id": "c75e240f-f04a-4750-ac8d-81122d651471", "serial": "c75e240f-f04a-4750-ac8d-81122d651471"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'c75e240f-f04a-4750-ac8d-81122d651471', 'no_device': None, 'attachment_id': 'e1a216f4-2362-4d9d-85a4-473eac3a6980'} {{(pid=74348) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 22 07:56:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-a8f3109d-843d-4520-bb29-f3e13d8abb2b tempest-TestVolumeSwap-538806457 tempest-TestVolumeSwap-538806457-project-admin] Lock "e93032ee-56bd-48be-8121-b0fd5273345e" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 22.107s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b8ee78f9-a2e6-4f2d-b93b-bf14d612259c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Acquiring lock "e93032ee-56bd-48be-8121-b0fd5273345e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b8ee78f9-a2e6-4f2d-b93b-bf14d612259c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Lock "e93032ee-56bd-48be-8121-b0fd5273345e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:10 user nova-compute[74348]: INFO nova.compute.manager [None req-b8ee78f9-a2e6-4f2d-b93b-bf14d612259c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Detaching volume c75e240f-f04a-4750-ac8d-81122d651471
Nov 22 07:56:10 user nova-compute[74348]: INFO nova.virt.block_device [None req-b8ee78f9-a2e6-4f2d-b93b-bf14d612259c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Attempting to driver detach volume c75e240f-f04a-4750-ac8d-81122d651471 from mountpoint /dev/vdb
Nov 22 07:56:10 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b8ee78f9-a2e6-4f2d-b93b-bf14d612259c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Attempting to detach device vdb from instance e93032ee-56bd-48be-8121-b0fd5273345e from the persistent domain config. {{(pid=74348) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 07:56:10 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-b8ee78f9-a2e6-4f2d-b93b-bf14d612259c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 07:56:10 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 07:56:10 user nova-compute[74348]:   <source dev="/dev/sdb"/>
Nov 22 07:56:10 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 07:56:10 user nova-compute[74348]:   <serial>c75e240f-f04a-4750-ac8d-81122d651471</serial>
Nov 22 07:56:10 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 07:56:10 user nova-compute[74348]: </disk>
Nov 22 07:56:10 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 07:56:10 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-b8ee78f9-a2e6-4f2d-b93b-bf14d612259c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Successfully detached device vdb from instance e93032ee-56bd-48be-8121-b0fd5273345e from the persistent domain config.
Nov 22 07:56:10 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b8ee78f9-a2e6-4f2d-b93b-bf14d612259c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e93032ee-56bd-48be-8121-b0fd5273345e from the live domain config. {{(pid=74348) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 07:56:10 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-b8ee78f9-a2e6-4f2d-b93b-bf14d612259c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 07:56:10 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 07:56:10 user nova-compute[74348]:   <source dev="/dev/sdb"/>
Nov 22 07:56:10 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 07:56:10 user nova-compute[74348]:   <serial>c75e240f-f04a-4750-ac8d-81122d651471</serial>
Nov 22 07:56:10 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 07:56:10 user nova-compute[74348]: </disk>
Nov 22 07:56:10 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 07:56:10 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b8ee78f9-a2e6-4f2d-b93b-bf14d612259c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e93032ee-56bd-48be-8121-b0fd5273345e {{(pid=74348) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 07:56:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-97695c4c-1b5c-4cc2-9f3a-2bcd092d17b1 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Acquiring lock "e042fd98-eb22-4c6e-9eec-4bb0908fd5ce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-97695c4c-1b5c-4cc2-9f3a-2bcd092d17b1 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Lock "e042fd98-eb22-4c6e-9eec-4bb0908fd5ce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-97695c4c-1b5c-4cc2-9f3a-2bcd092d17b1 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Acquiring lock "e042fd98-eb22-4c6e-9eec-4bb0908fd5ce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-97695c4c-1b5c-4cc2-9f3a-2bcd092d17b1 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Lock "e042fd98-eb22-4c6e-9eec-4bb0908fd5ce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-97695c4c-1b5c-4cc2-9f3a-2bcd092d17b1 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Lock "e042fd98-eb22-4c6e-9eec-4bb0908fd5ce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:15 user nova-compute[74348]: INFO nova.compute.manager [None req-97695c4c-1b5c-4cc2-9f3a-2bcd092d17b1 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Terminating instance
Nov 22 07:56:15 user nova-compute[74348]: DEBUG nova.compute.manager [None req-97695c4c-1b5c-4cc2-9f3a-2bcd092d17b1 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 07:56:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:16 user nova-compute[74348]: DEBUG nova.compute.manager [req-6dfe5fed-d81a-49be-a015-450013062233 req-d730a1a3-5a7d-4d84-9edb-de821ac64b3d service nova] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Received event network-vif-unplugged-f45f964e-a3d7-44c5-8629-db0cbcaeff15 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:56:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-6dfe5fed-d81a-49be-a015-450013062233 req-d730a1a3-5a7d-4d84-9edb-de821ac64b3d service nova] Acquiring lock "e042fd98-eb22-4c6e-9eec-4bb0908fd5ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-6dfe5fed-d81a-49be-a015-450013062233 req-d730a1a3-5a7d-4d84-9edb-de821ac64b3d service nova] Lock "e042fd98-eb22-4c6e-9eec-4bb0908fd5ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-6dfe5fed-d81a-49be-a015-450013062233 req-d730a1a3-5a7d-4d84-9edb-de821ac64b3d service nova] Lock "e042fd98-eb22-4c6e-9eec-4bb0908fd5ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:16 user nova-compute[74348]: DEBUG nova.compute.manager [req-6dfe5fed-d81a-49be-a015-450013062233 req-d730a1a3-5a7d-4d84-9edb-de821ac64b3d service nova] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] No waiting events found dispatching network-vif-unplugged-f45f964e-a3d7-44c5-8629-db0cbcaeff15 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:56:16 user nova-compute[74348]: DEBUG nova.compute.manager [req-6dfe5fed-d81a-49be-a015-450013062233 req-d730a1a3-5a7d-4d84-9edb-de821ac64b3d service nova] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Received event network-vif-unplugged-f45f964e-a3d7-44c5-8629-db0cbcaeff15 for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 07:56:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:16 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Instance destroyed successfully.
Nov 22 07:56:16 user nova-compute[74348]: DEBUG nova.objects.instance [None req-97695c4c-1b5c-4cc2-9f3a-2bcd092d17b1 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Lazy-loading 'resources' on Instance uuid e042fd98-eb22-4c6e-9eec-4bb0908fd5ce {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:56:16 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-97695c4c-1b5c-4cc2-9f3a-2bcd092d17b1 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:54:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-633870897',display_name='tempest-ServersNegativeTestJSON-server-633870897',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-633870897',id=13,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:54:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dee2e6be4a484d32bac3fda2043aa23d',ramdisk_id='',reservation_id='r-u1ypc3ee',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1255640261',owner_user_name='tempest-ServersNegativeTestJSON-1255640261-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T07:54:33Z,user_data=None,user_id='8d2925596cad453baed756b931a54586',uuid=e042fd98-eb22-4c6e-9eec-4bb0908fd5ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f45f964e-a3d7-44c5-8629-db0cbcaeff15", "address": "fa:16:3e:f0:ab:86", "network": {"id": "7f692ef6-9a86-4aba-a055-8877d70394ba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1993883418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee2e6be4a484d32bac3fda2043aa23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf45f964e-a3", "ovs_interfaceid": "f45f964e-a3d7-44c5-8629-db0cbcaeff15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 07:56:16 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-97695c4c-1b5c-4cc2-9f3a-2bcd092d17b1 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Converting VIF {"id": "f45f964e-a3d7-44c5-8629-db0cbcaeff15", "address": "fa:16:3e:f0:ab:86", "network": {"id": "7f692ef6-9a86-4aba-a055-8877d70394ba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1993883418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee2e6be4a484d32bac3fda2043aa23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf45f964e-a3", "ovs_interfaceid": "f45f964e-a3d7-44c5-8629-db0cbcaeff15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:56:16 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-97695c4c-1b5c-4cc2-9f3a-2bcd092d17b1 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:ab:86,bridge_name='br-int',has_traffic_filtering=True,id=f45f964e-a3d7-44c5-8629-db0cbcaeff15,network=Network(7f692ef6-9a86-4aba-a055-8877d70394ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf45f964e-a3') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:56:16 user nova-compute[74348]: DEBUG os_vif [None req-97695c4c-1b5c-4cc2-9f3a-2bcd092d17b1 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:ab:86,bridge_name='br-int',has_traffic_filtering=True,id=f45f964e-a3d7-44c5-8629-db0cbcaeff15,network=Network(7f692ef6-9a86-4aba-a055-8877d70394ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf45f964e-a3') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 07:56:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf45f964e-a3, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:56:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:56:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ff50aaa5-c8bd-487f-94b4-0d3b937e75d0) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:56:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:56:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:16 user nova-compute[74348]: INFO os_vif [None req-97695c4c-1b5c-4cc2-9f3a-2bcd092d17b1 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:ab:86,bridge_name='br-int',has_traffic_filtering=True,id=f45f964e-a3d7-44c5-8629-db0cbcaeff15,network=Network(7f692ef6-9a86-4aba-a055-8877d70394ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf45f964e-a3')
Nov 22 07:56:16 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-97695c4c-1b5c-4cc2-9f3a-2bcd092d17b1 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Deleting instance files /opt/stack/data/nova/instances/e042fd98-eb22-4c6e-9eec-4bb0908fd5ce_del
Nov 22 07:56:16 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-97695c4c-1b5c-4cc2-9f3a-2bcd092d17b1 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Deletion of /opt/stack/data/nova/instances/e042fd98-eb22-4c6e-9eec-4bb0908fd5ce_del complete
Nov 22 07:56:16 user nova-compute[74348]: INFO nova.compute.manager [None req-97695c4c-1b5c-4cc2-9f3a-2bcd092d17b1 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 22 07:56:16 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-97695c4c-1b5c-4cc2-9f3a-2bcd092d17b1 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 07:56:16 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 07:56:16 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 07:56:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:17 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:56:17 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Took 0.99 seconds to deallocate network for instance.
Nov 22 07:56:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-97695c4c-1b5c-4cc2-9f3a-2bcd092d17b1 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-97695c4c-1b5c-4cc2-9f3a-2bcd092d17b1 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:17 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-97695c4c-1b5c-4cc2-9f3a-2bcd092d17b1 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:56:17 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-97695c4c-1b5c-4cc2-9f3a-2bcd092d17b1 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:56:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-97695c4c-1b5c-4cc2-9f3a-2bcd092d17b1 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.357s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:17 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-97695c4c-1b5c-4cc2-9f3a-2bcd092d17b1 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Deleted allocations for instance e042fd98-eb22-4c6e-9eec-4bb0908fd5ce
Nov 22 07:56:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-97695c4c-1b5c-4cc2-9f3a-2bcd092d17b1 tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Lock "e042fd98-eb22-4c6e-9eec-4bb0908fd5ce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.351s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:18 user nova-compute[74348]: DEBUG nova.compute.manager [req-1b4ab742-b3a1-4c58-99db-7490e8b80329 req-c197fae4-1308-4208-bb8f-0183f91c4755 service nova] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Received event network-vif-plugged-f45f964e-a3d7-44c5-8629-db0cbcaeff15 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:56:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-1b4ab742-b3a1-4c58-99db-7490e8b80329 req-c197fae4-1308-4208-bb8f-0183f91c4755 service nova] Acquiring lock "e042fd98-eb22-4c6e-9eec-4bb0908fd5ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-1b4ab742-b3a1-4c58-99db-7490e8b80329 req-c197fae4-1308-4208-bb8f-0183f91c4755 service nova] Lock "e042fd98-eb22-4c6e-9eec-4bb0908fd5ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-1b4ab742-b3a1-4c58-99db-7490e8b80329 req-c197fae4-1308-4208-bb8f-0183f91c4755 service nova] Lock "e042fd98-eb22-4c6e-9eec-4bb0908fd5ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:18 user nova-compute[74348]: DEBUG nova.compute.manager [req-1b4ab742-b3a1-4c58-99db-7490e8b80329 req-c197fae4-1308-4208-bb8f-0183f91c4755 service nova] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] No waiting events found dispatching network-vif-plugged-f45f964e-a3d7-44c5-8629-db0cbcaeff15 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:56:18 user nova-compute[74348]: WARNING nova.compute.manager [req-1b4ab742-b3a1-4c58-99db-7490e8b80329 req-c197fae4-1308-4208-bb8f-0183f91c4755 service nova] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Received unexpected event network-vif-plugged-f45f964e-a3d7-44c5-8629-db0cbcaeff15 for instance with vm_state deleted and task_state None.
Nov 22 07:56:18 user nova-compute[74348]: DEBUG nova.compute.manager [req-1b4ab742-b3a1-4c58-99db-7490e8b80329 req-c197fae4-1308-4208-bb8f-0183f91c4755 service nova] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Received event network-vif-plugged-f45f964e-a3d7-44c5-8629-db0cbcaeff15 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:56:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-1b4ab742-b3a1-4c58-99db-7490e8b80329 req-c197fae4-1308-4208-bb8f-0183f91c4755 service nova] Acquiring lock "e042fd98-eb22-4c6e-9eec-4bb0908fd5ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-1b4ab742-b3a1-4c58-99db-7490e8b80329 req-c197fae4-1308-4208-bb8f-0183f91c4755 service nova] Lock "e042fd98-eb22-4c6e-9eec-4bb0908fd5ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-1b4ab742-b3a1-4c58-99db-7490e8b80329 req-c197fae4-1308-4208-bb8f-0183f91c4755 service nova] Lock "e042fd98-eb22-4c6e-9eec-4bb0908fd5ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:18 user nova-compute[74348]: DEBUG nova.compute.manager [req-1b4ab742-b3a1-4c58-99db-7490e8b80329 req-c197fae4-1308-4208-bb8f-0183f91c4755 service nova] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] No waiting events found dispatching network-vif-plugged-f45f964e-a3d7-44c5-8629-db0cbcaeff15 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:56:18 user nova-compute[74348]: WARNING nova.compute.manager [req-1b4ab742-b3a1-4c58-99db-7490e8b80329 req-c197fae4-1308-4208-bb8f-0183f91c4755 service nova] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Received unexpected event network-vif-plugged-f45f964e-a3d7-44c5-8629-db0cbcaeff15 for instance with vm_state deleted and task_state None.
Nov 22 07:56:18 user nova-compute[74348]: DEBUG nova.compute.manager [req-1b4ab742-b3a1-4c58-99db-7490e8b80329 req-c197fae4-1308-4208-bb8f-0183f91c4755 service nova] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Received event network-vif-plugged-f45f964e-a3d7-44c5-8629-db0cbcaeff15 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:56:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-1b4ab742-b3a1-4c58-99db-7490e8b80329 req-c197fae4-1308-4208-bb8f-0183f91c4755 service nova] Acquiring lock "e042fd98-eb22-4c6e-9eec-4bb0908fd5ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-1b4ab742-b3a1-4c58-99db-7490e8b80329 req-c197fae4-1308-4208-bb8f-0183f91c4755 service nova] Lock "e042fd98-eb22-4c6e-9eec-4bb0908fd5ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-1b4ab742-b3a1-4c58-99db-7490e8b80329 req-c197fae4-1308-4208-bb8f-0183f91c4755 service nova] Lock "e042fd98-eb22-4c6e-9eec-4bb0908fd5ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:18 user nova-compute[74348]: DEBUG nova.compute.manager [req-1b4ab742-b3a1-4c58-99db-7490e8b80329 req-c197fae4-1308-4208-bb8f-0183f91c4755 service nova] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] No waiting events found dispatching network-vif-plugged-f45f964e-a3d7-44c5-8629-db0cbcaeff15 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:56:18 user nova-compute[74348]: WARNING nova.compute.manager [req-1b4ab742-b3a1-4c58-99db-7490e8b80329 req-c197fae4-1308-4208-bb8f-0183f91c4755 service nova] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Received unexpected event network-vif-plugged-f45f964e-a3d7-44c5-8629-db0cbcaeff15 for instance with vm_state deleted and task_state None.
Nov 22 07:56:18 user nova-compute[74348]: DEBUG nova.compute.manager [req-1b4ab742-b3a1-4c58-99db-7490e8b80329 req-c197fae4-1308-4208-bb8f-0183f91c4755 service nova] [instance: e042fd98-eb22-4c6e-9eec-4bb0908fd5ce] Received event network-vif-deleted-f45f964e-a3d7-44c5-8629-db0cbcaeff15 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:56:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9ebc5ac3-557e-4472-a642-300b054aeeb6 tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Acquiring lock "88730c14-fd2a-4f63-bc10-96cea0b057eb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9ebc5ac3-557e-4472-a642-300b054aeeb6 tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Lock "88730c14-fd2a-4f63-bc10-96cea0b057eb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9ebc5ac3-557e-4472-a642-300b054aeeb6 tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Acquiring lock "88730c14-fd2a-4f63-bc10-96cea0b057eb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9ebc5ac3-557e-4472-a642-300b054aeeb6 tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Lock "88730c14-fd2a-4f63-bc10-96cea0b057eb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9ebc5ac3-557e-4472-a642-300b054aeeb6 tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Lock "88730c14-fd2a-4f63-bc10-96cea0b057eb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:18 user nova-compute[74348]: INFO nova.compute.manager [None req-9ebc5ac3-557e-4472-a642-300b054aeeb6 tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Terminating instance
Nov 22 07:56:18 user nova-compute[74348]: DEBUG nova.compute.manager [None req-9ebc5ac3-557e-4472-a642-300b054aeeb6 tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 07:56:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:19 user nova-compute[74348]: DEBUG nova.compute.manager [req-d17d9456-a958-45a3-bf12-dc1294d77d8b req-bd24060d-521c-41d6-a177-a29ab3af958c service nova] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Received event network-vif-unplugged-6a071188-e54b-4bb7-b4dc-e2fce0291c7e {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:56:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d17d9456-a958-45a3-bf12-dc1294d77d8b req-bd24060d-521c-41d6-a177-a29ab3af958c service nova] Acquiring lock "88730c14-fd2a-4f63-bc10-96cea0b057eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d17d9456-a958-45a3-bf12-dc1294d77d8b req-bd24060d-521c-41d6-a177-a29ab3af958c service nova] Lock "88730c14-fd2a-4f63-bc10-96cea0b057eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d17d9456-a958-45a3-bf12-dc1294d77d8b req-bd24060d-521c-41d6-a177-a29ab3af958c service nova] Lock "88730c14-fd2a-4f63-bc10-96cea0b057eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:19 user nova-compute[74348]: DEBUG nova.compute.manager [req-d17d9456-a958-45a3-bf12-dc1294d77d8b req-bd24060d-521c-41d6-a177-a29ab3af958c service nova] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] No waiting events found dispatching network-vif-unplugged-6a071188-e54b-4bb7-b4dc-e2fce0291c7e {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:56:19 user nova-compute[74348]: DEBUG nova.compute.manager [req-d17d9456-a958-45a3-bf12-dc1294d77d8b req-bd24060d-521c-41d6-a177-a29ab3af958c service nova] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Received event network-vif-unplugged-6a071188-e54b-4bb7-b4dc-e2fce0291c7e for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 07:56:19 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Instance destroyed successfully.
Nov 22 07:56:19 user nova-compute[74348]: DEBUG nova.objects.instance [None req-9ebc5ac3-557e-4472-a642-300b054aeeb6 tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Lazy-loading 'resources' on Instance uuid 88730c14-fd2a-4f63-bc10-96cea0b057eb {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:56:19 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-9ebc5ac3-557e-4472-a642-300b054aeeb6 tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:53:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1543681504',display_name='tempest-VolumesAssistedSnapshotsTest-server-1543681504',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1543681504',id=9,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZrL4Zme8L5bDgoNSR9ziJX2TyZge1e3/XDHGsbuZ+V20qLhnP2XGt23MvkV9fvpiu1wrovpXO2ZxROkmxZ+WdDgETO0gYYTaunE5sl9Zg/2e5SlPb4uJ9pp4YjPUuj+g==',key_name='tempest-keypair-293749558',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:53:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d9d2d0075b4a4ee7980d9a0b2cb9a220',ramdisk_id='',reservation_id='r-j7mjj1lr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-855823521',owner_user_name='tempest-VolumesAssistedSnapshotsTest-855823521-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T07:53:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8238efe52d2844dba4fc57f733fc8003',uuid=88730c14-fd2a-4f63-bc10-96cea0b057eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a071188-e54b-4bb7-b4dc-e2fce0291c7e", "address": "fa:16:3e:ac:c1:ef", "network": {"id": "47fbdc54-3fce-4cf3-970c-4dbd738b71a6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2128185295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d2d0075b4a4ee7980d9a0b2cb9a220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a071188-e5", "ovs_interfaceid": "6a071188-e54b-4bb7-b4dc-e2fce0291c7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 07:56:19 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-9ebc5ac3-557e-4472-a642-300b054aeeb6 tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Converting VIF {"id": "6a071188-e54b-4bb7-b4dc-e2fce0291c7e", "address": "fa:16:3e:ac:c1:ef", "network": {"id": "47fbdc54-3fce-4cf3-970c-4dbd738b71a6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2128185295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d2d0075b4a4ee7980d9a0b2cb9a220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a071188-e5", "ovs_interfaceid": "6a071188-e54b-4bb7-b4dc-e2fce0291c7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:56:19 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-9ebc5ac3-557e-4472-a642-300b054aeeb6 tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:c1:ef,bridge_name='br-int',has_traffic_filtering=True,id=6a071188-e54b-4bb7-b4dc-e2fce0291c7e,network=Network(47fbdc54-3fce-4cf3-970c-4dbd738b71a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a071188-e5') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:56:19 user nova-compute[74348]: DEBUG os_vif [None req-9ebc5ac3-557e-4472-a642-300b054aeeb6 tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:c1:ef,bridge_name='br-int',has_traffic_filtering=True,id=6a071188-e54b-4bb7-b4dc-e2fce0291c7e,network=Network(47fbdc54-3fce-4cf3-970c-4dbd738b71a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a071188-e5') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 07:56:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a071188-e5, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:56:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:56:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f9004757-fa16-4391-a536-ea458b89d98f) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:56:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:56:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:19 user nova-compute[74348]: INFO os_vif [None req-9ebc5ac3-557e-4472-a642-300b054aeeb6 tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:c1:ef,bridge_name='br-int',has_traffic_filtering=True,id=6a071188-e54b-4bb7-b4dc-e2fce0291c7e,network=Network(47fbdc54-3fce-4cf3-970c-4dbd738b71a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a071188-e5')
Nov 22 07:56:19 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-9ebc5ac3-557e-4472-a642-300b054aeeb6 tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Deleting instance files /opt/stack/data/nova/instances/88730c14-fd2a-4f63-bc10-96cea0b057eb_del
Nov 22 07:56:19 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-9ebc5ac3-557e-4472-a642-300b054aeeb6 tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Deletion of /opt/stack/data/nova/instances/88730c14-fd2a-4f63-bc10-96cea0b057eb_del complete
Nov 22 07:56:19 user nova-compute[74348]: INFO nova.compute.manager [None req-9ebc5ac3-557e-4472-a642-300b054aeeb6 tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 22 07:56:19 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-9ebc5ac3-557e-4472-a642-300b054aeeb6 tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 07:56:19 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 07:56:19 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 07:56:20 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:56:20 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Took 0.62 seconds to deallocate network for instance.
Nov 22 07:56:20 user nova-compute[74348]: DEBUG nova.compute.manager [req-2024699f-4007-4860-8d4d-cbf642d22e69 req-89fc9fe2-95b7-4fe7-90cb-aa761adc65d5 service nova] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Received event network-vif-deleted-6a071188-e54b-4bb7-b4dc-e2fce0291c7e {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:56:20 user nova-compute[74348]: INFO nova.compute.manager [req-2024699f-4007-4860-8d4d-cbf642d22e69 req-89fc9fe2-95b7-4fe7-90cb-aa761adc65d5 service nova] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Neutron deleted interface 6a071188-e54b-4bb7-b4dc-e2fce0291c7e; detaching it from the instance and deleting it from the info cache
Nov 22 07:56:20 user nova-compute[74348]: DEBUG nova.network.neutron [req-2024699f-4007-4860-8d4d-cbf642d22e69 req-89fc9fe2-95b7-4fe7-90cb-aa761adc65d5 service nova] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:56:20 user nova-compute[74348]: DEBUG nova.compute.manager [req-2024699f-4007-4860-8d4d-cbf642d22e69 req-89fc9fe2-95b7-4fe7-90cb-aa761adc65d5 service nova] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Detach interface failed, port_id=6a071188-e54b-4bb7-b4dc-e2fce0291c7e, reason: Instance 88730c14-fd2a-4f63-bc10-96cea0b057eb could not be found. {{(pid=74348) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 07:56:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9ebc5ac3-557e-4472-a642-300b054aeeb6 tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9ebc5ac3-557e-4472-a642-300b054aeeb6 tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:20 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-9ebc5ac3-557e-4472-a642-300b054aeeb6 tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:56:20 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-9ebc5ac3-557e-4472-a642-300b054aeeb6 tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:56:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9ebc5ac3-557e-4472-a642-300b054aeeb6 tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:20 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-9ebc5ac3-557e-4472-a642-300b054aeeb6 tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Deleted allocations for instance 88730c14-fd2a-4f63-bc10-96cea0b057eb
Nov 22 07:56:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9ebc5ac3-557e-4472-a642-300b054aeeb6 tempest-VolumesAssistedSnapshotsTest-855823521 tempest-VolumesAssistedSnapshotsTest-855823521-project-member] Lock "88730c14-fd2a-4f63-bc10-96cea0b057eb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.100s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:21 user nova-compute[74348]: DEBUG nova.compute.manager [req-db9509a3-a4c4-42a9-b774-528f66b8e5fb req-8bac56ea-a762-459f-8d8a-dbd6dbda685b service nova] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Received event network-vif-plugged-6a071188-e54b-4bb7-b4dc-e2fce0291c7e {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:56:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-db9509a3-a4c4-42a9-b774-528f66b8e5fb req-8bac56ea-a762-459f-8d8a-dbd6dbda685b service nova] Acquiring lock "88730c14-fd2a-4f63-bc10-96cea0b057eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-db9509a3-a4c4-42a9-b774-528f66b8e5fb req-8bac56ea-a762-459f-8d8a-dbd6dbda685b service nova] Lock "88730c14-fd2a-4f63-bc10-96cea0b057eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-db9509a3-a4c4-42a9-b774-528f66b8e5fb req-8bac56ea-a762-459f-8d8a-dbd6dbda685b service nova] Lock "88730c14-fd2a-4f63-bc10-96cea0b057eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:21 user nova-compute[74348]: DEBUG nova.compute.manager [req-db9509a3-a4c4-42a9-b774-528f66b8e5fb req-8bac56ea-a762-459f-8d8a-dbd6dbda685b service nova] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] No waiting events found dispatching network-vif-plugged-6a071188-e54b-4bb7-b4dc-e2fce0291c7e {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:56:21 user nova-compute[74348]: WARNING nova.compute.manager [req-db9509a3-a4c4-42a9-b774-528f66b8e5fb req-8bac56ea-a762-459f-8d8a-dbd6dbda685b service nova] [instance: 88730c14-fd2a-4f63-bc10-96cea0b057eb] Received unexpected event network-vif-plugged-6a071188-e54b-4bb7-b4dc-e2fce0291c7e for instance with vm_state deleted and task_state None.
Nov 22 07:56:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:23 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-00f877b9-705d-4c50-9597-016d5ccbc72c tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Waiting for libvirt event about the detach of device tap1f80afa8-d6 with device alias net1 from instance bdad025e-8f6c-419a-99ea-bf277f6c5577 is timed out.
Nov 22 07:56:23 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-00f877b9-705d-4c50-9597-016d5ccbc72c tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c2:25:c9"/><model type="virtio"/><mtu size="1442"/><target dev="tap1f80afa8-d6"/></interface> {{(pid=74348) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 22 07:56:23 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-00f877b9-705d-4c50-9597-016d5ccbc72c tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c2:25:c9"/><model type="virtio"/><mtu size="1442"/><target dev="tap1f80afa8-d6"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 22 07:56:23 user nova-compute[74348]:   <name>instance-00000008</name>
Nov 22 07:56:23 user nova-compute[74348]:   <uuid>bdad025e-8f6c-419a-99ea-bf277f6c5577</uuid>
Nov 22 07:56:23 user nova-compute[74348]:   <metadata>
Nov 22 07:56:23 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 07:56:23 user nova-compute[74348]:   <nova:package version="0.0.0"/>
Nov 22 07:56:23 user nova-compute[74348]:   <nova:name>tempest-device-tagging-server-726810190</nova:name>
Nov 22 07:56:23 user nova-compute[74348]:   <nova:creationTime>2023-11-22 07:55:04</nova:creationTime>
Nov 22 07:56:23 user nova-compute[74348]:   <nova:flavor name="m1.tiny">
Nov 22 07:56:23 user nova-compute[74348]:     <nova:memory>512</nova:memory>
Nov 22 07:56:23 user nova-compute[74348]:     <nova:disk>1</nova:disk>
Nov 22 07:56:23 user nova-compute[74348]:     <nova:swap>0</nova:swap>
Nov 22 07:56:23 user nova-compute[74348]:     <nova:ephemeral>0</nova:ephemeral>
Nov 22 07:56:23 user nova-compute[74348]:     <nova:vcpus>1</nova:vcpus>
Nov 22 07:56:23 user nova-compute[74348]:   </nova:flavor>
Nov 22 07:56:23 user nova-compute[74348]:   <nova:owner>
Nov 22 07:56:23 user nova-compute[74348]:     <nova:user uuid="df4cae77b03e4395887815058f3a8a42">tempest-TaggedAttachmentsTest-659854772-project-member</nova:user>
Nov 22 07:56:23 user nova-compute[74348]:     <nova:project uuid="2f078468965946f6aed352374702843c">tempest-TaggedAttachmentsTest-659854772</nova:project>
Nov 22 07:56:23 user nova-compute[74348]:   </nova:owner>
Nov 22 07:56:23 user nova-compute[74348]:   <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 07:56:23 user nova-compute[74348]:   <nova:ports>
Nov 22 07:56:23 user nova-compute[74348]:     <nova:port uuid="f47b39b9-31a2-4f9b-a5e5-ec139067b6d4">
Nov 22 07:56:23 user nova-compute[74348]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 22 07:56:23 user nova-compute[74348]:     </nova:port>
Nov 22 07:56:23 user nova-compute[74348]:     <nova:port uuid="1f80afa8-d693-44a8-86ff-0fec89d2e510">
Nov 22 07:56:23 user nova-compute[74348]:       <nova:ip type="fixed" address="10.10.10.170" ipVersion="4"/>
Nov 22 07:56:23 user nova-compute[74348]:     </nova:port>
Nov 22 07:56:23 user nova-compute[74348]:   </nova:ports>
Nov 22 07:56:23 user nova-compute[74348]: </nova:instance>
Nov 22 07:56:23 user nova-compute[74348]:   </metadata>
Nov 22 07:56:23 user nova-compute[74348]:   <memory unit='KiB'>524288</memory>
Nov 22 07:56:23 user nova-compute[74348]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 22 07:56:23 user nova-compute[74348]:   <vcpu placement='static'>1</vcpu>
Nov 22 07:56:23 user nova-compute[74348]:   <resource>
Nov 22 07:56:23 user nova-compute[74348]:     <partition>/machine</partition>
Nov 22 07:56:23 user nova-compute[74348]:   </resource>
Nov 22 07:56:23 user nova-compute[74348]:   <sysinfo type='smbios'>
Nov 22 07:56:23 user nova-compute[74348]:     <system>
Nov 22 07:56:23 user nova-compute[74348]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 22 07:56:23 user nova-compute[74348]:       <entry name='product'>OpenStack Nova</entry>
Nov 22 07:56:23 user nova-compute[74348]:       <entry name='version'>0.0.0</entry>
Nov 22 07:56:23 user nova-compute[74348]:       <entry name='serial'>bdad025e-8f6c-419a-99ea-bf277f6c5577</entry>
Nov 22 07:56:23 user nova-compute[74348]:       <entry name='uuid'>bdad025e-8f6c-419a-99ea-bf277f6c5577</entry>
Nov 22 07:56:23 user nova-compute[74348]:       <entry name='family'>Virtual Machine</entry>
Nov 22 07:56:23 user nova-compute[74348]:     </system>
Nov 22 07:56:23 user nova-compute[74348]:   </sysinfo>
Nov 22 07:56:23 user nova-compute[74348]:   <os>
Nov 22 07:56:23 user nova-compute[74348]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 22 07:56:23 user nova-compute[74348]:     <boot dev='hd'/>
Nov 22 07:56:23 user nova-compute[74348]:     <smbios mode='sysinfo'/>
Nov 22 07:56:23 user nova-compute[74348]:   </os>
Nov 22 07:56:23 user nova-compute[74348]:   <features>
Nov 22 07:56:23 user nova-compute[74348]:     <acpi/>
Nov 22 07:56:23 user nova-compute[74348]:     <apic/>
Nov 22 07:56:23 user nova-compute[74348]:     <vmcoreinfo state='on'/>
Nov 22 07:56:23 user nova-compute[74348]:   </features>
Nov 22 07:56:23 user nova-compute[74348]:   <cpu mode='custom' match='exact' check='full'>
Nov 22 07:56:23 user nova-compute[74348]:     <model fallback='forbid'>Nehalem</model>
Nov 22 07:56:23 user nova-compute[74348]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 22 07:56:23 user nova-compute[74348]:     <feature policy='require' name='vme'/>
Nov 22 07:56:23 user nova-compute[74348]:     <feature policy='require' name='x2apic'/>
Nov 22 07:56:23 user nova-compute[74348]:     <feature policy='require' name='hypervisor'/>
Nov 22 07:56:23 user nova-compute[74348]:   </cpu>
Nov 22 07:56:23 user nova-compute[74348]:   <clock offset='utc'>
Nov 22 07:56:23 user nova-compute[74348]:     <timer name='pit' tickpolicy='delay'/>
Nov 22 07:56:23 user nova-compute[74348]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 22 07:56:23 user nova-compute[74348]:     <timer name='hpet' present='no'/>
Nov 22 07:56:23 user nova-compute[74348]:   </clock>
Nov 22 07:56:23 user nova-compute[74348]:   <on_poweroff>destroy</on_poweroff>
Nov 22 07:56:23 user nova-compute[74348]:   <on_reboot>restart</on_reboot>
Nov 22 07:56:23 user nova-compute[74348]:   <on_crash>destroy</on_crash>
Nov 22 07:56:23 user nova-compute[74348]:   <devices>
Nov 22 07:56:23 user nova-compute[74348]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 22 07:56:23 user nova-compute[74348]:     <disk type='file' device='disk'>
Nov 22 07:56:23 user nova-compute[74348]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 22 07:56:23 user nova-compute[74348]:       <source file='/opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/disk' index='2'/>
Nov 22 07:56:23 user nova-compute[74348]:       <backingStore type='file' index='3'>
Nov 22 07:56:23 user nova-compute[74348]:         <format type='raw'/>
Nov 22 07:56:23 user nova-compute[74348]:         <source file='/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263'/>
Nov 22 07:56:23 user nova-compute[74348]:         <backingStore/>
Nov 22 07:56:23 user nova-compute[74348]:       </backingStore>
Nov 22 07:56:23 user nova-compute[74348]:       <target dev='vda' bus='virtio'/>
Nov 22 07:56:23 user nova-compute[74348]:       <alias name='virtio-disk0'/>
Nov 22 07:56:23 user nova-compute[74348]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 22 07:56:23 user nova-compute[74348]:     </disk>
Nov 22 07:56:23 user nova-compute[74348]:     <disk type='file' device='cdrom'>
Nov 22 07:56:23 user nova-compute[74348]:       <driver name='qemu' type='raw' cache='none'/>
Nov 22 07:56:23 user nova-compute[74348]:       <source file='/opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/disk.config' index='1'/>
Nov 22 07:56:23 user nova-compute[74348]:       <backingStore/>
Nov 22 07:56:23 user nova-compute[74348]:       <target dev='hda' bus='ide'/>
Nov 22 07:56:23 user nova-compute[74348]:       <readonly/>
Nov 22 07:56:23 user nova-compute[74348]:       <alias name='ide0-0-0'/>
Nov 22 07:56:23 user nova-compute[74348]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 22 07:56:23 user nova-compute[74348]:     </disk>
Nov 22 07:56:23 user nova-compute[74348]:     <controller type='usb' index='0' model='none'>
Nov 22 07:56:23 user nova-compute[74348]:       <alias name='usb'/>
Nov 22 07:56:23 user nova-compute[74348]:     </controller>
Nov 22 07:56:23 user nova-compute[74348]:     <controller type='pci' index='0' model='pci-root'>
Nov 22 07:56:23 user nova-compute[74348]:       <alias name='pci.0'/>
Nov 22 07:56:23 user nova-compute[74348]:     </controller>
Nov 22 07:56:23 user nova-compute[74348]:     <controller type='ide' index='0'>
Nov 22 07:56:23 user nova-compute[74348]:       <alias name='ide'/>
Nov 22 07:56:23 user nova-compute[74348]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 22 07:56:23 user nova-compute[74348]:     </controller>
Nov 22 07:56:23 user nova-compute[74348]:     <interface type='ethernet'>
Nov 22 07:56:23 user nova-compute[74348]:       <mac address='fa:16:3e:36:02:a6'/>
Nov 22 07:56:23 user nova-compute[74348]:       <target dev='tapf47b39b9-31'/>
Nov 22 07:56:23 user nova-compute[74348]:       <model type='virtio'/>
Nov 22 07:56:23 user nova-compute[74348]:       <mtu size='1442'/>
Nov 22 07:56:23 user nova-compute[74348]:       <alias name='net0'/>
Nov 22 07:56:23 user nova-compute[74348]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 22 07:56:23 user nova-compute[74348]:     </interface>
Nov 22 07:56:23 user nova-compute[74348]:     <serial type='pty'>
Nov 22 07:56:23 user nova-compute[74348]:       <source path='/dev/pts/7'/>
Nov 22 07:56:23 user nova-compute[74348]:       <log file='/opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/console.log' append='off'/>
Nov 22 07:56:23 user nova-compute[74348]:       <target type='isa-serial' port='0'>
Nov 22 07:56:23 user nova-compute[74348]:         <model name='isa-serial'/>
Nov 22 07:56:23 user nova-compute[74348]:       </target>
Nov 22 07:56:23 user nova-compute[74348]:       <alias name='serial0'/>
Nov 22 07:56:23 user nova-compute[74348]:     </serial>
Nov 22 07:56:23 user nova-compute[74348]:     <console type='pty' tty='/dev/pts/7'>
Nov 22 07:56:23 user nova-compute[74348]:       <source path='/dev/pts/7'/>
Nov 22 07:56:23 user nova-compute[74348]:       <log file='/opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/console.log' append='off'/>
Nov 22 07:56:23 user nova-compute[74348]:       <target type='serial' port='0'/>
Nov 22 07:56:23 user nova-compute[74348]:       <alias name='serial0'/>
Nov 22 07:56:23 user nova-compute[74348]:     </console>
Nov 22 07:56:23 user nova-compute[74348]:     <input type='mouse' bus='ps2'>
Nov 22 07:56:23 user nova-compute[74348]:       <alias name='input0'/>
Nov 22 07:56:23 user nova-compute[74348]:     </input>
Nov 22 07:56:23 user nova-compute[74348]:     <input type='keyboard' bus='ps2'>
Nov 22 07:56:23 user nova-compute[74348]:       <alias name='input1'/>
Nov 22 07:56:23 user nova-compute[74348]:     </input>
Nov 22 07:56:23 user nova-compute[74348]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 22 07:56:23 user nova-compute[74348]:       <listen type='address' address='0.0.0.0'/>
Nov 22 07:56:23 user nova-compute[74348]:     </graphics>
Nov 22 07:56:23 user nova-compute[74348]:     <audio id='1' type='none'/>
Nov 22 07:56:23 user nova-compute[74348]:     <video>
Nov 22 07:56:23 user nova-compute[74348]:       <model type='virtio' heads='1' primary='yes'/>
Nov 22 07:56:23 user nova-compute[74348]:       <alias name='video0'/>
Nov 22 07:56:23 user nova-compute[74348]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 22 07:56:23 user nova-compute[74348]:     </video>
Nov 22 07:56:23 user nova-compute[74348]:     <memballoon model='virtio'>
Nov 22 07:56:23 user nova-compute[74348]:       <stats period='10'/>
Nov 22 07:56:23 user nova-compute[74348]:       <alias name='balloon0'/>
Nov 22 07:56:23 user nova-compute[74348]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 22 07:56:23 user nova-compute[74348]:     </memballoon>
Nov 22 07:56:23 user nova-compute[74348]:     <rng model='virtio'>
Nov 22 07:56:23 user nova-compute[74348]:       <backend model='random'>/dev/urandom</backend>
Nov 22 07:56:23 user nova-compute[74348]:       <alias name='rng0'/>
Nov 22 07:56:23 user nova-compute[74348]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 22 07:56:23 user nova-compute[74348]:     </rng>
Nov 22 07:56:23 user nova-compute[74348]:   </devices>
Nov 22 07:56:23 user nova-compute[74348]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 22 07:56:23 user nova-compute[74348]:     <label>libvirt-bdad025e-8f6c-419a-99ea-bf277f6c5577</label>
Nov 22 07:56:23 user nova-compute[74348]:     <imagelabel>libvirt-bdad025e-8f6c-419a-99ea-bf277f6c5577</imagelabel>
Nov 22 07:56:23 user nova-compute[74348]:   </seclabel>
Nov 22 07:56:23 user nova-compute[74348]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 22 07:56:23 user nova-compute[74348]:     <label>+64055:+108</label>
Nov 22 07:56:23 user nova-compute[74348]:     <imagelabel>+64055:+108</imagelabel>
Nov 22 07:56:23 user nova-compute[74348]:   </seclabel>
Nov 22 07:56:23 user nova-compute[74348]: </domain>
Nov 22 07:56:23 user nova-compute[74348]:  {{(pid=74348) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 22 07:56:23 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-00f877b9-705d-4c50-9597-016d5ccbc72c tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Successfully detached device tap1f80afa8-d6 from instance bdad025e-8f6c-419a-99ea-bf277f6c5577 from the live domain config.
Nov 22 07:56:23 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-00f877b9-705d-4c50-9597-016d5ccbc72c tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-726810190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-726810190',id=8,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2d2AMx5MTcXajy6b7uPsq3+jYxxbAAyYP5uwFXUURVQR6N2+iGSyaCZAQVBr0xq/5GZlgBfcRmwRXF9ZovM3nD3R4hcY3OcZ/S/sjuTSQBqYHlzsArXECyBywfXW3yNw==',key_name='tempest-keypair-266871328',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:53:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f078468965946f6aed352374702843c',ramdisk_id='',reservation_id='r-nuqss0no',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-659854772',owner_user_name='tempest-TaggedAttachmentsTest-659854772-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T07:53:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df4cae77b03e4395887815058f3a8a42',uuid=bdad025e-8f6c-419a-99ea-bf277f6c5577,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f80afa8-d693-44a8-86ff-0fec89d2e510", "address": "fa:16:3e:c2:25:c9", "network": {"id": "11db4075-7b75-40bf-b506-4f4ea3f9631c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2016258335", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2f078468965946f6aed352374702843c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f80afa8-d6", "ovs_interfaceid": "1f80afa8-d693-44a8-86ff-0fec89d2e510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 07:56:23 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-00f877b9-705d-4c50-9597-016d5ccbc72c tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Converting VIF {"id": "1f80afa8-d693-44a8-86ff-0fec89d2e510", "address": "fa:16:3e:c2:25:c9", "network": {"id": "11db4075-7b75-40bf-b506-4f4ea3f9631c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2016258335", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2f078468965946f6aed352374702843c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f80afa8-d6", "ovs_interfaceid": "1f80afa8-d693-44a8-86ff-0fec89d2e510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:56:23 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-00f877b9-705d-4c50-9597-016d5ccbc72c tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:25:c9,bridge_name='br-int',has_traffic_filtering=True,id=1f80afa8-d693-44a8-86ff-0fec89d2e510,network=Network(11db4075-7b75-40bf-b506-4f4ea3f9631c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f80afa8-d6') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:56:23 user nova-compute[74348]: DEBUG os_vif [None req-00f877b9-705d-4c50-9597-016d5ccbc72c tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:25:c9,bridge_name='br-int',has_traffic_filtering=True,id=1f80afa8-d693-44a8-86ff-0fec89d2e510,network=Network(11db4075-7b75-40bf-b506-4f4ea3f9631c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f80afa8-d6') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 07:56:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f80afa8-d6, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:56:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:56:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bd228c6e-d75f-4008-be05-e12d909b428c) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:56:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:56:23 user nova-compute[74348]: INFO os_vif [None req-00f877b9-705d-4c50-9597-016d5ccbc72c tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:25:c9,bridge_name='br-int',has_traffic_filtering=True,id=1f80afa8-d693-44a8-86ff-0fec89d2e510,network=Network(11db4075-7b75-40bf-b506-4f4ea3f9631c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f80afa8-d6')
Nov 22 07:56:23 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-00f877b9-705d-4c50-9597-016d5ccbc72c tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 07:56:23 user nova-compute[74348]:   <nova:package version="0.0.0"/>
Nov 22 07:56:23 user nova-compute[74348]:   <nova:name>tempest-device-tagging-server-726810190</nova:name>
Nov 22 07:56:23 user nova-compute[74348]:   <nova:creationTime>2023-11-22 07:56:23</nova:creationTime>
Nov 22 07:56:23 user nova-compute[74348]:   <nova:flavor name="m1.tiny">
Nov 22 07:56:23 user nova-compute[74348]:     <nova:memory>512</nova:memory>
Nov 22 07:56:23 user nova-compute[74348]:     <nova:disk>1</nova:disk>
Nov 22 07:56:23 user nova-compute[74348]:     <nova:swap>0</nova:swap>
Nov 22 07:56:23 user nova-compute[74348]:     <nova:ephemeral>0</nova:ephemeral>
Nov 22 07:56:23 user nova-compute[74348]:     <nova:vcpus>1</nova:vcpus>
Nov 22 07:56:23 user nova-compute[74348]:   </nova:flavor>
Nov 22 07:56:23 user nova-compute[74348]:   <nova:owner>
Nov 22 07:56:23 user nova-compute[74348]:     <nova:user uuid="df4cae77b03e4395887815058f3a8a42">tempest-TaggedAttachmentsTest-659854772-project-member</nova:user>
Nov 22 07:56:23 user nova-compute[74348]:     <nova:project uuid="2f078468965946f6aed352374702843c">tempest-TaggedAttachmentsTest-659854772</nova:project>
Nov 22 07:56:23 user nova-compute[74348]:   </nova:owner>
Nov 22 07:56:23 user nova-compute[74348]:   <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 07:56:23 user nova-compute[74348]:   <nova:ports>
Nov 22 07:56:23 user nova-compute[74348]:     <nova:port uuid="f47b39b9-31a2-4f9b-a5e5-ec139067b6d4">
Nov 22 07:56:23 user nova-compute[74348]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 22 07:56:23 user nova-compute[74348]:     </nova:port>
Nov 22 07:56:23 user nova-compute[74348]:   </nova:ports>
Nov 22 07:56:23 user nova-compute[74348]: </nova:instance>
Nov 22 07:56:23 user nova-compute[74348]:  {{(pid=74348) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 22 07:56:24 user nova-compute[74348]: DEBUG nova.compute.manager [req-f7aca1db-b06b-43b4-8f58-7170476d1f2a req-c754c71b-c75f-4068-a8c5-9b6cbc4cf0de service nova] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Received event network-vif-deleted-1f80afa8-d693-44a8-86ff-0fec89d2e510 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:56:24 user nova-compute[74348]: INFO nova.compute.manager [req-f7aca1db-b06b-43b4-8f58-7170476d1f2a req-c754c71b-c75f-4068-a8c5-9b6cbc4cf0de service nova] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Neutron deleted interface 1f80afa8-d693-44a8-86ff-0fec89d2e510; detaching it from the instance and deleting it from the info cache
Nov 22 07:56:24 user nova-compute[74348]: DEBUG nova.network.neutron [req-f7aca1db-b06b-43b4-8f58-7170476d1f2a req-c754c71b-c75f-4068-a8c5-9b6cbc4cf0de service nova] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Updating instance_info_cache with network_info: [{"id": "f47b39b9-31a2-4f9b-a5e5-ec139067b6d4", "address": "fa:16:3e:36:02:a6", "network": {"id": "e0159f32-e7c5-41b9-b652-8e2ca87f9018", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1248845008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f078468965946f6aed352374702843c", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47b39b9-31", "ovs_interfaceid": "f47b39b9-31a2-4f9b-a5e5-ec139067b6d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:56:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-00f877b9-705d-4c50-9597-016d5ccbc72c tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Acquiring lock "refresh_cache-bdad025e-8f6c-419a-99ea-bf277f6c5577" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:56:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-00f877b9-705d-4c50-9597-016d5ccbc72c tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Acquired lock "refresh_cache-bdad025e-8f6c-419a-99ea-bf277f6c5577" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:56:24 user nova-compute[74348]: DEBUG nova.network.neutron [None req-00f877b9-705d-4c50-9597-016d5ccbc72c tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 07:56:24 user nova-compute[74348]: DEBUG nova.objects.instance [req-f7aca1db-b06b-43b4-8f58-7170476d1f2a req-c754c71b-c75f-4068-a8c5-9b6cbc4cf0de service nova] Lazy-loading 'system_metadata' on Instance uuid bdad025e-8f6c-419a-99ea-bf277f6c5577 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:56:24 user nova-compute[74348]: DEBUG nova.objects.instance [req-f7aca1db-b06b-43b4-8f58-7170476d1f2a req-c754c71b-c75f-4068-a8c5-9b6cbc4cf0de service nova] Lazy-loading 'flavor' on Instance uuid bdad025e-8f6c-419a-99ea-bf277f6c5577 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:56:24 user nova-compute[74348]: DEBUG nova.objects.base [req-f7aca1db-b06b-43b4-8f58-7170476d1f2a req-c754c71b-c75f-4068-a8c5-9b6cbc4cf0de service nova] Object Instance<bdad025e-8f6c-419a-99ea-bf277f6c5577> lazy-loaded attributes: system_metadata,flavor {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 07:56:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [req-f7aca1db-b06b-43b4-8f58-7170476d1f2a req-c754c71b-c75f-4068-a8c5-9b6cbc4cf0de service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-726810190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-726810190',id=8,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2d2AMx5MTcXajy6b7uPsq3+jYxxbAAyYP5uwFXUURVQR6N2+iGSyaCZAQVBr0xq/5GZlgBfcRmwRXF9ZovM3nD3R4hcY3OcZ/S/sjuTSQBqYHlzsArXECyBywfXW3yNw==',key_name='tempest-keypair-266871328',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:53:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f078468965946f6aed352374702843c',ramdisk_id='',reservation_id='r-nuqss0no',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-659854772',owner_user_name='tempest-TaggedAttachmentsTest-659854772-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T07:53:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df4cae77b03e4395887815058f3a8a42',uuid=bdad025e-8f6c-419a-99ea-bf277f6c5577,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f80afa8-d693-44a8-86ff-0fec89d2e510", "address": "fa:16:3e:c2:25:c9", "network": {"id": "11db4075-7b75-40bf-b506-4f4ea3f9631c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2016258335", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2f078468965946f6aed352374702843c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f80afa8-d6", "ovs_interfaceid": "1f80afa8-d693-44a8-86ff-0fec89d2e510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 07:56:24 user nova-compute[74348]: DEBUG nova.network.os_vif_util [req-f7aca1db-b06b-43b4-8f58-7170476d1f2a req-c754c71b-c75f-4068-a8c5-9b6cbc4cf0de service nova] Converting VIF {"id": "1f80afa8-d693-44a8-86ff-0fec89d2e510", "address": "fa:16:3e:c2:25:c9", "network": {"id": "11db4075-7b75-40bf-b506-4f4ea3f9631c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2016258335", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2f078468965946f6aed352374702843c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f80afa8-d6", "ovs_interfaceid": "1f80afa8-d693-44a8-86ff-0fec89d2e510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:56:24 user nova-compute[74348]: DEBUG nova.network.os_vif_util [req-f7aca1db-b06b-43b4-8f58-7170476d1f2a req-c754c71b-c75f-4068-a8c5-9b6cbc4cf0de service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:25:c9,bridge_name='br-int',has_traffic_filtering=True,id=1f80afa8-d693-44a8-86ff-0fec89d2e510,network=Network(11db4075-7b75-40bf-b506-4f4ea3f9631c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f80afa8-d6') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:56:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [req-f7aca1db-b06b-43b4-8f58-7170476d1f2a req-c754c71b-c75f-4068-a8c5-9b6cbc4cf0de service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c2:25:c9"/><model type="virtio"/><mtu size="1442"/><target dev="tap1f80afa8-d6"/></interface> {{(pid=74348) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 22 07:56:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [req-f7aca1db-b06b-43b4-8f58-7170476d1f2a req-c754c71b-c75f-4068-a8c5-9b6cbc4cf0de service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c2:25:c9"/><model type="virtio"/><mtu size="1442"/><target dev="tap1f80afa8-d6"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 22 07:56:24 user nova-compute[74348]:   <name>instance-00000008</name>
Nov 22 07:56:24 user nova-compute[74348]:   <uuid>bdad025e-8f6c-419a-99ea-bf277f6c5577</uuid>
Nov 22 07:56:24 user nova-compute[74348]:   <metadata>
Nov 22 07:56:24 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 07:56:24 user nova-compute[74348]:   <nova:package version="0.0.0"/>
Nov 22 07:56:24 user nova-compute[74348]:   <nova:name>tempest-device-tagging-server-726810190</nova:name>
Nov 22 07:56:24 user nova-compute[74348]:   <nova:creationTime>2023-11-22 07:56:23</nova:creationTime>
Nov 22 07:56:24 user nova-compute[74348]:   <nova:flavor name="m1.tiny">
Nov 22 07:56:24 user nova-compute[74348]:     <nova:memory>512</nova:memory>
Nov 22 07:56:24 user nova-compute[74348]:     <nova:disk>1</nova:disk>
Nov 22 07:56:24 user nova-compute[74348]:     <nova:swap>0</nova:swap>
Nov 22 07:56:24 user nova-compute[74348]:     <nova:ephemeral>0</nova:ephemeral>
Nov 22 07:56:24 user nova-compute[74348]:     <nova:vcpus>1</nova:vcpus>
Nov 22 07:56:24 user nova-compute[74348]:   </nova:flavor>
Nov 22 07:56:24 user nova-compute[74348]:   <nova:owner>
Nov 22 07:56:24 user nova-compute[74348]:     <nova:user uuid="df4cae77b03e4395887815058f3a8a42">tempest-TaggedAttachmentsTest-659854772-project-member</nova:user>
Nov 22 07:56:24 user nova-compute[74348]:     <nova:project uuid="2f078468965946f6aed352374702843c">tempest-TaggedAttachmentsTest-659854772</nova:project>
Nov 22 07:56:24 user nova-compute[74348]:   </nova:owner>
Nov 22 07:56:24 user nova-compute[74348]:   <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 07:56:24 user nova-compute[74348]:   <nova:ports>
Nov 22 07:56:24 user nova-compute[74348]:     <nova:port uuid="f47b39b9-31a2-4f9b-a5e5-ec139067b6d4">
Nov 22 07:56:24 user nova-compute[74348]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 22 07:56:24 user nova-compute[74348]:     </nova:port>
Nov 22 07:56:24 user nova-compute[74348]:   </nova:ports>
Nov 22 07:56:24 user nova-compute[74348]: </nova:instance>
Nov 22 07:56:24 user nova-compute[74348]:   </metadata>
Nov 22 07:56:24 user nova-compute[74348]:   <memory unit='KiB'>524288</memory>
Nov 22 07:56:24 user nova-compute[74348]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 22 07:56:24 user nova-compute[74348]:   <vcpu placement='static'>1</vcpu>
Nov 22 07:56:24 user nova-compute[74348]:   <resource>
Nov 22 07:56:24 user nova-compute[74348]:     <partition>/machine</partition>
Nov 22 07:56:24 user nova-compute[74348]:   </resource>
Nov 22 07:56:24 user nova-compute[74348]:   <sysinfo type='smbios'>
Nov 22 07:56:24 user nova-compute[74348]:     <system>
Nov 22 07:56:24 user nova-compute[74348]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 22 07:56:24 user nova-compute[74348]:       <entry name='product'>OpenStack Nova</entry>
Nov 22 07:56:24 user nova-compute[74348]:       <entry name='version'>0.0.0</entry>
Nov 22 07:56:24 user nova-compute[74348]:       <entry name='serial'>bdad025e-8f6c-419a-99ea-bf277f6c5577</entry>
Nov 22 07:56:24 user nova-compute[74348]:       <entry name='uuid'>bdad025e-8f6c-419a-99ea-bf277f6c5577</entry>
Nov 22 07:56:24 user nova-compute[74348]:       <entry name='family'>Virtual Machine</entry>
Nov 22 07:56:24 user nova-compute[74348]:     </system>
Nov 22 07:56:24 user nova-compute[74348]:   </sysinfo>
Nov 22 07:56:24 user nova-compute[74348]:   <os>
Nov 22 07:56:24 user nova-compute[74348]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 22 07:56:24 user nova-compute[74348]:     <boot dev='hd'/>
Nov 22 07:56:24 user nova-compute[74348]:     <smbios mode='sysinfo'/>
Nov 22 07:56:24 user nova-compute[74348]:   </os>
Nov 22 07:56:24 user nova-compute[74348]:   <features>
Nov 22 07:56:24 user nova-compute[74348]:     <acpi/>
Nov 22 07:56:24 user nova-compute[74348]:     <apic/>
Nov 22 07:56:24 user nova-compute[74348]:     <vmcoreinfo state='on'/>
Nov 22 07:56:24 user nova-compute[74348]:   </features>
Nov 22 07:56:24 user nova-compute[74348]:   <cpu mode='custom' match='exact' check='full'>
Nov 22 07:56:24 user nova-compute[74348]:     <model fallback='forbid'>Nehalem</model>
Nov 22 07:56:24 user nova-compute[74348]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 22 07:56:24 user nova-compute[74348]:     <feature policy='require' name='vme'/>
Nov 22 07:56:24 user nova-compute[74348]:     <feature policy='require' name='x2apic'/>
Nov 22 07:56:24 user nova-compute[74348]:     <feature policy='require' name='hypervisor'/>
Nov 22 07:56:24 user nova-compute[74348]:   </cpu>
Nov 22 07:56:24 user nova-compute[74348]:   <clock offset='utc'>
Nov 22 07:56:24 user nova-compute[74348]:     <timer name='pit' tickpolicy='delay'/>
Nov 22 07:56:24 user nova-compute[74348]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 22 07:56:24 user nova-compute[74348]:     <timer name='hpet' present='no'/>
Nov 22 07:56:24 user nova-compute[74348]:   </clock>
Nov 22 07:56:24 user nova-compute[74348]:   <on_poweroff>destroy</on_poweroff>
Nov 22 07:56:24 user nova-compute[74348]:   <on_reboot>restart</on_reboot>
Nov 22 07:56:24 user nova-compute[74348]:   <on_crash>destroy</on_crash>
Nov 22 07:56:24 user nova-compute[74348]:   <devices>
Nov 22 07:56:24 user nova-compute[74348]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 22 07:56:24 user nova-compute[74348]:     <disk type='file' device='disk'>
Nov 22 07:56:24 user nova-compute[74348]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 22 07:56:24 user nova-compute[74348]:       <source file='/opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/disk' index='2'/>
Nov 22 07:56:24 user nova-compute[74348]:       <backingStore type='file' index='3'>
Nov 22 07:56:24 user nova-compute[74348]:         <format type='raw'/>
Nov 22 07:56:24 user nova-compute[74348]:         <source file='/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263'/>
Nov 22 07:56:24 user nova-compute[74348]:         <backingStore/>
Nov 22 07:56:24 user nova-compute[74348]:       </backingStore>
Nov 22 07:56:24 user nova-compute[74348]:       <target dev='vda' bus='virtio'/>
Nov 22 07:56:24 user nova-compute[74348]:       <alias name='virtio-disk0'/>
Nov 22 07:56:24 user nova-compute[74348]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 22 07:56:24 user nova-compute[74348]:     </disk>
Nov 22 07:56:24 user nova-compute[74348]:     <disk type='file' device='cdrom'>
Nov 22 07:56:24 user nova-compute[74348]:       <driver name='qemu' type='raw' cache='none'/>
Nov 22 07:56:24 user nova-compute[74348]:       <source file='/opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/disk.config' index='1'/>
Nov 22 07:56:24 user nova-compute[74348]:       <backingStore/>
Nov 22 07:56:24 user nova-compute[74348]:       <target dev='hda' bus='ide'/>
Nov 22 07:56:24 user nova-compute[74348]:       <readonly/>
Nov 22 07:56:24 user nova-compute[74348]:       <alias name='ide0-0-0'/>
Nov 22 07:56:24 user nova-compute[74348]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 22 07:56:24 user nova-compute[74348]:     </disk>
Nov 22 07:56:24 user nova-compute[74348]:     <controller type='usb' index='0' model='none'>
Nov 22 07:56:24 user nova-compute[74348]:       <alias name='usb'/>
Nov 22 07:56:24 user nova-compute[74348]:     </controller>
Nov 22 07:56:24 user nova-compute[74348]:     <controller type='pci' index='0' model='pci-root'>
Nov 22 07:56:24 user nova-compute[74348]:       <alias name='pci.0'/>
Nov 22 07:56:24 user nova-compute[74348]:     </controller>
Nov 22 07:56:24 user nova-compute[74348]:     <controller type='ide' index='0'>
Nov 22 07:56:24 user nova-compute[74348]:       <alias name='ide'/>
Nov 22 07:56:24 user nova-compute[74348]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 22 07:56:24 user nova-compute[74348]:     </controller>
Nov 22 07:56:24 user nova-compute[74348]:     <interface type='ethernet'>
Nov 22 07:56:24 user nova-compute[74348]:       <mac address='fa:16:3e:36:02:a6'/>
Nov 22 07:56:24 user nova-compute[74348]:       <target dev='tapf47b39b9-31'/>
Nov 22 07:56:24 user nova-compute[74348]:       <model type='virtio'/>
Nov 22 07:56:24 user nova-compute[74348]:       <mtu size='1442'/>
Nov 22 07:56:24 user nova-compute[74348]:       <alias name='net0'/>
Nov 22 07:56:24 user nova-compute[74348]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 22 07:56:24 user nova-compute[74348]:     </interface>
Nov 22 07:56:24 user nova-compute[74348]:     <serial type='pty'>
Nov 22 07:56:24 user nova-compute[74348]:       <source path='/dev/pts/7'/>
Nov 22 07:56:24 user nova-compute[74348]:       <log file='/opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/console.log' append='off'/>
Nov 22 07:56:24 user nova-compute[74348]:       <target type='isa-serial' port='0'>
Nov 22 07:56:24 user nova-compute[74348]:         <model name='isa-serial'/>
Nov 22 07:56:24 user nova-compute[74348]:       </target>
Nov 22 07:56:24 user nova-compute[74348]:       <alias name='serial0'/>
Nov 22 07:56:24 user nova-compute[74348]:     </serial>
Nov 22 07:56:24 user nova-compute[74348]:     <console type='pty' tty='/dev/pts/7'>
Nov 22 07:56:24 user nova-compute[74348]:       <source path='/dev/pts/7'/>
Nov 22 07:56:24 user nova-compute[74348]:       <log file='/opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/console.log' append='off'/>
Nov 22 07:56:24 user nova-compute[74348]:       <target type='serial' port='0'/>
Nov 22 07:56:24 user nova-compute[74348]:       <alias name='serial0'/>
Nov 22 07:56:24 user nova-compute[74348]:     </console>
Nov 22 07:56:24 user nova-compute[74348]:     <input type='mouse' bus='ps2'>
Nov 22 07:56:24 user nova-compute[74348]:       <alias name='input0'/>
Nov 22 07:56:24 user nova-compute[74348]:     </input>
Nov 22 07:56:24 user nova-compute[74348]:     <input type='keyboard' bus='ps2'>
Nov 22 07:56:24 user nova-compute[74348]:       <alias name='input1'/>
Nov 22 07:56:24 user nova-compute[74348]:     </input>
Nov 22 07:56:24 user nova-compute[74348]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 22 07:56:24 user nova-compute[74348]:       <listen type='address' address='0.0.0.0'/>
Nov 22 07:56:24 user nova-compute[74348]:     </graphics>
Nov 22 07:56:24 user nova-compute[74348]:     <audio id='1' type='none'/>
Nov 22 07:56:24 user nova-compute[74348]:     <video>
Nov 22 07:56:24 user nova-compute[74348]:       <model type='virtio' heads='1' primary='yes'/>
Nov 22 07:56:24 user nova-compute[74348]:       <alias name='video0'/>
Nov 22 07:56:24 user nova-compute[74348]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 22 07:56:24 user nova-compute[74348]:     </video>
Nov 22 07:56:24 user nova-compute[74348]:     <memballoon model='virtio'>
Nov 22 07:56:24 user nova-compute[74348]:       <stats period='10'/>
Nov 22 07:56:24 user nova-compute[74348]:       <alias name='balloon0'/>
Nov 22 07:56:24 user nova-compute[74348]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 22 07:56:24 user nova-compute[74348]:     </memballoon>
Nov 22 07:56:24 user nova-compute[74348]:     <rng model='virtio'>
Nov 22 07:56:24 user nova-compute[74348]:       <backend model='random'>/dev/urandom</backend>
Nov 22 07:56:24 user nova-compute[74348]:       <alias name='rng0'/>
Nov 22 07:56:24 user nova-compute[74348]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 22 07:56:24 user nova-compute[74348]:     </rng>
Nov 22 07:56:24 user nova-compute[74348]:   </devices>
Nov 22 07:56:24 user nova-compute[74348]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 22 07:56:24 user nova-compute[74348]:     <label>libvirt-bdad025e-8f6c-419a-99ea-bf277f6c5577</label>
Nov 22 07:56:24 user nova-compute[74348]:     <imagelabel>libvirt-bdad025e-8f6c-419a-99ea-bf277f6c5577</imagelabel>
Nov 22 07:56:24 user nova-compute[74348]:   </seclabel>
Nov 22 07:56:24 user nova-compute[74348]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 22 07:56:24 user nova-compute[74348]:     <label>+64055:+108</label>
Nov 22 07:56:24 user nova-compute[74348]:     <imagelabel>+64055:+108</imagelabel>
Nov 22 07:56:24 user nova-compute[74348]:   </seclabel>
Nov 22 07:56:24 user nova-compute[74348]: </domain>
Nov 22 07:56:24 user nova-compute[74348]:  {{(pid=74348) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 22 07:56:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [req-f7aca1db-b06b-43b4-8f58-7170476d1f2a req-c754c71b-c75f-4068-a8c5-9b6cbc4cf0de service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c2:25:c9"/><model type="virtio"/><mtu size="1442"/><target dev="tap1f80afa8-d6"/></interface> {{(pid=74348) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 22 07:56:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [req-f7aca1db-b06b-43b4-8f58-7170476d1f2a req-c754c71b-c75f-4068-a8c5-9b6cbc4cf0de service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c2:25:c9"/><model type="virtio"/><mtu size="1442"/><target dev="tap1f80afa8-d6"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 22 07:56:24 user nova-compute[74348]:   <name>instance-00000008</name>
Nov 22 07:56:24 user nova-compute[74348]:   <uuid>bdad025e-8f6c-419a-99ea-bf277f6c5577</uuid>
Nov 22 07:56:24 user nova-compute[74348]:   <metadata>
Nov 22 07:56:24 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 07:56:24 user nova-compute[74348]:   <nova:package version="0.0.0"/>
Nov 22 07:56:24 user nova-compute[74348]:   <nova:name>tempest-device-tagging-server-726810190</nova:name>
Nov 22 07:56:24 user nova-compute[74348]:   <nova:creationTime>2023-11-22 07:56:23</nova:creationTime>
Nov 22 07:56:24 user nova-compute[74348]:   <nova:flavor name="m1.tiny">
Nov 22 07:56:24 user nova-compute[74348]:     <nova:memory>512</nova:memory>
Nov 22 07:56:24 user nova-compute[74348]:     <nova:disk>1</nova:disk>
Nov 22 07:56:24 user nova-compute[74348]:     <nova:swap>0</nova:swap>
Nov 22 07:56:24 user nova-compute[74348]:     <nova:ephemeral>0</nova:ephemeral>
Nov 22 07:56:24 user nova-compute[74348]:     <nova:vcpus>1</nova:vcpus>
Nov 22 07:56:24 user nova-compute[74348]:   </nova:flavor>
Nov 22 07:56:24 user nova-compute[74348]:   <nova:owner>
Nov 22 07:56:24 user nova-compute[74348]:     <nova:user uuid="df4cae77b03e4395887815058f3a8a42">tempest-TaggedAttachmentsTest-659854772-project-member</nova:user>
Nov 22 07:56:24 user nova-compute[74348]:     <nova:project uuid="2f078468965946f6aed352374702843c">tempest-TaggedAttachmentsTest-659854772</nova:project>
Nov 22 07:56:24 user nova-compute[74348]:   </nova:owner>
Nov 22 07:56:24 user nova-compute[74348]:   <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 07:56:24 user nova-compute[74348]:   <nova:ports>
Nov 22 07:56:24 user nova-compute[74348]:     <nova:port uuid="f47b39b9-31a2-4f9b-a5e5-ec139067b6d4">
Nov 22 07:56:24 user nova-compute[74348]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 22 07:56:24 user nova-compute[74348]:     </nova:port>
Nov 22 07:56:24 user nova-compute[74348]:   </nova:ports>
Nov 22 07:56:24 user nova-compute[74348]: </nova:instance>
Nov 22 07:56:24 user nova-compute[74348]:   </metadata>
Nov 22 07:56:24 user nova-compute[74348]:   <memory unit='KiB'>524288</memory>
Nov 22 07:56:24 user nova-compute[74348]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 22 07:56:24 user nova-compute[74348]:   <vcpu placement='static'>1</vcpu>
Nov 22 07:56:24 user nova-compute[74348]:   <resource>
Nov 22 07:56:24 user nova-compute[74348]:     <partition>/machine</partition>
Nov 22 07:56:24 user nova-compute[74348]:   </resource>
Nov 22 07:56:24 user nova-compute[74348]:   <sysinfo type='smbios'>
Nov 22 07:56:24 user nova-compute[74348]:     <system>
Nov 22 07:56:24 user nova-compute[74348]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 22 07:56:24 user nova-compute[74348]:       <entry name='product'>OpenStack Nova</entry>
Nov 22 07:56:24 user nova-compute[74348]:       <entry name='version'>0.0.0</entry>
Nov 22 07:56:24 user nova-compute[74348]:       <entry name='serial'>bdad025e-8f6c-419a-99ea-bf277f6c5577</entry>
Nov 22 07:56:24 user nova-compute[74348]:       <entry name='uuid'>bdad025e-8f6c-419a-99ea-bf277f6c5577</entry>
Nov 22 07:56:24 user nova-compute[74348]:       <entry name='family'>Virtual Machine</entry>
Nov 22 07:56:24 user nova-compute[74348]:     </system>
Nov 22 07:56:24 user nova-compute[74348]:   </sysinfo>
Nov 22 07:56:24 user nova-compute[74348]:   <os>
Nov 22 07:56:24 user nova-compute[74348]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 22 07:56:24 user nova-compute[74348]:     <boot dev='hd'/>
Nov 22 07:56:24 user nova-compute[74348]:     <smbios mode='sysinfo'/>
Nov 22 07:56:24 user nova-compute[74348]:   </os>
Nov 22 07:56:24 user nova-compute[74348]:   <features>
Nov 22 07:56:24 user nova-compute[74348]:     <acpi/>
Nov 22 07:56:24 user nova-compute[74348]:     <apic/>
Nov 22 07:56:24 user nova-compute[74348]:     <vmcoreinfo state='on'/>
Nov 22 07:56:24 user nova-compute[74348]:   </features>
Nov 22 07:56:24 user nova-compute[74348]:   <cpu mode='custom' match='exact' check='full'>
Nov 22 07:56:24 user nova-compute[74348]:     <model fallback='forbid'>Nehalem</model>
Nov 22 07:56:24 user nova-compute[74348]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 22 07:56:24 user nova-compute[74348]:     <feature policy='require' name='vme'/>
Nov 22 07:56:24 user nova-compute[74348]:     <feature policy='require' name='x2apic'/>
Nov 22 07:56:24 user nova-compute[74348]:     <feature policy='require' name='hypervisor'/>
Nov 22 07:56:24 user nova-compute[74348]:   </cpu>
Nov 22 07:56:24 user nova-compute[74348]:   <clock offset='utc'>
Nov 22 07:56:24 user nova-compute[74348]:     <timer name='pit' tickpolicy='delay'/>
Nov 22 07:56:24 user nova-compute[74348]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 22 07:56:24 user nova-compute[74348]:     <timer name='hpet' present='no'/>
Nov 22 07:56:24 user nova-compute[74348]:   </clock>
Nov 22 07:56:24 user nova-compute[74348]:   <on_poweroff>destroy</on_poweroff>
Nov 22 07:56:24 user nova-compute[74348]:   <on_reboot>restart</on_reboot>
Nov 22 07:56:24 user nova-compute[74348]:   <on_crash>destroy</on_crash>
Nov 22 07:56:24 user nova-compute[74348]:   <devices>
Nov 22 07:56:24 user nova-compute[74348]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 22 07:56:24 user nova-compute[74348]:     <disk type='file' device='disk'>
Nov 22 07:56:24 user nova-compute[74348]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 22 07:56:24 user nova-compute[74348]:       <source file='/opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/disk' index='2'/>
Nov 22 07:56:24 user nova-compute[74348]:       <backingStore type='file' index='3'>
Nov 22 07:56:24 user nova-compute[74348]:         <format type='raw'/>
Nov 22 07:56:24 user nova-compute[74348]:         <source file='/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263'/>
Nov 22 07:56:24 user nova-compute[74348]:         <backingStore/>
Nov 22 07:56:24 user nova-compute[74348]:       </backingStore>
Nov 22 07:56:24 user nova-compute[74348]:       <target dev='vda' bus='virtio'/>
Nov 22 07:56:24 user nova-compute[74348]:       <alias name='virtio-disk0'/>
Nov 22 07:56:24 user nova-compute[74348]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 22 07:56:24 user nova-compute[74348]:     </disk>
Nov 22 07:56:24 user nova-compute[74348]:     <disk type='file' device='cdrom'>
Nov 22 07:56:24 user nova-compute[74348]:       <driver name='qemu' type='raw' cache='none'/>
Nov 22 07:56:24 user nova-compute[74348]:       <source file='/opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/disk.config' index='1'/>
Nov 22 07:56:24 user nova-compute[74348]:       <backingStore/>
Nov 22 07:56:24 user nova-compute[74348]:       <target dev='hda' bus='ide'/>
Nov 22 07:56:24 user nova-compute[74348]:       <readonly/>
Nov 22 07:56:24 user nova-compute[74348]:       <alias name='ide0-0-0'/>
Nov 22 07:56:24 user nova-compute[74348]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 22 07:56:24 user nova-compute[74348]:     </disk>
Nov 22 07:56:24 user nova-compute[74348]:     <controller type='usb' index='0' model='none'>
Nov 22 07:56:24 user nova-compute[74348]:       <alias name='usb'/>
Nov 22 07:56:24 user nova-compute[74348]:     </controller>
Nov 22 07:56:24 user nova-compute[74348]:     <controller type='pci' index='0' model='pci-root'>
Nov 22 07:56:24 user nova-compute[74348]:       <alias name='pci.0'/>
Nov 22 07:56:24 user nova-compute[74348]:     </controller>
Nov 22 07:56:24 user nova-compute[74348]:     <controller type='ide' index='0'>
Nov 22 07:56:24 user nova-compute[74348]:       <alias name='ide'/>
Nov 22 07:56:24 user nova-compute[74348]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 22 07:56:24 user nova-compute[74348]:     </controller>
Nov 22 07:56:24 user nova-compute[74348]:     <interface type='ethernet'>
Nov 22 07:56:24 user nova-compute[74348]:       <mac address='fa:16:3e:36:02:a6'/>
Nov 22 07:56:24 user nova-compute[74348]:       <target dev='tapf47b39b9-31'/>
Nov 22 07:56:24 user nova-compute[74348]:       <model type='virtio'/>
Nov 22 07:56:24 user nova-compute[74348]:       <mtu size='1442'/>
Nov 22 07:56:24 user nova-compute[74348]:       <alias name='net0'/>
Nov 22 07:56:24 user nova-compute[74348]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 22 07:56:24 user nova-compute[74348]:     </interface>
Nov 22 07:56:24 user nova-compute[74348]:     <serial type='pty'>
Nov 22 07:56:24 user nova-compute[74348]:       <source path='/dev/pts/7'/>
Nov 22 07:56:24 user nova-compute[74348]:       <log file='/opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/console.log' append='off'/>
Nov 22 07:56:24 user nova-compute[74348]:       <target type='isa-serial' port='0'>
Nov 22 07:56:24 user nova-compute[74348]:         <model name='isa-serial'/>
Nov 22 07:56:24 user nova-compute[74348]:       </target>
Nov 22 07:56:24 user nova-compute[74348]:       <alias name='serial0'/>
Nov 22 07:56:24 user nova-compute[74348]:     </serial>
Nov 22 07:56:24 user nova-compute[74348]:     <console type='pty' tty='/dev/pts/7'>
Nov 22 07:56:24 user nova-compute[74348]:       <source path='/dev/pts/7'/>
Nov 22 07:56:24 user nova-compute[74348]:       <log file='/opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/console.log' append='off'/>
Nov 22 07:56:24 user nova-compute[74348]:       <target type='serial' port='0'/>
Nov 22 07:56:24 user nova-compute[74348]:       <alias name='serial0'/>
Nov 22 07:56:24 user nova-compute[74348]:     </console>
Nov 22 07:56:24 user nova-compute[74348]:     <input type='mouse' bus='ps2'>
Nov 22 07:56:24 user nova-compute[74348]:       <alias name='input0'/>
Nov 22 07:56:24 user nova-compute[74348]:     </input>
Nov 22 07:56:24 user nova-compute[74348]:     <input type='keyboard' bus='ps2'>
Nov 22 07:56:24 user nova-compute[74348]:       <alias name='input1'/>
Nov 22 07:56:24 user nova-compute[74348]:     </input>
Nov 22 07:56:24 user nova-compute[74348]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 22 07:56:24 user nova-compute[74348]:       <listen type='address' address='0.0.0.0'/>
Nov 22 07:56:24 user nova-compute[74348]:     </graphics>
Nov 22 07:56:24 user nova-compute[74348]:     <audio id='1' type='none'/>
Nov 22 07:56:24 user nova-compute[74348]:     <video>
Nov 22 07:56:24 user nova-compute[74348]:       <model type='virtio' heads='1' primary='yes'/>
Nov 22 07:56:24 user nova-compute[74348]:       <alias name='video0'/>
Nov 22 07:56:24 user nova-compute[74348]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 22 07:56:24 user nova-compute[74348]:     </video>
Nov 22 07:56:24 user nova-compute[74348]:     <memballoon model='virtio'>
Nov 22 07:56:24 user nova-compute[74348]:       <stats period='10'/>
Nov 22 07:56:24 user nova-compute[74348]:       <alias name='balloon0'/>
Nov 22 07:56:24 user nova-compute[74348]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 22 07:56:24 user nova-compute[74348]:     </memballoon>
Nov 22 07:56:24 user nova-compute[74348]:     <rng model='virtio'>
Nov 22 07:56:24 user nova-compute[74348]:       <backend model='random'>/dev/urandom</backend>
Nov 22 07:56:24 user nova-compute[74348]:       <alias name='rng0'/>
Nov 22 07:56:24 user nova-compute[74348]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 22 07:56:24 user nova-compute[74348]:     </rng>
Nov 22 07:56:24 user nova-compute[74348]:   </devices>
Nov 22 07:56:24 user nova-compute[74348]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 22 07:56:24 user nova-compute[74348]:     <label>libvirt-bdad025e-8f6c-419a-99ea-bf277f6c5577</label>
Nov 22 07:56:24 user nova-compute[74348]:     <imagelabel>libvirt-bdad025e-8f6c-419a-99ea-bf277f6c5577</imagelabel>
Nov 22 07:56:24 user nova-compute[74348]:   </seclabel>
Nov 22 07:56:24 user nova-compute[74348]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 22 07:56:24 user nova-compute[74348]:     <label>+64055:+108</label>
Nov 22 07:56:24 user nova-compute[74348]:     <imagelabel>+64055:+108</imagelabel>
Nov 22 07:56:24 user nova-compute[74348]:   </seclabel>
Nov 22 07:56:24 user nova-compute[74348]: </domain>
Nov 22 07:56:24 user nova-compute[74348]:  {{(pid=74348) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 22 07:56:24 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [req-f7aca1db-b06b-43b4-8f58-7170476d1f2a req-c754c71b-c75f-4068-a8c5-9b6cbc4cf0de service nova] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Detaching interface fa:16:3e:c2:25:c9 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap1f80afa8-d6' not found.
Nov 22 07:56:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [req-f7aca1db-b06b-43b4-8f58-7170476d1f2a req-c754c71b-c75f-4068-a8c5-9b6cbc4cf0de service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-726810190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-726810190',id=8,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2d2AMx5MTcXajy6b7uPsq3+jYxxbAAyYP5uwFXUURVQR6N2+iGSyaCZAQVBr0xq/5GZlgBfcRmwRXF9ZovM3nD3R4hcY3OcZ/S/sjuTSQBqYHlzsArXECyBywfXW3yNw==',key_name='tempest-keypair-266871328',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:53:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f078468965946f6aed352374702843c',ramdisk_id='',reservation_id='r-nuqss0no',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-659854772',owner_user_name='tempest-TaggedAttachmentsTest-659854772-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T07:53:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df4cae77b03e4395887815058f3a8a42',uuid=bdad025e-8f6c-419a-99ea-bf277f6c5577,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f80afa8-d693-44a8-86ff-0fec89d2e510", "address": "fa:16:3e:c2:25:c9", "network": {"id": "11db4075-7b75-40bf-b506-4f4ea3f9631c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2016258335", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2f078468965946f6aed352374702843c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f80afa8-d6", "ovs_interfaceid": "1f80afa8-d693-44a8-86ff-0fec89d2e510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 07:56:24 user nova-compute[74348]: DEBUG nova.network.os_vif_util [req-f7aca1db-b06b-43b4-8f58-7170476d1f2a req-c754c71b-c75f-4068-a8c5-9b6cbc4cf0de service nova] Converting VIF {"id": "1f80afa8-d693-44a8-86ff-0fec89d2e510", "address": "fa:16:3e:c2:25:c9", "network": {"id": "11db4075-7b75-40bf-b506-4f4ea3f9631c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2016258335", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2f078468965946f6aed352374702843c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f80afa8-d6", "ovs_interfaceid": "1f80afa8-d693-44a8-86ff-0fec89d2e510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:56:24 user nova-compute[74348]: DEBUG nova.network.os_vif_util [req-f7aca1db-b06b-43b4-8f58-7170476d1f2a req-c754c71b-c75f-4068-a8c5-9b6cbc4cf0de service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:25:c9,bridge_name='br-int',has_traffic_filtering=True,id=1f80afa8-d693-44a8-86ff-0fec89d2e510,network=Network(11db4075-7b75-40bf-b506-4f4ea3f9631c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f80afa8-d6') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:56:24 user nova-compute[74348]: DEBUG os_vif [req-f7aca1db-b06b-43b4-8f58-7170476d1f2a req-c754c71b-c75f-4068-a8c5-9b6cbc4cf0de service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:25:c9,bridge_name='br-int',has_traffic_filtering=True,id=1f80afa8-d693-44a8-86ff-0fec89d2e510,network=Network(11db4075-7b75-40bf-b506-4f4ea3f9631c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f80afa8-d6') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 07:56:24 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:24 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f80afa8-d6, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:56:24 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 07:56:24 user nova-compute[74348]: INFO os_vif [req-f7aca1db-b06b-43b4-8f58-7170476d1f2a req-c754c71b-c75f-4068-a8c5-9b6cbc4cf0de service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:25:c9,bridge_name='br-int',has_traffic_filtering=True,id=1f80afa8-d693-44a8-86ff-0fec89d2e510,network=Network(11db4075-7b75-40bf-b506-4f4ea3f9631c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f80afa8-d6')
Nov 22 07:56:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [req-f7aca1db-b06b-43b4-8f58-7170476d1f2a req-c754c71b-c75f-4068-a8c5-9b6cbc4cf0de service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 07:56:24 user nova-compute[74348]:   <nova:package version="0.0.0"/>
Nov 22 07:56:24 user nova-compute[74348]:   <nova:name>tempest-device-tagging-server-726810190</nova:name>
Nov 22 07:56:24 user nova-compute[74348]:   <nova:creationTime>2023-11-22 07:56:24</nova:creationTime>
Nov 22 07:56:24 user nova-compute[74348]:   <nova:flavor name="m1.tiny">
Nov 22 07:56:24 user nova-compute[74348]:     <nova:memory>512</nova:memory>
Nov 22 07:56:24 user nova-compute[74348]:     <nova:disk>1</nova:disk>
Nov 22 07:56:24 user nova-compute[74348]:     <nova:swap>0</nova:swap>
Nov 22 07:56:24 user nova-compute[74348]:     <nova:ephemeral>0</nova:ephemeral>
Nov 22 07:56:24 user nova-compute[74348]:     <nova:vcpus>1</nova:vcpus>
Nov 22 07:56:24 user nova-compute[74348]:   </nova:flavor>
Nov 22 07:56:24 user nova-compute[74348]:   <nova:owner>
Nov 22 07:56:24 user nova-compute[74348]:     <nova:user uuid="df4cae77b03e4395887815058f3a8a42">tempest-TaggedAttachmentsTest-659854772-project-member</nova:user>
Nov 22 07:56:24 user nova-compute[74348]:     <nova:project uuid="2f078468965946f6aed352374702843c">tempest-TaggedAttachmentsTest-659854772</nova:project>
Nov 22 07:56:24 user nova-compute[74348]:   </nova:owner>
Nov 22 07:56:24 user nova-compute[74348]:   <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 07:56:24 user nova-compute[74348]:   <nova:ports>
Nov 22 07:56:24 user nova-compute[74348]:     <nova:port uuid="f47b39b9-31a2-4f9b-a5e5-ec139067b6d4">
Nov 22 07:56:24 user nova-compute[74348]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 22 07:56:24 user nova-compute[74348]:     </nova:port>
Nov 22 07:56:24 user nova-compute[74348]:   </nova:ports>
Nov 22 07:56:24 user nova-compute[74348]: </nova:instance>
Nov 22 07:56:24 user nova-compute[74348]:  {{(pid=74348) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 22 07:56:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Acquiring lock "bcedb385-b72a-49c2-b363-cf6da5804b60" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lock "bcedb385-b72a-49c2-b363-cf6da5804b60" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:25 user nova-compute[74348]: DEBUG nova.network.neutron [None req-00f877b9-705d-4c50-9597-016d5ccbc72c tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Updating instance_info_cache with network_info: [{"id": "f47b39b9-31a2-4f9b-a5e5-ec139067b6d4", "address": "fa:16:3e:36:02:a6", "network": {"id": "e0159f32-e7c5-41b9-b652-8e2ca87f9018", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1248845008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f078468965946f6aed352374702843c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47b39b9-31", "ovs_interfaceid": "f47b39b9-31a2-4f9b-a5e5-ec139067b6d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:56:25 user nova-compute[74348]: DEBUG nova.objects.instance [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lazy-loading 'flavor' on Instance uuid bcedb385-b72a-49c2-b363-cf6da5804b60 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:56:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-00f877b9-705d-4c50-9597-016d5ccbc72c tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Releasing lock "refresh_cache-bdad025e-8f6c-419a-99ea-bf277f6c5577" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:56:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lock "bcedb385-b72a-49c2-b363-cf6da5804b60" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-00f877b9-705d-4c50-9597-016d5ccbc72c tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Lock "interface-bdad025e-8f6c-419a-99ea-bf277f6c5577-1f80afa8-d693-44a8-86ff-0fec89d2e510" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 22.045s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Acquiring lock "bcedb385-b72a-49c2-b363-cf6da5804b60" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lock "bcedb385-b72a-49c2-b363-cf6da5804b60" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:25 user nova-compute[74348]: INFO nova.compute.manager [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Attaching volume 53b1125a-70bf-4535-950d-89a82c099803 to /dev/vdb
Nov 22 07:56:25 user nova-compute[74348]: DEBUG os_brick.utils [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:56:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:25 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[df25252a-1e6a-40b9-a4b2-e6f7967d4d1c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:25 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbb15fb-f1d2-4916-9f0a-44702a148f79]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:25 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffafedc-156f-48d4-99b0-d2788843c0f7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:25 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb6fe2c-0e84-489a-9c36-90c7e26c5e7d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 07:56:25 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 07:56:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 07:56:25 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 07:56:25 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2497be84-9bda-43b5-b342-fd47213291ab]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:25 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 07:56:25 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 07:56:25 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 07:56:25 user nova-compute[74348]: DEBUG os_brick.utils [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:56:25 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Updating existing volume attachment record: 3a594157-448e-4ec2-ba5b-22005f5ed435 {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 07:56:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:28 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:56:28 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:56:28 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:56:28 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 07:56:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-e36789b1-45e6-40f7-ba97-8962cb116a39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:56:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-e36789b1-45e6-40f7-ba97-8962cb116a39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:56:28 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 07:56:29 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Updating instance_info_cache with network_info: [{"id": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "address": "fa:16:3e:a7:50:2a", "network": {"id": "8a783b63-dae2-41eb-a00a-5cf8e94a5412", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872095489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beaa9566ba2842d49f843dbddc59854d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap618bd526-89", "ovs_interfaceid": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:56:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-e36789b1-45e6-40f7-ba97-8962cb116a39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:56:29 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 07:56:29 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:56:29 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:56:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:29 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 07:56:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/522f5959-4874-4c61-888d-6fb1cc4d72e6/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/522f5959-4874-4c61-888d-6fb1cc4d72e6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/522f5959-4874-4c61-888d-6fb1cc4d72e6/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/522f5959-4874-4c61-888d-6fb1cc4d72e6/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059bde4a-c5c9-45ab-9b4a-c969c74a6083/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059bde4a-c5c9-45ab-9b4a-c969c74a6083/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059bde4a-c5c9-45ab-9b4a-c969c74a6083/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059bde4a-c5c9-45ab-9b4a-c969c74a6083/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:30 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-b8ee78f9-a2e6-4f2d-b93b-bf14d612259c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e93032ee-56bd-48be-8121-b0fd5273345e is timed out.
Nov 22 07:56:30 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-b8ee78f9-a2e6-4f2d-b93b-bf14d612259c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Successfully detached device vdb from instance e93032ee-56bd-48be-8121-b0fd5273345e from the live domain config.
Nov 22 07:56:30 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8ee78f9-a2e6-4f2d-b93b-bf14d612259c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8ee78f9-a2e6-4f2d-b93b-bf14d612259c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mJansYWS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': 'c75e240f-f04a-4750-ac8d-81122d651471'}, None), 'kwargs': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:56:30 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-b8ee78f9-a2e6-4f2d-b93b-bf14d612259c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:56:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-b8ee78f9-a2e6-4f2d-b93b-bf14d612259c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-b8ee78f9-a2e6-4f2d-b93b-bf14d612259c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03de639-1ebe-40e6-8497-19c2ec870967]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8ee78f9-a2e6-4f2d-b93b-bf14d612259c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 07:56:30 user nova-compute[74348]: No targets found.
Nov 22 07:56:30 user nova-compute[74348]: iSNS:
Nov 22 07:56:30 user nova-compute[74348]: No targets found.
Nov 22 07:56:30 user nova-compute[74348]: STATIC:
Nov 22 07:56:30 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223
Nov 22 07:56:30 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:56:30 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:56:30 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471
Nov 22 07:56:30 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:56:30 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:56:30 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af
Nov 22 07:56:30 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:56:30 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:56:30 user nova-compute[74348]: FIRMWARE:
Nov 22 07:56:30 user nova-compute[74348]: No targets found.
Nov 22 07:56:30 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8ee78f9-a2e6-4f2d-b93b-bf14d612259c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 07:56:30 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 07:56:30 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8ee78f9-a2e6-4f2d-b93b-bf14d612259c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc88388-d7cd-45d9-9d34-eec9585bd727]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[87637676-4b69-44d4-8857-6a52b3820765]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8ee78f9-a2e6-4f2d-b93b-bf14d612259c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)
Nov 22 07:56:30 user nova-compute[74348]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:56:30 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:56:30 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8ee78f9-a2e6-4f2d-b93b-bf14d612259c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 (non-flash)
Nov 22 07:56:30 user nova-compute[74348]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:56:30 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:56:30 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8ee78f9-a2e6-4f2d-b93b-bf14d612259c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2228338dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471'): ({'sdb'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-b8ee78f9-a2e6-4f2d-b93b-bf14d612259c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Removing single pathed devices sdb {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0bc4f9-647b-45c0-8a5a-43ed98849aaa]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[61bfc62f-167f-4a5e-9e95-3f00960736f0]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-b8ee78f9-a2e6-4f2d-b93b-bf14d612259c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Flushing IO for device /dev/sdb {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5490f83f-6b6d-449c-979b-4be1458dfb70]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-b8ee78f9-a2e6-4f2d-b93b-bf14d612259c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Acquiring lock "e36789b1-45e6-40f7-ba97-8962cb116a39" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lock "e36789b1-45e6-40f7-ba97-8962cb116a39" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[04aea94a-6a62-4524-9b20-3bce72eef024]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-b8ee78f9-a2e6-4f2d-b93b-bf14d612259c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-b8ee78f9-a2e6-4f2d-b93b-bf14d612259c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] SCSI volumes sdb have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8ee78f9-a2e6-4f2d-b93b-bf14d612259c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG nova.objects.instance [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lazy-loading 'flavor' on Instance uuid e36789b1-45e6-40f7-ba97-8962cb116a39 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c088ac3-6520-4ebd-999c-6e5e2e0ed34c]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8ee78f9-a2e6-4f2d-b93b-bf14d612259c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lock "e36789b1-45e6-40f7-ba97-8962cb116a39" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e93032ee-56bd-48be-8121-b0fd5273345e/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ff2d2e-dceb-4811-bf57-b2e2a7419228]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8ee78f9-a2e6-4f2d-b93b-bf14d612259c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471, portal: 172.16.0.220,3260]
Nov 22 07:56:31 user nova-compute[74348]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471, portal: 172.16.0.220,3260] successful.
Nov 22 07:56:31 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c75e240f-f04a-4750-ac8d-81122d651471 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b2777e-09ae-4982-9cf8-3b5b2aa70bb3]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8ee78f9-a2e6-4f2d-b93b-bf14d612259c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-b8ee78f9-a2e6-4f2d-b93b-bf14d612259c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.415s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8ee78f9-a2e6-4f2d-b93b-bf14d612259c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] <== disconnect_volume: return (417ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8ee78f9-a2e6-4f2d-b93b-bf14d612259c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e93032ee-56bd-48be-8121-b0fd5273345e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e93032ee-56bd-48be-8121-b0fd5273345e/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Acquiring lock "e36789b1-45e6-40f7-ba97-8962cb116a39" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lock "e36789b1-45e6-40f7-ba97-8962cb116a39" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.004s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:31 user nova-compute[74348]: INFO nova.compute.manager [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Attaching volume d39d80c0-03af-4337-8739-906a6e6a5730 to /dev/vdb
Nov 22 07:56:31 user nova-compute[74348]: DEBUG os_brick.utils [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[05aaecad-363c-4b24-91a1-d88f33f32ad1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a89a87e-1194-4b82-86e8-a080ef157e66]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e3f234-45ca-442c-b997-8c0b942f5d68]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[849294a8-74a9-41b1-80ff-63d4734ab907]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e93032ee-56bd-48be-8121-b0fd5273345e/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecbabf54-d2b4-47e0-9e50-60ba8e7e9094/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 07:56:31 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 07:56:31 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8fe516-1f79-45b9-b778-b5beddb14959]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG os_brick.utils [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Updating existing volume attachment record: d201dda2-0338-460b-8282-883c68b17bc0 {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecbabf54-d2b4-47e0-9e50-60ba8e7e9094/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecbabf54-d2b4-47e0-9e50-60ba8e7e9094/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecbabf54-d2b4-47e0-9e50-60ba8e7e9094/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kOYubGxc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:56:31 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:56:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:56:31 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:56:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:56:31 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 07:56:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f431dca-2596-43b7-9a27-245df471e24e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 07:56:31 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbb050c-a701-4877-9349-cfa464cdc8dc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803] added
Nov 22 07:56:31 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ab5d3a-9b7a-4588-b4b3-8980a36dbadb]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9993e84-fb72-4b28-8cbc-0195d2e51790]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kOYubGxc {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kOYubGxc" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff2d124-b196-450f-9f2f-667f2b26dff5]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kOYubGxc'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b9adee-8f68-45ac-ae91-287e355d7d0c]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[31db099b-8812-46dc-af9f-d23cf1a76b5a]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:56:32 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:56:32 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:56:32 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:56:32 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafe9ec0-052c-467a-97e4-766c00ce6e2e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803, portal: 172.16.0.220,3260]
Nov 22 07:56:32 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803, portal: 172.16.0.220,3260] successful.
Nov 22 07:56:32 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[16832252-f8e9-4660-b2f8-bf0471710fff]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a9ccc5-8e9a-4f6c-86c9-960c4c5f7f92]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:56:32 user nova-compute[74348]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)
Nov 22 07:56:32 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:56:32 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:56:32 user nova-compute[74348]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)
Nov 22 07:56:32 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:56:32 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c921c13-0584-4d85-bbd8-8b13d3b3fee1]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kOYubGxc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:32 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 07:56:33 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:56:33 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:56:33 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=7892MB free_disk=25.24459457397461GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 07:56:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:33 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 059bde4a-c5c9-45ab-9b4a-c969c74a6083 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:56:33 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 522f5959-4874-4c61-888d-6fb1cc4d72e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:56:33 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance bcedb385-b72a-49c2-b363-cf6da5804b60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:56:33 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance e36789b1-45e6-40f7-ba97-8962cb116a39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:56:33 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance e93032ee-56bd-48be-8121-b0fd5273345e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:56:33 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance bdad025e-8f6c-419a-99ea-bf277f6c5577 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:56:33 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance abd7f2ed-b0c4-4e05-8161-b141a611f125 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:56:33 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance ecbabf54-d2b4-47e0-9e50-60ba8e7e9094 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:56:33 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 07:56:33 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 07:56:33 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.423s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:56:33 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] <== connect_volume: return (1426ms) {'type': 'block', 'scsi_wwn': '23639613563646635', 'path': '/dev/sdb'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:56:33 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639613563646635', 'path': '/dev/sdb'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 07:56:33 user nova-compute[74348]: DEBUG nova.objects.instance [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lazy-loading 'flavor' on Instance uuid bcedb385-b72a-49c2-b363-cf6da5804b60 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:56:33 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 07:56:33 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 07:56:33 user nova-compute[74348]:   <source dev="/dev/sdb"/>
Nov 22 07:56:33 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 07:56:33 user nova-compute[74348]:   <serial>53b1125a-70bf-4535-950d-89a82c099803</serial>
Nov 22 07:56:33 user nova-compute[74348]: </disk>
Nov 22 07:56:33 user nova-compute[74348]:  {{(pid=74348) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 07:56:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquiring lock "5f3bbae3-babf-44d2-96da-c459fb77d9c7" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "5f3bbae3-babf-44d2-96da-c459fb77d9c7" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:33 user nova-compute[74348]: INFO nova.compute.manager [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Unshelving
Nov 22 07:56:33 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:56:33 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:56:33 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 07:56:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.525s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:33 user nova-compute[74348]: INFO nova.virt.block_device [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Booting with volume 89d26526-c4cd-414b-a30a-b4c7bc0b7aee at /dev/vdc
Nov 22 07:56:33 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:56:33 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:56:33 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] No VIF found with MAC fa:16:3e:50:0c:08, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 07:56:33 user nova-compute[74348]: DEBUG os_brick.utils [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:56:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:33 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b28a4fe-6342-457d-9160-e70626930559]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:33 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ef18fb-cdc1-459a-bbc8-5f9999df81ff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:33 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0064ad-20d9-4aad-b2bf-122c8c5808db]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:33 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[149b8f9a-e4ba-4eae-896c-c04a2724c999]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 07:56:33 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 07:56:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 07:56:34 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 07:56:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[638587f0-dffb-4f61-ac51-08dabb085abf]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 07:56:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 07:56:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 07:56:34 user nova-compute[74348]: DEBUG os_brick.utils [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:56:34 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Updating existing volume attachment record: 62d2a552-802c-4645-978f-cc679230910b {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 07:56:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-afc1dece-bf5f-4fb1-9a7a-711694cb1756 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lock "bcedb385-b72a-49c2-b363-cf6da5804b60" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.784s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:34 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:56:34 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:56:34 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:56:34 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:56:34 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:56:34 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 07:56:35 user nova-compute[74348]: DEBUG nova.compute.manager [req-1189c449-9aa4-4160-b381-129505f766b4 req-8dd24569-01e2-4ca3-9aeb-5eb82971b161 service nova] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Received event network-changed-419fb32b-d220-42f3-98f1-acfeb9e531fd {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:56:35 user nova-compute[74348]: DEBUG nova.compute.manager [req-1189c449-9aa4-4160-b381-129505f766b4 req-8dd24569-01e2-4ca3-9aeb-5eb82971b161 service nova] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Refreshing instance network info cache due to event network-changed-419fb32b-d220-42f3-98f1-acfeb9e531fd. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:56:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-1189c449-9aa4-4160-b381-129505f766b4 req-8dd24569-01e2-4ca3-9aeb-5eb82971b161 service nova] Acquiring lock "refresh_cache-ecbabf54-d2b4-47e0-9e50-60ba8e7e9094" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:56:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-1189c449-9aa4-4160-b381-129505f766b4 req-8dd24569-01e2-4ca3-9aeb-5eb82971b161 service nova] Acquired lock "refresh_cache-ecbabf54-d2b4-47e0-9e50-60ba8e7e9094" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:56:35 user nova-compute[74348]: DEBUG nova.network.neutron [req-1189c449-9aa4-4160-b381-129505f766b4 req-8dd24569-01e2-4ca3-9aeb-5eb82971b161 service nova] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Refreshing network info cache for port 419fb32b-d220-42f3-98f1-acfeb9e531fd {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:56:36 user nova-compute[74348]: DEBUG nova.objects.instance [None req-b8ee78f9-a2e6-4f2d-b93b-bf14d612259c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Lazy-loading 'flavor' on Instance uuid e93032ee-56bd-48be-8121-b0fd5273345e {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:56:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b8ee78f9-a2e6-4f2d-b93b-bf14d612259c tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Lock "e93032ee-56bd-48be-8121-b0fd5273345e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 26.084s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:36 user nova-compute[74348]: DEBUG nova.network.neutron [req-1189c449-9aa4-4160-b381-129505f766b4 req-8dd24569-01e2-4ca3-9aeb-5eb82971b161 service nova] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Updated VIF entry in instance network info cache for port 419fb32b-d220-42f3-98f1-acfeb9e531fd. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 07:56:36 user nova-compute[74348]: DEBUG nova.network.neutron [req-1189c449-9aa4-4160-b381-129505f766b4 req-8dd24569-01e2-4ca3-9aeb-5eb82971b161 service nova] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Updating instance_info_cache with network_info: [{"id": "419fb32b-d220-42f3-98f1-acfeb9e531fd", "address": "fa:16:3e:1b:3f:49", "network": {"id": "5c50496a-0882-415b-8115-ddf7b65516a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-531638472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f569146bb9b04838ad8044260da6ad58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419fb32b-d2", "ovs_interfaceid": "419fb32b-d220-42f3-98f1-acfeb9e531fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:56:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-1189c449-9aa4-4160-b381-129505f766b4 req-8dd24569-01e2-4ca3-9aeb-5eb82971b161 service nova] Releasing lock "refresh_cache-ecbabf54-d2b4-47e0-9e50-60ba8e7e9094" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:56:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1381b76d-dd13-4826-997b-3d220c8b2b6f tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "ecbabf54-d2b4-47e0-9e50-60ba8e7e9094" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1381b76d-dd13-4826-997b-3d220c8b2b6f tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "ecbabf54-d2b4-47e0-9e50-60ba8e7e9094" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1381b76d-dd13-4826-997b-3d220c8b2b6f tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "ecbabf54-d2b4-47e0-9e50-60ba8e7e9094-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1381b76d-dd13-4826-997b-3d220c8b2b6f tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "ecbabf54-d2b4-47e0-9e50-60ba8e7e9094-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1381b76d-dd13-4826-997b-3d220c8b2b6f tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "ecbabf54-d2b4-47e0-9e50-60ba8e7e9094-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:36 user nova-compute[74348]: INFO nova.compute.manager [None req-1381b76d-dd13-4826-997b-3d220c8b2b6f tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Terminating instance
Nov 22 07:56:36 user nova-compute[74348]: DEBUG nova.compute.manager [None req-1381b76d-dd13-4826-997b-3d220c8b2b6f tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 07:56:36 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:36 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:36 user nova-compute[74348]: INFO nova.compute.manager [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Rescuing
Nov 22 07:56:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Acquiring lock "refresh_cache-bcedb385-b72a-49c2-b363-cf6da5804b60" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:56:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Acquired lock "refresh_cache-bcedb385-b72a-49c2-b363-cf6da5804b60" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:56:36 user nova-compute[74348]: DEBUG nova.network.neutron [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 07:56:36 user nova-compute[74348]: DEBUG nova.compute.manager [req-15391060-6c3d-40ea-96c1-8074045b75e2 req-bb2e4f48-7b6b-4e51-8536-45997c5e9e22 service nova] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Received event network-vif-unplugged-419fb32b-d220-42f3-98f1-acfeb9e531fd {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:56:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-15391060-6c3d-40ea-96c1-8074045b75e2 req-bb2e4f48-7b6b-4e51-8536-45997c5e9e22 service nova] Acquiring lock "ecbabf54-d2b4-47e0-9e50-60ba8e7e9094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-15391060-6c3d-40ea-96c1-8074045b75e2 req-bb2e4f48-7b6b-4e51-8536-45997c5e9e22 service nova] Lock "ecbabf54-d2b4-47e0-9e50-60ba8e7e9094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-15391060-6c3d-40ea-96c1-8074045b75e2 req-bb2e4f48-7b6b-4e51-8536-45997c5e9e22 service nova] Lock "ecbabf54-d2b4-47e0-9e50-60ba8e7e9094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:36 user nova-compute[74348]: DEBUG nova.compute.manager [req-15391060-6c3d-40ea-96c1-8074045b75e2 req-bb2e4f48-7b6b-4e51-8536-45997c5e9e22 service nova] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] No waiting events found dispatching network-vif-unplugged-419fb32b-d220-42f3-98f1-acfeb9e531fd {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:56:36 user nova-compute[74348]: DEBUG nova.compute.manager [req-15391060-6c3d-40ea-96c1-8074045b75e2 req-bb2e4f48-7b6b-4e51-8536-45997c5e9e22 service nova] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Received event network-vif-unplugged-419fb32b-d220-42f3-98f1-acfeb9e531fd for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 07:56:36 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:37 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:37 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Instance destroyed successfully.
Nov 22 07:56:37 user nova-compute[74348]: DEBUG nova.objects.instance [None req-1381b76d-dd13-4826-997b-3d220c8b2b6f tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lazy-loading 'resources' on Instance uuid ecbabf54-d2b4-47e0-9e50-60ba8e7e9094 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:56:37 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-1381b76d-dd13-4826-997b-3d220c8b2b6f tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:54:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1925396109',display_name='tempest-AttachVolumeNegativeTest-server-1925396109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1925396109',id=14,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjBXou7DEpKskNgQP5/T2/Hu4xm0pbvOYhHijfTcJjUn9lmgeBoLKll0lqjqxbm6sAWB151QSyvAd0KQuHUmPxJL1VCTgq+AFfmuRZCaiNo9S9VminI5VXmkaZgwHNcFQ==',key_name='tempest-keypair-2025050509',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:54:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f569146bb9b04838ad8044260da6ad58',ramdisk_id='',reservation_id='r-401i13x6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1606364171',owner_user_name='tempest-AttachVolumeNegativeTest-1606364171-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T07:54:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8eca17e3a564220b3b07af4eddadaca',uuid=ecbabf54-d2b4-47e0-9e50-60ba8e7e9094,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "419fb32b-d220-42f3-98f1-acfeb9e531fd", "address": "fa:16:3e:1b:3f:49", "network": {"id": "5c50496a-0882-415b-8115-ddf7b65516a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-531638472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f569146bb9b04838ad8044260da6ad58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419fb32b-d2", "ovs_interfaceid": "419fb32b-d220-42f3-98f1-acfeb9e531fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 07:56:37 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-1381b76d-dd13-4826-997b-3d220c8b2b6f tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Converting VIF {"id": "419fb32b-d220-42f3-98f1-acfeb9e531fd", "address": "fa:16:3e:1b:3f:49", "network": {"id": "5c50496a-0882-415b-8115-ddf7b65516a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-531638472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f569146bb9b04838ad8044260da6ad58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419fb32b-d2", "ovs_interfaceid": "419fb32b-d220-42f3-98f1-acfeb9e531fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:56:37 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-1381b76d-dd13-4826-997b-3d220c8b2b6f tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:3f:49,bridge_name='br-int',has_traffic_filtering=True,id=419fb32b-d220-42f3-98f1-acfeb9e531fd,network=Network(5c50496a-0882-415b-8115-ddf7b65516a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap419fb32b-d2') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:56:37 user nova-compute[74348]: DEBUG os_vif [None req-1381b76d-dd13-4826-997b-3d220c8b2b6f tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:3f:49,bridge_name='br-int',has_traffic_filtering=True,id=419fb32b-d220-42f3-98f1-acfeb9e531fd,network=Network(5c50496a-0882-415b-8115-ddf7b65516a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap419fb32b-d2') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 07:56:37 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:37 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap419fb32b-d2, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:56:37 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:37 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:56:37 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:37 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cbd48fce-3614-4b52-8c20-afaf9518e803) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:56:37 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:37 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:37 user nova-compute[74348]: INFO os_vif [None req-1381b76d-dd13-4826-997b-3d220c8b2b6f tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:3f:49,bridge_name='br-int',has_traffic_filtering=True,id=419fb32b-d220-42f3-98f1-acfeb9e531fd,network=Network(5c50496a-0882-415b-8115-ddf7b65516a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap419fb32b-d2')
Nov 22 07:56:37 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-1381b76d-dd13-4826-997b-3d220c8b2b6f tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Deleting instance files /opt/stack/data/nova/instances/ecbabf54-d2b4-47e0-9e50-60ba8e7e9094_del
Nov 22 07:56:37 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-1381b76d-dd13-4826-997b-3d220c8b2b6f tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Deletion of /opt/stack/data/nova/instances/ecbabf54-d2b4-47e0-9e50-60ba8e7e9094_del complete
Nov 22 07:56:37 user nova-compute[74348]: INFO nova.compute.manager [None req-1381b76d-dd13-4826-997b-3d220c8b2b6f tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Took 0.77 seconds to destroy the instance on the hypervisor.
Nov 22 07:56:37 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-1381b76d-dd13-4826-997b-3d220c8b2b6f tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 07:56:37 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 07:56:37 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 07:56:37 user nova-compute[74348]: DEBUG nova.network.neutron [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Updating instance_info_cache with network_info: [{"id": "07295502-d217-400f-8b56-9ff1ccd600cf", "address": "fa:16:3e:50:0c:08", "network": {"id": "fd2e1dc2-9099-48b4-b56d-bc5d09c892fe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1689843295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52a21c1ef18473aa64c139de7b920ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07295502-d2", "ovs_interfaceid": "07295502-d217-400f-8b56-9ff1ccd600cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:56:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Releasing lock "refresh_cache-bcedb385-b72a-49c2-b363-cf6da5804b60" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:56:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:38 user nova-compute[74348]: DEBUG nova.compute.manager [req-9df83d4d-fb1c-497d-829f-11facd10bd38 req-902c60b1-ef93-463f-a616-f1d535000a23 service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Received event network-vif-unplugged-07295502-d217-400f-8b56-9ff1ccd600cf {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:56:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9df83d4d-fb1c-497d-829f-11facd10bd38 req-902c60b1-ef93-463f-a616-f1d535000a23 service nova] Acquiring lock "bcedb385-b72a-49c2-b363-cf6da5804b60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9df83d4d-fb1c-497d-829f-11facd10bd38 req-902c60b1-ef93-463f-a616-f1d535000a23 service nova] Lock "bcedb385-b72a-49c2-b363-cf6da5804b60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9df83d4d-fb1c-497d-829f-11facd10bd38 req-902c60b1-ef93-463f-a616-f1d535000a23 service nova] Lock "bcedb385-b72a-49c2-b363-cf6da5804b60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:38 user nova-compute[74348]: DEBUG nova.compute.manager [req-9df83d4d-fb1c-497d-829f-11facd10bd38 req-902c60b1-ef93-463f-a616-f1d535000a23 service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] No waiting events found dispatching network-vif-unplugged-07295502-d217-400f-8b56-9ff1ccd600cf {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:56:38 user nova-compute[74348]: WARNING nova.compute.manager [req-9df83d4d-fb1c-497d-829f-11facd10bd38 req-902c60b1-ef93-463f-a616-f1d535000a23 service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Received unexpected event network-vif-unplugged-07295502-d217-400f-8b56-9ff1ccd600cf for instance with vm_state active and task_state rescuing.
Nov 22 07:56:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:38 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:56:38 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Took 1.18 seconds to deallocate network for instance.
Nov 22 07:56:38 user nova-compute[74348]: DEBUG nova.compute.manager [req-ed84d21e-bf3e-468b-baec-2cb79779a5e4 req-f7704aee-221b-408b-858d-d3006bdcfedb service nova] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Received event network-vif-deleted-419fb32b-d220-42f3-98f1-acfeb9e531fd {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:56:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1381b76d-dd13-4826-997b-3d220c8b2b6f tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1381b76d-dd13-4826-997b-3d220c8b2b6f tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:38 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Instance destroyed successfully.
Nov 22 07:56:38 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Attempting a stable device rescue
Nov 22 07:56:38 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74348) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 22 07:56:38 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Instance directory exists: not creating {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 22 07:56:38 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Creating image(s)
Nov 22 07:56:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Acquiring lock "/opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lock "/opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lock "/opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:38 user nova-compute[74348]: DEBUG nova.objects.instance [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lazy-loading 'trusted_certs' on Instance uuid bcedb385-b72a-49c2-b363-cf6da5804b60 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:56:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Acquiring lock "561eca1592e32a8ffe2eacefe61059b4b753129d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lock "561eca1592e32a8ffe2eacefe61059b4b753129d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/561eca1592e32a8ffe2eacefe61059b4b753129d.part --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:39 user nova-compute[74348]: DEBUG nova.compute.manager [req-df66293d-cd70-4c92-9ac8-e8430a6a1b61 req-ea71a345-fb25-4935-ad5a-b15b7d19bc76 service nova] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Received event network-vif-plugged-419fb32b-d220-42f3-98f1-acfeb9e531fd {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:56:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-df66293d-cd70-4c92-9ac8-e8430a6a1b61 req-ea71a345-fb25-4935-ad5a-b15b7d19bc76 service nova] Acquiring lock "ecbabf54-d2b4-47e0-9e50-60ba8e7e9094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-df66293d-cd70-4c92-9ac8-e8430a6a1b61 req-ea71a345-fb25-4935-ad5a-b15b7d19bc76 service nova] Lock "ecbabf54-d2b4-47e0-9e50-60ba8e7e9094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-df66293d-cd70-4c92-9ac8-e8430a6a1b61 req-ea71a345-fb25-4935-ad5a-b15b7d19bc76 service nova] Lock "ecbabf54-d2b4-47e0-9e50-60ba8e7e9094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:39 user nova-compute[74348]: DEBUG nova.compute.manager [req-df66293d-cd70-4c92-9ac8-e8430a6a1b61 req-ea71a345-fb25-4935-ad5a-b15b7d19bc76 service nova] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] No waiting events found dispatching network-vif-plugged-419fb32b-d220-42f3-98f1-acfeb9e531fd {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:56:39 user nova-compute[74348]: WARNING nova.compute.manager [req-df66293d-cd70-4c92-9ac8-e8430a6a1b61 req-ea71a345-fb25-4935-ad5a-b15b7d19bc76 service nova] [instance: ecbabf54-d2b4-47e0-9e50-60ba8e7e9094] Received unexpected event network-vif-plugged-419fb32b-d220-42f3-98f1-acfeb9e531fd for instance with vm_state deleted and task_state None.
Nov 22 07:56:40 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-1381b76d-dd13-4826-997b-3d220c8b2b6f tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-1381b76d-dd13-4826-997b-3d220c8b2b6f tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1381b76d-dd13-4826-997b-3d220c8b2b6f tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.427s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:40 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-1381b76d-dd13-4826-997b-3d220c8b2b6f tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Deleted allocations for instance ecbabf54-d2b4-47e0-9e50-60ba8e7e9094
Nov 22 07:56:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/561eca1592e32a8ffe2eacefe61059b4b753129d.part --force-share --output=json" returned: 0 in 0.203s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG nova.virt.images [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] d0e5292e-0166-4ba5-b038-3f56258ed627 was qcow2, converting to raw {{(pid=74348) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG nova.privsep.utils [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74348) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/561eca1592e32a8ffe2eacefe61059b4b753129d.part /opt/stack/data/nova/instances/_base/561eca1592e32a8ffe2eacefe61059b4b753129d.converted {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1381b76d-dd13-4826-997b-3d220c8b2b6f tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "ecbabf54-d2b4-47e0-9e50-60ba8e7e9094" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.656s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG nova.compute.manager [req-63479ad8-a83f-462d-9a32-418d198782de req-960318bc-3413-45fd-90bf-e962ace4a462 service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Received event network-vif-plugged-07295502-d217-400f-8b56-9ff1ccd600cf {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-63479ad8-a83f-462d-9a32-418d198782de req-960318bc-3413-45fd-90bf-e962ace4a462 service nova] Acquiring lock "bcedb385-b72a-49c2-b363-cf6da5804b60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-63479ad8-a83f-462d-9a32-418d198782de req-960318bc-3413-45fd-90bf-e962ace4a462 service nova] Lock "bcedb385-b72a-49c2-b363-cf6da5804b60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-63479ad8-a83f-462d-9a32-418d198782de req-960318bc-3413-45fd-90bf-e962ace4a462 service nova] Lock "bcedb385-b72a-49c2-b363-cf6da5804b60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG nova.compute.manager [req-63479ad8-a83f-462d-9a32-418d198782de req-960318bc-3413-45fd-90bf-e962ace4a462 service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] No waiting events found dispatching network-vif-plugged-07295502-d217-400f-8b56-9ff1ccd600cf {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:56:40 user nova-compute[74348]: WARNING nova.compute.manager [req-63479ad8-a83f-462d-9a32-418d198782de req-960318bc-3413-45fd-90bf-e962ace4a462 service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Received unexpected event network-vif-plugged-07295502-d217-400f-8b56-9ff1ccd600cf for instance with vm_state active and task_state rescuing.
Nov 22 07:56:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/561eca1592e32a8ffe2eacefe61059b4b753129d.part /opt/stack/data/nova/instances/_base/561eca1592e32a8ffe2eacefe61059b4b753129d.converted" returned: 0 in 0.262s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/561eca1592e32a8ffe2eacefe61059b4b753129d.converted --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/561eca1592e32a8ffe2eacefe61059b4b753129d.converted --force-share --output=json" returned: 0 in 0.182s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lock "561eca1592e32a8ffe2eacefe61059b4b753129d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.753s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Acquiring lock "561eca1592e32a8ffe2eacefe61059b4b753129d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lock "561eca1592e32a8ffe2eacefe61059b4b753129d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/561eca1592e32a8ffe2eacefe61059b4b753129d --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG nova.objects.instance [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lazy-loading 'pci_requests' on Instance uuid 5f3bbae3-babf-44d2-96da-c459fb77d9c7 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG nova.objects.instance [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lazy-loading 'numa_topology' on Instance uuid 5f3bbae3-babf-44d2-96da-c459fb77d9c7 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 07:56:40 user nova-compute[74348]: INFO nova.compute.claims [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Claim successful on node user
Nov 22 07:56:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/561eca1592e32a8ffe2eacefe61059b4b753129d --force-share --output=json" returned: 0 in 0.191s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/561eca1592e32a8ffe2eacefe61059b4b753129d,backing_fmt=raw /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk.rescue {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/561eca1592e32a8ffe2eacefe61059b4b753129d,backing_fmt=raw /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk.rescue" returned: 0 in 0.054s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lock "561eca1592e32a8ffe2eacefe61059b4b753129d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG nova.objects.instance [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lazy-loading 'migration_context' on Instance uuid bcedb385-b72a-49c2-b363-cf6da5804b60 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG nova.objects.base [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Object Instance<bcedb385-b72a-49c2-b363-cf6da5804b60> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Start _get_guest_xml network_info=[{"id": "07295502-d217-400f-8b56-9ff1ccd600cf", "address": "fa:16:3e:50:0c:08", "network": {"id": "fd2e1dc2-9099-48b4-b56d-bc5d09c892fe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1689843295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1689843295-network", "vif_mac": "fa:16:3e:50:0c:08"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52a21c1ef18473aa64c139de7b920ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07295502-d2", "ovs_interfaceid": "07295502-d217-400f-8b56-9ff1ccd600cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd0e5292e-0166-4ba5-b038-3f56258ed627', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kOYubGxc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'bcedb385-b72a-49c2-b363-cf6da5804b60', 'attached_at': '', 'detached_at': '', 'volume_id': '53b1125a-70bf-4535-950d-89a82c099803', 'serial': '53b1125a-70bf-4535-950d-89a82c099803'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'attachment_id': '3a594157-448e-4ec2-ba5b-22005f5ed435', 'volume_type': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG nova.objects.instance [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lazy-loading 'resources' on Instance uuid bcedb385-b72a-49c2-b363-cf6da5804b60 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG nova.objects.base [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Object Instance<bcedb385-b72a-49c2-b363-cf6da5804b60> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG nova.objects.instance [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lazy-loading 'numa_topology' on Instance uuid bcedb385-b72a-49c2-b363-cf6da5804b60 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG nova.objects.base [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Object Instance<bcedb385-b72a-49c2-b363-cf6da5804b60> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 07:56:40 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:56:40 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:56:40 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG nova.objects.instance [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lazy-loading 'vcpu_model' on Instance uuid bcedb385-b72a-49c2-b363-cf6da5804b60 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:56:40 user nova-compute[74348]: DEBUG nova.objects.base [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Object Instance<bcedb385-b72a-49c2-b363-cf6da5804b60> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kOYubGxc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:56:41 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:56:41 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:56:41 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:56:41 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:56:41 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 07:56:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[378cfbb5-45b1-4cd4-a6d4-1cc2241b56b7]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = kOYubGxc\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 22 07:56:41 user nova-compute[74348]: node.name = iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803
Nov 22 07:56:41 user nova-compute[74348]: node.tpgt = -1
Nov 22 07:56:41 user nova-compute[74348]: node.startup = automatic
Nov 22 07:56:41 user nova-compute[74348]: node.leading_login = No
Nov 22 07:56:41 user nova-compute[74348]: iface.iscsi_ifacename = default
Nov 22 07:56:41 user nova-compute[74348]: iface.net_ifacename = <empty>
Nov 22 07:56:41 user nova-compute[74348]: iface.ipaddress = <empty>
Nov 22 07:56:41 user nova-compute[74348]: iface.prefix_len = 0
Nov 22 07:56:41 user nova-compute[74348]: iface.hwaddress = <empty>
Nov 22 07:56:41 user nova-compute[74348]: iface.transport_name = tcp
Nov 22 07:56:41 user nova-compute[74348]: iface.initiatorname = <empty>
Nov 22 07:56:41 user nova-compute[74348]: iface.state = <empty>
Nov 22 07:56:41 user nova-compute[74348]: iface.vlan_id = 0
Nov 22 07:56:41 user nova-compute[74348]: iface.vlan_priority = 0
Nov 22 07:56:41 user nova-compute[74348]: iface.vlan_state = <empty>
Nov 22 07:56:41 user nova-compute[74348]: iface.iface_num = 0
Nov 22 07:56:41 user nova-compute[74348]: iface.mtu = 0
Nov 22 07:56:41 user nova-compute[74348]: iface.port = 0
Nov 22 07:56:41 user nova-compute[74348]: iface.bootproto = <empty>
Nov 22 07:56:41 user nova-compute[74348]: iface.subnet_mask = <empty>
Nov 22 07:56:41 user nova-compute[74348]: iface.gateway = <empty>
Nov 22 07:56:41 user nova-compute[74348]: iface.dhcp_alt_client_id_state = <empty>
Nov 22 07:56:41 user nova-compute[74348]: iface.dhcp_alt_client_id = <empty>
Nov 22 07:56:41 user nova-compute[74348]: iface.dhcp_dns = <empty>
Nov 22 07:56:41 user nova-compute[74348]: iface.dhcp_learn_iqn = <empty>
Nov 22 07:56:41 user nova-compute[74348]: iface.dhcp_req_vendor_id_state = <empty>
Nov 22 07:56:41 user nova-compute[74348]: iface.dhcp_vendor_id_state = <empty>
Nov 22 07:56:41 user nova-compute[74348]: iface.dhcp_vendor_id = <empty>
Nov 22 07:56:41 user nova-compute[74348]: iface.dhcp_slp_da = <empty>
Nov 22 07:56:41 user nova-compute[74348]: iface.fragmentation = <empty>
Nov 22 07:56:41 user nova-compute[74348]: iface.gratuitous_arp = <empty>
Nov 22 07:56:41 user nova-compute[74348]: iface.incoming_forwarding = <empty>
Nov 22 07:56:41 user nova-compute[74348]: iface.tos_state = <empty>
Nov 22 07:56:41 user nova-compute[74348]: iface.tos = 0
Nov 22 07:56:41 user nova-compute[74348]: iface.ttl = 0
Nov 22 07:56:41 user nova-compute[74348]: iface.delayed_ack = <empty>
Nov 22 07:56:41 user nova-compute[74348]: iface.tcp_nagle = <empty>
Nov 22 07:56:41 user nova-compute[74348]: iface.tcp_wsf_state = <empty>
Nov 22 07:56:41 user nova-compute[74348]: iface.tcp_wsf = 0
Nov 22 07:56:41 user nova-compute[74348]: iface.tcp_timer_scale = 0
Nov 22 07:56:41 user nova-compute[74348]: iface.tcp_timestamp = <empty>
Nov 22 07:56:41 user nova-compute[74348]: iface.redirect = <empty>
Nov 22 07:56:41 user nova-compute[74348]: iface.def_task_mgmt_timeout = 0
Nov 22 07:56:41 user nova-compute[74348]: iface.header_digest = <empty>
Nov 22 07:56:41 user nova-compute[74348]: iface.data_digest = <empty>
Nov 22 07:56:41 user nova-compute[74348]: iface.immediate_data = <empty>
Nov 22 07:56:41 user nova-compute[74348]: iface.initial_r2t = <empty>
Nov 22 07:56:41 user nova-compute[74348]: iface.data_seq_inorder = <empty>
Nov 22 07:56:41 user nova-compute[74348]: iface.data_pdu_inorder = <empty>
Nov 22 07:56:41 user nova-compute[74348]: iface.erl = 0
Nov 22 07:56:41 user nova-compute[74348]: iface.max_receive_data_len = 0
Nov 22 07:56:41 user nova-compute[74348]: iface.first_burst_len = 0
Nov 22 07:56:41 user nova-compute[74348]: iface.max_outstanding_r2t = 0
Nov 22 07:56:41 user nova-compute[74348]: iface.max_burst_len = 0
Nov 22 07:56:41 user nova-compute[74348]: iface.chap_auth = <empty>
Nov 22 07:56:41 user nova-compute[74348]: iface.bidi_chap = <empty>
Nov 22 07:56:41 user nova-compute[74348]: iface.strict_login_compliance = <empty>
Nov 22 07:56:41 user nova-compute[74348]: iface.discovery_auth = <empty>
Nov 22 07:56:41 user nova-compute[74348]: iface.discovery_logout = <empty>
Nov 22 07:56:41 user nova-compute[74348]: node.discovery_address = <empty>
Nov 22 07:56:41 user nova-compute[74348]: node.discovery_port = 0
Nov 22 07:56:41 user nova-compute[74348]: node.discovery_type = static
Nov 22 07:56:41 user nova-compute[74348]: node.session.initial_cmdsn = 0
Nov 22 07:56:41 user nova-compute[74348]: node.session.initial_login_retry_max = 8
Nov 22 07:56:41 user nova-compute[74348]: node.session.xmit_thread_priority = -20
Nov 22 07:56:41 user nova-compute[74348]: node.session.cmds_max = 128
Nov 22 07:56:41 user nova-compute[74348]: node.session.queue_depth = 32
Nov 22 07:56:41 user nova-compute[74348]: node.session.nr_sessions = 1
Nov 22 07:56:41 user nova-compute[74348]: node.session.auth.authmethod = CHAP
Nov 22 07:56:41 user nova-compute[74348]: node.session.auth.username = kOYubGxc
Nov 22 07:56:41 user nova-compute[74348]: node.session.auth.password = ***
Nov 22 07:56:41 user nova-compute[74348]: node.session.auth.username_in = <empty>
Nov 22 07:56:41 user nova-compute[74348]: node.session.auth.password_in = <empty>
Nov 22 07:56:41 user nova-compute[74348]: node.session.auth.chap_algs = MD5
Nov 22 07:56:41 user nova-compute[74348]: node.session.timeo.replacement_timeout = 120
Nov 22 07:56:41 user nova-compute[74348]: node.session.err_timeo.abort_timeout = 15
Nov 22 07:56:41 user nova-compute[74348]: node.session.err_timeo.lu_reset_timeout = 30
Nov 22 07:56:41 user nova-compute[74348]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 22 07:56:41 user nova-compute[74348]: node.session.err_timeo.host_reset_timeout = 60
Nov 22 07:56:41 user nova-compute[74348]: node.session.iscsi.FastAbort = Yes
Nov 22 07:56:41 user nova-compute[74348]: node.session.iscsi.InitialR2T = No
Nov 22 07:56:41 user nova-compute[74348]: node.session.iscsi.ImmediateData = Yes
Nov 22 07:56:41 user nova-compute[74348]: node.session.iscsi.FirstBurstLength = 262144
Nov 22 07:56:41 user nova-compute[74348]: node.session.iscsi.MaxBurstLength = 16776192
Nov 22 07:56:41 user nova-compute[74348]: node.session.iscsi.DefaultTime2Retain = 0
Nov 22 07:56:41 user nova-compute[74348]: node.session.iscsi.DefaultTime2Wait = 2
Nov 22 07:56:41 user nova-compute[74348]: node.session.iscsi.MaxConnections = 1
Nov 22 07:56:41 user nova-compute[74348]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 22 07:56:41 user nova-compute[74348]: node.session.iscsi.ERL = 0
Nov 22 07:56:41 user nova-compute[74348]: node.session.scan = manual
Nov 22 07:56:41 user nova-compute[74348]: node.session.reopen_max = 0
Nov 22 07:56:41 user nova-compute[74348]: node.conn[0].address = 172.16.0.220
Nov 22 07:56:41 user nova-compute[74348]: node.conn[0].port = 3260
Nov 22 07:56:41 user nova-compute[74348]: node.conn[0].startup = manual
Nov 22 07:56:41 user nova-compute[74348]: node.conn[0].tcp.window_size = 524288
Nov 22 07:56:41 user nova-compute[74348]: node.conn[0].tcp.type_of_service = 0
Nov 22 07:56:41 user nova-compute[74348]: node.conn[0].timeo.logout_timeout = 15
Nov 22 07:56:41 user nova-compute[74348]: node.conn[0].timeo.login_timeout = 15
Nov 22 07:56:41 user nova-compute[74348]: node.conn[0].timeo.auth_timeout = 45
Nov 22 07:56:41 user nova-compute[74348]: node.conn[0].timeo.noop_out_interval = 5
Nov 22 07:56:41 user nova-compute[74348]: node.conn[0].timeo.noop_out_timeout = 5
Nov 22 07:56:41 user nova-compute[74348]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 22 07:56:41 user nova-compute[74348]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 22 07:56:41 user nova-compute[74348]: node.conn[0].iscsi.HeaderDigest = None
Nov 22 07:56:41 user nova-compute[74348]: node.conn[0].iscsi.DataDigest = None
Nov 22 07:56:41 user nova-compute[74348]: node.conn[0].iscsi.IFMarker = No
Nov 22 07:56:41 user nova-compute[74348]: node.conn[0].iscsi.OFMarker = No
Nov 22 07:56:41 user nova-compute[74348]: # END RECORD
Nov 22 07:56:41 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd1dcef-95b4-40d7-a745-9e2470d14cbf]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[817d40c3-4a8f-43c8-bc66-14e1881e0ba0]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kOYubGxc {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kOYubGxc" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e0bfab-b8b4-4193-96f1-d9d673d78c94]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kOYubGxc'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb42898-d351-46a4-b786-219354a52f41]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd3266c-eedc-4119-8316-2cc454bc4f3b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:56:41 user nova-compute[74348]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)
Nov 22 07:56:41 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:56:41 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:56:41 user nova-compute[74348]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)
Nov 22 07:56:41 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:56:41 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.161s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] HCTL ('33', '0', '0', 0) found on session 18 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cac520-6705-474f-b201-8d84be1e7122]: (4, ('0 0 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Searching for a device in session 18 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kOYubGxc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.185s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] <== connect_volume: return (186ms) {'type': 'block', 'scsi_wwn': '23639613563646635', 'path': '/dev/sdb'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639613563646635', 'path': '/dev/sdb'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:52:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1265518421',display_name='tempest-ServerStableDeviceRescueTest-server-1265518421',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1265518421',id=3,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnGejlUCbU+TZ721uJZEGmLnTNVCBBM879Xewcu8isegoAWEt+xTskGWpM7X241rS86tQTNpoTmY80QMBL/L0CKb2yd4AKlvcL5MuFfyK4GKM1PMiVB7vqffS9ETA8vQg==',key_name='tempest-keypair-1916933864',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:52:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f52a21c1ef18473aa64c139de7b920ab',ramdisk_id='',reservation_id='r-hqpjdyae',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1621342321',owner_user_name='tempest-ServerStableDeviceRescueTest-1621342321-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:54:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7feabb30a9c14a209ad4fc962ef29481',uuid=bcedb385-b72a-49c2-b363-cf6da5804b60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07295502-d217-400f-8b56-9ff1ccd600cf", "address": "fa:16:3e:50:0c:08", "network": {"id": "fd2e1dc2-9099-48b4-b56d-bc5d09c892fe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1689843295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1689843295-network", "vif_mac": "fa:16:3e:50:0c:08"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52a21c1ef18473aa64c139de7b920ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07295502-d2", "ovs_interfaceid": "07295502-d217-400f-8b56-9ff1ccd600cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Converting VIF {"id": "07295502-d217-400f-8b56-9ff1ccd600cf", "address": "fa:16:3e:50:0c:08", "network": {"id": "fd2e1dc2-9099-48b4-b56d-bc5d09c892fe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1689843295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1689843295-network", "vif_mac": "fa:16:3e:50:0c:08"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52a21c1ef18473aa64c139de7b920ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07295502-d2", "ovs_interfaceid": "07295502-d217-400f-8b56-9ff1ccd600cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:0c:08,bridge_name='br-int',has_traffic_filtering=True,id=07295502-d217-400f-8b56-9ff1ccd600cf,network=Network(fd2e1dc2-9099-48b4-b56d-bc5d09c892fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07295502-d2') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG nova.objects.instance [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lazy-loading 'pci_devices' on Instance uuid bcedb385-b72a-49c2-b363-cf6da5804b60 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG nova.objects.base [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Object Instance<bcedb385-b72a-49c2-b363-cf6da5804b60> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] End _get_guest_xml xml=<domain type="kvm">
Nov 22 07:56:41 user nova-compute[74348]:   <uuid>bcedb385-b72a-49c2-b363-cf6da5804b60</uuid>
Nov 22 07:56:41 user nova-compute[74348]:   <name>instance-00000003</name>
Nov 22 07:56:41 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 07:56:41 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 07:56:41 user nova-compute[74348]:   <metadata>
Nov 22 07:56:41 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 07:56:41 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 07:56:41 user nova-compute[74348]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1265518421</nova:name>
Nov 22 07:56:41 user nova-compute[74348]:       <nova:creationTime>2023-11-22 07:56:40</nova:creationTime>
Nov 22 07:56:41 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 07:56:41 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 07:56:41 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 07:56:41 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 07:56:41 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 07:56:41 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 07:56:41 user nova-compute[74348]:       </nova:flavor>
Nov 22 07:56:41 user nova-compute[74348]:       <nova:owner>
Nov 22 07:56:41 user nova-compute[74348]:         <nova:user uuid="7feabb30a9c14a209ad4fc962ef29481">tempest-ServerStableDeviceRescueTest-1621342321-project-member</nova:user>
Nov 22 07:56:41 user nova-compute[74348]:         <nova:project uuid="f52a21c1ef18473aa64c139de7b920ab">tempest-ServerStableDeviceRescueTest-1621342321</nova:project>
Nov 22 07:56:41 user nova-compute[74348]:       </nova:owner>
Nov 22 07:56:41 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 07:56:41 user nova-compute[74348]:       <nova:ports>
Nov 22 07:56:41 user nova-compute[74348]:         <nova:port uuid="07295502-d217-400f-8b56-9ff1ccd600cf">
Nov 22 07:56:41 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 22 07:56:41 user nova-compute[74348]:         </nova:port>
Nov 22 07:56:41 user nova-compute[74348]:       </nova:ports>
Nov 22 07:56:41 user nova-compute[74348]:     </nova:instance>
Nov 22 07:56:41 user nova-compute[74348]:   </metadata>
Nov 22 07:56:41 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 07:56:41 user nova-compute[74348]:     <system>
Nov 22 07:56:41 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 07:56:41 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 07:56:41 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 07:56:41 user nova-compute[74348]:       <entry name="serial">bcedb385-b72a-49c2-b363-cf6da5804b60</entry>
Nov 22 07:56:41 user nova-compute[74348]:       <entry name="uuid">bcedb385-b72a-49c2-b363-cf6da5804b60</entry>
Nov 22 07:56:41 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 07:56:41 user nova-compute[74348]:     </system>
Nov 22 07:56:41 user nova-compute[74348]:   </sysinfo>
Nov 22 07:56:41 user nova-compute[74348]:   <os>
Nov 22 07:56:41 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 07:56:41 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 07:56:41 user nova-compute[74348]:   </os>
Nov 22 07:56:41 user nova-compute[74348]:   <features>
Nov 22 07:56:41 user nova-compute[74348]:     <acpi/>
Nov 22 07:56:41 user nova-compute[74348]:     <apic/>
Nov 22 07:56:41 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 07:56:41 user nova-compute[74348]:   </features>
Nov 22 07:56:41 user nova-compute[74348]:   <clock offset="utc">
Nov 22 07:56:41 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 07:56:41 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 07:56:41 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 07:56:41 user nova-compute[74348]:   </clock>
Nov 22 07:56:41 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 07:56:41 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 07:56:41 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 07:56:41 user nova-compute[74348]:   </cpu>
Nov 22 07:56:41 user nova-compute[74348]:   <devices>
Nov 22 07:56:41 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 07:56:41 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 07:56:41 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk"/>
Nov 22 07:56:41 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 07:56:41 user nova-compute[74348]:     </disk>
Nov 22 07:56:41 user nova-compute[74348]:     <disk type="block" device="disk">
Nov 22 07:56:41 user nova-compute[74348]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 07:56:41 user nova-compute[74348]:       <source dev="/dev/sdb"/>
Nov 22 07:56:41 user nova-compute[74348]:       <target dev="vdb" bus="virtio"/>
Nov 22 07:56:41 user nova-compute[74348]:       <serial>53b1125a-70bf-4535-950d-89a82c099803</serial>
Nov 22 07:56:41 user nova-compute[74348]:     </disk>
Nov 22 07:56:41 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 07:56:41 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 07:56:41 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk.rescue"/>
Nov 22 07:56:41 user nova-compute[74348]:       <target dev="vdc" bus="virtio"/>
Nov 22 07:56:41 user nova-compute[74348]:       <boot order="1"/>
Nov 22 07:56:41 user nova-compute[74348]:     </disk>
Nov 22 07:56:41 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 07:56:41 user nova-compute[74348]:       <mac address="fa:16:3e:50:0c:08"/>
Nov 22 07:56:41 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:56:41 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 07:56:41 user nova-compute[74348]:       <target dev="tap07295502-d2"/>
Nov 22 07:56:41 user nova-compute[74348]:     </interface>
Nov 22 07:56:41 user nova-compute[74348]:     <serial type="pty">
Nov 22 07:56:41 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/console.log" append="off"/>
Nov 22 07:56:41 user nova-compute[74348]:     </serial>
Nov 22 07:56:41 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 07:56:41 user nova-compute[74348]:     <video>
Nov 22 07:56:41 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:56:41 user nova-compute[74348]:     </video>
Nov 22 07:56:41 user nova-compute[74348]:     <rng model="virtio">
Nov 22 07:56:41 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 07:56:41 user nova-compute[74348]:     </rng>
Nov 22 07:56:41 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 07:56:41 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 07:56:41 user nova-compute[74348]:       <stats period="10"/>
Nov 22 07:56:41 user nova-compute[74348]:     </memballoon>
Nov 22 07:56:41 user nova-compute[74348]:   </devices>
Nov 22 07:56:41 user nova-compute[74348]: </domain>
Nov 22 07:56:41 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 07:56:41 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Instance destroyed successfully.
Nov 22 07:56:41 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] No VIF found with MAC fa:16:3e:50:0c:08, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 07:56:41 user nova-compute[74348]: INFO nova.network.neutron [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Updating port 094232d9-8ec1-401f-8908-2a698a5385bb with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 22 07:56:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:42 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquiring lock "refresh_cache-5f3bbae3-babf-44d2-96da-c459fb77d9c7" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:56:42 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquired lock "refresh_cache-5f3bbae3-babf-44d2-96da-c459fb77d9c7" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:56:42 user nova-compute[74348]: DEBUG nova.network.neutron [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 07:56:42 user nova-compute[74348]: DEBUG nova.compute.manager [req-72a274fa-533b-4f67-8a36-0991a1bff59e req-da88d679-3af6-4fcb-9f86-62f1d0ff3a4b service nova] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Received event network-changed-094232d9-8ec1-401f-8908-2a698a5385bb {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:56:42 user nova-compute[74348]: DEBUG nova.compute.manager [req-72a274fa-533b-4f67-8a36-0991a1bff59e req-da88d679-3af6-4fcb-9f86-62f1d0ff3a4b service nova] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Refreshing instance network info cache due to event network-changed-094232d9-8ec1-401f-8908-2a698a5385bb. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:56:42 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-72a274fa-533b-4f67-8a36-0991a1bff59e req-da88d679-3af6-4fcb-9f86-62f1d0ff3a4b service nova] Acquiring lock "refresh_cache-5f3bbae3-babf-44d2-96da-c459fb77d9c7" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:56:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:43 user nova-compute[74348]: DEBUG nova.compute.manager [req-478b943a-6c7f-4a26-b0ed-de33456f9f82 req-17594097-32ed-467f-bde1-0b4d72226cfd service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Received event network-vif-plugged-07295502-d217-400f-8b56-9ff1ccd600cf {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:56:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-478b943a-6c7f-4a26-b0ed-de33456f9f82 req-17594097-32ed-467f-bde1-0b4d72226cfd service nova] Acquiring lock "bcedb385-b72a-49c2-b363-cf6da5804b60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-478b943a-6c7f-4a26-b0ed-de33456f9f82 req-17594097-32ed-467f-bde1-0b4d72226cfd service nova] Lock "bcedb385-b72a-49c2-b363-cf6da5804b60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-478b943a-6c7f-4a26-b0ed-de33456f9f82 req-17594097-32ed-467f-bde1-0b4d72226cfd service nova] Lock "bcedb385-b72a-49c2-b363-cf6da5804b60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:43 user nova-compute[74348]: DEBUG nova.compute.manager [req-478b943a-6c7f-4a26-b0ed-de33456f9f82 req-17594097-32ed-467f-bde1-0b4d72226cfd service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] No waiting events found dispatching network-vif-plugged-07295502-d217-400f-8b56-9ff1ccd600cf {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:56:43 user nova-compute[74348]: WARNING nova.compute.manager [req-478b943a-6c7f-4a26-b0ed-de33456f9f82 req-17594097-32ed-467f-bde1-0b4d72226cfd service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Received unexpected event network-vif-plugged-07295502-d217-400f-8b56-9ff1ccd600cf for instance with vm_state active and task_state rescuing.
Nov 22 07:56:43 user nova-compute[74348]: DEBUG nova.network.neutron [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Updating instance_info_cache with network_info: [{"id": "094232d9-8ec1-401f-8908-2a698a5385bb", "address": "fa:16:3e:db:2f:02", "network": {"id": "4ef640bb-4a2f-4f98-8b01-b5df87fcb35a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1216437312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444367658c0241d0b5b377a73fedb52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap094232d9-8e", "ovs_interfaceid": "094232d9-8ec1-401f-8908-2a698a5385bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:56:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Releasing lock "refresh_cache-5f3bbae3-babf-44d2-96da-c459fb77d9c7" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:56:43 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 07:56:43 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Creating image(s)
Nov 22 07:56:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquiring lock "/opt/stack/data/nova/instances/5f3bbae3-babf-44d2-96da-c459fb77d9c7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "/opt/stack/data/nova/instances/5f3bbae3-babf-44d2-96da-c459fb77d9c7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "/opt/stack/data/nova/instances/5f3bbae3-babf-44d2-96da-c459fb77d9c7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:43 user nova-compute[74348]: DEBUG nova.objects.instance [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5f3bbae3-babf-44d2-96da-c459fb77d9c7 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:56:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-72a274fa-533b-4f67-8a36-0991a1bff59e req-da88d679-3af6-4fcb-9f86-62f1d0ff3a4b service nova] Acquired lock "refresh_cache-5f3bbae3-babf-44d2-96da-c459fb77d9c7" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:56:43 user nova-compute[74348]: DEBUG nova.network.neutron [req-72a274fa-533b-4f67-8a36-0991a1bff59e req-da88d679-3af6-4fcb-9f86-62f1d0ff3a4b service nova] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Refreshing network info cache for port 094232d9-8ec1-401f-8908-2a698a5385bb {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:56:43 user nova-compute[74348]: DEBUG nova.objects.base [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Object Instance<5f3bbae3-babf-44d2-96da-c459fb77d9c7> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 07:56:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquiring lock "93ba6134c82bcbb951d3cc380862ab9b2f4cfe57" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "93ba6134c82bcbb951d3cc380862ab9b2f4cfe57" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93ba6134c82bcbb951d3cc380862ab9b2f4cfe57.part --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93ba6134c82bcbb951d3cc380862ab9b2f4cfe57.part --force-share --output=json" returned: 0 in 0.177s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:44 user nova-compute[74348]: DEBUG nova.virt.images [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] 1e96f0a9-e42f-4190-8221-7914c6953262 was qcow2, converting to raw {{(pid=74348) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 22 07:56:44 user nova-compute[74348]: DEBUG nova.privsep.utils [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74348) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 07:56:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/93ba6134c82bcbb951d3cc380862ab9b2f4cfe57.part /opt/stack/data/nova/instances/_base/93ba6134c82bcbb951d3cc380862ab9b2f4cfe57.converted {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:44 user nova-compute[74348]: DEBUG nova.network.neutron [req-72a274fa-533b-4f67-8a36-0991a1bff59e req-da88d679-3af6-4fcb-9f86-62f1d0ff3a4b service nova] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Updated VIF entry in instance network info cache for port 094232d9-8ec1-401f-8908-2a698a5385bb. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 07:56:44 user nova-compute[74348]: DEBUG nova.network.neutron [req-72a274fa-533b-4f67-8a36-0991a1bff59e req-da88d679-3af6-4fcb-9f86-62f1d0ff3a4b service nova] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Updating instance_info_cache with network_info: [{"id": "094232d9-8ec1-401f-8908-2a698a5385bb", "address": "fa:16:3e:db:2f:02", "network": {"id": "4ef640bb-4a2f-4f98-8b01-b5df87fcb35a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1216437312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444367658c0241d0b5b377a73fedb52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap094232d9-8e", "ovs_interfaceid": "094232d9-8ec1-401f-8908-2a698a5385bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:56:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-72a274fa-533b-4f67-8a36-0991a1bff59e req-da88d679-3af6-4fcb-9f86-62f1d0ff3a4b service nova] Releasing lock "refresh_cache-5f3bbae3-babf-44d2-96da-c459fb77d9c7" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:56:44 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:45 user nova-compute[74348]: DEBUG nova.compute.manager [req-00e11f5e-1b53-4f0e-99da-f6205fcbc2a8 req-2bee083d-5428-4936-a8cd-7bf5d736969a service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Received event network-vif-plugged-07295502-d217-400f-8b56-9ff1ccd600cf {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:56:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-00e11f5e-1b53-4f0e-99da-f6205fcbc2a8 req-2bee083d-5428-4936-a8cd-7bf5d736969a service nova] Acquiring lock "bcedb385-b72a-49c2-b363-cf6da5804b60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-00e11f5e-1b53-4f0e-99da-f6205fcbc2a8 req-2bee083d-5428-4936-a8cd-7bf5d736969a service nova] Lock "bcedb385-b72a-49c2-b363-cf6da5804b60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-00e11f5e-1b53-4f0e-99da-f6205fcbc2a8 req-2bee083d-5428-4936-a8cd-7bf5d736969a service nova] Lock "bcedb385-b72a-49c2-b363-cf6da5804b60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:45 user nova-compute[74348]: DEBUG nova.compute.manager [req-00e11f5e-1b53-4f0e-99da-f6205fcbc2a8 req-2bee083d-5428-4936-a8cd-7bf5d736969a service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] No waiting events found dispatching network-vif-plugged-07295502-d217-400f-8b56-9ff1ccd600cf {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:56:45 user nova-compute[74348]: WARNING nova.compute.manager [req-00e11f5e-1b53-4f0e-99da-f6205fcbc2a8 req-2bee083d-5428-4936-a8cd-7bf5d736969a service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Received unexpected event network-vif-plugged-07295502-d217-400f-8b56-9ff1ccd600cf for instance with vm_state active and task_state rescuing.
Nov 22 07:56:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/93ba6134c82bcbb951d3cc380862ab9b2f4cfe57.part /opt/stack/data/nova/instances/_base/93ba6134c82bcbb951d3cc380862ab9b2f4cfe57.converted" returned: 0 in 0.281s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93ba6134c82bcbb951d3cc380862ab9b2f4cfe57.converted --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:45 user nova-compute[74348]: DEBUG nova.compute.manager [None req-9247e25e-4cdd-4d4d-8624-b6f784feff76 tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 07:56:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93ba6134c82bcbb951d3cc380862ab9b2f4cfe57.converted --force-share --output=json" returned: 0 in 0.171s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "93ba6134c82bcbb951d3cc380862ab9b2f4cfe57" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.834s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93ba6134c82bcbb951d3cc380862ab9b2f4cfe57 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93ba6134c82bcbb951d3cc380862ab9b2f4cfe57 --force-share --output=json" returned: 0 in 0.221s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquiring lock "93ba6134c82bcbb951d3cc380862ab9b2f4cfe57" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "93ba6134c82bcbb951d3cc380862ab9b2f4cfe57" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93ba6134c82bcbb951d3cc380862ab9b2f4cfe57 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93ba6134c82bcbb951d3cc380862ab9b2f4cfe57 --force-share --output=json" returned: 0 in 0.187s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93ba6134c82bcbb951d3cc380862ab9b2f4cfe57,backing_fmt=raw /opt/stack/data/nova/instances/5f3bbae3-babf-44d2-96da-c459fb77d9c7/disk 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93ba6134c82bcbb951d3cc380862ab9b2f4cfe57,backing_fmt=raw /opt/stack/data/nova/instances/5f3bbae3-babf-44d2-96da-c459fb77d9c7/disk 1073741824" returned: 0 in 0.047s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "93ba6134c82bcbb951d3cc380862ab9b2f4cfe57" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93ba6134c82bcbb951d3cc380862ab9b2f4cfe57 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93ba6134c82bcbb951d3cc380862ab9b2f4cfe57 --force-share --output=json" returned: 0 in 0.228s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:45 user nova-compute[74348]: DEBUG nova.objects.instance [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lazy-loading 'migration_context' on Instance uuid 5f3bbae3-babf-44d2-96da-c459fb77d9c7 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:56:45 user nova-compute[74348]: DEBUG nova.objects.base [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Object Instance<5f3bbae3-babf-44d2-96da-c459fb77d9c7> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 07:56:45 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Rebasing disk image.
Nov 22 07:56:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.208s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 -F raw /opt/stack/data/nova/instances/5f3bbae3-babf-44d2-96da-c459fb77d9c7/disk {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RoQzpAmu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:56:48 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:56:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:56:48 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:56:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:56:48 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 07:56:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[835e8b0a-481e-4fb7-9807-c0872b793cb3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 07:56:48 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6080f88b-1121-4465-bb1d-170b2829876b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730] added
Nov 22 07:56:48 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7dc125-c656-4198-90ff-bfd83fbef5d8]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[06da7f3b-29f3-4423-bea2-3366bc0824b2]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RoQzpAmu {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RoQzpAmu" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a37913-9526-4f4f-a21c-2511131c4fdd]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RoQzpAmu'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a510e8-29e9-4e5f-957b-0c7b0427424d]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0f56f1-bb17-464c-9ab0-cfe23e806dac]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:56:48 user nova-compute[74348]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)
Nov 22 07:56:48 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:56:48 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:56:48 user nova-compute[74348]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)
Nov 22 07:56:48 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:56:48 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[548b1a1e-dd5d-42bd-9e85-af78d35005f1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730, portal: 172.16.0.220,3260]
Nov 22 07:56:48 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730, portal: 172.16.0.220,3260] successful.
Nov 22 07:56:48 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.036s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b776c29b-3b2e-4857-9460-f10c490bbfc0]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7810439b-c50a-4142-9648-e7a05bf31a8a]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:56:48 user nova-compute[74348]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)
Nov 22 07:56:48 user nova-compute[74348]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 07:56:48 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:56:48 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:56:48 user nova-compute[74348]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)
Nov 22 07:56:48 user nova-compute[74348]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 07:56:48 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:56:48 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e588bbbd-cc3d-43a5-8516-1dfde5b4d2ed]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 07:56:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RoQzpAmu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 -F raw /opt/stack/data/nova/instances/5f3bbae3-babf-44d2-96da-c459fb77d9c7/disk" returned: 0 in 2.849s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Ensure instance console log exists: /opt/stack/data/nova/instances/5f3bbae3-babf-44d2-96da-c459fb77d9c7/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Start _get_guest_xml network_info=[{"id": "094232d9-8ec1-401f-8908-2a698a5385bb", "address": "fa:16:3e:db:2f:02", "network": {"id": "4ef640bb-4a2f-4f98-8b01-b5df87fcb35a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1216437312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444367658c0241d0b5b377a73fedb52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap094232d9-8e", "ovs_interfaceid": "094232d9-8ec1-401f-8908-2a698a5385bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='309fef2fd9010cdf734e01cd7870b811',container_format='bare',created_at=2023-11-22T07:54:40Z,direct_url=<?>,disk_format='qcow2',id=1e96f0a9-e42f-4190-8221-7914c6953262,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1450258036-shelved',owner='444367658c0241d0b5b377a73fedb52b',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-22T07:54:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'roLgUcmF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '5f3bbae3-babf-44d2-96da-c459fb77d9c7', 'attached_at': '', 'detached_at': '', 'volume_id': '89d26526-c4cd-414b-a30a-b4c7bc0b7aee', 'serial': '89d26526-c4cd-414b-a30a-b4c7bc0b7aee'}, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'attachment_id': '62d2a552-802c-4645-978f-cc679230910b', 'volume_type': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 07:56:49 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:56:49 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:56:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='309fef2fd9010cdf734e01cd7870b811',container_format='bare',created_at=2023-11-22T07:54:40Z,direct_url=<?>,disk_format='qcow2',id=1e96f0a9-e42f-4190-8221-7914c6953262,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1450258036-shelved',owner='444367658c0241d0b5b377a73fedb52b',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-22T07:54:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG nova.objects.instance [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5f3bbae3-babf-44d2-96da-c459fb77d9c7 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG nova.objects.base [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Object Instance<5f3bbae3-babf-44d2-96da-c459fb77d9c7> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'roLgUcmF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:56:49 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:56:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '26331326434623339', 'path': '/dev/sdd'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331326434623339', 'path': '/dev/sdd'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.610s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:56:49 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:56:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:56:49 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 07:56:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG nova.objects.instance [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lazy-loading 'flavor' on Instance uuid e36789b1-45e6-40f7-ba97-8962cb116a39 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0044d7c2-909a-4f1f-8903-7d0ba4262f12]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 07:56:49 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 07:56:49 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 07:56:49 user nova-compute[74348]:   <source dev="/dev/sdd"/>
Nov 22 07:56:49 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 07:56:49 user nova-compute[74348]:   <serial>d39d80c0-03af-4337-8739-906a6e6a5730</serial>
Nov 22 07:56:49 user nova-compute[74348]: </disk>
Nov 22 07:56:49 user nova-compute[74348]:  {{(pid=74348) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e3f8ba-5e5f-4a2b-8609-63f52a275a77]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee] added
Nov 22 07:56:49 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6726db9-a0c5-454a-8a86-04236f9e2587]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[862f1013-143f-466f-a650-74aa4aafd2ef]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v roLgUcmF {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v roLgUcmF" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0467a93-8306-4b80-ba2b-24b88264d770]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'roLgUcmF'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb70d534-1a2a-4493-af9e-afebbb465333]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[968c1e23-726e-49d2-87b7-ba5b65b95f88]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:56:49 user nova-compute[74348]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)
Nov 22 07:56:49 user nova-compute[74348]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 07:56:49 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:56:49 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:56:49 user nova-compute[74348]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)
Nov 22 07:56:49 user nova-compute[74348]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 07:56:49 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:56:49 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:56:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:50 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:50 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9552459c-6d3b-4080-821d-217af307e859]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:50 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee, portal: 172.16.0.220,3260]
Nov 22 07:56:50 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee, portal: 172.16.0.220,3260] successful.
Nov 22 07:56:50 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:50 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2816ee16-ec4f-4e6b-a344-4cda1211be27]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:50 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:50 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[783389ff-1177-497e-8736-29471f344a5d]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:50 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:56:50 user nova-compute[74348]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)
Nov 22 07:56:50 user nova-compute[74348]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 07:56:50 user nova-compute[74348]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee (non-flash)
Nov 22 07:56:50 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:56:50 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:56:50 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:56:50 user nova-compute[74348]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)
Nov 22 07:56:50 user nova-compute[74348]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 07:56:50 user nova-compute[74348]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee (non-flash)
Nov 22 07:56:50 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:56:50 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:56:50 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:56:50 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 07:56:50 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] HCTL ('36', '-', '-', 0) found on session 20 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 07:56:50 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 07:56:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.026s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:50 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2278d5-e51e-4e99-8f9f-0e2959028d68]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:50 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Searching for a device in session 20 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 07:56:50 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'roLgUcmF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 07:56:50 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:56:50 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:56:50 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] No VIF found with MAC fa:16:3e:a7:50:2a, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 07:56:50 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-a1fa6606-8d0d-412b-9ce1-5f6df4fbcedd tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lock "e36789b1-45e6-40f7-ba97-8962cb116a39" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.390s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:51 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.422s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:56:51 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] <== connect_volume: return (2032ms) {'type': 'block', 'scsi_wwn': '23062366137356338', 'path': '/dev/sde'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:56:51 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062366137356338', 'path': '/dev/sde'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 07:56:51 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-22T07:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1450258036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1450258036',id=5,image_ref='1e96f0a9-e42f-4190-8221-7914c6953262',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-784392895',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:52:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='444367658c0241d0b5b377a73fedb52b',ramdisk_id='',reservation_id='r-7t8ojxyu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1610098589',owner_user_name='tempest-AttachVolumeShelveTestJSON-1610098589-project-member',shelved_at='2023-11-22T07:54:44.973019',shelved_host='user',shelved_image_id='1e96f0a9-e42f-4190-8221-7914c6953262'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:56:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e8ce0d767724228bfd6cf3a4afad00d',uuid=5f3bbae3-babf-44d2-96da-c459fb77d9c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "094232d9-8ec1-401f-8908-2a698a5385bb", "address": "fa:16:3e:db:2f:02", "network": {"id": "4ef640bb-4a2f-4f98-8b01-b5df87fcb35a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1216437312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444367658c0241d0b5b377a73fedb52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap094232d9-8e", "ovs_interfaceid": "094232d9-8ec1-401f-8908-2a698a5385bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 07:56:51 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Converting VIF {"id": "094232d9-8ec1-401f-8908-2a698a5385bb", "address": "fa:16:3e:db:2f:02", "network": {"id": "4ef640bb-4a2f-4f98-8b01-b5df87fcb35a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1216437312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444367658c0241d0b5b377a73fedb52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap094232d9-8e", "ovs_interfaceid": "094232d9-8ec1-401f-8908-2a698a5385bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:56:51 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:2f:02,bridge_name='br-int',has_traffic_filtering=True,id=094232d9-8ec1-401f-8908-2a698a5385bb,network=Network(4ef640bb-4a2f-4f98-8b01-b5df87fcb35a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap094232d9-8e') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:56:51 user nova-compute[74348]: DEBUG nova.objects.instance [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lazy-loading 'pci_devices' on Instance uuid 5f3bbae3-babf-44d2-96da-c459fb77d9c7 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:56:51 user nova-compute[74348]: DEBUG nova.objects.base [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Object Instance<5f3bbae3-babf-44d2-96da-c459fb77d9c7> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 07:56:51 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] End _get_guest_xml xml=<domain type="kvm">
Nov 22 07:56:51 user nova-compute[74348]:   <uuid>5f3bbae3-babf-44d2-96da-c459fb77d9c7</uuid>
Nov 22 07:56:51 user nova-compute[74348]:   <name>instance-00000005</name>
Nov 22 07:56:51 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 07:56:51 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 07:56:51 user nova-compute[74348]:   <metadata>
Nov 22 07:56:51 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 07:56:51 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 07:56:51 user nova-compute[74348]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1450258036</nova:name>
Nov 22 07:56:51 user nova-compute[74348]:       <nova:creationTime>2023-11-22 07:56:49</nova:creationTime>
Nov 22 07:56:51 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 07:56:51 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 07:56:51 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 07:56:51 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 07:56:51 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 07:56:51 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 07:56:51 user nova-compute[74348]:       </nova:flavor>
Nov 22 07:56:51 user nova-compute[74348]:       <nova:owner>
Nov 22 07:56:51 user nova-compute[74348]:         <nova:user uuid="2e8ce0d767724228bfd6cf3a4afad00d">tempest-AttachVolumeShelveTestJSON-1610098589-project-member</nova:user>
Nov 22 07:56:51 user nova-compute[74348]:         <nova:project uuid="444367658c0241d0b5b377a73fedb52b">tempest-AttachVolumeShelveTestJSON-1610098589</nova:project>
Nov 22 07:56:51 user nova-compute[74348]:       </nova:owner>
Nov 22 07:56:51 user nova-compute[74348]:       <nova:root type="image" uuid="1e96f0a9-e42f-4190-8221-7914c6953262"/>
Nov 22 07:56:51 user nova-compute[74348]:       <nova:ports>
Nov 22 07:56:51 user nova-compute[74348]:         <nova:port uuid="094232d9-8ec1-401f-8908-2a698a5385bb">
Nov 22 07:56:51 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 22 07:56:51 user nova-compute[74348]:         </nova:port>
Nov 22 07:56:51 user nova-compute[74348]:       </nova:ports>
Nov 22 07:56:51 user nova-compute[74348]:     </nova:instance>
Nov 22 07:56:51 user nova-compute[74348]:   </metadata>
Nov 22 07:56:51 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 07:56:51 user nova-compute[74348]:     <system>
Nov 22 07:56:51 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 07:56:51 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 07:56:51 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 07:56:51 user nova-compute[74348]:       <entry name="serial">5f3bbae3-babf-44d2-96da-c459fb77d9c7</entry>
Nov 22 07:56:51 user nova-compute[74348]:       <entry name="uuid">5f3bbae3-babf-44d2-96da-c459fb77d9c7</entry>
Nov 22 07:56:51 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 07:56:51 user nova-compute[74348]:     </system>
Nov 22 07:56:51 user nova-compute[74348]:   </sysinfo>
Nov 22 07:56:51 user nova-compute[74348]:   <os>
Nov 22 07:56:51 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 07:56:51 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 07:56:51 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 07:56:51 user nova-compute[74348]:   </os>
Nov 22 07:56:51 user nova-compute[74348]:   <features>
Nov 22 07:56:51 user nova-compute[74348]:     <acpi/>
Nov 22 07:56:51 user nova-compute[74348]:     <apic/>
Nov 22 07:56:51 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 07:56:51 user nova-compute[74348]:   </features>
Nov 22 07:56:51 user nova-compute[74348]:   <clock offset="utc">
Nov 22 07:56:51 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 07:56:51 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 07:56:51 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 07:56:51 user nova-compute[74348]:   </clock>
Nov 22 07:56:51 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 07:56:51 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 07:56:51 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 07:56:51 user nova-compute[74348]:   </cpu>
Nov 22 07:56:51 user nova-compute[74348]:   <devices>
Nov 22 07:56:51 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 07:56:51 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 07:56:51 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/5f3bbae3-babf-44d2-96da-c459fb77d9c7/disk"/>
Nov 22 07:56:51 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 07:56:51 user nova-compute[74348]:     </disk>
Nov 22 07:56:51 user nova-compute[74348]:     <disk type="block" device="disk">
Nov 22 07:56:51 user nova-compute[74348]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 07:56:51 user nova-compute[74348]:       <source dev="/dev/sde"/>
Nov 22 07:56:51 user nova-compute[74348]:       <target dev="vdc" bus="virtio"/>
Nov 22 07:56:51 user nova-compute[74348]:       <serial>89d26526-c4cd-414b-a30a-b4c7bc0b7aee</serial>
Nov 22 07:56:51 user nova-compute[74348]:     </disk>
Nov 22 07:56:51 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 07:56:51 user nova-compute[74348]:       <mac address="fa:16:3e:db:2f:02"/>
Nov 22 07:56:51 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:56:51 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 07:56:51 user nova-compute[74348]:       <target dev="tap094232d9-8e"/>
Nov 22 07:56:51 user nova-compute[74348]:     </interface>
Nov 22 07:56:51 user nova-compute[74348]:     <serial type="pty">
Nov 22 07:56:51 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/5f3bbae3-babf-44d2-96da-c459fb77d9c7/console.log" append="off"/>
Nov 22 07:56:51 user nova-compute[74348]:     </serial>
Nov 22 07:56:51 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 07:56:51 user nova-compute[74348]:     <video>
Nov 22 07:56:51 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:56:51 user nova-compute[74348]:     </video>
Nov 22 07:56:51 user nova-compute[74348]:     <rng model="virtio">
Nov 22 07:56:51 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 07:56:51 user nova-compute[74348]:     </rng>
Nov 22 07:56:51 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 07:56:51 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 07:56:51 user nova-compute[74348]:       <stats period="10"/>
Nov 22 07:56:51 user nova-compute[74348]:     </memballoon>
Nov 22 07:56:51 user nova-compute[74348]:   </devices>
Nov 22 07:56:51 user nova-compute[74348]: </domain>
Nov 22 07:56:51 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 07:56:51 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-22T07:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1450258036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1450258036',id=5,image_ref='1e96f0a9-e42f-4190-8221-7914c6953262',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-784392895',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:52:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='444367658c0241d0b5b377a73fedb52b',ramdisk_id='',reservation_id='r-7t8ojxyu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1610098589',owner_user_name='tempest-AttachVolumeShelveTestJSON-1610098589-project-member',shelved_at='2023-11-22T07:54:44.973019',shelved_host='user',shelved_image_id='1e96f0a9-e42f-4190-8221-7914c6953262'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:56:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e8ce0d767724228bfd6cf3a4afad00d',uuid=5f3bbae3-babf-44d2-96da-c459fb77d9c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "094232d9-8ec1-401f-8908-2a698a5385bb", "address": "fa:16:3e:db:2f:02", "network": {"id": "4ef640bb-4a2f-4f98-8b01-b5df87fcb35a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1216437312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444367658c0241d0b5b377a73fedb52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap094232d9-8e", "ovs_interfaceid": "094232d9-8ec1-401f-8908-2a698a5385bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 07:56:51 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Converting VIF {"id": "094232d9-8ec1-401f-8908-2a698a5385bb", "address": "fa:16:3e:db:2f:02", "network": {"id": "4ef640bb-4a2f-4f98-8b01-b5df87fcb35a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1216437312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444367658c0241d0b5b377a73fedb52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap094232d9-8e", "ovs_interfaceid": "094232d9-8ec1-401f-8908-2a698a5385bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:56:51 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:2f:02,bridge_name='br-int',has_traffic_filtering=True,id=094232d9-8ec1-401f-8908-2a698a5385bb,network=Network(4ef640bb-4a2f-4f98-8b01-b5df87fcb35a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap094232d9-8e') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:56:51 user nova-compute[74348]: DEBUG os_vif [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:2f:02,bridge_name='br-int',has_traffic_filtering=True,id=094232d9-8ec1-401f-8908-2a698a5385bb,network=Network(4ef640bb-4a2f-4f98-8b01-b5df87fcb35a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap094232d9-8e') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 07:56:51 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:51 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:56:51 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 07:56:51 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:51 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '97a3bd30-7f97-5aa1-aecb-80ea76b9cfa5', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:56:51 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:51 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:56:51 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:51 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap094232d9-8e, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:56:51 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap094232d9-8e, col_values=(('qos', UUID('d4a7c737-bfdc-4ed5-94f8-889b204e2354')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:56:51 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap094232d9-8e, col_values=(('external_ids', {'iface-id': '094232d9-8ec1-401f-8908-2a698a5385bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:2f:02', 'vm-uuid': '5f3bbae3-babf-44d2-96da-c459fb77d9c7'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:56:51 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:51 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:56:51 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:51 user nova-compute[74348]: INFO os_vif [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:2f:02,bridge_name='br-int',has_traffic_filtering=True,id=094232d9-8ec1-401f-8908-2a698a5385bb,network=Network(4ef640bb-4a2f-4f98-8b01-b5df87fcb35a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap094232d9-8e')
Nov 22 07:56:51 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:56:51 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:56:51 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] No VIF found with MAC fa:16:3e:db:2f:02, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 07:56:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:52 user nova-compute[74348]: DEBUG nova.compute.manager [req-9314e101-8a9b-4ab7-8352-8ff7a776f051 req-5ef9eb80-3e27-44c5-9467-da4bef325c30 service nova] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Received event network-vif-plugged-094232d9-8ec1-401f-8908-2a698a5385bb {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:56:52 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9314e101-8a9b-4ab7-8352-8ff7a776f051 req-5ef9eb80-3e27-44c5-9467-da4bef325c30 service nova] Acquiring lock "5f3bbae3-babf-44d2-96da-c459fb77d9c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:52 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9314e101-8a9b-4ab7-8352-8ff7a776f051 req-5ef9eb80-3e27-44c5-9467-da4bef325c30 service nova] Lock "5f3bbae3-babf-44d2-96da-c459fb77d9c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:52 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9314e101-8a9b-4ab7-8352-8ff7a776f051 req-5ef9eb80-3e27-44c5-9467-da4bef325c30 service nova] Lock "5f3bbae3-babf-44d2-96da-c459fb77d9c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:52 user nova-compute[74348]: DEBUG nova.compute.manager [req-9314e101-8a9b-4ab7-8352-8ff7a776f051 req-5ef9eb80-3e27-44c5-9467-da4bef325c30 service nova] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] No waiting events found dispatching network-vif-plugged-094232d9-8ec1-401f-8908-2a698a5385bb {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:56:52 user nova-compute[74348]: WARNING nova.compute.manager [req-9314e101-8a9b-4ab7-8352-8ff7a776f051 req-5ef9eb80-3e27-44c5-9467-da4bef325c30 service nova] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Received unexpected event network-vif-plugged-094232d9-8ec1-401f-8908-2a698a5385bb for instance with vm_state shelved_offloaded and task_state spawning.
Nov 22 07:56:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-dca28e65-ef71-4c3a-b630-615cbc75d481 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Acquiring lock "bdad025e-8f6c-419a-99ea-bf277f6c5577" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-dca28e65-ef71-4c3a-b630-615cbc75d481 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Lock "bdad025e-8f6c-419a-99ea-bf277f6c5577" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-dca28e65-ef71-4c3a-b630-615cbc75d481 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Acquiring lock "bdad025e-8f6c-419a-99ea-bf277f6c5577-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-dca28e65-ef71-4c3a-b630-615cbc75d481 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Lock "bdad025e-8f6c-419a-99ea-bf277f6c5577-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-dca28e65-ef71-4c3a-b630-615cbc75d481 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Lock "bdad025e-8f6c-419a-99ea-bf277f6c5577-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:53 user nova-compute[74348]: DEBUG nova.compute.manager [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Stashing vm_state: active {{(pid=74348) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 22 07:56:53 user nova-compute[74348]: INFO nova.compute.manager [None req-dca28e65-ef71-4c3a-b630-615cbc75d481 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Terminating instance
Nov 22 07:56:53 user nova-compute[74348]: DEBUG nova.compute.manager [None req-dca28e65-ef71-4c3a-b630-615cbc75d481 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 07:56:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:54 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 07:56:54 user nova-compute[74348]: INFO nova.compute.claims [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Claim successful on node user
Nov 22 07:56:54 user nova-compute[74348]: INFO nova.compute.resource_tracker [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Updating resource usage from migration e079ba17-515d-44ed-8a81-250f95515ae9
Nov 22 07:56:54 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:56:54 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:56:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.463s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:54 user nova-compute[74348]: INFO nova.compute.manager [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Migrating
Nov 22 07:56:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:56:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:56:54 user nova-compute[74348]: INFO nova.compute.rpcapi [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 22 07:56:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:56:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Acquiring lock "refresh_cache-e36789b1-45e6-40f7-ba97-8962cb116a39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:56:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Acquired lock "refresh_cache-e36789b1-45e6-40f7-ba97-8962cb116a39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:56:54 user nova-compute[74348]: DEBUG nova.network.neutron [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 07:56:54 user nova-compute[74348]: DEBUG nova.compute.manager [req-44cf25ef-d3ed-4fb6-a186-eba23bacb718 req-cd0b74ab-989f-4da2-a1b5-87be829a4229 service nova] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Received event network-vif-unplugged-f47b39b9-31a2-4f9b-a5e5-ec139067b6d4 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:56:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-44cf25ef-d3ed-4fb6-a186-eba23bacb718 req-cd0b74ab-989f-4da2-a1b5-87be829a4229 service nova] Acquiring lock "bdad025e-8f6c-419a-99ea-bf277f6c5577-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-44cf25ef-d3ed-4fb6-a186-eba23bacb718 req-cd0b74ab-989f-4da2-a1b5-87be829a4229 service nova] Lock "bdad025e-8f6c-419a-99ea-bf277f6c5577-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-44cf25ef-d3ed-4fb6-a186-eba23bacb718 req-cd0b74ab-989f-4da2-a1b5-87be829a4229 service nova] Lock "bdad025e-8f6c-419a-99ea-bf277f6c5577-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:54 user nova-compute[74348]: DEBUG nova.compute.manager [req-44cf25ef-d3ed-4fb6-a186-eba23bacb718 req-cd0b74ab-989f-4da2-a1b5-87be829a4229 service nova] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] No waiting events found dispatching network-vif-unplugged-f47b39b9-31a2-4f9b-a5e5-ec139067b6d4 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:56:54 user nova-compute[74348]: DEBUG nova.compute.manager [req-44cf25ef-d3ed-4fb6-a186-eba23bacb718 req-cd0b74ab-989f-4da2-a1b5-87be829a4229 service nova] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Received event network-vif-unplugged-f47b39b9-31a2-4f9b-a5e5-ec139067b6d4 for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 07:56:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:54 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Instance destroyed successfully.
Nov 22 07:56:54 user nova-compute[74348]: DEBUG nova.objects.instance [None req-dca28e65-ef71-4c3a-b630-615cbc75d481 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Lazy-loading 'resources' on Instance uuid bdad025e-8f6c-419a-99ea-bf277f6c5577 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:56:54 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-dca28e65-ef71-4c3a-b630-615cbc75d481 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T07:53:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-726810190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-726810190',id=8,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2d2AMx5MTcXajy6b7uPsq3+jYxxbAAyYP5uwFXUURVQR6N2+iGSyaCZAQVBr0xq/5GZlgBfcRmwRXF9ZovM3nD3R4hcY3OcZ/S/sjuTSQBqYHlzsArXECyBywfXW3yNw==',key_name='tempest-keypair-266871328',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:53:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f078468965946f6aed352374702843c',ramdisk_id='',reservation_id='r-nuqss0no',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-659854772',owner_user_name='tempest-TaggedAttachmentsTest-659854772-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T07:53:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df4cae77b03e4395887815058f3a8a42',uuid=bdad025e-8f6c-419a-99ea-bf277f6c5577,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f47b39b9-31a2-4f9b-a5e5-ec139067b6d4", "address": "fa:16:3e:36:02:a6", "network": {"id": "e0159f32-e7c5-41b9-b652-8e2ca87f9018", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1248845008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f078468965946f6aed352374702843c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47b39b9-31", "ovs_interfaceid": "f47b39b9-31a2-4f9b-a5e5-ec139067b6d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 07:56:54 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-dca28e65-ef71-4c3a-b630-615cbc75d481 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Converting VIF {"id": "f47b39b9-31a2-4f9b-a5e5-ec139067b6d4", "address": "fa:16:3e:36:02:a6", "network": {"id": "e0159f32-e7c5-41b9-b652-8e2ca87f9018", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1248845008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f078468965946f6aed352374702843c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47b39b9-31", "ovs_interfaceid": "f47b39b9-31a2-4f9b-a5e5-ec139067b6d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:56:54 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-dca28e65-ef71-4c3a-b630-615cbc75d481 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:02:a6,bridge_name='br-int',has_traffic_filtering=True,id=f47b39b9-31a2-4f9b-a5e5-ec139067b6d4,network=Network(e0159f32-e7c5-41b9-b652-8e2ca87f9018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf47b39b9-31') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:56:54 user nova-compute[74348]: DEBUG os_vif [None req-dca28e65-ef71-4c3a-b630-615cbc75d481 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:02:a6,bridge_name='br-int',has_traffic_filtering=True,id=f47b39b9-31a2-4f9b-a5e5-ec139067b6d4,network=Network(e0159f32-e7c5-41b9-b652-8e2ca87f9018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf47b39b9-31') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 07:56:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf47b39b9-31, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:56:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:56:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f3063bbe-5200-4f64-958c-30736ec03c6a) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:56:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:56:54 user nova-compute[74348]: INFO os_vif [None req-dca28e65-ef71-4c3a-b630-615cbc75d481 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:02:a6,bridge_name='br-int',has_traffic_filtering=True,id=f47b39b9-31a2-4f9b-a5e5-ec139067b6d4,network=Network(e0159f32-e7c5-41b9-b652-8e2ca87f9018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf47b39b9-31')
Nov 22 07:56:54 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-dca28e65-ef71-4c3a-b630-615cbc75d481 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Deleting instance files /opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577_del
Nov 22 07:56:54 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-dca28e65-ef71-4c3a-b630-615cbc75d481 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Deletion of /opt/stack/data/nova/instances/bdad025e-8f6c-419a-99ea-bf277f6c5577_del complete
Nov 22 07:56:54 user nova-compute[74348]: INFO nova.compute.manager [None req-dca28e65-ef71-4c3a-b630-615cbc75d481 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 22 07:56:54 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-dca28e65-ef71-4c3a-b630-615cbc75d481 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 07:56:54 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 07:56:54 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 07:56:55 user nova-compute[74348]: DEBUG nova.compute.manager [req-e22f96bf-43f3-472e-af52-1d3e112af9f0 req-be5f3940-2076-4f9a-8e2f-4b506c0bfc39 service nova] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Received event network-vif-plugged-094232d9-8ec1-401f-8908-2a698a5385bb {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:56:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e22f96bf-43f3-472e-af52-1d3e112af9f0 req-be5f3940-2076-4f9a-8e2f-4b506c0bfc39 service nova] Acquiring lock "5f3bbae3-babf-44d2-96da-c459fb77d9c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e22f96bf-43f3-472e-af52-1d3e112af9f0 req-be5f3940-2076-4f9a-8e2f-4b506c0bfc39 service nova] Lock "5f3bbae3-babf-44d2-96da-c459fb77d9c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e22f96bf-43f3-472e-af52-1d3e112af9f0 req-be5f3940-2076-4f9a-8e2f-4b506c0bfc39 service nova] Lock "5f3bbae3-babf-44d2-96da-c459fb77d9c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:55 user nova-compute[74348]: DEBUG nova.compute.manager [req-e22f96bf-43f3-472e-af52-1d3e112af9f0 req-be5f3940-2076-4f9a-8e2f-4b506c0bfc39 service nova] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] No waiting events found dispatching network-vif-plugged-094232d9-8ec1-401f-8908-2a698a5385bb {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:56:55 user nova-compute[74348]: WARNING nova.compute.manager [req-e22f96bf-43f3-472e-af52-1d3e112af9f0 req-be5f3940-2076-4f9a-8e2f-4b506c0bfc39 service nova] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Received unexpected event network-vif-plugged-094232d9-8ec1-401f-8908-2a698a5385bb for instance with vm_state shelved_offloaded and task_state spawning.
Nov 22 07:56:55 user nova-compute[74348]: DEBUG nova.compute.manager [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 07:56:55 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 07:56:55 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Instance spawned successfully.
Nov 22 07:56:55 user nova-compute[74348]: DEBUG nova.compute.manager [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 07:56:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-810a994d-c33a-4dde-a570-7aadfffeffc2 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "5f3bbae3-babf-44d2-96da-c459fb77d9c7" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 22.043s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:55 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:56 user nova-compute[74348]: DEBUG nova.network.neutron [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Updating instance_info_cache with network_info: [{"id": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "address": "fa:16:3e:a7:50:2a", "network": {"id": "8a783b63-dae2-41eb-a00a-5cf8e94a5412", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872095489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beaa9566ba2842d49f843dbddc59854d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap618bd526-89", "ovs_interfaceid": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:56:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Releasing lock "refresh_cache-e36789b1-45e6-40f7-ba97-8962cb116a39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:56:56 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Starting migrate_disk_and_power_off {{(pid=74348) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 22 07:56:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:56 user nova-compute[74348]: DEBUG nova.compute.manager [req-dedea89c-5d3b-4f3d-8ee8-b664b82cd0db req-40600602-6756-4629-a025-2985bab503b3 service nova] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Received event network-vif-plugged-f47b39b9-31a2-4f9b-a5e5-ec139067b6d4 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:56:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-dedea89c-5d3b-4f3d-8ee8-b664b82cd0db req-40600602-6756-4629-a025-2985bab503b3 service nova] Acquiring lock "bdad025e-8f6c-419a-99ea-bf277f6c5577-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-dedea89c-5d3b-4f3d-8ee8-b664b82cd0db req-40600602-6756-4629-a025-2985bab503b3 service nova] Lock "bdad025e-8f6c-419a-99ea-bf277f6c5577-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-dedea89c-5d3b-4f3d-8ee8-b664b82cd0db req-40600602-6756-4629-a025-2985bab503b3 service nova] Lock "bdad025e-8f6c-419a-99ea-bf277f6c5577-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:56 user nova-compute[74348]: DEBUG nova.compute.manager [req-dedea89c-5d3b-4f3d-8ee8-b664b82cd0db req-40600602-6756-4629-a025-2985bab503b3 service nova] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] No waiting events found dispatching network-vif-plugged-f47b39b9-31a2-4f9b-a5e5-ec139067b6d4 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:56:56 user nova-compute[74348]: WARNING nova.compute.manager [req-dedea89c-5d3b-4f3d-8ee8-b664b82cd0db req-40600602-6756-4629-a025-2985bab503b3 service nova] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Received unexpected event network-vif-plugged-f47b39b9-31a2-4f9b-a5e5-ec139067b6d4 for instance with vm_state active and task_state deleting.
Nov 22 07:56:57 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:57 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Took 2.33 seconds to deallocate network for instance.
Nov 22 07:56:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:57 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Instance destroyed successfully.
Nov 22 07:56:57 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2131516711',display_name='tempest-ServerActionsTestOtherB-server-2131516711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2131516711',id=4,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNk1MOJm11bQ93eU1QYv8ji0a1vxy2ayCOX/9R0SEaykivxTwmzY2ykLPWhT+1BMkwgumhcTt15jzBxURGp9c6w0OYjMGs9IXzcm5BaMYRSciSb/BXxgpEqQZEDxBbmLrQ==',key_name='tempest-keypair-1880925410',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:52:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='beaa9566ba2842d49f843dbddc59854d',ramdisk_id='',reservation_id='r-0nqnkret',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-849589705',owner_user_name='tempest-ServerActionsTestOtherB-849589705-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:56:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3b62e16105c4210bfc24e71c09ede28',uuid=e36789b1-45e6-40f7-ba97-8962cb116a39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "address": "fa:16:3e:a7:50:2a", "network": {"id": "8a783b63-dae2-41eb-a00a-5cf8e94a5412", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872095489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-872095489-network", "vif_mac": "fa:16:3e:a7:50:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beaa9566ba2842d49f843dbddc59854d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap618bd526-89", "ovs_interfaceid": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Converting VIF {"id": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "address": "fa:16:3e:a7:50:2a", "network": {"id": "8a783b63-dae2-41eb-a00a-5cf8e94a5412", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872095489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-872095489-network", "vif_mac": "fa:16:3e:a7:50:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beaa9566ba2842d49f843dbddc59854d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap618bd526-89", "ovs_interfaceid": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:50:2a,bridge_name='br-int',has_traffic_filtering=True,id=618bd526-892d-4dfb-8ba6-f65e83e3f467,network=Network(8a783b63-dae2-41eb-a00a-5cf8e94a5412),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap618bd526-89') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG os_vif [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:50:2a,bridge_name='br-int',has_traffic_filtering=True,id=618bd526-892d-4dfb-8ba6-f65e83e3f467,network=Network(8a783b63-dae2-41eb-a00a-5cf8e94a5412),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap618bd526-89') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap618bd526-89, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8a8736b9-d067-4ac0-a42a-c21890c95775) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:56:57 user nova-compute[74348]: INFO os_vif [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:50:2a,bridge_name='br-int',has_traffic_filtering=True,id=618bd526-892d-4dfb-8ba6-f65e83e3f467,network=Network(8a783b63-dae2-41eb-a00a-5cf8e94a5412),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap618bd526-89')
Nov 22 07:56:57 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RoQzpAmu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:56:57 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:56:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-dca28e65-ef71-4c3a-b630-615cbc75d481 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-dca28e65-ef71-4c3a-b630-615cbc75d481 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e3e048-db9c-48a7-b226-ef11bacdc2fd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 07:56:57 user nova-compute[74348]: No targets found.
Nov 22 07:56:57 user nova-compute[74348]: iSNS:
Nov 22 07:56:57 user nova-compute[74348]: No targets found.
Nov 22 07:56:57 user nova-compute[74348]: STATIC:
Nov 22 07:56:57 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223
Nov 22 07:56:57 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:56:57 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:56:57 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af
Nov 22 07:56:57 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:56:57 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:56:57 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee
Nov 22 07:56:57 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:56:57 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:56:57 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730
Nov 22 07:56:57 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:56:57 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:56:57 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803
Nov 22 07:56:57 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:56:57 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:56:57 user nova-compute[74348]: FIRMWARE:
Nov 22 07:56:57 user nova-compute[74348]: No targets found.
Nov 22 07:56:57 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 07:56:57 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 07:56:57 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c821cb5-1134-4913-a654-50147c4af165]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[59319edf-a882-4aab-a624-3ba59e52d044]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:56:57 user nova-compute[74348]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)
Nov 22 07:56:57 user nova-compute[74348]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 07:56:57 user nova-compute[74348]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee (non-flash)
Nov 22 07:56:57 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:56:57 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:56:57 user nova-compute[74348]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)
Nov 22 07:56:57 user nova-compute[74348]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 07:56:57 user nova-compute[74348]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee (non-flash)
Nov 22 07:56:57 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:56:57 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f22285bc550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730'): ({'sdd'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Removing single pathed devices sdd {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[166a40e8-ea2b-46ac-9d15-735c24d252ed]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[014e9b85-e892-4a77-93d5-aea939f18e6f]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Flushing IO for device /dev/sdd {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a9424a-fc13-4767-9f54-84a629b82baa]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.070s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc7bbf4-faa8-4084-977e-8b36c665e55c]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] SCSI volumes sdd have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6897f415-d719-4c90-96f7-3779097a99a2]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b54f12-1d64-41b7-9564-f0a15f651eab]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730, portal: 172.16.0.220,3260]
Nov 22 07:56:57 user nova-compute[74348]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730, portal: 172.16.0.220,3260] successful.
Nov 22 07:56:57 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-dca28e65-ef71-4c3a-b630-615cbc75d481 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3080a5ee-7d93-45eb-984e-2ba7eed215b0]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.438s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] <== disconnect_volume: return (441ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-dca28e65-ef71-4c3a-b630-615cbc75d481 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:56:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-dca28e65-ef71-4c3a-b630-615cbc75d481 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.560s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:57 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-dca28e65-ef71-4c3a-b630-615cbc75d481 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Deleted allocations for instance bdad025e-8f6c-419a-99ea-bf277f6c5577
Nov 22 07:56:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-dca28e65-ef71-4c3a-b630-615cbc75d481 tempest-TaggedAttachmentsTest-659854772 tempest-TaggedAttachmentsTest-659854772-project-member] Lock "bdad025e-8f6c-419a-99ea-bf277f6c5577" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.165s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:58 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 07:56:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39_resize/disk /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:56:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] CMD "cp -r /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39_resize/disk /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk" returned: 0 in 0.325s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39_resize/disk.info /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk.info {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:56:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] CMD "cp -r /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39_resize/disk.info /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk.info" returned: 0 in 0.037s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:56:58 user nova-compute[74348]: DEBUG nova.compute.manager [req-f7ba81f0-467c-46fe-8c52-ffb4b5c5b5b3 req-803f8aad-b48a-4deb-b722-d039fe0442a4 service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Received event network-vif-unplugged-618bd526-892d-4dfb-8ba6-f65e83e3f467 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:56:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f7ba81f0-467c-46fe-8c52-ffb4b5c5b5b3 req-803f8aad-b48a-4deb-b722-d039fe0442a4 service nova] Acquiring lock "e36789b1-45e6-40f7-ba97-8962cb116a39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f7ba81f0-467c-46fe-8c52-ffb4b5c5b5b3 req-803f8aad-b48a-4deb-b722-d039fe0442a4 service nova] Lock "e36789b1-45e6-40f7-ba97-8962cb116a39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f7ba81f0-467c-46fe-8c52-ffb4b5c5b5b3 req-803f8aad-b48a-4deb-b722-d039fe0442a4 service nova] Lock "e36789b1-45e6-40f7-ba97-8962cb116a39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:58 user nova-compute[74348]: DEBUG nova.compute.manager [req-f7ba81f0-467c-46fe-8c52-ffb4b5c5b5b3 req-803f8aad-b48a-4deb-b722-d039fe0442a4 service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] No waiting events found dispatching network-vif-unplugged-618bd526-892d-4dfb-8ba6-f65e83e3f467 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:56:58 user nova-compute[74348]: WARNING nova.compute.manager [req-f7ba81f0-467c-46fe-8c52-ffb4b5c5b5b3 req-803f8aad-b48a-4deb-b722-d039fe0442a4 service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Received unexpected event network-vif-unplugged-618bd526-892d-4dfb-8ba6-f65e83e3f467 for instance with vm_state active and task_state resize_migrating.
Nov 22 07:56:58 user nova-compute[74348]: DEBUG nova.compute.manager [req-f7ba81f0-467c-46fe-8c52-ffb4b5c5b5b3 req-803f8aad-b48a-4deb-b722-d039fe0442a4 service nova] [instance: bdad025e-8f6c-419a-99ea-bf277f6c5577] Received event network-vif-deleted-f47b39b9-31a2-4f9b-a5e5-ec139067b6d4 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:56:58 user nova-compute[74348]: DEBUG nova.compute.manager [req-f7ba81f0-467c-46fe-8c52-ffb4b5c5b5b3 req-803f8aad-b48a-4deb-b722-d039fe0442a4 service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Received event network-vif-plugged-618bd526-892d-4dfb-8ba6-f65e83e3f467 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:56:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f7ba81f0-467c-46fe-8c52-ffb4b5c5b5b3 req-803f8aad-b48a-4deb-b722-d039fe0442a4 service nova] Acquiring lock "e36789b1-45e6-40f7-ba97-8962cb116a39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f7ba81f0-467c-46fe-8c52-ffb4b5c5b5b3 req-803f8aad-b48a-4deb-b722-d039fe0442a4 service nova] Lock "e36789b1-45e6-40f7-ba97-8962cb116a39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f7ba81f0-467c-46fe-8c52-ffb4b5c5b5b3 req-803f8aad-b48a-4deb-b722-d039fe0442a4 service nova] Lock "e36789b1-45e6-40f7-ba97-8962cb116a39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:56:58 user nova-compute[74348]: DEBUG nova.compute.manager [req-f7ba81f0-467c-46fe-8c52-ffb4b5c5b5b3 req-803f8aad-b48a-4deb-b722-d039fe0442a4 service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] No waiting events found dispatching network-vif-plugged-618bd526-892d-4dfb-8ba6-f65e83e3f467 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:56:58 user nova-compute[74348]: WARNING nova.compute.manager [req-f7ba81f0-467c-46fe-8c52-ffb4b5c5b5b3 req-803f8aad-b48a-4deb-b722-d039fe0442a4 service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Received unexpected event network-vif-plugged-618bd526-892d-4dfb-8ba6-f65e83e3f467 for instance with vm_state active and task_state resize_migrating.
Nov 22 07:56:59 user nova-compute[74348]: DEBUG nova.network.neutron [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Port 618bd526-892d-4dfb-8ba6-f65e83e3f467 binding to destination host user is already ACTIVE {{(pid=74348) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 22 07:56:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Acquiring lock "e36789b1-45e6-40f7-ba97-8962cb116a39-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:56:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lock "e36789b1-45e6-40f7-ba97-8962cb116a39-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.004s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:56:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lock "e36789b1-45e6-40f7-ba97-8962cb116a39-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:57:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Acquiring lock "refresh_cache-e36789b1-45e6-40f7-ba97-8962cb116a39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:57:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Acquired lock "refresh_cache-e36789b1-45e6-40f7-ba97-8962cb116a39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:57:00 user nova-compute[74348]: DEBUG nova.network.neutron [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 07:57:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8f17be02-9cbf-4624-91ed-6fe6185565ab tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Acquiring lock "e93032ee-56bd-48be-8121-b0fd5273345e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:57:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8f17be02-9cbf-4624-91ed-6fe6185565ab tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Lock "e93032ee-56bd-48be-8121-b0fd5273345e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:57:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8f17be02-9cbf-4624-91ed-6fe6185565ab tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Acquiring lock "e93032ee-56bd-48be-8121-b0fd5273345e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:57:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8f17be02-9cbf-4624-91ed-6fe6185565ab tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Lock "e93032ee-56bd-48be-8121-b0fd5273345e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:57:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8f17be02-9cbf-4624-91ed-6fe6185565ab tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Lock "e93032ee-56bd-48be-8121-b0fd5273345e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:57:00 user nova-compute[74348]: INFO nova.compute.manager [None req-8f17be02-9cbf-4624-91ed-6fe6185565ab tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Terminating instance
Nov 22 07:57:00 user nova-compute[74348]: DEBUG nova.compute.manager [None req-8f17be02-9cbf-4624-91ed-6fe6185565ab tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 07:57:00 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:00 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:00 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:00 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:00 user nova-compute[74348]: DEBUG nova.compute.manager [req-09339a54-ff13-4909-95a4-806022728296 req-47ba1348-f868-4863-ac29-abf9d1970387 service nova] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Received event network-vif-unplugged-8ddcc793-e3ca-4db4-aff2-40d8121797a7 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:57:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-09339a54-ff13-4909-95a4-806022728296 req-47ba1348-f868-4863-ac29-abf9d1970387 service nova] Acquiring lock "e93032ee-56bd-48be-8121-b0fd5273345e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:57:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-09339a54-ff13-4909-95a4-806022728296 req-47ba1348-f868-4863-ac29-abf9d1970387 service nova] Lock "e93032ee-56bd-48be-8121-b0fd5273345e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:57:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-09339a54-ff13-4909-95a4-806022728296 req-47ba1348-f868-4863-ac29-abf9d1970387 service nova] Lock "e93032ee-56bd-48be-8121-b0fd5273345e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:57:00 user nova-compute[74348]: DEBUG nova.compute.manager [req-09339a54-ff13-4909-95a4-806022728296 req-47ba1348-f868-4863-ac29-abf9d1970387 service nova] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] No waiting events found dispatching network-vif-unplugged-8ddcc793-e3ca-4db4-aff2-40d8121797a7 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:57:00 user nova-compute[74348]: DEBUG nova.compute.manager [req-09339a54-ff13-4909-95a4-806022728296 req-47ba1348-f868-4863-ac29-abf9d1970387 service nova] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Received event network-vif-unplugged-8ddcc793-e3ca-4db4-aff2-40d8121797a7 for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 07:57:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:01 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Instance destroyed successfully.
Nov 22 07:57:01 user nova-compute[74348]: DEBUG nova.objects.instance [None req-8f17be02-9cbf-4624-91ed-6fe6185565ab tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Lazy-loading 'resources' on Instance uuid e93032ee-56bd-48be-8121-b0fd5273345e {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:57:01 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-8f17be02-9cbf-4624-91ed-6fe6185565ab tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:53:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1879973268',display_name='tempest-TestVolumeSwap-server-1879973268',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1879973268',id=7,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLh/4FmkwLePg6CHlXFuO4YYuopb9Yn8NN8+2qDpGIfhm/HNm553Eq300rrCPrU4JUX6GZSwjDEOxSmOTa0pXnHKHiiG3GSQuY4n46dhe368jkirPNGBUVvBWJ9q326K+Q==',key_name='tempest-keypair-2037151951',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:53:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c1d3b860b77e438c8961b6b6919c6b0a',ramdisk_id='',reservation_id='r-53kdny44',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1684900043',owner_user_name='tempest-TestVolumeSwap-1684900043-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T07:53:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de2cd6e49b88491fac65f905cd339249',uuid=e93032ee-56bd-48be-8121-b0fd5273345e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ddcc793-e3ca-4db4-aff2-40d8121797a7", "address": "fa:16:3e:52:83:64", "network": {"id": "9cd1842b-a00c-4bcf-9fe4-1bfd8209bbd4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-186126001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d3b860b77e438c8961b6b6919c6b0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ddcc793-e3", "ovs_interfaceid": "8ddcc793-e3ca-4db4-aff2-40d8121797a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 07:57:01 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-8f17be02-9cbf-4624-91ed-6fe6185565ab tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Converting VIF {"id": "8ddcc793-e3ca-4db4-aff2-40d8121797a7", "address": "fa:16:3e:52:83:64", "network": {"id": "9cd1842b-a00c-4bcf-9fe4-1bfd8209bbd4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-186126001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1d3b860b77e438c8961b6b6919c6b0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ddcc793-e3", "ovs_interfaceid": "8ddcc793-e3ca-4db4-aff2-40d8121797a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:57:01 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-8f17be02-9cbf-4624-91ed-6fe6185565ab tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:83:64,bridge_name='br-int',has_traffic_filtering=True,id=8ddcc793-e3ca-4db4-aff2-40d8121797a7,network=Network(9cd1842b-a00c-4bcf-9fe4-1bfd8209bbd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ddcc793-e3') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:57:01 user nova-compute[74348]: DEBUG os_vif [None req-8f17be02-9cbf-4624-91ed-6fe6185565ab tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:83:64,bridge_name='br-int',has_traffic_filtering=True,id=8ddcc793-e3ca-4db4-aff2-40d8121797a7,network=Network(9cd1842b-a00c-4bcf-9fe4-1bfd8209bbd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ddcc793-e3') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 07:57:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ddcc793-e3, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:57:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:57:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=50a9d705-58a7-4617-9e51-6cfe4fb90f0b) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:57:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:01 user nova-compute[74348]: INFO os_vif [None req-8f17be02-9cbf-4624-91ed-6fe6185565ab tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:83:64,bridge_name='br-int',has_traffic_filtering=True,id=8ddcc793-e3ca-4db4-aff2-40d8121797a7,network=Network(9cd1842b-a00c-4bcf-9fe4-1bfd8209bbd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ddcc793-e3')
Nov 22 07:57:01 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-8f17be02-9cbf-4624-91ed-6fe6185565ab tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Deleting instance files /opt/stack/data/nova/instances/e93032ee-56bd-48be-8121-b0fd5273345e_del
Nov 22 07:57:01 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-8f17be02-9cbf-4624-91ed-6fe6185565ab tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Deletion of /opt/stack/data/nova/instances/e93032ee-56bd-48be-8121-b0fd5273345e_del complete
Nov 22 07:57:01 user nova-compute[74348]: INFO nova.compute.manager [None req-8f17be02-9cbf-4624-91ed-6fe6185565ab tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Took 1.09 seconds to destroy the instance on the hypervisor.
Nov 22 07:57:01 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-8f17be02-9cbf-4624-91ed-6fe6185565ab tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 07:57:01 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 07:57:01 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 07:57:01 user nova-compute[74348]: DEBUG nova.network.neutron [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Updating instance_info_cache with network_info: [{"id": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "address": "fa:16:3e:a7:50:2a", "network": {"id": "8a783b63-dae2-41eb-a00a-5cf8e94a5412", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872095489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beaa9566ba2842d49f843dbddc59854d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap618bd526-89", "ovs_interfaceid": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:57:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Releasing lock "refresh_cache-e36789b1-45e6-40f7-ba97-8962cb116a39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:57:01 user nova-compute[74348]: DEBUG os_brick.utils [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:57:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:01 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01a7d59-7025-4079-869d-83bd6ab35041]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:57:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:01 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b55406-a72f-4a2b-8451-518f0bf00bff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:57:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:01 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac53e55-d28f-4d2d-8887-7854f238d35d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:57:01 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a5298b-e627-4b7b-a22c-8605d75720a5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:57:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 07:57:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 07:57:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 07:57:01 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 07:57:01 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[77926fe6-9c4b-4e1f-ac97-7f779c0db936]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:57:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 07:57:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 07:57:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 07:57:02 user nova-compute[74348]: DEBUG os_brick.utils [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:57:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:02 user nova-compute[74348]: DEBUG nova.compute.manager [req-4eb7fdd5-2c20-4c0f-8601-41a939d4f8a0 req-c0244589-5ccd-48f7-a84c-a3b0a90a8168 service nova] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Received event network-vif-plugged-8ddcc793-e3ca-4db4-aff2-40d8121797a7 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:57:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4eb7fdd5-2c20-4c0f-8601-41a939d4f8a0 req-c0244589-5ccd-48f7-a84c-a3b0a90a8168 service nova] Acquiring lock "e93032ee-56bd-48be-8121-b0fd5273345e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:57:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4eb7fdd5-2c20-4c0f-8601-41a939d4f8a0 req-c0244589-5ccd-48f7-a84c-a3b0a90a8168 service nova] Lock "e93032ee-56bd-48be-8121-b0fd5273345e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:57:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4eb7fdd5-2c20-4c0f-8601-41a939d4f8a0 req-c0244589-5ccd-48f7-a84c-a3b0a90a8168 service nova] Lock "e93032ee-56bd-48be-8121-b0fd5273345e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:57:02 user nova-compute[74348]: DEBUG nova.compute.manager [req-4eb7fdd5-2c20-4c0f-8601-41a939d4f8a0 req-c0244589-5ccd-48f7-a84c-a3b0a90a8168 service nova] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] No waiting events found dispatching network-vif-plugged-8ddcc793-e3ca-4db4-aff2-40d8121797a7 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:57:02 user nova-compute[74348]: WARNING nova.compute.manager [req-4eb7fdd5-2c20-4c0f-8601-41a939d4f8a0 req-c0244589-5ccd-48f7-a84c-a3b0a90a8168 service nova] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Received unexpected event network-vif-plugged-8ddcc793-e3ca-4db4-aff2-40d8121797a7 for instance with vm_state active and task_state deleting.
Nov 22 07:57:03 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:57:03 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Took 1.68 seconds to deallocate network for instance.
Nov 22 07:57:03 user nova-compute[74348]: DEBUG nova.compute.manager [req-8b25232d-4b35-4e52-9b2a-6320668a106c req-7eb1ff87-af79-4ddc-a894-b0f6eedc2384 service nova] [instance: e93032ee-56bd-48be-8121-b0fd5273345e] Received event network-vif-deleted-8ddcc793-e3ca-4db4-aff2-40d8121797a7 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:57:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8f17be02-9cbf-4624-91ed-6fe6185565ab tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:57:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8f17be02-9cbf-4624-91ed-6fe6185565ab tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:57:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:03 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-8f17be02-9cbf-4624-91ed-6fe6185565ab tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:57:03 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-8f17be02-9cbf-4624-91ed-6fe6185565ab tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:57:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8f17be02-9cbf-4624-91ed-6fe6185565ab tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.315s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:57:03 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-8f17be02-9cbf-4624-91ed-6fe6185565ab tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Deleted allocations for instance e93032ee-56bd-48be-8121-b0fd5273345e
Nov 22 07:57:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8f17be02-9cbf-4624-91ed-6fe6185565ab tempest-TestVolumeSwap-1684900043 tempest-TestVolumeSwap-1684900043-project-member] Lock "e93032ee-56bd-48be-8121-b0fd5273345e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.346s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:57:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Acquiring lock "9c36455f-5fd6-4813-9c44-499e3742ed39" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:57:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lock "9c36455f-5fd6-4813-9c44-499e3742ed39" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:57:08 user nova-compute[74348]: DEBUG nova.compute.manager [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 07:57:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:57:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:57:08 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 07:57:08 user nova-compute[74348]: INFO nova.compute.claims [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Claim successful on node user
Nov 22 07:57:09 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:57:09 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:57:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:57:09 user nova-compute[74348]: DEBUG nova.compute.manager [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 07:57:09 user nova-compute[74348]: DEBUG nova.compute.manager [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 07:57:09 user nova-compute[74348]: DEBUG nova.network.neutron [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 07:57:09 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 07:57:09 user nova-compute[74348]: DEBUG nova.compute.manager [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 07:57:09 user nova-compute[74348]: DEBUG nova.policy [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9d4446ab7daa45fa8c843c2d991de43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8780c23b60e4abe85276f2d71c591b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 07:57:09 user nova-compute[74348]: DEBUG nova.compute.manager [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 07:57:09 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 07:57:09 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Creating image(s)
Nov 22 07:57:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Acquiring lock "/opt/stack/data/nova/instances/9c36455f-5fd6-4813-9c44-499e3742ed39/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:57:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lock "/opt/stack/data/nova/instances/9c36455f-5fd6-4813-9c44-499e3742ed39/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:57:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lock "/opt/stack/data/nova/instances/9c36455f-5fd6-4813-9c44-499e3742ed39/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:57:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.213s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Acquiring lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:57:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:57:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.206s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/9c36455f-5fd6-4813-9c44-499e3742ed39/disk 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/9c36455f-5fd6-4813-9c44-499e3742ed39/disk 1073741824" returned: 0 in 0.052s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:57:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:10 user nova-compute[74348]: DEBUG nova.network.neutron [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Successfully created port: e8c429ee-f5b4-4cf5-935c-5d4631b369e3 {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 07:57:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.239s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:10 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9c36455f-5fd6-4813-9c44-499e3742ed39/disk. size=1073741824 {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 07:57:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c36455f-5fd6-4813-9c44-499e3742ed39/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c36455f-5fd6-4813-9c44-499e3742ed39/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:10 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Cannot resize image /opt/stack/data/nova/instances/9c36455f-5fd6-4813-9c44-499e3742ed39/disk to a smaller size. {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 07:57:10 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 07:57:10 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Ensure instance console log exists: /opt/stack/data/nova/instances/9c36455f-5fd6-4813-9c44-499e3742ed39/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 07:57:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:57:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:57:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:57:10 user nova-compute[74348]: DEBUG nova.network.neutron [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Successfully updated port: e8c429ee-f5b4-4cf5-935c-5d4631b369e3 {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 07:57:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Acquiring lock "refresh_cache-9c36455f-5fd6-4813-9c44-499e3742ed39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:57:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Acquired lock "refresh_cache-9c36455f-5fd6-4813-9c44-499e3742ed39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:57:10 user nova-compute[74348]: DEBUG nova.network.neutron [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 07:57:10 user nova-compute[74348]: DEBUG nova.compute.manager [req-700f4f19-ecf1-45d2-b4e6-3ea7e91f64be req-58db9805-b514-4909-bff2-3599c7293a1c service nova] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Received event network-changed-e8c429ee-f5b4-4cf5-935c-5d4631b369e3 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:57:10 user nova-compute[74348]: DEBUG nova.compute.manager [req-700f4f19-ecf1-45d2-b4e6-3ea7e91f64be req-58db9805-b514-4909-bff2-3599c7293a1c service nova] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Refreshing instance network info cache due to event network-changed-e8c429ee-f5b4-4cf5-935c-5d4631b369e3. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:57:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-700f4f19-ecf1-45d2-b4e6-3ea7e91f64be req-58db9805-b514-4909-bff2-3599c7293a1c service nova] Acquiring lock "refresh_cache-9c36455f-5fd6-4813-9c44-499e3742ed39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:57:10 user nova-compute[74348]: DEBUG nova.network.neutron [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG nova.network.neutron [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Updating instance_info_cache with network_info: [{"id": "e8c429ee-f5b4-4cf5-935c-5d4631b369e3", "address": "fa:16:3e:87:e1:4c", "network": {"id": "c405fff5-285f-47eb-8bae-867c6393edf2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-368785799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8780c23b60e4abe85276f2d71c591b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c429ee-f5", "ovs_interfaceid": "e8c429ee-f5b4-4cf5-935c-5d4631b369e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Releasing lock "refresh_cache-9c36455f-5fd6-4813-9c44-499e3742ed39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG nova.compute.manager [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Instance network_info: |[{"id": "e8c429ee-f5b4-4cf5-935c-5d4631b369e3", "address": "fa:16:3e:87:e1:4c", "network": {"id": "c405fff5-285f-47eb-8bae-867c6393edf2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-368785799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8780c23b60e4abe85276f2d71c591b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c429ee-f5", "ovs_interfaceid": "e8c429ee-f5b4-4cf5-935c-5d4631b369e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-700f4f19-ecf1-45d2-b4e6-3ea7e91f64be req-58db9805-b514-4909-bff2-3599c7293a1c service nova] Acquired lock "refresh_cache-9c36455f-5fd6-4813-9c44-499e3742ed39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG nova.network.neutron [req-700f4f19-ecf1-45d2-b4e6-3ea7e91f64be req-58db9805-b514-4909-bff2-3599c7293a1c service nova] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Refreshing network info cache for port e8c429ee-f5b4-4cf5-935c-5d4631b369e3 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Start _get_guest_xml network_info=[{"id": "e8c429ee-f5b4-4cf5-935c-5d4631b369e3", "address": "fa:16:3e:87:e1:4c", "network": {"id": "c405fff5-285f-47eb-8bae-867c6393edf2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-368785799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8780c23b60e4abe85276f2d71c591b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c429ee-f5", "ovs_interfaceid": "e8c429ee-f5b4-4cf5-935c-5d4631b369e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 07:57:11 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:57:11 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:57:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:57:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-478948806',display_name='tempest-VolumesAdminNegativeTest-server-478948806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-478948806',id=15,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeOXC7u3TOzHgB3Shtn6SnT6dcLnIROZ8883sTf+uKoKMeNKw3Wm5qNGZfCoXIooRQgnQ0hVgU6dUiQ0QL7jRKjKp9YjAJRU03WiiaXwZCTsoNH7pKBOFry4O0ra+81cQ==',key_name='tempest-keypair-24853503',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8780c23b60e4abe85276f2d71c591b0',ramdisk_id='',reservation_id='r-mxdyaa26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1341066445',owner_user_name='tempest-VolumesAdminNegativeTest-1341066445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:57:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d4446ab7daa45fa8c843c2d991de43f',uuid=9c36455f-5fd6-4813-9c44-499e3742ed39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8c429ee-f5b4-4cf5-935c-5d4631b369e3", "address": "fa:16:3e:87:e1:4c", "network": {"id": "c405fff5-285f-47eb-8bae-867c6393edf2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-368785799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8780c23b60e4abe85276f2d71c591b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c429ee-f5", "ovs_interfaceid": "e8c429ee-f5b4-4cf5-935c-5d4631b369e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Converting VIF {"id": "e8c429ee-f5b4-4cf5-935c-5d4631b369e3", "address": "fa:16:3e:87:e1:4c", "network": {"id": "c405fff5-285f-47eb-8bae-867c6393edf2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-368785799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8780c23b60e4abe85276f2d71c591b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c429ee-f5", "ovs_interfaceid": "e8c429ee-f5b4-4cf5-935c-5d4631b369e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:e1:4c,bridge_name='br-int',has_traffic_filtering=True,id=e8c429ee-f5b4-4cf5-935c-5d4631b369e3,network=Network(c405fff5-285f-47eb-8bae-867c6393edf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c429ee-f5') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG nova.objects.instance [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lazy-loading 'pci_devices' on Instance uuid 9c36455f-5fd6-4813-9c44-499e3742ed39 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] End _get_guest_xml xml=<domain type="kvm">
Nov 22 07:57:11 user nova-compute[74348]:   <uuid>9c36455f-5fd6-4813-9c44-499e3742ed39</uuid>
Nov 22 07:57:11 user nova-compute[74348]:   <name>instance-0000000f</name>
Nov 22 07:57:11 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 07:57:11 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 07:57:11 user nova-compute[74348]:   <metadata>
Nov 22 07:57:11 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 07:57:11 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 07:57:11 user nova-compute[74348]:       <nova:name>tempest-VolumesAdminNegativeTest-server-478948806</nova:name>
Nov 22 07:57:11 user nova-compute[74348]:       <nova:creationTime>2023-11-22 07:57:11</nova:creationTime>
Nov 22 07:57:11 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 07:57:11 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 07:57:11 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 07:57:11 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 07:57:11 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 07:57:11 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 07:57:11 user nova-compute[74348]:       </nova:flavor>
Nov 22 07:57:11 user nova-compute[74348]:       <nova:owner>
Nov 22 07:57:11 user nova-compute[74348]:         <nova:user uuid="9d4446ab7daa45fa8c843c2d991de43f">tempest-VolumesAdminNegativeTest-1341066445-project-member</nova:user>
Nov 22 07:57:11 user nova-compute[74348]:         <nova:project uuid="a8780c23b60e4abe85276f2d71c591b0">tempest-VolumesAdminNegativeTest-1341066445</nova:project>
Nov 22 07:57:11 user nova-compute[74348]:       </nova:owner>
Nov 22 07:57:11 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 07:57:11 user nova-compute[74348]:       <nova:ports>
Nov 22 07:57:11 user nova-compute[74348]:         <nova:port uuid="e8c429ee-f5b4-4cf5-935c-5d4631b369e3">
Nov 22 07:57:11 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 22 07:57:11 user nova-compute[74348]:         </nova:port>
Nov 22 07:57:11 user nova-compute[74348]:       </nova:ports>
Nov 22 07:57:11 user nova-compute[74348]:     </nova:instance>
Nov 22 07:57:11 user nova-compute[74348]:   </metadata>
Nov 22 07:57:11 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 07:57:11 user nova-compute[74348]:     <system>
Nov 22 07:57:11 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 07:57:11 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 07:57:11 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 07:57:11 user nova-compute[74348]:       <entry name="serial">9c36455f-5fd6-4813-9c44-499e3742ed39</entry>
Nov 22 07:57:11 user nova-compute[74348]:       <entry name="uuid">9c36455f-5fd6-4813-9c44-499e3742ed39</entry>
Nov 22 07:57:11 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 07:57:11 user nova-compute[74348]:     </system>
Nov 22 07:57:11 user nova-compute[74348]:   </sysinfo>
Nov 22 07:57:11 user nova-compute[74348]:   <os>
Nov 22 07:57:11 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 07:57:11 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 07:57:11 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 07:57:11 user nova-compute[74348]:   </os>
Nov 22 07:57:11 user nova-compute[74348]:   <features>
Nov 22 07:57:11 user nova-compute[74348]:     <acpi/>
Nov 22 07:57:11 user nova-compute[74348]:     <apic/>
Nov 22 07:57:11 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 07:57:11 user nova-compute[74348]:   </features>
Nov 22 07:57:11 user nova-compute[74348]:   <clock offset="utc">
Nov 22 07:57:11 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 07:57:11 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 07:57:11 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 07:57:11 user nova-compute[74348]:   </clock>
Nov 22 07:57:11 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 07:57:11 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 07:57:11 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 07:57:11 user nova-compute[74348]:   </cpu>
Nov 22 07:57:11 user nova-compute[74348]:   <devices>
Nov 22 07:57:11 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 07:57:11 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 07:57:11 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/9c36455f-5fd6-4813-9c44-499e3742ed39/disk"/>
Nov 22 07:57:11 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 07:57:11 user nova-compute[74348]:     </disk>
Nov 22 07:57:11 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 07:57:11 user nova-compute[74348]:       <mac address="fa:16:3e:87:e1:4c"/>
Nov 22 07:57:11 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:57:11 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 07:57:11 user nova-compute[74348]:       <target dev="tape8c429ee-f5"/>
Nov 22 07:57:11 user nova-compute[74348]:     </interface>
Nov 22 07:57:11 user nova-compute[74348]:     <serial type="pty">
Nov 22 07:57:11 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/9c36455f-5fd6-4813-9c44-499e3742ed39/console.log" append="off"/>
Nov 22 07:57:11 user nova-compute[74348]:     </serial>
Nov 22 07:57:11 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 07:57:11 user nova-compute[74348]:     <video>
Nov 22 07:57:11 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:57:11 user nova-compute[74348]:     </video>
Nov 22 07:57:11 user nova-compute[74348]:     <rng model="virtio">
Nov 22 07:57:11 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 07:57:11 user nova-compute[74348]:     </rng>
Nov 22 07:57:11 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 07:57:11 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 07:57:11 user nova-compute[74348]:       <stats period="10"/>
Nov 22 07:57:11 user nova-compute[74348]:     </memballoon>
Nov 22 07:57:11 user nova-compute[74348]:   </devices>
Nov 22 07:57:11 user nova-compute[74348]: </domain>
Nov 22 07:57:11 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:57:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-478948806',display_name='tempest-VolumesAdminNegativeTest-server-478948806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-478948806',id=15,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeOXC7u3TOzHgB3Shtn6SnT6dcLnIROZ8883sTf+uKoKMeNKw3Wm5qNGZfCoXIooRQgnQ0hVgU6dUiQ0QL7jRKjKp9YjAJRU03WiiaXwZCTsoNH7pKBOFry4O0ra+81cQ==',key_name='tempest-keypair-24853503',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8780c23b60e4abe85276f2d71c591b0',ramdisk_id='',reservation_id='r-mxdyaa26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1341066445',owner_user_name='tempest-VolumesAdminNegativeTest-1341066445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:57:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d4446ab7daa45fa8c843c2d991de43f',uuid=9c36455f-5fd6-4813-9c44-499e3742ed39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8c429ee-f5b4-4cf5-935c-5d4631b369e3", "address": "fa:16:3e:87:e1:4c", "network": {"id": "c405fff5-285f-47eb-8bae-867c6393edf2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-368785799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8780c23b60e4abe85276f2d71c591b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c429ee-f5", "ovs_interfaceid": "e8c429ee-f5b4-4cf5-935c-5d4631b369e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Converting VIF {"id": "e8c429ee-f5b4-4cf5-935c-5d4631b369e3", "address": "fa:16:3e:87:e1:4c", "network": {"id": "c405fff5-285f-47eb-8bae-867c6393edf2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-368785799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8780c23b60e4abe85276f2d71c591b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c429ee-f5", "ovs_interfaceid": "e8c429ee-f5b4-4cf5-935c-5d4631b369e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:e1:4c,bridge_name='br-int',has_traffic_filtering=True,id=e8c429ee-f5b4-4cf5-935c-5d4631b369e3,network=Network(c405fff5-285f-47eb-8bae-867c6393edf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c429ee-f5') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG os_vif [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:e1:4c,bridge_name='br-int',has_traffic_filtering=True,id=e8c429ee-f5b4-4cf5-935c-5d4631b369e3,network=Network(c405fff5-285f-47eb-8bae-867c6393edf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c429ee-f5') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'db188e3a-2764-5e3f-87ed-3b3b8d2d82fe', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8c429ee-f5, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape8c429ee-f5, col_values=(('qos', UUID('191d3a80-45b3-4bc8-8b92-836ba616ce15')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape8c429ee-f5, col_values=(('external_ids', {'iface-id': 'e8c429ee-f5b4-4cf5-935c-5d4631b369e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:e1:4c', 'vm-uuid': '9c36455f-5fd6-4813-9c44-499e3742ed39'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:11 user nova-compute[74348]: INFO os_vif [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:e1:4c,bridge_name='br-int',has_traffic_filtering=True,id=e8c429ee-f5b4-4cf5-935c-5d4631b369e3,network=Network(c405fff5-285f-47eb-8bae-867c6393edf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c429ee-f5')
Nov 22 07:57:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] No VIF found with MAC fa:16:3e:87:e1:4c, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG nova.network.neutron [req-700f4f19-ecf1-45d2-b4e6-3ea7e91f64be req-58db9805-b514-4909-bff2-3599c7293a1c service nova] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Updated VIF entry in instance network info cache for port e8c429ee-f5b4-4cf5-935c-5d4631b369e3. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG nova.network.neutron [req-700f4f19-ecf1-45d2-b4e6-3ea7e91f64be req-58db9805-b514-4909-bff2-3599c7293a1c service nova] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Updating instance_info_cache with network_info: [{"id": "e8c429ee-f5b4-4cf5-935c-5d4631b369e3", "address": "fa:16:3e:87:e1:4c", "network": {"id": "c405fff5-285f-47eb-8bae-867c6393edf2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-368785799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8780c23b60e4abe85276f2d71c591b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c429ee-f5", "ovs_interfaceid": "e8c429ee-f5b4-4cf5-935c-5d4631b369e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:57:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-700f4f19-ecf1-45d2-b4e6-3ea7e91f64be req-58db9805-b514-4909-bff2-3599c7293a1c service nova] Releasing lock "refresh_cache-9c36455f-5fd6-4813-9c44-499e3742ed39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:57:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:13 user nova-compute[74348]: DEBUG nova.compute.manager [req-60b1e179-a568-4bfd-85a0-8569f7345323 req-5a44d070-4bb8-4f27-a769-f9aecdb5bc56 service nova] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Received event network-vif-plugged-e8c429ee-f5b4-4cf5-935c-5d4631b369e3 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:57:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-60b1e179-a568-4bfd-85a0-8569f7345323 req-5a44d070-4bb8-4f27-a769-f9aecdb5bc56 service nova] Acquiring lock "9c36455f-5fd6-4813-9c44-499e3742ed39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:57:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-60b1e179-a568-4bfd-85a0-8569f7345323 req-5a44d070-4bb8-4f27-a769-f9aecdb5bc56 service nova] Lock "9c36455f-5fd6-4813-9c44-499e3742ed39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:57:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-60b1e179-a568-4bfd-85a0-8569f7345323 req-5a44d070-4bb8-4f27-a769-f9aecdb5bc56 service nova] Lock "9c36455f-5fd6-4813-9c44-499e3742ed39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:57:13 user nova-compute[74348]: DEBUG nova.compute.manager [req-60b1e179-a568-4bfd-85a0-8569f7345323 req-5a44d070-4bb8-4f27-a769-f9aecdb5bc56 service nova] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] No waiting events found dispatching network-vif-plugged-e8c429ee-f5b4-4cf5-935c-5d4631b369e3 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:57:13 user nova-compute[74348]: WARNING nova.compute.manager [req-60b1e179-a568-4bfd-85a0-8569f7345323 req-5a44d070-4bb8-4f27-a769-f9aecdb5bc56 service nova] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Received unexpected event network-vif-plugged-e8c429ee-f5b4-4cf5-935c-5d4631b369e3 for instance with vm_state building and task_state spawning.
Nov 22 07:57:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:15 user nova-compute[74348]: DEBUG nova.compute.manager [req-419ab23a-8bde-4dd1-b5d0-97b1f59a783b req-d1d1c331-c679-4352-9be6-f5dc0b8a520b service nova] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Received event network-vif-plugged-e8c429ee-f5b4-4cf5-935c-5d4631b369e3 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:57:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-419ab23a-8bde-4dd1-b5d0-97b1f59a783b req-d1d1c331-c679-4352-9be6-f5dc0b8a520b service nova] Acquiring lock "9c36455f-5fd6-4813-9c44-499e3742ed39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:57:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-419ab23a-8bde-4dd1-b5d0-97b1f59a783b req-d1d1c331-c679-4352-9be6-f5dc0b8a520b service nova] Lock "9c36455f-5fd6-4813-9c44-499e3742ed39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:57:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-419ab23a-8bde-4dd1-b5d0-97b1f59a783b req-d1d1c331-c679-4352-9be6-f5dc0b8a520b service nova] Lock "9c36455f-5fd6-4813-9c44-499e3742ed39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:57:15 user nova-compute[74348]: DEBUG nova.compute.manager [req-419ab23a-8bde-4dd1-b5d0-97b1f59a783b req-d1d1c331-c679-4352-9be6-f5dc0b8a520b service nova] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] No waiting events found dispatching network-vif-plugged-e8c429ee-f5b4-4cf5-935c-5d4631b369e3 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:57:15 user nova-compute[74348]: WARNING nova.compute.manager [req-419ab23a-8bde-4dd1-b5d0-97b1f59a783b req-d1d1c331-c679-4352-9be6-f5dc0b8a520b service nova] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Received unexpected event network-vif-plugged-e8c429ee-f5b4-4cf5-935c-5d4631b369e3 for instance with vm_state building and task_state spawning.
Nov 22 07:57:15 user nova-compute[74348]: DEBUG nova.compute.manager [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 07:57:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 07:57:15 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Instance spawned successfully.
Nov 22 07:57:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 07:57:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:57:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:57:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:57:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:57:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:57:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:57:15 user nova-compute[74348]: INFO nova.compute.manager [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Took 5.84 seconds to spawn the instance on the hypervisor.
Nov 22 07:57:15 user nova-compute[74348]: DEBUG nova.compute.manager [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 07:57:15 user nova-compute[74348]: INFO nova.compute.manager [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Took 6.69 seconds to build instance.
Nov 22 07:57:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-879d4588-a151-4320-8381-49ffe9cb9d70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lock "9c36455f-5fd6-4813-9c44-499e3742ed39" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.831s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:57:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:17 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Starting finish_migration {{(pid=74348) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 22 07:57:17 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Instance directory exists: not creating {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 22 07:57:17 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Creating image(s)
Nov 22 07:57:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.220s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:17 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk. size=21474836480 {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 07:57:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk 21474836480 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk 21474836480" returned: 0 in 0.054s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Did not create local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Ensure instance console log exists: /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Start _get_guest_xml network_info=[{"id": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "address": "fa:16:3e:a7:50:2a", "network": {"id": "8a783b63-dae2-41eb-a00a-5cf8e94a5412", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872095489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-872095489-network", "vif_mac": "fa:16:3e:a7:50:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beaa9566ba2842d49f843dbddc59854d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap618bd526-89", "ovs_interfaceid": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RoQzpAmu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'e36789b1-45e6-40f7-ba97-8962cb116a39', 'attached_at': '2023-11-22T07:57:17.000000', 'detached_at': '', 'volume_id': 'd39d80c0-03af-4337-8739-906a6e6a5730', 'serial': 'd39d80c0-03af-4337-8739-906a6e6a5730'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'attachment_id': '432d8a5b-4e69-4e87-9dd6-92c49985f515', 'volume_type': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 07:57:18 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:57:18 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:57:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RoQzpAmu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:57:18 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:57:18 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:57:18 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:57:18 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:57:18 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 07:57:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9affba-a3c9-494f-8232-75c6818745dd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 07:57:18 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b8842c-4f9a-466a-a6a9-1b48f4bf2229]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730] added
Nov 22 07:57:18 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2429009-f542-4df1-9fae-82dc1b1e97ae]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b229f9-24db-477a-86d3-c4a0be86f391]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RoQzpAmu {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RoQzpAmu" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b27f11-f816-47e9-ae07-a6acfb912371]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RoQzpAmu'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ec7fe1-8a3e-4433-a090-57f43e6e829f]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d39618-6799-4d4d-96fd-039951f7344d]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:57:18 user nova-compute[74348]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)
Nov 22 07:57:18 user nova-compute[74348]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee (non-flash)
Nov 22 07:57:18 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:57:18 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:57:18 user nova-compute[74348]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)
Nov 22 07:57:18 user nova-compute[74348]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee (non-flash)
Nov 22 07:57:18 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:57:18 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d9146c-f178-4c9f-8d02-df04e8c73680]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730, portal: 172.16.0.220,3260]
Nov 22 07:57:18 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730, portal: 172.16.0.220,3260] successful.
Nov 22 07:57:18 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3a02e4-b955-4b6d-bf87-e10b6f1a9e25]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4c9c97-11ae-4081-8825-923b44c81ab0]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:57:18 user nova-compute[74348]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)
Nov 22 07:57:18 user nova-compute[74348]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee (non-flash)
Nov 22 07:57:18 user nova-compute[74348]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 07:57:18 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:57:18 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:57:18 user nova-compute[74348]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)
Nov 22 07:57:18 user nova-compute[74348]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee (non-flash)
Nov 22 07:57:18 user nova-compute[74348]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 07:57:18 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:57:18 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[66890b17-de2e-4f7a-827e-30ebdfe04147]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:57:18 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: None {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 07:57:19 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 07:57:19 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RoQzpAmu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 07:57:19 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:57:19 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '26331326434623339', 'path': '/dev/sdd'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:57:19 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331326434623339', 'path': '/dev/sdd'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 07:57:19 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2131516711',display_name='tempest-ServerActionsTestOtherB-server-2131516711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2131516711',id=4,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNk1MOJm11bQ93eU1QYv8ji0a1vxy2ayCOX/9R0SEaykivxTwmzY2ykLPWhT+1BMkwgumhcTt15jzBxURGp9c6w0OYjMGs9IXzcm5BaMYRSciSb/BXxgpEqQZEDxBbmLrQ==',key_name='tempest-keypair-1880925410',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:52:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='beaa9566ba2842d49f843dbddc59854d',ramdisk_id='',reservation_id='r-0nqnkret',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-849589705',owner_user_name='tempest-ServerActionsTestOtherB-849589705-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:57:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3b62e16105c4210bfc24e71c09ede28',uuid=e36789b1-45e6-40f7-ba97-8962cb116a39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "address": "fa:16:3e:a7:50:2a", "network": {"id": "8a783b63-dae2-41eb-a00a-5cf8e94a5412", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872095489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-872095489-network", "vif_mac": "fa:16:3e:a7:50:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beaa9566ba2842d49f843dbddc59854d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap618bd526-89", "ovs_interfaceid": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 07:57:19 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Converting VIF {"id": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "address": "fa:16:3e:a7:50:2a", "network": {"id": "8a783b63-dae2-41eb-a00a-5cf8e94a5412", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872095489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-872095489-network", "vif_mac": "fa:16:3e:a7:50:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beaa9566ba2842d49f843dbddc59854d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap618bd526-89", "ovs_interfaceid": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:57:19 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:50:2a,bridge_name='br-int',has_traffic_filtering=True,id=618bd526-892d-4dfb-8ba6-f65e83e3f467,network=Network(8a783b63-dae2-41eb-a00a-5cf8e94a5412),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap618bd526-89') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:57:19 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] End _get_guest_xml xml=<domain type="kvm">
Nov 22 07:57:19 user nova-compute[74348]:   <uuid>e36789b1-45e6-40f7-ba97-8962cb116a39</uuid>
Nov 22 07:57:19 user nova-compute[74348]:   <name>instance-00000004</name>
Nov 22 07:57:19 user nova-compute[74348]:   <memory>2097152</memory>
Nov 22 07:57:19 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 07:57:19 user nova-compute[74348]:   <metadata>
Nov 22 07:57:19 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 07:57:19 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 07:57:19 user nova-compute[74348]:       <nova:name>tempest-ServerActionsTestOtherB-server-2131516711</nova:name>
Nov 22 07:57:19 user nova-compute[74348]:       <nova:creationTime>2023-11-22 07:57:18</nova:creationTime>
Nov 22 07:57:19 user nova-compute[74348]:       <nova:flavor name="m1.small">
Nov 22 07:57:19 user nova-compute[74348]:         <nova:memory>2048</nova:memory>
Nov 22 07:57:19 user nova-compute[74348]:         <nova:disk>20</nova:disk>
Nov 22 07:57:19 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 07:57:19 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 07:57:19 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 07:57:19 user nova-compute[74348]:       </nova:flavor>
Nov 22 07:57:19 user nova-compute[74348]:       <nova:owner>
Nov 22 07:57:19 user nova-compute[74348]:         <nova:user uuid="a3b62e16105c4210bfc24e71c09ede28">tempest-ServerActionsTestOtherB-849589705-project-member</nova:user>
Nov 22 07:57:19 user nova-compute[74348]:         <nova:project uuid="beaa9566ba2842d49f843dbddc59854d">tempest-ServerActionsTestOtherB-849589705</nova:project>
Nov 22 07:57:19 user nova-compute[74348]:       </nova:owner>
Nov 22 07:57:19 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 07:57:19 user nova-compute[74348]:       <nova:ports>
Nov 22 07:57:19 user nova-compute[74348]:         <nova:port uuid="618bd526-892d-4dfb-8ba6-f65e83e3f467">
Nov 22 07:57:19 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 22 07:57:19 user nova-compute[74348]:         </nova:port>
Nov 22 07:57:19 user nova-compute[74348]:       </nova:ports>
Nov 22 07:57:19 user nova-compute[74348]:     </nova:instance>
Nov 22 07:57:19 user nova-compute[74348]:   </metadata>
Nov 22 07:57:19 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 07:57:19 user nova-compute[74348]:     <system>
Nov 22 07:57:19 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 07:57:19 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 07:57:19 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 07:57:19 user nova-compute[74348]:       <entry name="serial">e36789b1-45e6-40f7-ba97-8962cb116a39</entry>
Nov 22 07:57:19 user nova-compute[74348]:       <entry name="uuid">e36789b1-45e6-40f7-ba97-8962cb116a39</entry>
Nov 22 07:57:19 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 07:57:19 user nova-compute[74348]:     </system>
Nov 22 07:57:19 user nova-compute[74348]:   </sysinfo>
Nov 22 07:57:19 user nova-compute[74348]:   <os>
Nov 22 07:57:19 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 07:57:19 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 07:57:19 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 07:57:19 user nova-compute[74348]:   </os>
Nov 22 07:57:19 user nova-compute[74348]:   <features>
Nov 22 07:57:19 user nova-compute[74348]:     <acpi/>
Nov 22 07:57:19 user nova-compute[74348]:     <apic/>
Nov 22 07:57:19 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 07:57:19 user nova-compute[74348]:   </features>
Nov 22 07:57:19 user nova-compute[74348]:   <clock offset="utc">
Nov 22 07:57:19 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 07:57:19 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 07:57:19 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 07:57:19 user nova-compute[74348]:   </clock>
Nov 22 07:57:19 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 07:57:19 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 07:57:19 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 07:57:19 user nova-compute[74348]:   </cpu>
Nov 22 07:57:19 user nova-compute[74348]:   <devices>
Nov 22 07:57:19 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 07:57:19 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 07:57:19 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk"/>
Nov 22 07:57:19 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 07:57:19 user nova-compute[74348]:     </disk>
Nov 22 07:57:19 user nova-compute[74348]:     <disk type="block" device="disk">
Nov 22 07:57:19 user nova-compute[74348]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 07:57:19 user nova-compute[74348]:       <source dev="/dev/sdd"/>
Nov 22 07:57:19 user nova-compute[74348]:       <target dev="vdb" bus="virtio"/>
Nov 22 07:57:19 user nova-compute[74348]:       <serial>d39d80c0-03af-4337-8739-906a6e6a5730</serial>
Nov 22 07:57:19 user nova-compute[74348]:     </disk>
Nov 22 07:57:19 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 07:57:19 user nova-compute[74348]:       <mac address="fa:16:3e:a7:50:2a"/>
Nov 22 07:57:19 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:57:19 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 07:57:19 user nova-compute[74348]:       <target dev="tap618bd526-89"/>
Nov 22 07:57:19 user nova-compute[74348]:     </interface>
Nov 22 07:57:19 user nova-compute[74348]:     <serial type="pty">
Nov 22 07:57:19 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/console.log" append="off"/>
Nov 22 07:57:19 user nova-compute[74348]:     </serial>
Nov 22 07:57:19 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 07:57:19 user nova-compute[74348]:     <video>
Nov 22 07:57:19 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:57:19 user nova-compute[74348]:     </video>
Nov 22 07:57:19 user nova-compute[74348]:     <rng model="virtio">
Nov 22 07:57:19 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 07:57:19 user nova-compute[74348]:     </rng>
Nov 22 07:57:19 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 07:57:19 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 07:57:19 user nova-compute[74348]:       <stats period="10"/>
Nov 22 07:57:19 user nova-compute[74348]:     </memballoon>
Nov 22 07:57:19 user nova-compute[74348]:   </devices>
Nov 22 07:57:19 user nova-compute[74348]: </domain>
Nov 22 07:57:19 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 07:57:19 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2131516711',display_name='tempest-ServerActionsTestOtherB-server-2131516711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2131516711',id=4,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNk1MOJm11bQ93eU1QYv8ji0a1vxy2ayCOX/9R0SEaykivxTwmzY2ykLPWhT+1BMkwgumhcTt15jzBxURGp9c6w0OYjMGs9IXzcm5BaMYRSciSb/BXxgpEqQZEDxBbmLrQ==',key_name='tempest-keypair-1880925410',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:52:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='beaa9566ba2842d49f843dbddc59854d',ramdisk_id='',reservation_id='r-0nqnkret',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-849589705',owner_user_name='tempest-ServerActionsTestOtherB-849589705-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:57:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3b62e16105c4210bfc24e71c09ede28',uuid=e36789b1-45e6-40f7-ba97-8962cb116a39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "address": "fa:16:3e:a7:50:2a", "network": {"id": "8a783b63-dae2-41eb-a00a-5cf8e94a5412", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872095489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-872095489-network", "vif_mac": "fa:16:3e:a7:50:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beaa9566ba2842d49f843dbddc59854d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap618bd526-89", "ovs_interfaceid": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 07:57:19 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Converting VIF {"id": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "address": "fa:16:3e:a7:50:2a", "network": {"id": "8a783b63-dae2-41eb-a00a-5cf8e94a5412", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872095489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-872095489-network", "vif_mac": "fa:16:3e:a7:50:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beaa9566ba2842d49f843dbddc59854d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap618bd526-89", "ovs_interfaceid": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:57:19 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:50:2a,bridge_name='br-int',has_traffic_filtering=True,id=618bd526-892d-4dfb-8ba6-f65e83e3f467,network=Network(8a783b63-dae2-41eb-a00a-5cf8e94a5412),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap618bd526-89') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:57:19 user nova-compute[74348]: DEBUG os_vif [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:50:2a,bridge_name='br-int',has_traffic_filtering=True,id=618bd526-892d-4dfb-8ba6-f65e83e3f467,network=Network(8a783b63-dae2-41eb-a00a-5cf8e94a5412),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap618bd526-89') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 07:57:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:57:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 07:57:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3dbd3f92-55f5-5042-88ab-15741eaa68d0', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:57:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:57:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap618bd526-89, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:57:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap618bd526-89, col_values=(('qos', UUID('0ff1d67d-7176-4970-9a59-e60fdbe4a156')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:57:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap618bd526-89, col_values=(('external_ids', {'iface-id': '618bd526-892d-4dfb-8ba6-f65e83e3f467', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:50:2a', 'vm-uuid': 'e36789b1-45e6-40f7-ba97-8962cb116a39'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:57:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:57:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:19 user nova-compute[74348]: INFO os_vif [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:50:2a,bridge_name='br-int',has_traffic_filtering=True,id=618bd526-892d-4dfb-8ba6-f65e83e3f467,network=Network(8a783b63-dae2-41eb-a00a-5cf8e94a5412),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap618bd526-89')
Nov 22 07:57:19 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:57:19 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:57:19 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] No VIF found with MAC fa:16:3e:a7:50:2a, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 07:57:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:21 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:21 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:21 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:21 user nova-compute[74348]: DEBUG nova.compute.manager [req-efe71b5e-993d-4e8a-9ffc-0a29ee6a27a5 req-3c9ef5eb-3e10-4d96-998d-d7793e2ed60c service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Received event network-vif-plugged-618bd526-892d-4dfb-8ba6-f65e83e3f467 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:57:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-efe71b5e-993d-4e8a-9ffc-0a29ee6a27a5 req-3c9ef5eb-3e10-4d96-998d-d7793e2ed60c service nova] Acquiring lock "e36789b1-45e6-40f7-ba97-8962cb116a39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:57:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-efe71b5e-993d-4e8a-9ffc-0a29ee6a27a5 req-3c9ef5eb-3e10-4d96-998d-d7793e2ed60c service nova] Lock "e36789b1-45e6-40f7-ba97-8962cb116a39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:57:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-efe71b5e-993d-4e8a-9ffc-0a29ee6a27a5 req-3c9ef5eb-3e10-4d96-998d-d7793e2ed60c service nova] Lock "e36789b1-45e6-40f7-ba97-8962cb116a39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:57:21 user nova-compute[74348]: DEBUG nova.compute.manager [req-efe71b5e-993d-4e8a-9ffc-0a29ee6a27a5 req-3c9ef5eb-3e10-4d96-998d-d7793e2ed60c service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] No waiting events found dispatching network-vif-plugged-618bd526-892d-4dfb-8ba6-f65e83e3f467 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:57:21 user nova-compute[74348]: WARNING nova.compute.manager [req-efe71b5e-993d-4e8a-9ffc-0a29ee6a27a5 req-3c9ef5eb-3e10-4d96-998d-d7793e2ed60c service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Received unexpected event network-vif-plugged-618bd526-892d-4dfb-8ba6-f65e83e3f467 for instance with vm_state active and task_state resize_finish.
Nov 22 07:57:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:23 user nova-compute[74348]: DEBUG nova.compute.manager [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 07:57:23 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Instance running successfully.
Nov 22 07:57:23 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Failed to set time: agent not configured {{(pid=74348) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 22 07:57:23 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-40b22875-bd9c-43e5-bb19-a8a7b8f2e213 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] finish_migration finished successfully. {{(pid=74348) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 22 07:57:23 user nova-compute[74348]: DEBUG nova.compute.manager [req-d179f54f-5342-428d-a8ad-363975400227 req-91325c42-20db-47b4-8c6e-eeae141a948f service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Received event network-vif-plugged-618bd526-892d-4dfb-8ba6-f65e83e3f467 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:57:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d179f54f-5342-428d-a8ad-363975400227 req-91325c42-20db-47b4-8c6e-eeae141a948f service nova] Acquiring lock "e36789b1-45e6-40f7-ba97-8962cb116a39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:57:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d179f54f-5342-428d-a8ad-363975400227 req-91325c42-20db-47b4-8c6e-eeae141a948f service nova] Lock "e36789b1-45e6-40f7-ba97-8962cb116a39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:57:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d179f54f-5342-428d-a8ad-363975400227 req-91325c42-20db-47b4-8c6e-eeae141a948f service nova] Lock "e36789b1-45e6-40f7-ba97-8962cb116a39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:57:23 user nova-compute[74348]: DEBUG nova.compute.manager [req-d179f54f-5342-428d-a8ad-363975400227 req-91325c42-20db-47b4-8c6e-eeae141a948f service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] No waiting events found dispatching network-vif-plugged-618bd526-892d-4dfb-8ba6-f65e83e3f467 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:57:23 user nova-compute[74348]: WARNING nova.compute.manager [req-d179f54f-5342-428d-a8ad-363975400227 req-91325c42-20db-47b4-8c6e-eeae141a948f service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Received unexpected event network-vif-plugged-618bd526-892d-4dfb-8ba6-f65e83e3f467 for instance with vm_state active and task_state resize_finish.
Nov 22 07:57:24 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:28 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:57:28 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 07:57:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1d6d0334-6d7b-45ad-a7c8-fade23bb0e37 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "522f5959-4874-4c61-888d-6fb1cc4d72e6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:57:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1d6d0334-6d7b-45ad-a7c8-fade23bb0e37 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "522f5959-4874-4c61-888d-6fb1cc4d72e6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:57:28 user nova-compute[74348]: INFO nova.compute.manager [None req-1d6d0334-6d7b-45ad-a7c8-fade23bb0e37 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Detaching volume 0c375792-1e67-4f49-81d8-fb2d11c2e223
Nov 22 07:57:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-5f3bbae3-babf-44d2-96da-c459fb77d9c7" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:57:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-5f3bbae3-babf-44d2-96da-c459fb77d9c7" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:57:28 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 07:57:28 user nova-compute[74348]: INFO nova.virt.block_device [None req-1d6d0334-6d7b-45ad-a7c8-fade23bb0e37 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Attempting to driver detach volume 0c375792-1e67-4f49-81d8-fb2d11c2e223 from mountpoint /dev/vdb
Nov 22 07:57:28 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-1d6d0334-6d7b-45ad-a7c8-fade23bb0e37 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Attempting to detach device vdb from instance 522f5959-4874-4c61-888d-6fb1cc4d72e6 from the persistent domain config. {{(pid=74348) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 07:57:28 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-1d6d0334-6d7b-45ad-a7c8-fade23bb0e37 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 07:57:28 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 07:57:28 user nova-compute[74348]:   <source dev="/dev/sdi"/>
Nov 22 07:57:28 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 07:57:28 user nova-compute[74348]:   <serial>0c375792-1e67-4f49-81d8-fb2d11c2e223</serial>
Nov 22 07:57:28 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 07:57:28 user nova-compute[74348]: </disk>
Nov 22 07:57:28 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 07:57:28 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-1d6d0334-6d7b-45ad-a7c8-fade23bb0e37 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Successfully detached device vdb from instance 522f5959-4874-4c61-888d-6fb1cc4d72e6 from the persistent domain config.
Nov 22 07:57:28 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-1d6d0334-6d7b-45ad-a7c8-fade23bb0e37 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 522f5959-4874-4c61-888d-6fb1cc4d72e6 from the live domain config. {{(pid=74348) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 07:57:28 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-1d6d0334-6d7b-45ad-a7c8-fade23bb0e37 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 07:57:28 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 07:57:28 user nova-compute[74348]:   <source dev="/dev/sdi"/>
Nov 22 07:57:28 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 07:57:28 user nova-compute[74348]:   <serial>0c375792-1e67-4f49-81d8-fb2d11c2e223</serial>
Nov 22 07:57:28 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 07:57:28 user nova-compute[74348]: </disk>
Nov 22 07:57:28 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 07:57:29 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-1d6d0334-6d7b-45ad-a7c8-fade23bb0e37 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 522f5959-4874-4c61-888d-6fb1cc4d72e6 {{(pid=74348) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 07:57:29 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Updating instance_info_cache with network_info: [{"id": "094232d9-8ec1-401f-8908-2a698a5385bb", "address": "fa:16:3e:db:2f:02", "network": {"id": "4ef640bb-4a2f-4f98-8b01-b5df87fcb35a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1216437312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444367658c0241d0b5b377a73fedb52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap094232d9-8e", "ovs_interfaceid": "094232d9-8ec1-401f-8908-2a698a5385bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:57:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-5f3bbae3-babf-44d2-96da-c459fb77d9c7" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:57:29 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 07:57:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:30 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:57:30 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:57:31 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:57:31 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:57:31 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 07:57:31 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:57:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:57:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:57:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:57:31 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 07:57:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3bbae3-babf-44d2-96da-c459fb77d9c7/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3bbae3-babf-44d2-96da-c459fb77d9c7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3bbae3-babf-44d2-96da-c459fb77d9c7/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3bbae3-babf-44d2-96da-c459fb77d9c7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:32 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 07:57:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/522f5959-4874-4c61-888d-6fb1cc4d72e6/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/522f5959-4874-4c61-888d-6fb1cc4d72e6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/522f5959-4874-4c61-888d-6fb1cc4d72e6/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/522f5959-4874-4c61-888d-6fb1cc4d72e6/disk --force-share --output=json" returned: 0 in 0.307s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059bde4a-c5c9-45ab-9b4a-c969c74a6083/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059bde4a-c5c9-45ab-9b4a-c969c74a6083/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059bde4a-c5c9-45ab-9b4a-c969c74a6083/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059bde4a-c5c9-45ab-9b4a-c969c74a6083/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "765f8c47-c042-4430-8d35-07926ad693fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:57:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "765f8c47-c042-4430-8d35-07926ad693fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:57:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:33 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 07:57:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk.rescue --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:33 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 07:57:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:57:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:57:33 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 07:57:33 user nova-compute[74348]: INFO nova.compute.claims [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Claim successful on node user
Nov 22 07:57:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk.rescue --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c36455f-5fd6-4813-9c44-499e3742ed39/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c36455f-5fd6-4813-9c44-499e3742ed39/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c36455f-5fd6-4813-9c44-499e3742ed39/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:34 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:57:34 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:57:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.626s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:57:34 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 07:57:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c36455f-5fd6-4813-9c44-499e3742ed39/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:34 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 07:57:34 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 07:57:34 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 07:57:34 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 07:57:34 user nova-compute[74348]: DEBUG nova.policy [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1d5c8274eca14965b6cbfe22110f904d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31d898cdc69494a8825e8d93a0d04bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 07:57:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:34 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 07:57:34 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 07:57:34 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Creating image(s)
Nov 22 07:57:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "/opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:57:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "/opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:57:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "/opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:57:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:34 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 07:57:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:34 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 07:57:35 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Successfully created port: 3ee3f6b1-b929-404a-b3bb-6ece1c2d1052 {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 07:57:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.588s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:57:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:57:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:35 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:57:35 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:57:35 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=7782MB free_disk=25.167762756347656GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 07:57:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:57:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:57:35 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Applying migration context for instance e36789b1-45e6-40f7-ba97-8962cb116a39 as it has an incoming, in-progress migration e079ba17-515d-44ed-8a81-250f95515ae9. Migration status is finished {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 22 07:57:35 user nova-compute[74348]: INFO nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Updating resource usage from migration e079ba17-515d-44ed-8a81-250f95515ae9
Nov 22 07:57:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.190s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk 1073741824" returned: 0 in 0.058s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:57:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:35 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 059bde4a-c5c9-45ab-9b4a-c969c74a6083 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:57:35 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 522f5959-4874-4c61-888d-6fb1cc4d72e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:57:35 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance bcedb385-b72a-49c2-b363-cf6da5804b60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:57:35 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance abd7f2ed-b0c4-4e05-8161-b141a611f125 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:57:35 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 5f3bbae3-babf-44d2-96da-c459fb77d9c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:57:35 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Migration e079ba17-515d-44ed-8a81-250f95515ae9 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 22 07:57:35 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance e36789b1-45e6-40f7-ba97-8962cb116a39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:57:35 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 9c36455f-5fd6-4813-9c44-499e3742ed39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:57:35 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 765f8c47-c042-4430-8d35-07926ad693fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:57:35 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 07:57:35 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 07:57:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.177s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:35 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Checking if we can resize image /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk. size=1073741824 {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 07:57:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:35 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Cannot resize image /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk to a smaller size. {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 07:57:35 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 07:57:35 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Ensure instance console log exists: /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 07:57:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:57:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:57:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:57:35 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:57:35 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:57:35 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 07:57:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.688s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:57:35 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Successfully updated port: 3ee3f6b1-b929-404a-b3bb-6ece1c2d1052 {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 07:57:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "refresh_cache-765f8c47-c042-4430-8d35-07926ad693fe" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:57:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquired lock "refresh_cache-765f8c47-c042-4430-8d35-07926ad693fe" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:57:35 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 07:57:35 user nova-compute[74348]: DEBUG nova.compute.manager [req-bfbca981-8f98-45b6-a034-5b136168793b req-35c0f7e4-db9f-48c6-ba84-81b39c341957 service nova] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Received event network-changed-3ee3f6b1-b929-404a-b3bb-6ece1c2d1052 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:57:35 user nova-compute[74348]: DEBUG nova.compute.manager [req-bfbca981-8f98-45b6-a034-5b136168793b req-35c0f7e4-db9f-48c6-ba84-81b39c341957 service nova] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Refreshing instance network info cache due to event network-changed-3ee3f6b1-b929-404a-b3bb-6ece1c2d1052. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:57:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-bfbca981-8f98-45b6-a034-5b136168793b req-35c0f7e4-db9f-48c6-ba84-81b39c341957 service nova] Acquiring lock "refresh_cache-765f8c47-c042-4430-8d35-07926ad693fe" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Updating instance_info_cache with network_info: [{"id": "3ee3f6b1-b929-404a-b3bb-6ece1c2d1052", "address": "fa:16:3e:60:74:68", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee3f6b1-b9", "ovs_interfaceid": "3ee3f6b1-b929-404a-b3bb-6ece1c2d1052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Releasing lock "refresh_cache-765f8c47-c042-4430-8d35-07926ad693fe" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Instance network_info: |[{"id": "3ee3f6b1-b929-404a-b3bb-6ece1c2d1052", "address": "fa:16:3e:60:74:68", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee3f6b1-b9", "ovs_interfaceid": "3ee3f6b1-b929-404a-b3bb-6ece1c2d1052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-bfbca981-8f98-45b6-a034-5b136168793b req-35c0f7e4-db9f-48c6-ba84-81b39c341957 service nova] Acquired lock "refresh_cache-765f8c47-c042-4430-8d35-07926ad693fe" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG nova.network.neutron [req-bfbca981-8f98-45b6-a034-5b136168793b req-35c0f7e4-db9f-48c6-ba84-81b39c341957 service nova] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Refreshing network info cache for port 3ee3f6b1-b929-404a-b3bb-6ece1c2d1052 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Start _get_guest_xml network_info=[{"id": "3ee3f6b1-b929-404a-b3bb-6ece1c2d1052", "address": "fa:16:3e:60:74:68", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee3f6b1-b9", "ovs_interfaceid": "3ee3f6b1-b929-404a-b3bb-6ece1c2d1052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 07:57:36 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:57:36 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:57:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:57:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1927344265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1927344265',id=16,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a31d898cdc69494a8825e8d93a0d04bc',ramdisk_id='',reservation_id='r-3xazfxkp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-502521972',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:57:34Z,user_data=None,user_id='1d5c8274eca14965b6cbfe22110f904d',uuid=765f8c47-c042-4430-8d35-07926ad693fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ee3f6b1-b929-404a-b3bb-6ece1c2d1052", "address": "fa:16:3e:60:74:68", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee3f6b1-b9", "ovs_interfaceid": "3ee3f6b1-b929-404a-b3bb-6ece1c2d1052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Converting VIF {"id": "3ee3f6b1-b929-404a-b3bb-6ece1c2d1052", "address": "fa:16:3e:60:74:68", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee3f6b1-b9", "ovs_interfaceid": "3ee3f6b1-b929-404a-b3bb-6ece1c2d1052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:74:68,bridge_name='br-int',has_traffic_filtering=True,id=3ee3f6b1-b929-404a-b3bb-6ece1c2d1052,network=Network(6fe60468-191c-4d84-8dce-55c056f88936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ee3f6b1-b9') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG nova.objects.instance [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lazy-loading 'pci_devices' on Instance uuid 765f8c47-c042-4430-8d35-07926ad693fe {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] End _get_guest_xml xml=<domain type="kvm">
Nov 22 07:57:36 user nova-compute[74348]:   <uuid>765f8c47-c042-4430-8d35-07926ad693fe</uuid>
Nov 22 07:57:36 user nova-compute[74348]:   <name>instance-00000010</name>
Nov 22 07:57:36 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 07:57:36 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 07:57:36 user nova-compute[74348]:   <metadata>
Nov 22 07:57:36 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 07:57:36 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 07:57:36 user nova-compute[74348]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1927344265</nova:name>
Nov 22 07:57:36 user nova-compute[74348]:       <nova:creationTime>2023-11-22 07:57:36</nova:creationTime>
Nov 22 07:57:36 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 07:57:36 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 07:57:36 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 07:57:36 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 07:57:36 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 07:57:36 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 07:57:36 user nova-compute[74348]:       </nova:flavor>
Nov 22 07:57:36 user nova-compute[74348]:       <nova:owner>
Nov 22 07:57:36 user nova-compute[74348]:         <nova:user uuid="1d5c8274eca14965b6cbfe22110f904d">tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member</nova:user>
Nov 22 07:57:36 user nova-compute[74348]:         <nova:project uuid="a31d898cdc69494a8825e8d93a0d04bc">tempest-ServerBootFromVolumeStableRescueTest-502521972</nova:project>
Nov 22 07:57:36 user nova-compute[74348]:       </nova:owner>
Nov 22 07:57:36 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 07:57:36 user nova-compute[74348]:       <nova:ports>
Nov 22 07:57:36 user nova-compute[74348]:         <nova:port uuid="3ee3f6b1-b929-404a-b3bb-6ece1c2d1052">
Nov 22 07:57:36 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 22 07:57:36 user nova-compute[74348]:         </nova:port>
Nov 22 07:57:36 user nova-compute[74348]:       </nova:ports>
Nov 22 07:57:36 user nova-compute[74348]:     </nova:instance>
Nov 22 07:57:36 user nova-compute[74348]:   </metadata>
Nov 22 07:57:36 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 07:57:36 user nova-compute[74348]:     <system>
Nov 22 07:57:36 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 07:57:36 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 07:57:36 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 07:57:36 user nova-compute[74348]:       <entry name="serial">765f8c47-c042-4430-8d35-07926ad693fe</entry>
Nov 22 07:57:36 user nova-compute[74348]:       <entry name="uuid">765f8c47-c042-4430-8d35-07926ad693fe</entry>
Nov 22 07:57:36 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 07:57:36 user nova-compute[74348]:     </system>
Nov 22 07:57:36 user nova-compute[74348]:   </sysinfo>
Nov 22 07:57:36 user nova-compute[74348]:   <os>
Nov 22 07:57:36 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 07:57:36 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 07:57:36 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 07:57:36 user nova-compute[74348]:   </os>
Nov 22 07:57:36 user nova-compute[74348]:   <features>
Nov 22 07:57:36 user nova-compute[74348]:     <acpi/>
Nov 22 07:57:36 user nova-compute[74348]:     <apic/>
Nov 22 07:57:36 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 07:57:36 user nova-compute[74348]:   </features>
Nov 22 07:57:36 user nova-compute[74348]:   <clock offset="utc">
Nov 22 07:57:36 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 07:57:36 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 07:57:36 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 07:57:36 user nova-compute[74348]:   </clock>
Nov 22 07:57:36 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 07:57:36 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 07:57:36 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 07:57:36 user nova-compute[74348]:   </cpu>
Nov 22 07:57:36 user nova-compute[74348]:   <devices>
Nov 22 07:57:36 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 07:57:36 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 07:57:36 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk"/>
Nov 22 07:57:36 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 07:57:36 user nova-compute[74348]:     </disk>
Nov 22 07:57:36 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 07:57:36 user nova-compute[74348]:       <mac address="fa:16:3e:60:74:68"/>
Nov 22 07:57:36 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:57:36 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 07:57:36 user nova-compute[74348]:       <target dev="tap3ee3f6b1-b9"/>
Nov 22 07:57:36 user nova-compute[74348]:     </interface>
Nov 22 07:57:36 user nova-compute[74348]:     <serial type="pty">
Nov 22 07:57:36 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/console.log" append="off"/>
Nov 22 07:57:36 user nova-compute[74348]:     </serial>
Nov 22 07:57:36 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 07:57:36 user nova-compute[74348]:     <video>
Nov 22 07:57:36 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:57:36 user nova-compute[74348]:     </video>
Nov 22 07:57:36 user nova-compute[74348]:     <rng model="virtio">
Nov 22 07:57:36 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 07:57:36 user nova-compute[74348]:     </rng>
Nov 22 07:57:36 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 07:57:36 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 07:57:36 user nova-compute[74348]:       <stats period="10"/>
Nov 22 07:57:36 user nova-compute[74348]:     </memballoon>
Nov 22 07:57:36 user nova-compute[74348]:   </devices>
Nov 22 07:57:36 user nova-compute[74348]: </domain>
Nov 22 07:57:36 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:57:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1927344265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1927344265',id=16,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a31d898cdc69494a8825e8d93a0d04bc',ramdisk_id='',reservation_id='r-3xazfxkp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-502521972',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:57:34Z,user_data=None,user_id='1d5c8274eca14965b6cbfe22110f904d',uuid=765f8c47-c042-4430-8d35-07926ad693fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ee3f6b1-b929-404a-b3bb-6ece1c2d1052", "address": "fa:16:3e:60:74:68", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee3f6b1-b9", "ovs_interfaceid": "3ee3f6b1-b929-404a-b3bb-6ece1c2d1052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Converting VIF {"id": "3ee3f6b1-b929-404a-b3bb-6ece1c2d1052", "address": "fa:16:3e:60:74:68", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee3f6b1-b9", "ovs_interfaceid": "3ee3f6b1-b929-404a-b3bb-6ece1c2d1052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:74:68,bridge_name='br-int',has_traffic_filtering=True,id=3ee3f6b1-b929-404a-b3bb-6ece1c2d1052,network=Network(6fe60468-191c-4d84-8dce-55c056f88936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ee3f6b1-b9') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG os_vif [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:74:68,bridge_name='br-int',has_traffic_filtering=True,id=3ee3f6b1-b929-404a-b3bb-6ece1c2d1052,network=Network(6fe60468-191c-4d84-8dce-55c056f88936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ee3f6b1-b9') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '83db1d42-3fd6-50d8-9d67-6469da5b3b5d', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ee3f6b1-b9, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3ee3f6b1-b9, col_values=(('qos', UUID('5a26f008-e3ed-4437-995a-bd9e2a6208fd')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3ee3f6b1-b9, col_values=(('external_ids', {'iface-id': '3ee3f6b1-b929-404a-b3bb-6ece1c2d1052', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:74:68', 'vm-uuid': '765f8c47-c042-4430-8d35-07926ad693fe'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:36 user nova-compute[74348]: INFO os_vif [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:74:68,bridge_name='br-int',has_traffic_filtering=True,id=3ee3f6b1-b929-404a-b3bb-6ece1c2d1052,network=Network(6fe60468-191c-4d84-8dce-55c056f88936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ee3f6b1-b9')
Nov 22 07:57:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] No VIF found with MAC fa:16:3e:60:74:68, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:57:36 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:57:37 user nova-compute[74348]: DEBUG nova.network.neutron [req-bfbca981-8f98-45b6-a034-5b136168793b req-35c0f7e4-db9f-48c6-ba84-81b39c341957 service nova] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Updated VIF entry in instance network info cache for port 3ee3f6b1-b929-404a-b3bb-6ece1c2d1052. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 07:57:37 user nova-compute[74348]: DEBUG nova.network.neutron [req-bfbca981-8f98-45b6-a034-5b136168793b req-35c0f7e4-db9f-48c6-ba84-81b39c341957 service nova] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Updating instance_info_cache with network_info: [{"id": "3ee3f6b1-b929-404a-b3bb-6ece1c2d1052", "address": "fa:16:3e:60:74:68", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee3f6b1-b9", "ovs_interfaceid": "3ee3f6b1-b929-404a-b3bb-6ece1c2d1052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:57:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-bfbca981-8f98-45b6-a034-5b136168793b req-35c0f7e4-db9f-48c6-ba84-81b39c341957 service nova] Releasing lock "refresh_cache-765f8c47-c042-4430-8d35-07926ad693fe" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:57:37 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:37 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:37 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:38 user nova-compute[74348]: DEBUG nova.compute.manager [req-cbe152d4-1f3f-4bd9-bf3b-960d81acd843 req-0b13a51e-34bf-49da-98f2-1f3e823799b9 service nova] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Received event network-vif-plugged-3ee3f6b1-b929-404a-b3bb-6ece1c2d1052 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:57:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-cbe152d4-1f3f-4bd9-bf3b-960d81acd843 req-0b13a51e-34bf-49da-98f2-1f3e823799b9 service nova] Acquiring lock "765f8c47-c042-4430-8d35-07926ad693fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:57:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-cbe152d4-1f3f-4bd9-bf3b-960d81acd843 req-0b13a51e-34bf-49da-98f2-1f3e823799b9 service nova] Lock "765f8c47-c042-4430-8d35-07926ad693fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:57:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-cbe152d4-1f3f-4bd9-bf3b-960d81acd843 req-0b13a51e-34bf-49da-98f2-1f3e823799b9 service nova] Lock "765f8c47-c042-4430-8d35-07926ad693fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:57:38 user nova-compute[74348]: DEBUG nova.compute.manager [req-cbe152d4-1f3f-4bd9-bf3b-960d81acd843 req-0b13a51e-34bf-49da-98f2-1f3e823799b9 service nova] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] No waiting events found dispatching network-vif-plugged-3ee3f6b1-b929-404a-b3bb-6ece1c2d1052 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:57:38 user nova-compute[74348]: WARNING nova.compute.manager [req-cbe152d4-1f3f-4bd9-bf3b-960d81acd843 req-0b13a51e-34bf-49da-98f2-1f3e823799b9 service nova] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Received unexpected event network-vif-plugged-3ee3f6b1-b929-404a-b3bb-6ece1c2d1052 for instance with vm_state building and task_state spawning.
Nov 22 07:57:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:40 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 07:57:40 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 07:57:40 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Instance spawned successfully.
Nov 22 07:57:40 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 07:57:40 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:57:40 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:57:40 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:57:40 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:57:40 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:57:40 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:57:40 user nova-compute[74348]: DEBUG nova.compute.manager [req-3c135325-e81d-4e4e-b296-3405b45ad2fc req-b756c942-d470-46bf-9a15-4444bc9ab2b2 service nova] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Received event network-vif-plugged-3ee3f6b1-b929-404a-b3bb-6ece1c2d1052 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:57:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3c135325-e81d-4e4e-b296-3405b45ad2fc req-b756c942-d470-46bf-9a15-4444bc9ab2b2 service nova] Acquiring lock "765f8c47-c042-4430-8d35-07926ad693fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:57:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3c135325-e81d-4e4e-b296-3405b45ad2fc req-b756c942-d470-46bf-9a15-4444bc9ab2b2 service nova] Lock "765f8c47-c042-4430-8d35-07926ad693fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:57:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3c135325-e81d-4e4e-b296-3405b45ad2fc req-b756c942-d470-46bf-9a15-4444bc9ab2b2 service nova] Lock "765f8c47-c042-4430-8d35-07926ad693fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:57:40 user nova-compute[74348]: DEBUG nova.compute.manager [req-3c135325-e81d-4e4e-b296-3405b45ad2fc req-b756c942-d470-46bf-9a15-4444bc9ab2b2 service nova] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] No waiting events found dispatching network-vif-plugged-3ee3f6b1-b929-404a-b3bb-6ece1c2d1052 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:57:40 user nova-compute[74348]: WARNING nova.compute.manager [req-3c135325-e81d-4e4e-b296-3405b45ad2fc req-b756c942-d470-46bf-9a15-4444bc9ab2b2 service nova] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Received unexpected event network-vif-plugged-3ee3f6b1-b929-404a-b3bb-6ece1c2d1052 for instance with vm_state building and task_state spawning.
Nov 22 07:57:40 user nova-compute[74348]: INFO nova.compute.manager [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Took 5.66 seconds to spawn the instance on the hypervisor.
Nov 22 07:57:40 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 07:57:40 user nova-compute[74348]: INFO nova.compute.manager [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Took 6.71 seconds to build instance.
Nov 22 07:57:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ca723841-d96a-4cb9-9c4f-e5d27341c321 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "765f8c47-c042-4430-8d35-07926ad693fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.857s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:57:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:46 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:49 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-1d6d0334-6d7b-45ad-a7c8-fade23bb0e37 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 522f5959-4874-4c61-888d-6fb1cc4d72e6 is timed out.
Nov 22 07:57:49 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-1d6d0334-6d7b-45ad-a7c8-fade23bb0e37 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Successfully detached device vdb from instance 522f5959-4874-4c61-888d-6fb1cc4d72e6 from the live domain config.
Nov 22 07:57:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d6d0334-6d7b-45ad-a7c8-fade23bb0e37 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6d0334-6d7b-45ad-a7c8-fade23bb0e37 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WZYfOwLR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:57:49 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-1d6d0334-6d7b-45ad-a7c8-fade23bb0e37 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:57:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-1d6d0334-6d7b-45ad-a7c8-fade23bb0e37 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-1d6d0334-6d7b-45ad-a7c8-fade23bb0e37 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6922eac-56a6-4016-a190-b0278e4047f4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6d0334-6d7b-45ad-a7c8-fade23bb0e37 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 07:57:49 user nova-compute[74348]: No targets found.
Nov 22 07:57:49 user nova-compute[74348]: iSNS:
Nov 22 07:57:49 user nova-compute[74348]: No targets found.
Nov 22 07:57:49 user nova-compute[74348]: STATIC:
Nov 22 07:57:49 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223
Nov 22 07:57:49 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:57:49 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:57:49 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af
Nov 22 07:57:49 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:57:49 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:57:49 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee
Nov 22 07:57:49 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:57:49 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:57:49 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730
Nov 22 07:57:49 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:57:49 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:57:49 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803
Nov 22 07:57:49 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:57:49 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:57:49 user nova-compute[74348]: FIRMWARE:
Nov 22 07:57:49 user nova-compute[74348]: No targets found.
Nov 22 07:57:49 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6d0334-6d7b-45ad-a7c8-fade23bb0e37 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 07:57:49 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 07:57:49 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6d0334-6d7b-45ad-a7c8-fade23bb0e37 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a38f3b8-6bd6-411e-ab3f-9ae257fff5ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d92f63-0d0e-4b5a-baa0-a99a367c1ca2]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6d0334-6d7b-45ad-a7c8-fade23bb0e37 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:57:49 user nova-compute[74348]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)
Nov 22 07:57:49 user nova-compute[74348]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee (non-flash)
Nov 22 07:57:49 user nova-compute[74348]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 07:57:49 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:57:49 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6d0334-6d7b-45ad-a7c8-fade23bb0e37 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:57:49 user nova-compute[74348]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)
Nov 22 07:57:49 user nova-compute[74348]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee (non-flash)
Nov 22 07:57:49 user nova-compute[74348]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 07:57:49 user nova-compute[74348]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 (non-flash)
Nov 22 07:57:49 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6d0334-6d7b-45ad-a7c8-fade23bb0e37 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f22550bb9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223'): ({'sdi'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-1d6d0334-6d7b-45ad-a7c8-fade23bb0e37 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Removing single pathed devices sdi {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c5fb79-fc39-4b96-8ea9-f6262295d2ac]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b2c46e-755f-450c-84f9-ceb90a4f39c2]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-1d6d0334-6d7b-45ad-a7c8-fade23bb0e37 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Flushing IO for device /dev/sdi {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[21387643-4383-4181-a495-3b74da8b9592]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-1d6d0334-6d7b-45ad-a7c8-fade23bb0e37 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.052s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca47082-fa9d-4f77-bdbf-7657d8797ce7]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-1d6d0334-6d7b-45ad-a7c8-fade23bb0e37 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-1d6d0334-6d7b-45ad-a7c8-fade23bb0e37 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] SCSI volumes sdi have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6d0334-6d7b-45ad-a7c8-fade23bb0e37 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1627f36a-ac9b-4a0a-af1e-a554fa8cb6aa]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6d0334-6d7b-45ad-a7c8-fade23bb0e37 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 -p 172.16.0.220:3260 --logout" returned: 0 in 0.132s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f1c2ec-5f0b-48eb-adaf-66015edbfa5e]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6d0334-6d7b-45ad-a7c8-fade23bb0e37 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223, portal: 172.16.0.220,3260]
Nov 22 07:57:49 user nova-compute[74348]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223, portal: 172.16.0.220,3260] successful.
Nov 22 07:57:49 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c375792-1e67-4f49-81d8-fb2d11c2e223 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[077a7641-f53e-4a44-98d9-c4c097037126]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6d0334-6d7b-45ad-a7c8-fade23bb0e37 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-1d6d0334-6d7b-45ad-a7c8-fade23bb0e37 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.430s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6d0334-6d7b-45ad-a7c8-fade23bb0e37 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] <== disconnect_volume: return (431ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:57:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d6d0334-6d7b-45ad-a7c8-fade23bb0e37 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 07:57:50 user nova-compute[74348]: DEBUG nova.objects.instance [None req-1d6d0334-6d7b-45ad-a7c8-fade23bb0e37 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lazy-loading 'flavor' on Instance uuid 522f5959-4874-4c61-888d-6fb1cc4d72e6 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:57:50 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1d6d0334-6d7b-45ad-a7c8-fade23bb0e37 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "522f5959-4874-4c61-888d-6fb1cc4d72e6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.122s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:57:51 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Acquiring lock "abd7f2ed-b0c4-4e05-8161-b141a611f125" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:57:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Lock "abd7f2ed-b0c4-4e05-8161-b141a611f125" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:57:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Acquiring lock "abd7f2ed-b0c4-4e05-8161-b141a611f125-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:57:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Lock "abd7f2ed-b0c4-4e05-8161-b141a611f125-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:57:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Lock "abd7f2ed-b0c4-4e05-8161-b141a611f125-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:57:57 user nova-compute[74348]: INFO nova.compute.manager [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Terminating instance
Nov 22 07:57:57 user nova-compute[74348]: DEBUG nova.compute.manager [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 07:57:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:57 user nova-compute[74348]: DEBUG nova.compute.manager [req-d338a419-b400-4175-a80c-553a87807f1f req-c8a53e57-2091-4e14-b489-68b588f42c9b service nova] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Received event network-vif-unplugged-c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:57:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d338a419-b400-4175-a80c-553a87807f1f req-c8a53e57-2091-4e14-b489-68b588f42c9b service nova] Acquiring lock "abd7f2ed-b0c4-4e05-8161-b141a611f125-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:57:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d338a419-b400-4175-a80c-553a87807f1f req-c8a53e57-2091-4e14-b489-68b588f42c9b service nova] Lock "abd7f2ed-b0c4-4e05-8161-b141a611f125-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:57:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d338a419-b400-4175-a80c-553a87807f1f req-c8a53e57-2091-4e14-b489-68b588f42c9b service nova] Lock "abd7f2ed-b0c4-4e05-8161-b141a611f125-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:57:57 user nova-compute[74348]: DEBUG nova.compute.manager [req-d338a419-b400-4175-a80c-553a87807f1f req-c8a53e57-2091-4e14-b489-68b588f42c9b service nova] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] No waiting events found dispatching network-vif-unplugged-c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:57:57 user nova-compute[74348]: DEBUG nova.compute.manager [req-d338a419-b400-4175-a80c-553a87807f1f req-c8a53e57-2091-4e14-b489-68b588f42c9b service nova] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Received event network-vif-unplugged-c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3 for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 07:57:58 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Instance destroyed successfully.
Nov 22 07:57:58 user nova-compute[74348]: DEBUG nova.objects.instance [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Lazy-loading 'resources' on Instance uuid abd7f2ed-b0c4-4e05-8161-b141a611f125 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-22T07:53:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-478037569',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1680569585',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO27qptUwzzdqwLnhCZkr2apu987NWn6IIEhHr7PT4GpTS02zQZcCrEc7XvQW2xsPa1rEu/bPT5i3T2uHMpmNx2zLdQ2Q19AVu91BBTgcbEZQzR0OotNI2TgNid7aWNdEg==',key_name='tempest-keypair-2082604002',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:56:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac4a9f365081417e81c935755cb6ddb7',ramdisk_id='',reservation_id='r-2h02xod7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-628585113',owner_user_name='tempest-ServerActionsV293TestJSON-628585113-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T07:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad47d30fba8048b99bf017fc43335532',uuid=abd7f2ed-b0c4-4e05-8161-b141a611f125,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3", "address": "fa:16:3e:d1:85:73", "network": {"id": "5826faef-2095-4993-a655-a168237a5018", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1612032334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac4a9f365081417e81c935755cb6ddb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f3237e-bc", "ovs_interfaceid": "c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Converting VIF {"id": "c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3", "address": "fa:16:3e:d1:85:73", "network": {"id": "5826faef-2095-4993-a655-a168237a5018", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1612032334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac4a9f365081417e81c935755cb6ddb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f3237e-bc", "ovs_interfaceid": "c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:85:73,bridge_name='br-int',has_traffic_filtering=True,id=c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3,network=Network(5826faef-2095-4993-a655-a168237a5018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f3237e-bc') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG os_vif [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:85:73,bridge_name='br-int',has_traffic_filtering=True,id=c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3,network=Network(5826faef-2095-4993-a655-a168237a5018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f3237e-bc') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc6f3237e-bc, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8b2ec1fe-d2e4-422f-afb1-99803c2693e4) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:58 user nova-compute[74348]: INFO os_vif [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:85:73,bridge_name='br-int',has_traffic_filtering=True,id=c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3,network=Network(5826faef-2095-4993-a655-a168237a5018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f3237e-bc')
Nov 22 07:57:58 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UHWXwBSk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:57:58 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:57:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec15345-e961-4710-94a4-fe723ea72dbb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 07:57:58 user nova-compute[74348]: No targets found.
Nov 22 07:57:58 user nova-compute[74348]: iSNS:
Nov 22 07:57:58 user nova-compute[74348]: No targets found.
Nov 22 07:57:58 user nova-compute[74348]: STATIC:
Nov 22 07:57:58 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af
Nov 22 07:57:58 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:57:58 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:57:58 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee
Nov 22 07:57:58 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:57:58 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:57:58 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730
Nov 22 07:57:58 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:57:58 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:57:58 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803
Nov 22 07:57:58 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:57:58 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:57:58 user nova-compute[74348]: FIRMWARE:
Nov 22 07:57:58 user nova-compute[74348]: No targets found.
Nov 22 07:57:58 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 07:57:58 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 07:57:58 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4062337e-bd0f-4363-b48c-a592fb5155f3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd11c38d-0ece-4af2-9edf-8d19c8ddd07d]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:57:58 user nova-compute[74348]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)
Nov 22 07:57:58 user nova-compute[74348]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee (non-flash)
Nov 22 07:57:58 user nova-compute[74348]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 07:57:58 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af (non-flash)
Nov 22 07:57:58 user nova-compute[74348]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)
Nov 22 07:57:58 user nova-compute[74348]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee (non-flash)
Nov 22 07:57:58 user nova-compute[74348]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 07:57:58 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f222832bc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af'): ({'sdc'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Removing single pathed devices sdc {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1461a94e-0dbe-4649-bf25-1088caf47f4b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8f8eb9-95f9-4dde-97b8-222095dc2782]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Flushing IO for device /dev/sdc {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f2574a-58d3-4104-9e8e-923d6662565d]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50187d9-c81d-47ec-b4b3-ced4761e4625]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] SCSI volumes sdc have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23336393336653864', '/dev/disk/by-id/scsi-1SCST_BIO68ed5984-36936e8d9ab624ea', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_68ed5984') {{(pid=85159) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7d4cdf-f62e-419f-b18c-80ee92f625c8]: (4, None) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7297a43-7eac-42fa-ae6b-c856cfca70bb]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e15f79-17a2-4534-9e05-9094d52dbedc]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af, portal: 172.16.0.220,3260]
Nov 22 07:57:58 user nova-compute[74348]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af, portal: 172.16.0.220,3260] successful.
Nov 22 07:57:58 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf17ece2-1f33-4fa3-af81-8534b3fe79af -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aade409-1c3d-4787-b8ac-1a26129d85bb]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] <== disconnect_volume: return (383ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 07:57:58 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Deleting instance files /opt/stack/data/nova/instances/abd7f2ed-b0c4-4e05-8161-b141a611f125_del
Nov 22 07:57:58 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Deletion of /opt/stack/data/nova/instances/abd7f2ed-b0c4-4e05-8161-b141a611f125_del complete
Nov 22 07:57:58 user nova-compute[74348]: INFO nova.compute.manager [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Took 1.35 seconds to destroy the instance on the hypervisor.
Nov 22 07:57:58 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 07:57:58 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 07:57:59 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:57:59 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Took 0.82 seconds to deallocate network for instance.
Nov 22 07:58:00 user nova-compute[74348]: DEBUG nova.compute.manager [req-d8179290-37fc-4298-ac2b-ac4b529b458b req-3538eaab-1c46-4e4a-804a-ed0f0ad77a97 service nova] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Received event network-vif-plugged-c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:58:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d8179290-37fc-4298-ac2b-ac4b529b458b req-3538eaab-1c46-4e4a-804a-ed0f0ad77a97 service nova] Acquiring lock "abd7f2ed-b0c4-4e05-8161-b141a611f125-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:58:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d8179290-37fc-4298-ac2b-ac4b529b458b req-3538eaab-1c46-4e4a-804a-ed0f0ad77a97 service nova] Lock "abd7f2ed-b0c4-4e05-8161-b141a611f125-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:58:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d8179290-37fc-4298-ac2b-ac4b529b458b req-3538eaab-1c46-4e4a-804a-ed0f0ad77a97 service nova] Lock "abd7f2ed-b0c4-4e05-8161-b141a611f125-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:58:00 user nova-compute[74348]: DEBUG nova.compute.manager [req-d8179290-37fc-4298-ac2b-ac4b529b458b req-3538eaab-1c46-4e4a-804a-ed0f0ad77a97 service nova] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] No waiting events found dispatching network-vif-plugged-c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:58:00 user nova-compute[74348]: WARNING nova.compute.manager [req-d8179290-37fc-4298-ac2b-ac4b529b458b req-3538eaab-1c46-4e4a-804a-ed0f0ad77a97 service nova] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Received unexpected event network-vif-plugged-c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3 for instance with vm_state active and task_state deleting.
Nov 22 07:58:00 user nova-compute[74348]: DEBUG nova.compute.manager [req-d8179290-37fc-4298-ac2b-ac4b529b458b req-3538eaab-1c46-4e4a-804a-ed0f0ad77a97 service nova] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Received event network-vif-deleted-c6f3237e-bc9c-4ef9-b036-cafe52ec5dd3 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:58:00 user nova-compute[74348]: INFO nova.compute.manager [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Took 0.85 seconds to detach 1 volumes for instance.
Nov 22 07:58:00 user nova-compute[74348]: DEBUG nova.compute.manager [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] [instance: abd7f2ed-b0c4-4e05-8161-b141a611f125] Deleting volume: bf17ece2-1f33-4fa3-af81-8534b3fe79af {{(pid=74348) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 22 07:58:00 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:58:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:58:01 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:58:01 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:58:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.550s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:58:01 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Deleted allocations for instance abd7f2ed-b0c4-4e05-8161-b141a611f125
Nov 22 07:58:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-74ac2382-9db3-4b22-b1e5-c32ed2794e8a tempest-ServerActionsV293TestJSON-628585113 tempest-ServerActionsV293TestJSON-628585113-project-member] Lock "abd7f2ed-b0c4-4e05-8161-b141a611f125" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.052s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:58:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Acquiring lock "84fd55a1-d62e-4191-923e-b5bf7cb47490" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:58:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Lock "84fd55a1-d62e-4191-923e-b5bf7cb47490" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:58:17 user nova-compute[74348]: DEBUG nova.compute.manager [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 07:58:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:58:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:58:17 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 07:58:17 user nova-compute[74348]: INFO nova.compute.claims [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Claim successful on node user
Nov 22 07:58:17 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:58:17 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:58:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.432s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:58:17 user nova-compute[74348]: DEBUG nova.compute.manager [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 07:58:17 user nova-compute[74348]: DEBUG nova.compute.manager [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 07:58:17 user nova-compute[74348]: DEBUG nova.network.neutron [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 07:58:17 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 07:58:17 user nova-compute[74348]: DEBUG nova.compute.manager [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 07:58:17 user nova-compute[74348]: DEBUG nova.policy [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f6622dc18fbf43928613859e101d3ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98fce8c0dad44e4a3eed3886fa5defc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 07:58:17 user nova-compute[74348]: DEBUG nova.compute.manager [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 07:58:17 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 07:58:17 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Creating image(s)
Nov 22 07:58:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Acquiring lock "/opt/stack/data/nova/instances/84fd55a1-d62e-4191-923e-b5bf7cb47490/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:58:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Lock "/opt/stack/data/nova/instances/84fd55a1-d62e-4191-923e-b5bf7cb47490/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:58:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Lock "/opt/stack/data/nova/instances/84fd55a1-d62e-4191-923e-b5bf7cb47490/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:58:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.180s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Acquiring lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:58:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:58:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.180s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/84fd55a1-d62e-4191-923e-b5bf7cb47490/disk 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/84fd55a1-d62e-4191-923e-b5bf7cb47490/disk 1073741824" returned: 0 in 0.057s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:58:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:18 user nova-compute[74348]: DEBUG nova.network.neutron [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Successfully created port: a74a748c-17ee-4a29-b4da-175f7e2dec75 {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 07:58:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.187s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:18 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Checking if we can resize image /opt/stack/data/nova/instances/84fd55a1-d62e-4191-923e-b5bf7cb47490/disk. size=1073741824 {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 07:58:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84fd55a1-d62e-4191-923e-b5bf7cb47490/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84fd55a1-d62e-4191-923e-b5bf7cb47490/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:18 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Cannot resize image /opt/stack/data/nova/instances/84fd55a1-d62e-4191-923e-b5bf7cb47490/disk to a smaller size. {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 07:58:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 07:58:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Ensure instance console log exists: /opt/stack/data/nova/instances/84fd55a1-d62e-4191-923e-b5bf7cb47490/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 07:58:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:58:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:58:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:58:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9a170b65-acbd-46c0-abf9-ebc19410e8e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "522f5959-4874-4c61-888d-6fb1cc4d72e6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:58:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9a170b65-acbd-46c0-abf9-ebc19410e8e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "522f5959-4874-4c61-888d-6fb1cc4d72e6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:58:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9a170b65-acbd-46c0-abf9-ebc19410e8e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "522f5959-4874-4c61-888d-6fb1cc4d72e6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:58:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9a170b65-acbd-46c0-abf9-ebc19410e8e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "522f5959-4874-4c61-888d-6fb1cc4d72e6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:58:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9a170b65-acbd-46c0-abf9-ebc19410e8e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "522f5959-4874-4c61-888d-6fb1cc4d72e6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:58:18 user nova-compute[74348]: INFO nova.compute.manager [None req-9a170b65-acbd-46c0-abf9-ebc19410e8e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Terminating instance
Nov 22 07:58:18 user nova-compute[74348]: DEBUG nova.compute.manager [None req-9a170b65-acbd-46c0-abf9-ebc19410e8e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 07:58:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:19 user nova-compute[74348]: DEBUG nova.compute.manager [req-7865c903-90d0-4530-8180-39a22ac25938 req-023c27d5-b089-44f0-90a7-d53cacc93ecc service nova] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Received event network-vif-unplugged-72ea4eea-6e08-44b2-9274-0f849d534f05 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:58:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-7865c903-90d0-4530-8180-39a22ac25938 req-023c27d5-b089-44f0-90a7-d53cacc93ecc service nova] Acquiring lock "522f5959-4874-4c61-888d-6fb1cc4d72e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:58:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-7865c903-90d0-4530-8180-39a22ac25938 req-023c27d5-b089-44f0-90a7-d53cacc93ecc service nova] Lock "522f5959-4874-4c61-888d-6fb1cc4d72e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:58:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-7865c903-90d0-4530-8180-39a22ac25938 req-023c27d5-b089-44f0-90a7-d53cacc93ecc service nova] Lock "522f5959-4874-4c61-888d-6fb1cc4d72e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:58:19 user nova-compute[74348]: DEBUG nova.compute.manager [req-7865c903-90d0-4530-8180-39a22ac25938 req-023c27d5-b089-44f0-90a7-d53cacc93ecc service nova] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] No waiting events found dispatching network-vif-unplugged-72ea4eea-6e08-44b2-9274-0f849d534f05 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:58:19 user nova-compute[74348]: DEBUG nova.compute.manager [req-7865c903-90d0-4530-8180-39a22ac25938 req-023c27d5-b089-44f0-90a7-d53cacc93ecc service nova] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Received event network-vif-unplugged-72ea4eea-6e08-44b2-9274-0f849d534f05 for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 07:58:19 user nova-compute[74348]: DEBUG nova.network.neutron [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Successfully updated port: a74a748c-17ee-4a29-b4da-175f7e2dec75 {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 07:58:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Acquiring lock "refresh_cache-84fd55a1-d62e-4191-923e-b5bf7cb47490" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:58:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Acquired lock "refresh_cache-84fd55a1-d62e-4191-923e-b5bf7cb47490" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:58:19 user nova-compute[74348]: DEBUG nova.network.neutron [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 07:58:19 user nova-compute[74348]: DEBUG nova.network.neutron [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 07:58:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:19 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Instance destroyed successfully.
Nov 22 07:58:19 user nova-compute[74348]: DEBUG nova.objects.instance [None req-9a170b65-acbd-46c0-abf9-ebc19410e8e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lazy-loading 'resources' on Instance uuid 522f5959-4874-4c61-888d-6fb1cc4d72e6 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:58:19 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-9a170b65-acbd-46c0-abf9-ebc19410e8e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:52:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1983625057',display_name='tempest-AttachVolumeNegativeTest-server-1983625057',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1983625057',id=2,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUEUSzbhctY9QxlGiT7YnV5JvIkRFZox5OS7b+KfaYmQXTXFpWhe/1XseZC4+mBl1JkBrsltqpkgU7fseXZPlbodnE7rHw58wKDjvvRxRJ5zkvyLCGi1M8DnDfwOYoRog==',key_name='tempest-keypair-1590408668',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:52:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f569146bb9b04838ad8044260da6ad58',ramdisk_id='',reservation_id='r-od43lihf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1606364171',owner_user_name='tempest-AttachVolumeNegativeTest-1606364171-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T07:52:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8eca17e3a564220b3b07af4eddadaca',uuid=522f5959-4874-4c61-888d-6fb1cc4d72e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72ea4eea-6e08-44b2-9274-0f849d534f05", "address": "fa:16:3e:1e:82:7c", "network": {"id": "5c50496a-0882-415b-8115-ddf7b65516a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-531638472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f569146bb9b04838ad8044260da6ad58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72ea4eea-6e", "ovs_interfaceid": "72ea4eea-6e08-44b2-9274-0f849d534f05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 07:58:19 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-9a170b65-acbd-46c0-abf9-ebc19410e8e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Converting VIF {"id": "72ea4eea-6e08-44b2-9274-0f849d534f05", "address": "fa:16:3e:1e:82:7c", "network": {"id": "5c50496a-0882-415b-8115-ddf7b65516a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-531638472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f569146bb9b04838ad8044260da6ad58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72ea4eea-6e", "ovs_interfaceid": "72ea4eea-6e08-44b2-9274-0f849d534f05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:58:19 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-9a170b65-acbd-46c0-abf9-ebc19410e8e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:82:7c,bridge_name='br-int',has_traffic_filtering=True,id=72ea4eea-6e08-44b2-9274-0f849d534f05,network=Network(5c50496a-0882-415b-8115-ddf7b65516a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72ea4eea-6e') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:58:19 user nova-compute[74348]: DEBUG os_vif [None req-9a170b65-acbd-46c0-abf9-ebc19410e8e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:82:7c,bridge_name='br-int',has_traffic_filtering=True,id=72ea4eea-6e08-44b2-9274-0f849d534f05,network=Network(5c50496a-0882-415b-8115-ddf7b65516a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72ea4eea-6e') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 07:58:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72ea4eea-6e, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:58:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:58:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e1d445c5-8939-4620-848e-c95dca0a1db6) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:58:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:58:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:19 user nova-compute[74348]: INFO os_vif [None req-9a170b65-acbd-46c0-abf9-ebc19410e8e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:82:7c,bridge_name='br-int',has_traffic_filtering=True,id=72ea4eea-6e08-44b2-9274-0f849d534f05,network=Network(5c50496a-0882-415b-8115-ddf7b65516a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72ea4eea-6e')
Nov 22 07:58:19 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-9a170b65-acbd-46c0-abf9-ebc19410e8e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Deleting instance files /opt/stack/data/nova/instances/522f5959-4874-4c61-888d-6fb1cc4d72e6_del
Nov 22 07:58:19 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-9a170b65-acbd-46c0-abf9-ebc19410e8e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Deletion of /opt/stack/data/nova/instances/522f5959-4874-4c61-888d-6fb1cc4d72e6_del complete
Nov 22 07:58:19 user nova-compute[74348]: INFO nova.compute.manager [None req-9a170b65-acbd-46c0-abf9-ebc19410e8e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 22 07:58:19 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-9a170b65-acbd-46c0-abf9-ebc19410e8e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 07:58:19 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 07:58:19 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG nova.network.neutron [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Updating instance_info_cache with network_info: [{"id": "a74a748c-17ee-4a29-b4da-175f7e2dec75", "address": "fa:16:3e:5b:e5:05", "network": {"id": "9687a505-bb8c-4081-a331-cfd06e876714", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1471469940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a98fce8c0dad44e4a3eed3886fa5defc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74a748c-17", "ovs_interfaceid": "a74a748c-17ee-4a29-b4da-175f7e2dec75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Releasing lock "refresh_cache-84fd55a1-d62e-4191-923e-b5bf7cb47490" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG nova.compute.manager [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Instance network_info: |[{"id": "a74a748c-17ee-4a29-b4da-175f7e2dec75", "address": "fa:16:3e:5b:e5:05", "network": {"id": "9687a505-bb8c-4081-a331-cfd06e876714", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1471469940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a98fce8c0dad44e4a3eed3886fa5defc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74a748c-17", "ovs_interfaceid": "a74a748c-17ee-4a29-b4da-175f7e2dec75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Start _get_guest_xml network_info=[{"id": "a74a748c-17ee-4a29-b4da-175f7e2dec75", "address": "fa:16:3e:5b:e5:05", "network": {"id": "9687a505-bb8c-4081-a331-cfd06e876714", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1471469940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a98fce8c0dad44e4a3eed3886fa5defc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74a748c-17", "ovs_interfaceid": "a74a748c-17ee-4a29-b4da-175f7e2dec75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 07:58:20 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:58:20 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:58:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:58:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1710593216',display_name='tempest-DeleteServersTestJSON-server-1710593216',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1710593216',id=17,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a98fce8c0dad44e4a3eed3886fa5defc',ramdisk_id='',reservation_id='r-fihgnmmm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1803229756',owner_user_name='tempest-DeleteServersTestJSON-1803229756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:58:18Z,user_data=None,user_id='f6622dc18fbf43928613859e101d3ca9',uuid=84fd55a1-d62e-4191-923e-b5bf7cb47490,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a74a748c-17ee-4a29-b4da-175f7e2dec75", "address": "fa:16:3e:5b:e5:05", "network": {"id": "9687a505-bb8c-4081-a331-cfd06e876714", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1471469940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a98fce8c0dad44e4a3eed3886fa5defc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74a748c-17", "ovs_interfaceid": "a74a748c-17ee-4a29-b4da-175f7e2dec75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Converting VIF {"id": "a74a748c-17ee-4a29-b4da-175f7e2dec75", "address": "fa:16:3e:5b:e5:05", "network": {"id": "9687a505-bb8c-4081-a331-cfd06e876714", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1471469940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a98fce8c0dad44e4a3eed3886fa5defc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74a748c-17", "ovs_interfaceid": "a74a748c-17ee-4a29-b4da-175f7e2dec75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:e5:05,bridge_name='br-int',has_traffic_filtering=True,id=a74a748c-17ee-4a29-b4da-175f7e2dec75,network=Network(9687a505-bb8c-4081-a331-cfd06e876714),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa74a748c-17') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG nova.objects.instance [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Lazy-loading 'pci_devices' on Instance uuid 84fd55a1-d62e-4191-923e-b5bf7cb47490 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] End _get_guest_xml xml=<domain type="kvm">
Nov 22 07:58:20 user nova-compute[74348]:   <uuid>84fd55a1-d62e-4191-923e-b5bf7cb47490</uuid>
Nov 22 07:58:20 user nova-compute[74348]:   <name>instance-00000011</name>
Nov 22 07:58:20 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 07:58:20 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 07:58:20 user nova-compute[74348]:   <metadata>
Nov 22 07:58:20 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 07:58:20 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 07:58:20 user nova-compute[74348]:       <nova:name>tempest-DeleteServersTestJSON-server-1710593216</nova:name>
Nov 22 07:58:20 user nova-compute[74348]:       <nova:creationTime>2023-11-22 07:58:20</nova:creationTime>
Nov 22 07:58:20 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 07:58:20 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 07:58:20 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 07:58:20 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 07:58:20 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 07:58:20 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 07:58:20 user nova-compute[74348]:       </nova:flavor>
Nov 22 07:58:20 user nova-compute[74348]:       <nova:owner>
Nov 22 07:58:20 user nova-compute[74348]:         <nova:user uuid="f6622dc18fbf43928613859e101d3ca9">tempest-DeleteServersTestJSON-1803229756-project-member</nova:user>
Nov 22 07:58:20 user nova-compute[74348]:         <nova:project uuid="a98fce8c0dad44e4a3eed3886fa5defc">tempest-DeleteServersTestJSON-1803229756</nova:project>
Nov 22 07:58:20 user nova-compute[74348]:       </nova:owner>
Nov 22 07:58:20 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 07:58:20 user nova-compute[74348]:       <nova:ports>
Nov 22 07:58:20 user nova-compute[74348]:         <nova:port uuid="a74a748c-17ee-4a29-b4da-175f7e2dec75">
Nov 22 07:58:20 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 22 07:58:20 user nova-compute[74348]:         </nova:port>
Nov 22 07:58:20 user nova-compute[74348]:       </nova:ports>
Nov 22 07:58:20 user nova-compute[74348]:     </nova:instance>
Nov 22 07:58:20 user nova-compute[74348]:   </metadata>
Nov 22 07:58:20 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 07:58:20 user nova-compute[74348]:     <system>
Nov 22 07:58:20 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 07:58:20 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 07:58:20 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 07:58:20 user nova-compute[74348]:       <entry name="serial">84fd55a1-d62e-4191-923e-b5bf7cb47490</entry>
Nov 22 07:58:20 user nova-compute[74348]:       <entry name="uuid">84fd55a1-d62e-4191-923e-b5bf7cb47490</entry>
Nov 22 07:58:20 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 07:58:20 user nova-compute[74348]:     </system>
Nov 22 07:58:20 user nova-compute[74348]:   </sysinfo>
Nov 22 07:58:20 user nova-compute[74348]:   <os>
Nov 22 07:58:20 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 07:58:20 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 07:58:20 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 07:58:20 user nova-compute[74348]:   </os>
Nov 22 07:58:20 user nova-compute[74348]:   <features>
Nov 22 07:58:20 user nova-compute[74348]:     <acpi/>
Nov 22 07:58:20 user nova-compute[74348]:     <apic/>
Nov 22 07:58:20 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 07:58:20 user nova-compute[74348]:   </features>
Nov 22 07:58:20 user nova-compute[74348]:   <clock offset="utc">
Nov 22 07:58:20 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 07:58:20 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 07:58:20 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 07:58:20 user nova-compute[74348]:   </clock>
Nov 22 07:58:20 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 07:58:20 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 07:58:20 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 07:58:20 user nova-compute[74348]:   </cpu>
Nov 22 07:58:20 user nova-compute[74348]:   <devices>
Nov 22 07:58:20 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 07:58:20 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 07:58:20 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/84fd55a1-d62e-4191-923e-b5bf7cb47490/disk"/>
Nov 22 07:58:20 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 07:58:20 user nova-compute[74348]:     </disk>
Nov 22 07:58:20 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 07:58:20 user nova-compute[74348]:       <mac address="fa:16:3e:5b:e5:05"/>
Nov 22 07:58:20 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:58:20 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 07:58:20 user nova-compute[74348]:       <target dev="tapa74a748c-17"/>
Nov 22 07:58:20 user nova-compute[74348]:     </interface>
Nov 22 07:58:20 user nova-compute[74348]:     <serial type="pty">
Nov 22 07:58:20 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/84fd55a1-d62e-4191-923e-b5bf7cb47490/console.log" append="off"/>
Nov 22 07:58:20 user nova-compute[74348]:     </serial>
Nov 22 07:58:20 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 07:58:20 user nova-compute[74348]:     <video>
Nov 22 07:58:20 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:58:20 user nova-compute[74348]:     </video>
Nov 22 07:58:20 user nova-compute[74348]:     <rng model="virtio">
Nov 22 07:58:20 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 07:58:20 user nova-compute[74348]:     </rng>
Nov 22 07:58:20 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 07:58:20 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 07:58:20 user nova-compute[74348]:       <stats period="10"/>
Nov 22 07:58:20 user nova-compute[74348]:     </memballoon>
Nov 22 07:58:20 user nova-compute[74348]:   </devices>
Nov 22 07:58:20 user nova-compute[74348]: </domain>
Nov 22 07:58:20 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:58:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1710593216',display_name='tempest-DeleteServersTestJSON-server-1710593216',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1710593216',id=17,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a98fce8c0dad44e4a3eed3886fa5defc',ramdisk_id='',reservation_id='r-fihgnmmm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1803229756',owner_user_name='tempest-DeleteServersTestJSON-1803229756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:58:18Z,user_data=None,user_id='f6622dc18fbf43928613859e101d3ca9',uuid=84fd55a1-d62e-4191-923e-b5bf7cb47490,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a74a748c-17ee-4a29-b4da-175f7e2dec75", "address": "fa:16:3e:5b:e5:05", "network": {"id": "9687a505-bb8c-4081-a331-cfd06e876714", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1471469940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a98fce8c0dad44e4a3eed3886fa5defc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74a748c-17", "ovs_interfaceid": "a74a748c-17ee-4a29-b4da-175f7e2dec75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Converting VIF {"id": "a74a748c-17ee-4a29-b4da-175f7e2dec75", "address": "fa:16:3e:5b:e5:05", "network": {"id": "9687a505-bb8c-4081-a331-cfd06e876714", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1471469940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a98fce8c0dad44e4a3eed3886fa5defc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74a748c-17", "ovs_interfaceid": "a74a748c-17ee-4a29-b4da-175f7e2dec75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:e5:05,bridge_name='br-int',has_traffic_filtering=True,id=a74a748c-17ee-4a29-b4da-175f7e2dec75,network=Network(9687a505-bb8c-4081-a331-cfd06e876714),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa74a748c-17') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG os_vif [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:e5:05,bridge_name='br-int',has_traffic_filtering=True,id=a74a748c-17ee-4a29-b4da-175f7e2dec75,network=Network(9687a505-bb8c-4081-a331-cfd06e876714),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa74a748c-17') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e3fb09c7-182f-5acd-8c9c-8268e7afc92e', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa74a748c-17, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa74a748c-17, col_values=(('qos', UUID('f414d97e-dddc-4678-81fa-45bcb818addf')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa74a748c-17, col_values=(('external_ids', {'iface-id': 'a74a748c-17ee-4a29-b4da-175f7e2dec75', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:e5:05', 'vm-uuid': '84fd55a1-d62e-4191-923e-b5bf7cb47490'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:20 user nova-compute[74348]: INFO os_vif [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:e5:05,bridge_name='br-int',has_traffic_filtering=True,id=a74a748c-17ee-4a29-b4da-175f7e2dec75,network=Network(9687a505-bb8c-4081-a331-cfd06e876714),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa74a748c-17')
Nov 22 07:58:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:58:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] No VIF found with MAC fa:16:3e:5b:e5:05, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 07:58:21 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:58:21 user nova-compute[74348]: DEBUG nova.compute.manager [req-9df37294-678c-44a6-b328-50fc1ac8d9ec req-cd02cd5e-a09b-4625-b4ac-749ef3c65556 service nova] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Received event network-changed-a74a748c-17ee-4a29-b4da-175f7e2dec75 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:58:21 user nova-compute[74348]: DEBUG nova.compute.manager [req-9df37294-678c-44a6-b328-50fc1ac8d9ec req-cd02cd5e-a09b-4625-b4ac-749ef3c65556 service nova] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Refreshing instance network info cache due to event network-changed-a74a748c-17ee-4a29-b4da-175f7e2dec75. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:58:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9df37294-678c-44a6-b328-50fc1ac8d9ec req-cd02cd5e-a09b-4625-b4ac-749ef3c65556 service nova] Acquiring lock "refresh_cache-84fd55a1-d62e-4191-923e-b5bf7cb47490" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:58:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9df37294-678c-44a6-b328-50fc1ac8d9ec req-cd02cd5e-a09b-4625-b4ac-749ef3c65556 service nova] Acquired lock "refresh_cache-84fd55a1-d62e-4191-923e-b5bf7cb47490" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:58:21 user nova-compute[74348]: DEBUG nova.network.neutron [req-9df37294-678c-44a6-b328-50fc1ac8d9ec req-cd02cd5e-a09b-4625-b4ac-749ef3c65556 service nova] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Refreshing network info cache for port a74a748c-17ee-4a29-b4da-175f7e2dec75 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:58:21 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Took 1.66 seconds to deallocate network for instance.
Nov 22 07:58:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9a170b65-acbd-46c0-abf9-ebc19410e8e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:58:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9a170b65-acbd-46c0-abf9-ebc19410e8e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:58:22 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-9a170b65-acbd-46c0-abf9-ebc19410e8e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:58:22 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-9a170b65-acbd-46c0-abf9-ebc19410e8e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:58:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9a170b65-acbd-46c0-abf9-ebc19410e8e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.390s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:58:22 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-9a170b65-acbd-46c0-abf9-ebc19410e8e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Deleted allocations for instance 522f5959-4874-4c61-888d-6fb1cc4d72e6
Nov 22 07:58:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9a170b65-acbd-46c0-abf9-ebc19410e8e4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "522f5959-4874-4c61-888d-6fb1cc4d72e6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.320s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:58:22 user nova-compute[74348]: DEBUG nova.network.neutron [req-9df37294-678c-44a6-b328-50fc1ac8d9ec req-cd02cd5e-a09b-4625-b4ac-749ef3c65556 service nova] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Updated VIF entry in instance network info cache for port a74a748c-17ee-4a29-b4da-175f7e2dec75. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 07:58:22 user nova-compute[74348]: DEBUG nova.network.neutron [req-9df37294-678c-44a6-b328-50fc1ac8d9ec req-cd02cd5e-a09b-4625-b4ac-749ef3c65556 service nova] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Updating instance_info_cache with network_info: [{"id": "a74a748c-17ee-4a29-b4da-175f7e2dec75", "address": "fa:16:3e:5b:e5:05", "network": {"id": "9687a505-bb8c-4081-a331-cfd06e876714", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1471469940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a98fce8c0dad44e4a3eed3886fa5defc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74a748c-17", "ovs_interfaceid": "a74a748c-17ee-4a29-b4da-175f7e2dec75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:58:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9df37294-678c-44a6-b328-50fc1ac8d9ec req-cd02cd5e-a09b-4625-b4ac-749ef3c65556 service nova] Releasing lock "refresh_cache-84fd55a1-d62e-4191-923e-b5bf7cb47490" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:58:22 user nova-compute[74348]: DEBUG nova.compute.manager [req-9df37294-678c-44a6-b328-50fc1ac8d9ec req-cd02cd5e-a09b-4625-b4ac-749ef3c65556 service nova] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Received event network-vif-plugged-72ea4eea-6e08-44b2-9274-0f849d534f05 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:58:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9df37294-678c-44a6-b328-50fc1ac8d9ec req-cd02cd5e-a09b-4625-b4ac-749ef3c65556 service nova] Acquiring lock "522f5959-4874-4c61-888d-6fb1cc4d72e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:58:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9df37294-678c-44a6-b328-50fc1ac8d9ec req-cd02cd5e-a09b-4625-b4ac-749ef3c65556 service nova] Lock "522f5959-4874-4c61-888d-6fb1cc4d72e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:58:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9df37294-678c-44a6-b328-50fc1ac8d9ec req-cd02cd5e-a09b-4625-b4ac-749ef3c65556 service nova] Lock "522f5959-4874-4c61-888d-6fb1cc4d72e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:58:22 user nova-compute[74348]: DEBUG nova.compute.manager [req-9df37294-678c-44a6-b328-50fc1ac8d9ec req-cd02cd5e-a09b-4625-b4ac-749ef3c65556 service nova] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] No waiting events found dispatching network-vif-plugged-72ea4eea-6e08-44b2-9274-0f849d534f05 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:58:22 user nova-compute[74348]: WARNING nova.compute.manager [req-9df37294-678c-44a6-b328-50fc1ac8d9ec req-cd02cd5e-a09b-4625-b4ac-749ef3c65556 service nova] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Received unexpected event network-vif-plugged-72ea4eea-6e08-44b2-9274-0f849d534f05 for instance with vm_state active and task_state deleting.
Nov 22 07:58:22 user nova-compute[74348]: DEBUG nova.compute.manager [req-9df37294-678c-44a6-b328-50fc1ac8d9ec req-cd02cd5e-a09b-4625-b4ac-749ef3c65556 service nova] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Received event network-vif-plugged-72ea4eea-6e08-44b2-9274-0f849d534f05 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:58:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9df37294-678c-44a6-b328-50fc1ac8d9ec req-cd02cd5e-a09b-4625-b4ac-749ef3c65556 service nova] Acquiring lock "522f5959-4874-4c61-888d-6fb1cc4d72e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:58:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9df37294-678c-44a6-b328-50fc1ac8d9ec req-cd02cd5e-a09b-4625-b4ac-749ef3c65556 service nova] Lock "522f5959-4874-4c61-888d-6fb1cc4d72e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:58:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9df37294-678c-44a6-b328-50fc1ac8d9ec req-cd02cd5e-a09b-4625-b4ac-749ef3c65556 service nova] Lock "522f5959-4874-4c61-888d-6fb1cc4d72e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:58:22 user nova-compute[74348]: DEBUG nova.compute.manager [req-9df37294-678c-44a6-b328-50fc1ac8d9ec req-cd02cd5e-a09b-4625-b4ac-749ef3c65556 service nova] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] No waiting events found dispatching network-vif-plugged-72ea4eea-6e08-44b2-9274-0f849d534f05 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:58:22 user nova-compute[74348]: WARNING nova.compute.manager [req-9df37294-678c-44a6-b328-50fc1ac8d9ec req-cd02cd5e-a09b-4625-b4ac-749ef3c65556 service nova] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Received unexpected event network-vif-plugged-72ea4eea-6e08-44b2-9274-0f849d534f05 for instance with vm_state active and task_state deleting.
Nov 22 07:58:22 user nova-compute[74348]: DEBUG nova.compute.manager [req-9df37294-678c-44a6-b328-50fc1ac8d9ec req-cd02cd5e-a09b-4625-b4ac-749ef3c65556 service nova] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Received event network-vif-plugged-72ea4eea-6e08-44b2-9274-0f849d534f05 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:58:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9df37294-678c-44a6-b328-50fc1ac8d9ec req-cd02cd5e-a09b-4625-b4ac-749ef3c65556 service nova] Acquiring lock "522f5959-4874-4c61-888d-6fb1cc4d72e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:58:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9df37294-678c-44a6-b328-50fc1ac8d9ec req-cd02cd5e-a09b-4625-b4ac-749ef3c65556 service nova] Lock "522f5959-4874-4c61-888d-6fb1cc4d72e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:58:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9df37294-678c-44a6-b328-50fc1ac8d9ec req-cd02cd5e-a09b-4625-b4ac-749ef3c65556 service nova] Lock "522f5959-4874-4c61-888d-6fb1cc4d72e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:58:22 user nova-compute[74348]: DEBUG nova.compute.manager [req-9df37294-678c-44a6-b328-50fc1ac8d9ec req-cd02cd5e-a09b-4625-b4ac-749ef3c65556 service nova] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] No waiting events found dispatching network-vif-plugged-72ea4eea-6e08-44b2-9274-0f849d534f05 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:58:22 user nova-compute[74348]: WARNING nova.compute.manager [req-9df37294-678c-44a6-b328-50fc1ac8d9ec req-cd02cd5e-a09b-4625-b4ac-749ef3c65556 service nova] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Received unexpected event network-vif-plugged-72ea4eea-6e08-44b2-9274-0f849d534f05 for instance with vm_state active and task_state deleting.
Nov 22 07:58:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:23 user nova-compute[74348]: DEBUG nova.compute.manager [req-af3004e9-005e-4b20-83d3-4cbd472d1c3f req-9d0cc84c-1eac-4297-9abc-52a6c0d175a7 service nova] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Received event network-vif-plugged-72ea4eea-6e08-44b2-9274-0f849d534f05 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:58:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-af3004e9-005e-4b20-83d3-4cbd472d1c3f req-9d0cc84c-1eac-4297-9abc-52a6c0d175a7 service nova] Acquiring lock "522f5959-4874-4c61-888d-6fb1cc4d72e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:58:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-af3004e9-005e-4b20-83d3-4cbd472d1c3f req-9d0cc84c-1eac-4297-9abc-52a6c0d175a7 service nova] Lock "522f5959-4874-4c61-888d-6fb1cc4d72e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:58:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-af3004e9-005e-4b20-83d3-4cbd472d1c3f req-9d0cc84c-1eac-4297-9abc-52a6c0d175a7 service nova] Lock "522f5959-4874-4c61-888d-6fb1cc4d72e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:58:23 user nova-compute[74348]: DEBUG nova.compute.manager [req-af3004e9-005e-4b20-83d3-4cbd472d1c3f req-9d0cc84c-1eac-4297-9abc-52a6c0d175a7 service nova] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] No waiting events found dispatching network-vif-plugged-72ea4eea-6e08-44b2-9274-0f849d534f05 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:58:23 user nova-compute[74348]: WARNING nova.compute.manager [req-af3004e9-005e-4b20-83d3-4cbd472d1c3f req-9d0cc84c-1eac-4297-9abc-52a6c0d175a7 service nova] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Received unexpected event network-vif-plugged-72ea4eea-6e08-44b2-9274-0f849d534f05 for instance with vm_state deleted and task_state None.
Nov 22 07:58:23 user nova-compute[74348]: DEBUG nova.compute.manager [req-af3004e9-005e-4b20-83d3-4cbd472d1c3f req-9d0cc84c-1eac-4297-9abc-52a6c0d175a7 service nova] [instance: 522f5959-4874-4c61-888d-6fb1cc4d72e6] Received event network-vif-deleted-72ea4eea-6e08-44b2-9274-0f849d534f05 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:58:23 user nova-compute[74348]: DEBUG nova.compute.manager [req-af3004e9-005e-4b20-83d3-4cbd472d1c3f req-9d0cc84c-1eac-4297-9abc-52a6c0d175a7 service nova] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Received event network-vif-plugged-a74a748c-17ee-4a29-b4da-175f7e2dec75 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:58:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-af3004e9-005e-4b20-83d3-4cbd472d1c3f req-9d0cc84c-1eac-4297-9abc-52a6c0d175a7 service nova] Acquiring lock "84fd55a1-d62e-4191-923e-b5bf7cb47490-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:58:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-af3004e9-005e-4b20-83d3-4cbd472d1c3f req-9d0cc84c-1eac-4297-9abc-52a6c0d175a7 service nova] Lock "84fd55a1-d62e-4191-923e-b5bf7cb47490-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:58:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-af3004e9-005e-4b20-83d3-4cbd472d1c3f req-9d0cc84c-1eac-4297-9abc-52a6c0d175a7 service nova] Lock "84fd55a1-d62e-4191-923e-b5bf7cb47490-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:58:23 user nova-compute[74348]: DEBUG nova.compute.manager [req-af3004e9-005e-4b20-83d3-4cbd472d1c3f req-9d0cc84c-1eac-4297-9abc-52a6c0d175a7 service nova] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] No waiting events found dispatching network-vif-plugged-a74a748c-17ee-4a29-b4da-175f7e2dec75 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:58:23 user nova-compute[74348]: WARNING nova.compute.manager [req-af3004e9-005e-4b20-83d3-4cbd472d1c3f req-9d0cc84c-1eac-4297-9abc-52a6c0d175a7 service nova] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Received unexpected event network-vif-plugged-a74a748c-17ee-4a29-b4da-175f7e2dec75 for instance with vm_state building and task_state spawning.
Nov 22 07:58:23 user nova-compute[74348]: DEBUG nova.compute.manager [req-af3004e9-005e-4b20-83d3-4cbd472d1c3f req-9d0cc84c-1eac-4297-9abc-52a6c0d175a7 service nova] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Received event network-vif-plugged-a74a748c-17ee-4a29-b4da-175f7e2dec75 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:58:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-af3004e9-005e-4b20-83d3-4cbd472d1c3f req-9d0cc84c-1eac-4297-9abc-52a6c0d175a7 service nova] Acquiring lock "84fd55a1-d62e-4191-923e-b5bf7cb47490-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:58:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-af3004e9-005e-4b20-83d3-4cbd472d1c3f req-9d0cc84c-1eac-4297-9abc-52a6c0d175a7 service nova] Lock "84fd55a1-d62e-4191-923e-b5bf7cb47490-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:58:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-af3004e9-005e-4b20-83d3-4cbd472d1c3f req-9d0cc84c-1eac-4297-9abc-52a6c0d175a7 service nova] Lock "84fd55a1-d62e-4191-923e-b5bf7cb47490-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:58:23 user nova-compute[74348]: DEBUG nova.compute.manager [req-af3004e9-005e-4b20-83d3-4cbd472d1c3f req-9d0cc84c-1eac-4297-9abc-52a6c0d175a7 service nova] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] No waiting events found dispatching network-vif-plugged-a74a748c-17ee-4a29-b4da-175f7e2dec75 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:58:23 user nova-compute[74348]: WARNING nova.compute.manager [req-af3004e9-005e-4b20-83d3-4cbd472d1c3f req-9d0cc84c-1eac-4297-9abc-52a6c0d175a7 service nova] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Received unexpected event network-vif-plugged-a74a748c-17ee-4a29-b4da-175f7e2dec75 for instance with vm_state building and task_state spawning.
Nov 22 07:58:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-234c6c78-2f36-4fc0-bdad-9d1bc5e3f762 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquiring lock "5f3bbae3-babf-44d2-96da-c459fb77d9c7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:58:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-234c6c78-2f36-4fc0-bdad-9d1bc5e3f762 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "5f3bbae3-babf-44d2-96da-c459fb77d9c7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:58:24 user nova-compute[74348]: INFO nova.compute.manager [None req-234c6c78-2f36-4fc0-bdad-9d1bc5e3f762 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Detaching volume 89d26526-c4cd-414b-a30a-b4c7bc0b7aee
Nov 22 07:58:24 user nova-compute[74348]: INFO nova.virt.block_device [None req-234c6c78-2f36-4fc0-bdad-9d1bc5e3f762 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Attempting to driver detach volume 89d26526-c4cd-414b-a30a-b4c7bc0b7aee from mountpoint /dev/vdc
Nov 22 07:58:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-234c6c78-2f36-4fc0-bdad-9d1bc5e3f762 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Attempting to detach device vdc from instance 5f3bbae3-babf-44d2-96da-c459fb77d9c7 from the persistent domain config. {{(pid=74348) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 07:58:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-234c6c78-2f36-4fc0-bdad-9d1bc5e3f762 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 07:58:24 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 07:58:24 user nova-compute[74348]:   <source dev="/dev/sde"/>
Nov 22 07:58:24 user nova-compute[74348]:   <target dev="vdc" bus="virtio"/>
Nov 22 07:58:24 user nova-compute[74348]:   <serial>89d26526-c4cd-414b-a30a-b4c7bc0b7aee</serial>
Nov 22 07:58:24 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 22 07:58:24 user nova-compute[74348]: </disk>
Nov 22 07:58:24 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 07:58:24 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-234c6c78-2f36-4fc0-bdad-9d1bc5e3f762 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Successfully detached device vdc from instance 5f3bbae3-babf-44d2-96da-c459fb77d9c7 from the persistent domain config.
Nov 22 07:58:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-234c6c78-2f36-4fc0-bdad-9d1bc5e3f762 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 5f3bbae3-babf-44d2-96da-c459fb77d9c7 from the live domain config. {{(pid=74348) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 07:58:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-234c6c78-2f36-4fc0-bdad-9d1bc5e3f762 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 07:58:24 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 07:58:24 user nova-compute[74348]:   <source dev="/dev/sde"/>
Nov 22 07:58:24 user nova-compute[74348]:   <target dev="vdc" bus="virtio"/>
Nov 22 07:58:24 user nova-compute[74348]:   <serial>89d26526-c4cd-414b-a30a-b4c7bc0b7aee</serial>
Nov 22 07:58:24 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 22 07:58:24 user nova-compute[74348]: </disk>
Nov 22 07:58:24 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 07:58:24 user nova-compute[74348]: DEBUG nova.compute.manager [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 07:58:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 07:58:24 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Instance spawned successfully.
Nov 22 07:58:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 07:58:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:58:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:58:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:58:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:58:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:58:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:58:24 user nova-compute[74348]: INFO nova.compute.manager [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Took 6.58 seconds to spawn the instance on the hypervisor.
Nov 22 07:58:24 user nova-compute[74348]: DEBUG nova.compute.manager [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 07:58:24 user nova-compute[74348]: INFO nova.compute.manager [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Took 7.44 seconds to build instance.
Nov 22 07:58:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d99a8782-3a7f-4adc-ab98-77523e6ea356 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Lock "84fd55a1-d62e-4191-923e-b5bf7cb47490" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.626s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:58:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-234c6c78-2f36-4fc0-bdad-9d1bc5e3f762 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 5f3bbae3-babf-44d2-96da-c459fb77d9c7 {{(pid=74348) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 07:58:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:27 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Acquiring lock "053355df-8b23-48fa-a0e1-9750314d72d5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:58:27 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Lock "053355df-8b23-48fa-a0e1-9750314d72d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:58:27 user nova-compute[74348]: DEBUG nova.compute.manager [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 07:58:27 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:58:27 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:58:27 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 07:58:27 user nova-compute[74348]: INFO nova.compute.claims [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Claim successful on node user
Nov 22 07:58:27 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:58:27 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:58:27 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.527s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:58:27 user nova-compute[74348]: DEBUG nova.compute.manager [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 07:58:28 user nova-compute[74348]: DEBUG nova.compute.manager [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 07:58:28 user nova-compute[74348]: DEBUG nova.network.neutron [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 07:58:28 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 07:58:28 user nova-compute[74348]: DEBUG nova.compute.manager [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 07:58:28 user nova-compute[74348]: DEBUG nova.compute.manager [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 07:58:28 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 07:58:28 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Creating image(s)
Nov 22 07:58:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Acquiring lock "/opt/stack/data/nova/instances/053355df-8b23-48fa-a0e1-9750314d72d5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:58:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Lock "/opt/stack/data/nova/instances/053355df-8b23-48fa-a0e1-9750314d72d5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:58:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Lock "/opt/stack/data/nova/instances/053355df-8b23-48fa-a0e1-9750314d72d5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:58:28 user nova-compute[74348]: DEBUG nova.policy [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9fea00e1160641538d279d94d11e1861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1c8d1a7445415a94870492c19da491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 07:58:28 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:28 user nova-compute[74348]: INFO nova.compute.manager [None req-235edc44-8c93-45a3-aa3b-dd839b2ae23f tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Unrescuing
Nov 22 07:58:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-235edc44-8c93-45a3-aa3b-dd839b2ae23f tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Acquiring lock "refresh_cache-bcedb385-b72a-49c2-b363-cf6da5804b60" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:58:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-235edc44-8c93-45a3-aa3b-dd839b2ae23f tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Acquired lock "refresh_cache-bcedb385-b72a-49c2-b363-cf6da5804b60" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:58:28 user nova-compute[74348]: DEBUG nova.network.neutron [None req-235edc44-8c93-45a3-aa3b-dd839b2ae23f tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 07:58:28 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.205s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Acquiring lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:58:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:58:28 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:28 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:58:28 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 07:58:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:28 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Didn't find any instances for network info cache update. {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 07:58:28 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.269s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:28 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/053355df-8b23-48fa-a0e1-9750314d72d5/disk 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:28 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/053355df-8b23-48fa-a0e1-9750314d72d5/disk 1073741824" returned: 0 in 0.072s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.349s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:58:28 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.233s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:29 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Checking if we can resize image /opt/stack/data/nova/instances/053355df-8b23-48fa-a0e1-9750314d72d5/disk. size=1073741824 {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 07:58:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/053355df-8b23-48fa-a0e1-9750314d72d5/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/053355df-8b23-48fa-a0e1-9750314d72d5/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:29 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Cannot resize image /opt/stack/data/nova/instances/053355df-8b23-48fa-a0e1-9750314d72d5/disk to a smaller size. {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 07:58:29 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 07:58:29 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Ensure instance console log exists: /opt/stack/data/nova/instances/053355df-8b23-48fa-a0e1-9750314d72d5/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 07:58:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:58:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:58:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:58:29 user nova-compute[74348]: DEBUG nova.network.neutron [None req-235edc44-8c93-45a3-aa3b-dd839b2ae23f tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Updating instance_info_cache with network_info: [{"id": "07295502-d217-400f-8b56-9ff1ccd600cf", "address": "fa:16:3e:50:0c:08", "network": {"id": "fd2e1dc2-9099-48b4-b56d-bc5d09c892fe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1689843295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52a21c1ef18473aa64c139de7b920ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07295502-d2", "ovs_interfaceid": "07295502-d217-400f-8b56-9ff1ccd600cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:58:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-235edc44-8c93-45a3-aa3b-dd839b2ae23f tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Releasing lock "refresh_cache-bcedb385-b72a-49c2-b363-cf6da5804b60" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:58:29 user nova-compute[74348]: DEBUG nova.objects.instance [None req-235edc44-8c93-45a3-aa3b-dd839b2ae23f tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lazy-loading 'flavor' on Instance uuid bcedb385-b72a-49c2-b363-cf6da5804b60 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:58:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:29 user nova-compute[74348]: DEBUG nova.compute.manager [req-e383a71d-502a-41aa-9a15-9d0e21719f92 req-88fdcdcf-de62-41d8-9ee4-2a78d56780e8 service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Received event network-vif-unplugged-07295502-d217-400f-8b56-9ff1ccd600cf {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:58:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e383a71d-502a-41aa-9a15-9d0e21719f92 req-88fdcdcf-de62-41d8-9ee4-2a78d56780e8 service nova] Acquiring lock "bcedb385-b72a-49c2-b363-cf6da5804b60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:58:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e383a71d-502a-41aa-9a15-9d0e21719f92 req-88fdcdcf-de62-41d8-9ee4-2a78d56780e8 service nova] Lock "bcedb385-b72a-49c2-b363-cf6da5804b60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:58:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e383a71d-502a-41aa-9a15-9d0e21719f92 req-88fdcdcf-de62-41d8-9ee4-2a78d56780e8 service nova] Lock "bcedb385-b72a-49c2-b363-cf6da5804b60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:58:29 user nova-compute[74348]: DEBUG nova.compute.manager [req-e383a71d-502a-41aa-9a15-9d0e21719f92 req-88fdcdcf-de62-41d8-9ee4-2a78d56780e8 service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] No waiting events found dispatching network-vif-unplugged-07295502-d217-400f-8b56-9ff1ccd600cf {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:58:29 user nova-compute[74348]: WARNING nova.compute.manager [req-e383a71d-502a-41aa-9a15-9d0e21719f92 req-88fdcdcf-de62-41d8-9ee4-2a78d56780e8 service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Received unexpected event network-vif-unplugged-07295502-d217-400f-8b56-9ff1ccd600cf for instance with vm_state rescued and task_state unrescuing.
Nov 22 07:58:30 user nova-compute[74348]: DEBUG nova.network.neutron [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Successfully created port: 85ddecaf-c55f-42ec-8138-ce602da0b898 {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 07:58:30 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Instance destroyed successfully.
Nov 22 07:58:30 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:58:30 user nova-compute[74348]: DEBUG nova.compute.manager [req-d77e2b53-9fe6-4fa3-abe6-2c28a1aa6591 req-39b60462-2c15-4e79-84ff-9fa9b314dcfc service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Received event network-changed-07295502-d217-400f-8b56-9ff1ccd600cf {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:58:30 user nova-compute[74348]: DEBUG nova.compute.manager [req-d77e2b53-9fe6-4fa3-abe6-2c28a1aa6591 req-39b60462-2c15-4e79-84ff-9fa9b314dcfc service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Refreshing instance network info cache due to event network-changed-07295502-d217-400f-8b56-9ff1ccd600cf. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:58:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d77e2b53-9fe6-4fa3-abe6-2c28a1aa6591 req-39b60462-2c15-4e79-84ff-9fa9b314dcfc service nova] Acquiring lock "refresh_cache-bcedb385-b72a-49c2-b363-cf6da5804b60" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:58:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d77e2b53-9fe6-4fa3-abe6-2c28a1aa6591 req-39b60462-2c15-4e79-84ff-9fa9b314dcfc service nova] Acquired lock "refresh_cache-bcedb385-b72a-49c2-b363-cf6da5804b60" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:58:30 user nova-compute[74348]: DEBUG nova.network.neutron [req-d77e2b53-9fe6-4fa3-abe6-2c28a1aa6591 req-39b60462-2c15-4e79-84ff-9fa9b314dcfc service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Refreshing network info cache for port 07295502-d217-400f-8b56-9ff1ccd600cf {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:58:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:30 user nova-compute[74348]: DEBUG nova.network.neutron [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Successfully updated port: 85ddecaf-c55f-42ec-8138-ce602da0b898 {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 07:58:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Acquiring lock "refresh_cache-053355df-8b23-48fa-a0e1-9750314d72d5" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:58:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Acquired lock "refresh_cache-053355df-8b23-48fa-a0e1-9750314d72d5" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:58:30 user nova-compute[74348]: DEBUG nova.network.neutron [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 07:58:30 user nova-compute[74348]: DEBUG nova.compute.manager [req-5a61d6fe-8dda-46e9-8fa0-45315b4b0a0f req-9c1dc568-5dfe-454e-8735-dcc8fc169f5a service nova] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Received event network-changed-85ddecaf-c55f-42ec-8138-ce602da0b898 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:58:30 user nova-compute[74348]: DEBUG nova.compute.manager [req-5a61d6fe-8dda-46e9-8fa0-45315b4b0a0f req-9c1dc568-5dfe-454e-8735-dcc8fc169f5a service nova] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Refreshing instance network info cache due to event network-changed-85ddecaf-c55f-42ec-8138-ce602da0b898. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:58:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-5a61d6fe-8dda-46e9-8fa0-45315b4b0a0f req-9c1dc568-5dfe-454e-8735-dcc8fc169f5a service nova] Acquiring lock "refresh_cache-053355df-8b23-48fa-a0e1-9750314d72d5" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:58:30 user nova-compute[74348]: DEBUG nova.network.neutron [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG nova.network.neutron [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Updating instance_info_cache with network_info: [{"id": "85ddecaf-c55f-42ec-8138-ce602da0b898", "address": "fa:16:3e:d2:3b:90", "network": {"id": "31e6da15-f021-49a0-8962-09b5c0d46129", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "648389b0c2f64438bdce146d4d816370", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ddecaf-c5", "ovs_interfaceid": "85ddecaf-c55f-42ec-8138-ce602da0b898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG nova.network.neutron [req-d77e2b53-9fe6-4fa3-abe6-2c28a1aa6591 req-39b60462-2c15-4e79-84ff-9fa9b314dcfc service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Updated VIF entry in instance network info cache for port 07295502-d217-400f-8b56-9ff1ccd600cf. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG nova.network.neutron [req-d77e2b53-9fe6-4fa3-abe6-2c28a1aa6591 req-39b60462-2c15-4e79-84ff-9fa9b314dcfc service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Updating instance_info_cache with network_info: [{"id": "07295502-d217-400f-8b56-9ff1ccd600cf", "address": "fa:16:3e:50:0c:08", "network": {"id": "fd2e1dc2-9099-48b4-b56d-bc5d09c892fe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1689843295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52a21c1ef18473aa64c139de7b920ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07295502-d2", "ovs_interfaceid": "07295502-d217-400f-8b56-9ff1ccd600cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Releasing lock "refresh_cache-053355df-8b23-48fa-a0e1-9750314d72d5" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG nova.compute.manager [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Instance network_info: |[{"id": "85ddecaf-c55f-42ec-8138-ce602da0b898", "address": "fa:16:3e:d2:3b:90", "network": {"id": "31e6da15-f021-49a0-8962-09b5c0d46129", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "648389b0c2f64438bdce146d4d816370", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ddecaf-c5", "ovs_interfaceid": "85ddecaf-c55f-42ec-8138-ce602da0b898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-5a61d6fe-8dda-46e9-8fa0-45315b4b0a0f req-9c1dc568-5dfe-454e-8735-dcc8fc169f5a service nova] Acquired lock "refresh_cache-053355df-8b23-48fa-a0e1-9750314d72d5" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG nova.network.neutron [req-5a61d6fe-8dda-46e9-8fa0-45315b4b0a0f req-9c1dc568-5dfe-454e-8735-dcc8fc169f5a service nova] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Refreshing network info cache for port 85ddecaf-c55f-42ec-8138-ce602da0b898 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Start _get_guest_xml network_info=[{"id": "85ddecaf-c55f-42ec-8138-ce602da0b898", "address": "fa:16:3e:d2:3b:90", "network": {"id": "31e6da15-f021-49a0-8962-09b5c0d46129", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "648389b0c2f64438bdce146d4d816370", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ddecaf-c5", "ovs_interfaceid": "85ddecaf-c55f-42ec-8138-ce602da0b898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d77e2b53-9fe6-4fa3-abe6-2c28a1aa6591 req-39b60462-2c15-4e79-84ff-9fa9b314dcfc service nova] Releasing lock "refresh_cache-bcedb385-b72a-49c2-b363-cf6da5804b60" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:58:31 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:58:31 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:58:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:58:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-111861990',display_name='tempest-VolumesNegativeTest-instance-111861990',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-111861990',id=18,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f1c8d1a7445415a94870492c19da491',ramdisk_id='',reservation_id='r-kbseapqb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2144577195',owner_user_name='tempest-VolumesNegativeTest-2144577195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:58:28Z,user_data=None,user_id='9fea00e1160641538d279d94d11e1861',uuid=053355df-8b23-48fa-a0e1-9750314d72d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85ddecaf-c55f-42ec-8138-ce602da0b898", "address": "fa:16:3e:d2:3b:90", "network": {"id": "31e6da15-f021-49a0-8962-09b5c0d46129", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "648389b0c2f64438bdce146d4d816370", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ddecaf-c5", "ovs_interfaceid": "85ddecaf-c55f-42ec-8138-ce602da0b898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Converting VIF {"id": "85ddecaf-c55f-42ec-8138-ce602da0b898", "address": "fa:16:3e:d2:3b:90", "network": {"id": "31e6da15-f021-49a0-8962-09b5c0d46129", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "648389b0c2f64438bdce146d4d816370", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ddecaf-c5", "ovs_interfaceid": "85ddecaf-c55f-42ec-8138-ce602da0b898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:3b:90,bridge_name='br-int',has_traffic_filtering=True,id=85ddecaf-c55f-42ec-8138-ce602da0b898,network=Network(31e6da15-f021-49a0-8962-09b5c0d46129),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ddecaf-c5') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG nova.objects.instance [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Lazy-loading 'pci_devices' on Instance uuid 053355df-8b23-48fa-a0e1-9750314d72d5 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] End _get_guest_xml xml=<domain type="kvm">
Nov 22 07:58:31 user nova-compute[74348]:   <uuid>053355df-8b23-48fa-a0e1-9750314d72d5</uuid>
Nov 22 07:58:31 user nova-compute[74348]:   <name>instance-00000012</name>
Nov 22 07:58:31 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 07:58:31 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 07:58:31 user nova-compute[74348]:   <metadata>
Nov 22 07:58:31 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 07:58:31 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 07:58:31 user nova-compute[74348]:       <nova:name>tempest-VolumesNegativeTest-instance-111861990</nova:name>
Nov 22 07:58:31 user nova-compute[74348]:       <nova:creationTime>2023-11-22 07:58:31</nova:creationTime>
Nov 22 07:58:31 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 07:58:31 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 07:58:31 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 07:58:31 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 07:58:31 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 07:58:31 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 07:58:31 user nova-compute[74348]:       </nova:flavor>
Nov 22 07:58:31 user nova-compute[74348]:       <nova:owner>
Nov 22 07:58:31 user nova-compute[74348]:         <nova:user uuid="9fea00e1160641538d279d94d11e1861">tempest-VolumesNegativeTest-2144577195-project-member</nova:user>
Nov 22 07:58:31 user nova-compute[74348]:         <nova:project uuid="7f1c8d1a7445415a94870492c19da491">tempest-VolumesNegativeTest-2144577195</nova:project>
Nov 22 07:58:31 user nova-compute[74348]:       </nova:owner>
Nov 22 07:58:31 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 07:58:31 user nova-compute[74348]:       <nova:ports>
Nov 22 07:58:31 user nova-compute[74348]:         <nova:port uuid="85ddecaf-c55f-42ec-8138-ce602da0b898">
Nov 22 07:58:31 user nova-compute[74348]:           <nova:ip type="fixed" address="192.168.233.183" ipVersion="4"/>
Nov 22 07:58:31 user nova-compute[74348]:         </nova:port>
Nov 22 07:58:31 user nova-compute[74348]:       </nova:ports>
Nov 22 07:58:31 user nova-compute[74348]:     </nova:instance>
Nov 22 07:58:31 user nova-compute[74348]:   </metadata>
Nov 22 07:58:31 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 07:58:31 user nova-compute[74348]:     <system>
Nov 22 07:58:31 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 07:58:31 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 07:58:31 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 07:58:31 user nova-compute[74348]:       <entry name="serial">053355df-8b23-48fa-a0e1-9750314d72d5</entry>
Nov 22 07:58:31 user nova-compute[74348]:       <entry name="uuid">053355df-8b23-48fa-a0e1-9750314d72d5</entry>
Nov 22 07:58:31 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 07:58:31 user nova-compute[74348]:     </system>
Nov 22 07:58:31 user nova-compute[74348]:   </sysinfo>
Nov 22 07:58:31 user nova-compute[74348]:   <os>
Nov 22 07:58:31 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 07:58:31 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 07:58:31 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 07:58:31 user nova-compute[74348]:   </os>
Nov 22 07:58:31 user nova-compute[74348]:   <features>
Nov 22 07:58:31 user nova-compute[74348]:     <acpi/>
Nov 22 07:58:31 user nova-compute[74348]:     <apic/>
Nov 22 07:58:31 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 07:58:31 user nova-compute[74348]:   </features>
Nov 22 07:58:31 user nova-compute[74348]:   <clock offset="utc">
Nov 22 07:58:31 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 07:58:31 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 07:58:31 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 07:58:31 user nova-compute[74348]:   </clock>
Nov 22 07:58:31 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 07:58:31 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 07:58:31 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 07:58:31 user nova-compute[74348]:   </cpu>
Nov 22 07:58:31 user nova-compute[74348]:   <devices>
Nov 22 07:58:31 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 07:58:31 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 07:58:31 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/053355df-8b23-48fa-a0e1-9750314d72d5/disk"/>
Nov 22 07:58:31 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 07:58:31 user nova-compute[74348]:     </disk>
Nov 22 07:58:31 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 07:58:31 user nova-compute[74348]:       <mac address="fa:16:3e:d2:3b:90"/>
Nov 22 07:58:31 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:58:31 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 07:58:31 user nova-compute[74348]:       <target dev="tap85ddecaf-c5"/>
Nov 22 07:58:31 user nova-compute[74348]:     </interface>
Nov 22 07:58:31 user nova-compute[74348]:     <serial type="pty">
Nov 22 07:58:31 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/053355df-8b23-48fa-a0e1-9750314d72d5/console.log" append="off"/>
Nov 22 07:58:31 user nova-compute[74348]:     </serial>
Nov 22 07:58:31 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 07:58:31 user nova-compute[74348]:     <video>
Nov 22 07:58:31 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:58:31 user nova-compute[74348]:     </video>
Nov 22 07:58:31 user nova-compute[74348]:     <rng model="virtio">
Nov 22 07:58:31 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 07:58:31 user nova-compute[74348]:     </rng>
Nov 22 07:58:31 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 07:58:31 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 07:58:31 user nova-compute[74348]:       <stats period="10"/>
Nov 22 07:58:31 user nova-compute[74348]:     </memballoon>
Nov 22 07:58:31 user nova-compute[74348]:   </devices>
Nov 22 07:58:31 user nova-compute[74348]: </domain>
Nov 22 07:58:31 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:58:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-111861990',display_name='tempest-VolumesNegativeTest-instance-111861990',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-111861990',id=18,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f1c8d1a7445415a94870492c19da491',ramdisk_id='',reservation_id='r-kbseapqb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2144577195',owner_user_name='tempest-VolumesNegativeTest-2144577195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:58:28Z,user_data=None,user_id='9fea00e1160641538d279d94d11e1861',uuid=053355df-8b23-48fa-a0e1-9750314d72d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85ddecaf-c55f-42ec-8138-ce602da0b898", "address": "fa:16:3e:d2:3b:90", "network": {"id": "31e6da15-f021-49a0-8962-09b5c0d46129", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "648389b0c2f64438bdce146d4d816370", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ddecaf-c5", "ovs_interfaceid": "85ddecaf-c55f-42ec-8138-ce602da0b898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Converting VIF {"id": "85ddecaf-c55f-42ec-8138-ce602da0b898", "address": "fa:16:3e:d2:3b:90", "network": {"id": "31e6da15-f021-49a0-8962-09b5c0d46129", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "648389b0c2f64438bdce146d4d816370", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ddecaf-c5", "ovs_interfaceid": "85ddecaf-c55f-42ec-8138-ce602da0b898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:3b:90,bridge_name='br-int',has_traffic_filtering=True,id=85ddecaf-c55f-42ec-8138-ce602da0b898,network=Network(31e6da15-f021-49a0-8962-09b5c0d46129),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ddecaf-c5') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG os_vif [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:3b:90,bridge_name='br-int',has_traffic_filtering=True,id=85ddecaf-c55f-42ec-8138-ce602da0b898,network=Network(31e6da15-f021-49a0-8962-09b5c0d46129),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ddecaf-c5') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f0e61f5f-7985-571d-b39e-34709ddef9d7', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85ddecaf-c5, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap85ddecaf-c5, col_values=(('qos', UUID('d4d884a5-4ad3-4b0e-af35-adcf463d3f36')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap85ddecaf-c5, col_values=(('external_ids', {'iface-id': '85ddecaf-c55f-42ec-8138-ce602da0b898', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:3b:90', 'vm-uuid': '053355df-8b23-48fa-a0e1-9750314d72d5'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:31 user nova-compute[74348]: INFO os_vif [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:3b:90,bridge_name='br-int',has_traffic_filtering=True,id=85ddecaf-c55f-42ec-8138-ce602da0b898,network=Network(31e6da15-f021-49a0-8962-09b5c0d46129),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ddecaf-c5')
Nov 22 07:58:31 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] No VIF found with MAC fa:16:3e:d2:3b:90, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG nova.network.neutron [req-5a61d6fe-8dda-46e9-8fa0-45315b4b0a0f req-9c1dc568-5dfe-454e-8735-dcc8fc169f5a service nova] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Updated VIF entry in instance network info cache for port 85ddecaf-c55f-42ec-8138-ce602da0b898. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG nova.network.neutron [req-5a61d6fe-8dda-46e9-8fa0-45315b4b0a0f req-9c1dc568-5dfe-454e-8735-dcc8fc169f5a service nova] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Updating instance_info_cache with network_info: [{"id": "85ddecaf-c55f-42ec-8138-ce602da0b898", "address": "fa:16:3e:d2:3b:90", "network": {"id": "31e6da15-f021-49a0-8962-09b5c0d46129", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "648389b0c2f64438bdce146d4d816370", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ddecaf-c5", "ovs_interfaceid": "85ddecaf-c55f-42ec-8138-ce602da0b898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-5a61d6fe-8dda-46e9-8fa0-45315b4b0a0f req-9c1dc568-5dfe-454e-8735-dcc8fc169f5a service nova] Releasing lock "refresh_cache-053355df-8b23-48fa-a0e1-9750314d72d5" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:32 user nova-compute[74348]: DEBUG nova.compute.manager [req-4188ac09-9291-4137-82dc-5b017662260a req-96c77dbd-d984-4bac-bb36-0f21b94a3cd4 service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Received event network-vif-plugged-07295502-d217-400f-8b56-9ff1ccd600cf {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:58:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4188ac09-9291-4137-82dc-5b017662260a req-96c77dbd-d984-4bac-bb36-0f21b94a3cd4 service nova] Acquiring lock "bcedb385-b72a-49c2-b363-cf6da5804b60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:58:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4188ac09-9291-4137-82dc-5b017662260a req-96c77dbd-d984-4bac-bb36-0f21b94a3cd4 service nova] Lock "bcedb385-b72a-49c2-b363-cf6da5804b60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:58:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4188ac09-9291-4137-82dc-5b017662260a req-96c77dbd-d984-4bac-bb36-0f21b94a3cd4 service nova] Lock "bcedb385-b72a-49c2-b363-cf6da5804b60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:58:32 user nova-compute[74348]: DEBUG nova.compute.manager [req-4188ac09-9291-4137-82dc-5b017662260a req-96c77dbd-d984-4bac-bb36-0f21b94a3cd4 service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] No waiting events found dispatching network-vif-plugged-07295502-d217-400f-8b56-9ff1ccd600cf {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:58:32 user nova-compute[74348]: WARNING nova.compute.manager [req-4188ac09-9291-4137-82dc-5b017662260a req-96c77dbd-d984-4bac-bb36-0f21b94a3cd4 service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Received unexpected event network-vif-plugged-07295502-d217-400f-8b56-9ff1ccd600cf for instance with vm_state rescued and task_state unrescuing.
Nov 22 07:58:32 user nova-compute[74348]: DEBUG nova.compute.manager [req-4188ac09-9291-4137-82dc-5b017662260a req-96c77dbd-d984-4bac-bb36-0f21b94a3cd4 service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Received event network-vif-plugged-07295502-d217-400f-8b56-9ff1ccd600cf {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:58:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4188ac09-9291-4137-82dc-5b017662260a req-96c77dbd-d984-4bac-bb36-0f21b94a3cd4 service nova] Acquiring lock "bcedb385-b72a-49c2-b363-cf6da5804b60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:58:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4188ac09-9291-4137-82dc-5b017662260a req-96c77dbd-d984-4bac-bb36-0f21b94a3cd4 service nova] Lock "bcedb385-b72a-49c2-b363-cf6da5804b60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:58:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4188ac09-9291-4137-82dc-5b017662260a req-96c77dbd-d984-4bac-bb36-0f21b94a3cd4 service nova] Lock "bcedb385-b72a-49c2-b363-cf6da5804b60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:58:32 user nova-compute[74348]: DEBUG nova.compute.manager [req-4188ac09-9291-4137-82dc-5b017662260a req-96c77dbd-d984-4bac-bb36-0f21b94a3cd4 service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] No waiting events found dispatching network-vif-plugged-07295502-d217-400f-8b56-9ff1ccd600cf {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:58:32 user nova-compute[74348]: WARNING nova.compute.manager [req-4188ac09-9291-4137-82dc-5b017662260a req-96c77dbd-d984-4bac-bb36-0f21b94a3cd4 service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Received unexpected event network-vif-plugged-07295502-d217-400f-8b56-9ff1ccd600cf for instance with vm_state rescued and task_state unrescuing.
Nov 22 07:58:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:32 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:58:32 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:58:32 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 07:58:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:32 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:58:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:32 user nova-compute[74348]: DEBUG nova.compute.manager [req-8819f6ac-8b0c-4f8e-8dbb-73009ec457ce req-4f62fde6-9642-4e1e-8a0f-d64d383ec345 service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Received event network-changed-07295502-d217-400f-8b56-9ff1ccd600cf {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:58:32 user nova-compute[74348]: DEBUG nova.compute.manager [req-8819f6ac-8b0c-4f8e-8dbb-73009ec457ce req-4f62fde6-9642-4e1e-8a0f-d64d383ec345 service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Refreshing instance network info cache due to event network-changed-07295502-d217-400f-8b56-9ff1ccd600cf. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:58:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-8819f6ac-8b0c-4f8e-8dbb-73009ec457ce req-4f62fde6-9642-4e1e-8a0f-d64d383ec345 service nova] Acquiring lock "refresh_cache-bcedb385-b72a-49c2-b363-cf6da5804b60" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:58:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-8819f6ac-8b0c-4f8e-8dbb-73009ec457ce req-4f62fde6-9642-4e1e-8a0f-d64d383ec345 service nova] Acquired lock "refresh_cache-bcedb385-b72a-49c2-b363-cf6da5804b60" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:58:32 user nova-compute[74348]: DEBUG nova.network.neutron [req-8819f6ac-8b0c-4f8e-8dbb-73009ec457ce req-4f62fde6-9642-4e1e-8a0f-d64d383ec345 service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Refreshing network info cache for port 07295502-d217-400f-8b56-9ff1ccd600cf {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:58:33 user nova-compute[74348]: DEBUG nova.network.neutron [req-8819f6ac-8b0c-4f8e-8dbb-73009ec457ce req-4f62fde6-9642-4e1e-8a0f-d64d383ec345 service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Updated VIF entry in instance network info cache for port 07295502-d217-400f-8b56-9ff1ccd600cf. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 07:58:33 user nova-compute[74348]: DEBUG nova.network.neutron [req-8819f6ac-8b0c-4f8e-8dbb-73009ec457ce req-4f62fde6-9642-4e1e-8a0f-d64d383ec345 service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Updating instance_info_cache with network_info: [{"id": "07295502-d217-400f-8b56-9ff1ccd600cf", "address": "fa:16:3e:50:0c:08", "network": {"id": "fd2e1dc2-9099-48b4-b56d-bc5d09c892fe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1689843295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52a21c1ef18473aa64c139de7b920ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07295502-d2", "ovs_interfaceid": "07295502-d217-400f-8b56-9ff1ccd600cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:58:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-8819f6ac-8b0c-4f8e-8dbb-73009ec457ce req-4f62fde6-9642-4e1e-8a0f-d64d383ec345 service nova] Releasing lock "refresh_cache-bcedb385-b72a-49c2-b363-cf6da5804b60" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:58:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:33 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:58:33 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:58:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:58:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:58:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:58:33 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 07:58:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/053355df-8b23-48fa-a0e1-9750314d72d5/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:34 user nova-compute[74348]: DEBUG nova.compute.manager [req-3cafc228-67d7-4be1-83db-097f1c26bf96 req-83d571b9-7dd3-4cce-96b7-d151de5962cc service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Received event network-vif-plugged-07295502-d217-400f-8b56-9ff1ccd600cf {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:58:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3cafc228-67d7-4be1-83db-097f1c26bf96 req-83d571b9-7dd3-4cce-96b7-d151de5962cc service nova] Acquiring lock "bcedb385-b72a-49c2-b363-cf6da5804b60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:58:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3cafc228-67d7-4be1-83db-097f1c26bf96 req-83d571b9-7dd3-4cce-96b7-d151de5962cc service nova] Lock "bcedb385-b72a-49c2-b363-cf6da5804b60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:58:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3cafc228-67d7-4be1-83db-097f1c26bf96 req-83d571b9-7dd3-4cce-96b7-d151de5962cc service nova] Lock "bcedb385-b72a-49c2-b363-cf6da5804b60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:58:34 user nova-compute[74348]: DEBUG nova.compute.manager [req-3cafc228-67d7-4be1-83db-097f1c26bf96 req-83d571b9-7dd3-4cce-96b7-d151de5962cc service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] No waiting events found dispatching network-vif-plugged-07295502-d217-400f-8b56-9ff1ccd600cf {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:58:34 user nova-compute[74348]: WARNING nova.compute.manager [req-3cafc228-67d7-4be1-83db-097f1c26bf96 req-83d571b9-7dd3-4cce-96b7-d151de5962cc service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Received unexpected event network-vif-plugged-07295502-d217-400f-8b56-9ff1ccd600cf for instance with vm_state rescued and task_state unrescuing.
Nov 22 07:58:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/053355df-8b23-48fa-a0e1-9750314d72d5/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/053355df-8b23-48fa-a0e1-9750314d72d5/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/053355df-8b23-48fa-a0e1-9750314d72d5/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3bbae3-babf-44d2-96da-c459fb77d9c7/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3bbae3-babf-44d2-96da-c459fb77d9c7/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3bbae3-babf-44d2-96da-c459fb77d9c7/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:34 user nova-compute[74348]: DEBUG nova.compute.manager [req-4bc923d7-a496-4902-b9e7-1e302e54d35f req-f07602d0-cf3a-4f7d-9f48-f906967368e7 service nova] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Received event network-vif-plugged-85ddecaf-c55f-42ec-8138-ce602da0b898 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:58:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4bc923d7-a496-4902-b9e7-1e302e54d35f req-f07602d0-cf3a-4f7d-9f48-f906967368e7 service nova] Acquiring lock "053355df-8b23-48fa-a0e1-9750314d72d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:58:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4bc923d7-a496-4902-b9e7-1e302e54d35f req-f07602d0-cf3a-4f7d-9f48-f906967368e7 service nova] Lock "053355df-8b23-48fa-a0e1-9750314d72d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:58:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4bc923d7-a496-4902-b9e7-1e302e54d35f req-f07602d0-cf3a-4f7d-9f48-f906967368e7 service nova] Lock "053355df-8b23-48fa-a0e1-9750314d72d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:58:34 user nova-compute[74348]: DEBUG nova.compute.manager [req-4bc923d7-a496-4902-b9e7-1e302e54d35f req-f07602d0-cf3a-4f7d-9f48-f906967368e7 service nova] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] No waiting events found dispatching network-vif-plugged-85ddecaf-c55f-42ec-8138-ce602da0b898 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:58:34 user nova-compute[74348]: WARNING nova.compute.manager [req-4bc923d7-a496-4902-b9e7-1e302e54d35f req-f07602d0-cf3a-4f7d-9f48-f906967368e7 service nova] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Received unexpected event network-vif-plugged-85ddecaf-c55f-42ec-8138-ce602da0b898 for instance with vm_state building and task_state spawning.
Nov 22 07:58:34 user nova-compute[74348]: DEBUG nova.compute.manager [req-4bc923d7-a496-4902-b9e7-1e302e54d35f req-f07602d0-cf3a-4f7d-9f48-f906967368e7 service nova] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Received event network-vif-plugged-85ddecaf-c55f-42ec-8138-ce602da0b898 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:58:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4bc923d7-a496-4902-b9e7-1e302e54d35f req-f07602d0-cf3a-4f7d-9f48-f906967368e7 service nova] Acquiring lock "053355df-8b23-48fa-a0e1-9750314d72d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:58:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4bc923d7-a496-4902-b9e7-1e302e54d35f req-f07602d0-cf3a-4f7d-9f48-f906967368e7 service nova] Lock "053355df-8b23-48fa-a0e1-9750314d72d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:58:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4bc923d7-a496-4902-b9e7-1e302e54d35f req-f07602d0-cf3a-4f7d-9f48-f906967368e7 service nova] Lock "053355df-8b23-48fa-a0e1-9750314d72d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:58:34 user nova-compute[74348]: DEBUG nova.compute.manager [req-4bc923d7-a496-4902-b9e7-1e302e54d35f req-f07602d0-cf3a-4f7d-9f48-f906967368e7 service nova] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] No waiting events found dispatching network-vif-plugged-85ddecaf-c55f-42ec-8138-ce602da0b898 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:58:34 user nova-compute[74348]: WARNING nova.compute.manager [req-4bc923d7-a496-4902-b9e7-1e302e54d35f req-f07602d0-cf3a-4f7d-9f48-f906967368e7 service nova] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Received unexpected event network-vif-plugged-85ddecaf-c55f-42ec-8138-ce602da0b898 for instance with vm_state building and task_state spawning.
Nov 22 07:58:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3bbae3-babf-44d2-96da-c459fb77d9c7/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059bde4a-c5c9-45ab-9b4a-c969c74a6083/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:35 user nova-compute[74348]: DEBUG nova.compute.manager [None req-235edc44-8c93-45a3-aa3b-dd839b2ae23f tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 07:58:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059bde4a-c5c9-45ab-9b4a-c969c74a6083/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059bde4a-c5c9-45ab-9b4a-c969c74a6083/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059bde4a-c5c9-45ab-9b4a-c969c74a6083/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:35 user nova-compute[74348]: DEBUG nova.compute.manager [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 07:58:35 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 07:58:35 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Instance spawned successfully.
Nov 22 07:58:35 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 07:58:35 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:58:35 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:58:35 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:58:35 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:58:35 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:58:35 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:58:36 user nova-compute[74348]: INFO nova.compute.manager [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Took 7.78 seconds to spawn the instance on the hypervisor.
Nov 22 07:58:36 user nova-compute[74348]: DEBUG nova.compute.manager [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 07:58:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:36 user nova-compute[74348]: INFO nova.compute.manager [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Took 8.76 seconds to build instance.
Nov 22 07:58:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-47fb1176-8bb4-4412-821e-2cb61bdda0d2 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Lock "053355df-8b23-48fa-a0e1-9750314d72d5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.870s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:58:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 07:58:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84fd55a1-d62e-4191-923e-b5bf7cb47490/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:36 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84fd55a1-d62e-4191-923e-b5bf7cb47490/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84fd55a1-d62e-4191-923e-b5bf7cb47490/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84fd55a1-d62e-4191-923e-b5bf7cb47490/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c36455f-5fd6-4813-9c44-499e3742ed39/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c36455f-5fd6-4813-9c44-499e3742ed39/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c36455f-5fd6-4813-9c44-499e3742ed39/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c36455f-5fd6-4813-9c44-499e3742ed39/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk --force-share --output=json" returned: 0 in 0.344s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:37 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 07:58:38 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:58:38 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:58:38 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=7766MB free_disk=25.14798355102539GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 07:58:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:58:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:58:38 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Applying migration context for instance e36789b1-45e6-40f7-ba97-8962cb116a39 as it has an incoming, in-progress migration e079ba17-515d-44ed-8a81-250f95515ae9. Migration status is finished {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 22 07:58:38 user nova-compute[74348]: INFO nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Updating resource usage from migration e079ba17-515d-44ed-8a81-250f95515ae9
Nov 22 07:58:38 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 059bde4a-c5c9-45ab-9b4a-c969c74a6083 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:58:38 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance bcedb385-b72a-49c2-b363-cf6da5804b60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:58:38 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 5f3bbae3-babf-44d2-96da-c459fb77d9c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:58:38 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Migration e079ba17-515d-44ed-8a81-250f95515ae9 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 22 07:58:38 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance e36789b1-45e6-40f7-ba97-8962cb116a39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:58:38 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 9c36455f-5fd6-4813-9c44-499e3742ed39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:58:38 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 765f8c47-c042-4430-8d35-07926ad693fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:58:38 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 84fd55a1-d62e-4191-923e-b5bf7cb47490 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:58:38 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 053355df-8b23-48fa-a0e1-9750314d72d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:58:38 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 07:58:38 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 07:58:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:38 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Refreshing inventories for resource provider 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 22 07:58:38 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Updating ProviderTree inventory for provider 52690f6a-773f-4e8d-be85-d278b6522975 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 22 07:58:38 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Updating inventory in ProviderTree for provider 52690f6a-773f-4e8d-be85-d278b6522975 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 22 07:58:38 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Refreshing aggregate associations for resource provider 52690f6a-773f-4e8d-be85-d278b6522975, aggregates: None {{(pid=74348) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 22 07:58:38 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Refreshing trait associations for resource provider 52690f6a-773f-4e8d-be85-d278b6522975, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=74348) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 22 07:58:39 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:58:39 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:58:39 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 07:58:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.053s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:58:39 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:58:39 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Cleaning up deleted instances {{(pid=74348) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 22 07:58:39 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] There are 0 instances to clean {{(pid=74348) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 22 07:58:39 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:58:39 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74348) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 22 07:58:39 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:40 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:58:40 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:58:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:44 user nova-compute[74348]: DEBUG nova.network.neutron [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Port 618bd526-892d-4dfb-8ba6-f65e83e3f467 binding to destination host user is already ACTIVE {{(pid=74348) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 22 07:58:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Acquiring lock "refresh_cache-e36789b1-45e6-40f7-ba97-8962cb116a39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:58:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Acquired lock "refresh_cache-e36789b1-45e6-40f7-ba97-8962cb116a39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:58:44 user nova-compute[74348]: DEBUG nova.network.neutron [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 07:58:44 user nova-compute[74348]: DEBUG nova.network.neutron [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Updating instance_info_cache with network_info: [{"id": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "address": "fa:16:3e:a7:50:2a", "network": {"id": "8a783b63-dae2-41eb-a00a-5cf8e94a5412", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872095489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beaa9566ba2842d49f843dbddc59854d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap618bd526-89", "ovs_interfaceid": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:58:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Releasing lock "refresh_cache-e36789b1-45e6-40f7-ba97-8962cb116a39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:58:44 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Creating tmpfile /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/tmpx29_2bpo to verify with other compute node that the instance is on the same shared storage. {{(pid=74348) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 22 07:58:44 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-234c6c78-2f36-4fc0-bdad-9d1bc5e3f762 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 5f3bbae3-babf-44d2-96da-c459fb77d9c7 is timed out.
Nov 22 07:58:44 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-234c6c78-2f36-4fc0-bdad-9d1bc5e3f762 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Successfully detached device vdc from instance 5f3bbae3-babf-44d2-96da-c459fb77d9c7 from the live domain config.
Nov 22 07:58:44 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-234c6c78-2f36-4fc0-bdad-9d1bc5e3f762 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 07:58:44 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-234c6c78-2f36-4fc0-bdad-9d1bc5e3f762 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'roLgUcmF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:58:44 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-234c6c78-2f36-4fc0-bdad-9d1bc5e3f762 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:58:44 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-234c6c78-2f36-4fc0-bdad-9d1bc5e3f762 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:58:44 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-234c6c78-2f36-4fc0-bdad-9d1bc5e3f762 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:58:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:44 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:44 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa862ab8-4e0f-4bb1-952a-1974f492acd5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:58:44 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-234c6c78-2f36-4fc0-bdad-9d1bc5e3f762 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 07:58:44 user nova-compute[74348]: No targets found.
Nov 22 07:58:44 user nova-compute[74348]: iSNS:
Nov 22 07:58:44 user nova-compute[74348]: No targets found.
Nov 22 07:58:44 user nova-compute[74348]: STATIC:
Nov 22 07:58:44 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee
Nov 22 07:58:44 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:58:44 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:58:44 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730
Nov 22 07:58:44 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:58:44 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:58:44 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803
Nov 22 07:58:44 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:58:44 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:58:44 user nova-compute[74348]: FIRMWARE:
Nov 22 07:58:44 user nova-compute[74348]: No targets found.
Nov 22 07:58:44 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:58:44 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-234c6c78-2f36-4fc0-bdad-9d1bc5e3f762 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 07:58:44 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 07:58:44 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 07:58:44 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-234c6c78-2f36-4fc0-bdad-9d1bc5e3f762 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 07:58:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:44 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[10fa72e4-8e38-426a-86ed-dceecc060237]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:58:44 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:44 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6546fb-54e6-416e-a7b9-572902401bfd]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:58:44 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-234c6c78-2f36-4fc0-bdad-9d1bc5e3f762 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)
Nov 22 07:58:44 user nova-compute[74348]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee (non-flash)
Nov 22 07:58:44 user nova-compute[74348]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 07:58:44 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:58:44 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-234c6c78-2f36-4fc0-bdad-9d1bc5e3f762 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)
Nov 22 07:58:44 user nova-compute[74348]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee (non-flash)
Nov 22 07:58:44 user nova-compute[74348]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 07:58:44 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:58:44 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-234c6c78-2f36-4fc0-bdad-9d1bc5e3f762 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f224c495090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee'): ({'sde'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 07:58:44 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-234c6c78-2f36-4fc0-bdad-9d1bc5e3f762 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Removing single pathed devices sde {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 07:58:44 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:44 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.039s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:44 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edbd99d-5114-4a91-8f42-2603a3b99db7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:58:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.043s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[62aef5ef-d3e9-4468-bdf3-7ad27cc6e948]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-234c6c78-2f36-4fc0-bdad-9d1bc5e3f762 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Flushing IO for device /dev/sde {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38a5f58-0732-407e-b563-9702c2ef8243]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-234c6c78-2f36-4fc0-bdad-9d1bc5e3f762 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.056s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[93323d98-8d0e-41b4-88bd-4ff0523c47fd]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-234c6c78-2f36-4fc0-bdad-9d1bc5e3f762 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-234c6c78-2f36-4fc0-bdad-9d1bc5e3f762 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] SCSI volumes sde have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-234c6c78-2f36-4fc0-bdad-9d1bc5e3f762 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff6697e-9338-488d-a0e4-39bbe78c38c8]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-234c6c78-2f36-4fc0-bdad-9d1bc5e3f762 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG nova.compute.manager [req-35660efe-75d7-40a4-b1fb-eedc3ec58269 req-6afc0c3c-a937-410e-9e30-7d544518cc59 service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Received event network-vif-unplugged-618bd526-892d-4dfb-8ba6-f65e83e3f467 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-35660efe-75d7-40a4-b1fb-eedc3ec58269 req-6afc0c3c-a937-410e-9e30-7d544518cc59 service nova] Acquiring lock "e36789b1-45e6-40f7-ba97-8962cb116a39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-35660efe-75d7-40a4-b1fb-eedc3ec58269 req-6afc0c3c-a937-410e-9e30-7d544518cc59 service nova] Lock "e36789b1-45e6-40f7-ba97-8962cb116a39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-35660efe-75d7-40a4-b1fb-eedc3ec58269 req-6afc0c3c-a937-410e-9e30-7d544518cc59 service nova] Lock "e36789b1-45e6-40f7-ba97-8962cb116a39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG nova.compute.manager [req-35660efe-75d7-40a4-b1fb-eedc3ec58269 req-6afc0c3c-a937-410e-9e30-7d544518cc59 service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] No waiting events found dispatching network-vif-unplugged-618bd526-892d-4dfb-8ba6-f65e83e3f467 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:58:45 user nova-compute[74348]: WARNING nova.compute.manager [req-35660efe-75d7-40a4-b1fb-eedc3ec58269 req-6afc0c3c-a937-410e-9e30-7d544518cc59 service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Received unexpected event network-vif-unplugged-618bd526-892d-4dfb-8ba6-f65e83e3f467 for instance with vm_state resized and task_state resize_reverting.
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e004e94c-9f3a-4b26-94db-e593c77999ba]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-234c6c78-2f36-4fc0-bdad-9d1bc5e3f762 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee, portal: 172.16.0.220,3260]
Nov 22 07:58:45 user nova-compute[74348]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee, portal: 172.16.0.220,3260] successful.
Nov 22 07:58:45 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89d26526-c4cd-414b-a30a-b4c7bc0b7aee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8b94f9-5054-439f-a9c0-f4f5392c4422]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-234c6c78-2f36-4fc0-bdad-9d1bc5e3f762 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-234c6c78-2f36-4fc0-bdad-9d1bc5e3f762 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.436s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-234c6c78-2f36-4fc0-bdad-9d1bc5e3f762 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] <== disconnect_volume: return (437ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-234c6c78-2f36-4fc0-bdad-9d1bc5e3f762 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 07:58:45 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Instance destroyed successfully.
Nov 22 07:58:45 user nova-compute[74348]: DEBUG nova.objects.instance [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lazy-loading 'resources' on Instance uuid e36789b1-45e6-40f7-ba97-8962cb116a39 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2131516711',display_name='tempest-ServerActionsTestOtherB-server-2131516711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2131516711',id=4,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNk1MOJm11bQ93eU1QYv8ji0a1vxy2ayCOX/9R0SEaykivxTwmzY2ykLPWhT+1BMkwgumhcTt15jzBxURGp9c6w0OYjMGs9IXzcm5BaMYRSciSb/BXxgpEqQZEDxBbmLrQ==',key_name='tempest-keypair-1880925410',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:57:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='beaa9566ba2842d49f843dbddc59854d',ramdisk_id='',reservation_id='r-0nqnkret',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-849589705',owner_user_name='tempest-ServerActionsTestOtherB-849589705-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T07:57:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3b62e16105c4210bfc24e71c09ede28',uuid=e36789b1-45e6-40f7-ba97-8962cb116a39,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "address": "fa:16:3e:a7:50:2a", "network": {"id": "8a783b63-dae2-41eb-a00a-5cf8e94a5412", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872095489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beaa9566ba2842d49f843dbddc59854d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap618bd526-89", "ovs_interfaceid": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Converting VIF {"id": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "address": "fa:16:3e:a7:50:2a", "network": {"id": "8a783b63-dae2-41eb-a00a-5cf8e94a5412", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872095489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beaa9566ba2842d49f843dbddc59854d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap618bd526-89", "ovs_interfaceid": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:50:2a,bridge_name='br-int',has_traffic_filtering=True,id=618bd526-892d-4dfb-8ba6-f65e83e3f467,network=Network(8a783b63-dae2-41eb-a00a-5cf8e94a5412),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap618bd526-89') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG os_vif [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:50:2a,bridge_name='br-int',has_traffic_filtering=True,id=618bd526-892d-4dfb-8ba6-f65e83e3f467,network=Network(8a783b63-dae2-41eb-a00a-5cf8e94a5412),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap618bd526-89') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap618bd526-89, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0ff1d67d-7176-4970-9a59-e60fdbe4a156) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:58:45 user nova-compute[74348]: INFO os_vif [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:50:2a,bridge_name='br-int',has_traffic_filtering=True,id=618bd526-892d-4dfb-8ba6-f65e83e3f467,network=Network(8a783b63-dae2-41eb-a00a-5cf8e94a5412),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap618bd526-89')
Nov 22 07:58:45 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RoQzpAmu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:58:45 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:58:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8578d7c-7eb6-4ce8-a729-a55645d1cb86]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 07:58:45 user nova-compute[74348]: No targets found.
Nov 22 07:58:45 user nova-compute[74348]: iSNS:
Nov 22 07:58:45 user nova-compute[74348]: No targets found.
Nov 22 07:58:45 user nova-compute[74348]: STATIC:
Nov 22 07:58:45 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730
Nov 22 07:58:45 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:58:45 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:58:45 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803
Nov 22 07:58:45 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:58:45 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:58:45 user nova-compute[74348]: FIRMWARE:
Nov 22 07:58:45 user nova-compute[74348]: No targets found.
Nov 22 07:58:45 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 07:58:45 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 07:58:45 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb963562-92f9-4234-9cc7-0b655cee9903]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ae091b-6f7f-43d3-b64a-ab7d1e6faa49]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)
Nov 22 07:58:45 user nova-compute[74348]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 07:58:45 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)
Nov 22 07:58:45 user nova-compute[74348]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 07:58:45 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f224c3743a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730'): ({'sdd'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Removing single pathed devices sdd {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.100s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f412f640-525d-4e9e-8cd3-36c29aad8a33]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[689fa03d-3416-4d20-96d3-7242785b9b68]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Flushing IO for device /dev/sdd {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ef97c7-d2ba-4f9b-b121-46045f0c3f04]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a072dff-b56e-4b29-8684-152875ebac39]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] SCSI volumes sdd have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbcdf90-c097-42d0-a9de-2e26cdacbd98]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ee2850-782f-4afc-8a17-10a72a9d82c2]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730, portal: 172.16.0.220,3260]
Nov 22 07:58:45 user nova-compute[74348]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730, portal: 172.16.0.220,3260] successful.
Nov 22 07:58:45 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:58:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:46 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6106045e-c634-480d-9bff-cb1820314e2d]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:58:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:58:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.438s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:58:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] <== disconnect_volume: return (439ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:58:46 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 07:58:46 user nova-compute[74348]: DEBUG nova.objects.instance [None req-234c6c78-2f36-4fc0-bdad-9d1bc5e3f762 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lazy-loading 'flavor' on Instance uuid 5f3bbae3-babf-44d2-96da-c459fb77d9c7 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:58:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-234c6c78-2f36-4fc0-bdad-9d1bc5e3f762 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "5f3bbae3-babf-44d2-96da-c459fb77d9c7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.293s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:58:46 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:58:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:58:47 user nova-compute[74348]: DEBUG nova.objects.instance [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lazy-loading 'migration_context' on Instance uuid e36789b1-45e6-40f7-ba97-8962cb116a39 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:58:47 user nova-compute[74348]: DEBUG nova.objects.base [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Object Instance<e36789b1-45e6-40f7-ba97-8962cb116a39> lazy-loaded attributes: resources,migration_context {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 07:58:47 user nova-compute[74348]: DEBUG nova.compute.manager [req-55b8b330-3568-4677-9456-d675724ecd08 req-da6a6d3f-d59b-433a-9218-a302087b195c service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Received event network-vif-plugged-618bd526-892d-4dfb-8ba6-f65e83e3f467 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:58:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-55b8b330-3568-4677-9456-d675724ecd08 req-da6a6d3f-d59b-433a-9218-a302087b195c service nova] Acquiring lock "e36789b1-45e6-40f7-ba97-8962cb116a39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:58:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-55b8b330-3568-4677-9456-d675724ecd08 req-da6a6d3f-d59b-433a-9218-a302087b195c service nova] Lock "e36789b1-45e6-40f7-ba97-8962cb116a39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:58:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-55b8b330-3568-4677-9456-d675724ecd08 req-da6a6d3f-d59b-433a-9218-a302087b195c service nova] Lock "e36789b1-45e6-40f7-ba97-8962cb116a39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:58:47 user nova-compute[74348]: DEBUG nova.compute.manager [req-55b8b330-3568-4677-9456-d675724ecd08 req-da6a6d3f-d59b-433a-9218-a302087b195c service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] No waiting events found dispatching network-vif-plugged-618bd526-892d-4dfb-8ba6-f65e83e3f467 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:58:47 user nova-compute[74348]: WARNING nova.compute.manager [req-55b8b330-3568-4677-9456-d675724ecd08 req-da6a6d3f-d59b-433a-9218-a302087b195c service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Received unexpected event network-vif-plugged-618bd526-892d-4dfb-8ba6-f65e83e3f467 for instance with vm_state resized and task_state resize_reverting.
Nov 22 07:58:47 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:58:47 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:58:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.573s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:58:47 user nova-compute[74348]: INFO nova.compute.manager [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Swapping old allocation on dict_keys(['52690f6a-773f-4e8d-be85-d278b6522975']) held by migration e079ba17-515d-44ed-8a81-250f95515ae9 for instance
Nov 22 07:58:48 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Overwriting current allocation {'allocations': {'52690f6a-773f-4e8d-be85-d278b6522975': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 23}}, 'project_id': 'beaa9566ba2842d49f843dbddc59854d', 'user_id': 'a3b62e16105c4210bfc24e71c09ede28', 'consumer_generation': 1} on consumer e36789b1-45e6-40f7-ba97-8962cb116a39 {{(pid=74348) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 22 07:58:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Acquiring lock "refresh_cache-e36789b1-45e6-40f7-ba97-8962cb116a39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:58:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Acquired lock "refresh_cache-e36789b1-45e6-40f7-ba97-8962cb116a39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:58:48 user nova-compute[74348]: DEBUG nova.network.neutron [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 07:58:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:48 user nova-compute[74348]: DEBUG nova.network.neutron [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Updating instance_info_cache with network_info: [{"id": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "address": "fa:16:3e:a7:50:2a", "network": {"id": "8a783b63-dae2-41eb-a00a-5cf8e94a5412", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872095489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beaa9566ba2842d49f843dbddc59854d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap618bd526-89", "ovs_interfaceid": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:58:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Releasing lock "refresh_cache-e36789b1-45e6-40f7-ba97-8962cb116a39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:58:48 user nova-compute[74348]: DEBUG os_brick.utils [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:58:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a57686d-0c5f-40cc-bf1d-989cf477425b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:58:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbf6cff-3277-432b-9bbd-2b6c3850116f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:58:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71e927d-d33c-4364-8b3b-80d70c61c9b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:58:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5061933c-b1ca-462c-bdf0-aa81be4024ed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:58:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 07:58:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 07:58:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 07:58:48 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 07:58:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[271c8f57-492c-4462-b66d-1c4b50bcf75d]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:58:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 07:58:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 07:58:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 07:58:48 user nova-compute[74348]: DEBUG os_brick.utils [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:58:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:50 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Acquiring lock "a635cbbc-6b87-4877-80a8-bd4001c407c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:58:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "a635cbbc-6b87-4877-80a8-bd4001c407c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:58:53 user nova-compute[74348]: DEBUG nova.compute.manager [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 07:58:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:58:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:58:54 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 07:58:54 user nova-compute[74348]: INFO nova.compute.claims [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Claim successful on node user
Nov 22 07:58:54 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:58:54 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:58:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.415s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:58:54 user nova-compute[74348]: DEBUG nova.compute.manager [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 07:58:54 user nova-compute[74348]: DEBUG nova.compute.manager [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 07:58:54 user nova-compute[74348]: DEBUG nova.network.neutron [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 07:58:54 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 07:58:54 user nova-compute[74348]: DEBUG nova.compute.manager [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 07:58:54 user nova-compute[74348]: DEBUG nova.policy [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cbd1eed03be64a42b8ba9d0200b10692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d76d03d17cc4e5bb52a32a2f8fbd629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 07:58:54 user nova-compute[74348]: DEBUG nova.compute.manager [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 07:58:54 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 07:58:54 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Creating image(s)
Nov 22 07:58:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Acquiring lock "/opt/stack/data/nova/instances/a635cbbc-6b87-4877-80a8-bd4001c407c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:58:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "/opt/stack/data/nova/instances/a635cbbc-6b87-4877-80a8-bd4001c407c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:58:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "/opt/stack/data/nova/instances/a635cbbc-6b87-4877-80a8-bd4001c407c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.022s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:58:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Acquiring lock "b7a5e4adbbfeb9a70d9166224120b3b8d8eb4b0b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:58:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "b7a5e4adbbfeb9a70d9166224120b3b8d8eb4b0b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:58:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7a5e4adbbfeb9a70d9166224120b3b8d8eb4b0b.part --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:55 user nova-compute[74348]: DEBUG nova.network.neutron [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Successfully created port: 25edb763-90ad-43e6-98c1-6baf85e723d5 {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 07:58:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7a5e4adbbfeb9a70d9166224120b3b8d8eb4b0b.part --force-share --output=json" returned: 0 in 0.211s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:55 user nova-compute[74348]: DEBUG nova.virt.images [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] 4f886734-5ace-46df-b52c-e3caa804822c was qcow2, converting to raw {{(pid=74348) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 22 07:58:55 user nova-compute[74348]: DEBUG nova.privsep.utils [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74348) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 07:58:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b7a5e4adbbfeb9a70d9166224120b3b8d8eb4b0b.part /opt/stack/data/nova/instances/_base/b7a5e4adbbfeb9a70d9166224120b3b8d8eb4b0b.converted {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b7a5e4adbbfeb9a70d9166224120b3b8d8eb4b0b.part /opt/stack/data/nova/instances/_base/b7a5e4adbbfeb9a70d9166224120b3b8d8eb4b0b.converted" returned: 0 in 0.206s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7a5e4adbbfeb9a70d9166224120b3b8d8eb4b0b.converted --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:55 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7a5e4adbbfeb9a70d9166224120b3b8d8eb4b0b.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "b7a5e4adbbfeb9a70d9166224120b3b8d8eb4b0b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.059s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:58:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7a5e4adbbfeb9a70d9166224120b3b8d8eb4b0b --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:55 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Starting finish_revert_migration {{(pid=74348) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 22 07:58:55 user nova-compute[74348]: DEBUG nova.network.neutron [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Successfully updated port: 25edb763-90ad-43e6-98c1-6baf85e723d5 {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 07:58:55 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Start _get_guest_xml network_info=[{"id": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "address": "fa:16:3e:a7:50:2a", "network": {"id": "8a783b63-dae2-41eb-a00a-5cf8e94a5412", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872095489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beaa9566ba2842d49f843dbddc59854d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap618bd526-89", "ovs_interfaceid": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RoQzpAmu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'e36789b1-45e6-40f7-ba97-8962cb116a39', 'attached_at': '2023-11-22T07:58:56.000000', 'detached_at': '', 'volume_id': 'd39d80c0-03af-4337-8739-906a6e6a5730', 'serial': 'd39d80c0-03af-4337-8739-906a6e6a5730'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'attachment_id': 'e799ba8a-fb44-434e-bc0b-fc22fde0086d', 'volume_type': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 07:58:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Acquiring lock "refresh_cache-a635cbbc-6b87-4877-80a8-bd4001c407c6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:58:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Acquired lock "refresh_cache-a635cbbc-6b87-4877-80a8-bd4001c407c6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:58:55 user nova-compute[74348]: DEBUG nova.network.neutron [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 07:58:55 user nova-compute[74348]: DEBUG nova.compute.manager [req-4ef43aec-6cda-4689-a6df-6e81fa5ddfbc req-3c6c6494-ebc8-4500-9b2e-072dfc98e87e service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Received event network-changed-25edb763-90ad-43e6-98c1-6baf85e723d5 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:58:55 user nova-compute[74348]: DEBUG nova.compute.manager [req-4ef43aec-6cda-4689-a6df-6e81fa5ddfbc req-3c6c6494-ebc8-4500-9b2e-072dfc98e87e service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Refreshing instance network info cache due to event network-changed-25edb763-90ad-43e6-98c1-6baf85e723d5. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:58:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4ef43aec-6cda-4689-a6df-6e81fa5ddfbc req-3c6c6494-ebc8-4500-9b2e-072dfc98e87e service nova] Acquiring lock "refresh_cache-a635cbbc-6b87-4877-80a8-bd4001c407c6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:58:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7a5e4adbbfeb9a70d9166224120b3b8d8eb4b0b --force-share --output=json" returned: 0 in 0.222s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Acquiring lock "b7a5e4adbbfeb9a70d9166224120b3b8d8eb4b0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:58:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "b7a5e4adbbfeb9a70d9166224120b3b8d8eb4b0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:58:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7a5e4adbbfeb9a70d9166224120b3b8d8eb4b0b --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:56 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:58:56 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.objects.instance [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lazy-loading 'vcpu_model' on Instance uuid e36789b1-45e6-40f7-ba97-8962cb116a39 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RoQzpAmu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:58:56 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:58:56 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:58:56 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:58:56 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:58:56 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.network.neutron [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6afbb89c-ca4a-4875-b6a5-d64855ef3ae4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 07:58:56 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46199cd-a933-4c67-8a17-7741a3898e27]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730] added
Nov 22 07:58:56 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7a5e4adbbfeb9a70d9166224120b3b8d8eb4b0b --force-share --output=json" returned: 0 in 0.187s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7a5e4adbbfeb9a70d9166224120b3b8d8eb4b0b,backing_fmt=raw /opt/stack/data/nova/instances/a635cbbc-6b87-4877-80a8-bd4001c407c6/disk 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aac1c3b-8a4c-4dfa-aa22-f058fbe03479]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7a5e4adbbfeb9a70d9166224120b3b8d8eb4b0b,backing_fmt=raw /opt/stack/data/nova/instances/a635cbbc-6b87-4877-80a8-bd4001c407c6/disk 1073741824" returned: 0 in 0.054s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "b7a5e4adbbfeb9a70d9166224120b3b8d8eb4b0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7a5e4adbbfeb9a70d9166224120b3b8d8eb4b0b --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8edea892-2a43-4f41-a9ea-f2e1baf01513]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RoQzpAmu {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RoQzpAmu" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[accee9e3-0134-41d3-93f1-e7a19c8456d1]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RoQzpAmu'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3bdd5e-4cc9-4e02-8a51-10f45b052673]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42e53c2-b42e-4e26-967f-7af5e75bd841]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)
Nov 22 07:58:56 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)
Nov 22 07:58:56 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec190b4-c72d-4fa4-851a-3230ec973557]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7a5e4adbbfeb9a70d9166224120b3b8d8eb4b0b --force-share --output=json" returned: 0 in 0.187s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730, portal: 172.16.0.220,3260]
Nov 22 07:58:56 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730, portal: 172.16.0.220,3260] successful.
Nov 22 07:58:56 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a635cbbc-6b87-4877-80a8-bd4001c407c6/disk. size=1073741824 {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a635cbbc-6b87-4877-80a8-bd4001c407c6/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f402e150-1905-49c0-8e7b-b627f2c62d1d]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.network.neutron [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Updating instance_info_cache with network_info: [{"id": "25edb763-90ad-43e6-98c1-6baf85e723d5", "address": "fa:16:3e:a5:2d:c8", "network": {"id": "442abc57-45e5-4cd7-878e-979afa78c421", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1395369508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d76d03d17cc4e5bb52a32a2f8fbd629", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25edb763-90", "ovs_interfaceid": "25edb763-90ad-43e6-98c1-6baf85e723d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Releasing lock "refresh_cache-a635cbbc-6b87-4877-80a8-bd4001c407c6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.compute.manager [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Instance network_info: |[{"id": "25edb763-90ad-43e6-98c1-6baf85e723d5", "address": "fa:16:3e:a5:2d:c8", "network": {"id": "442abc57-45e5-4cd7-878e-979afa78c421", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1395369508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d76d03d17cc4e5bb52a32a2f8fbd629", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25edb763-90", "ovs_interfaceid": "25edb763-90ad-43e6-98c1-6baf85e723d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4ef43aec-6cda-4689-a6df-6e81fa5ddfbc req-3c6c6494-ebc8-4500-9b2e-072dfc98e87e service nova] Acquired lock "refresh_cache-a635cbbc-6b87-4877-80a8-bd4001c407c6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.network.neutron [req-4ef43aec-6cda-4689-a6df-6e81fa5ddfbc req-3c6c6494-ebc8-4500-9b2e-072dfc98e87e service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Refreshing network info cache for port 25edb763-90ad-43e6-98c1-6baf85e723d5 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[52cdf9ff-38b9-41a9-95b2-365e917e0b9f]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)
Nov 22 07:58:56 user nova-compute[74348]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 07:58:56 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)
Nov 22 07:58:56 user nova-compute[74348]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 07:58:56 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.413s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.036s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0060311a-d23d-4b17-8a5e-b2c44cafbf84]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: None {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a635cbbc-6b87-4877-80a8-bd4001c407c6/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Cannot resize image /opt/stack/data/nova/instances/a635cbbc-6b87-4877-80a8-bd4001c407c6/disk to a smaller size. {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Ensure instance console log exists: /opt/stack/data/nova/instances/a635cbbc-6b87-4877-80a8-bd4001c407c6/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Start _get_guest_xml network_info=[{"id": "25edb763-90ad-43e6-98c1-6baf85e723d5", "address": "fa:16:3e:a5:2d:c8", "network": {"id": "442abc57-45e5-4cd7-878e-979afa78c421", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1395369508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d76d03d17cc4e5bb52a32a2f8fbd629", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25edb763-90", "ovs_interfaceid": "25edb763-90ad-43e6-98c1-6baf85e723d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:58:50Z,direct_url=<?>,disk_format='qcow2',id=4f886734-5ace-46df-b52c-e3caa804822c,min_disk=0,min_ram=0,name='tempest-scenario-img--943699153',owner='0d76d03d17cc4e5bb52a32a2f8fbd629',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:58:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '4f886734-5ace-46df-b52c-e3caa804822c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 07:58:56 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:58:56 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:58:50Z,direct_url=<?>,disk_format='qcow2',id=4f886734-5ace-46df-b52c-e3caa804822c,min_disk=0,min_ram=0,name='tempest-scenario-img--943699153',owner='0d76d03d17cc4e5bb52a32a2f8fbd629',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:58:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:58:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1710778813',display_name='tempest-TestMinimumBasicScenario-server-1710778813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1710778813',id=19,image_ref='4f886734-5ace-46df-b52c-e3caa804822c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPf9GX11OafuHoT9ofuhjFoeTzRRPmShTAJMsT9i8I5ORMZS0S45M55gXRkwQTzdVnPq3dOA8Rf2U6W4vgKlq0UG1bzKFpjnmYUsgpcIBDzhWNaz3dJyseDrhmQvEX4BQw==',key_name='tempest-TestMinimumBasicScenario-1841491850',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d76d03d17cc4e5bb52a32a2f8fbd629',ramdisk_id='',reservation_id='r-9lpz0te2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f886734-5ace-46df-b52c-e3caa804822c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1824455706',owner_user_name='tempest-TestMinimumBasicScenario-1824455706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:58:55Z,user_data=None,user_id='cbd1eed03be64a42b8ba9d0200b10692',uuid=a635cbbc-6b87-4877-80a8-bd4001c407c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25edb763-90ad-43e6-98c1-6baf85e723d5", "address": "fa:16:3e:a5:2d:c8", "network": {"id": "442abc57-45e5-4cd7-878e-979afa78c421", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1395369508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d76d03d17cc4e5bb52a32a2f8fbd629", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25edb763-90", "ovs_interfaceid": "25edb763-90ad-43e6-98c1-6baf85e723d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Converting VIF {"id": "25edb763-90ad-43e6-98c1-6baf85e723d5", "address": "fa:16:3e:a5:2d:c8", "network": {"id": "442abc57-45e5-4cd7-878e-979afa78c421", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1395369508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d76d03d17cc4e5bb52a32a2f8fbd629", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25edb763-90", "ovs_interfaceid": "25edb763-90ad-43e6-98c1-6baf85e723d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:2d:c8,bridge_name='br-int',has_traffic_filtering=True,id=25edb763-90ad-43e6-98c1-6baf85e723d5,network=Network(442abc57-45e5-4cd7-878e-979afa78c421),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25edb763-90') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.objects.instance [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lazy-loading 'pci_devices' on Instance uuid a635cbbc-6b87-4877-80a8-bd4001c407c6 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] End _get_guest_xml xml=<domain type="kvm">
Nov 22 07:58:56 user nova-compute[74348]:   <uuid>a635cbbc-6b87-4877-80a8-bd4001c407c6</uuid>
Nov 22 07:58:56 user nova-compute[74348]:   <name>instance-00000013</name>
Nov 22 07:58:56 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 07:58:56 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 07:58:56 user nova-compute[74348]:   <metadata>
Nov 22 07:58:56 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 07:58:56 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 07:58:56 user nova-compute[74348]:       <nova:name>tempest-TestMinimumBasicScenario-server-1710778813</nova:name>
Nov 22 07:58:56 user nova-compute[74348]:       <nova:creationTime>2023-11-22 07:58:56</nova:creationTime>
Nov 22 07:58:56 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 07:58:56 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 07:58:56 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 07:58:56 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 07:58:56 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 07:58:56 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 07:58:56 user nova-compute[74348]:       </nova:flavor>
Nov 22 07:58:56 user nova-compute[74348]:       <nova:owner>
Nov 22 07:58:56 user nova-compute[74348]:         <nova:user uuid="cbd1eed03be64a42b8ba9d0200b10692">tempest-TestMinimumBasicScenario-1824455706-project-member</nova:user>
Nov 22 07:58:56 user nova-compute[74348]:         <nova:project uuid="0d76d03d17cc4e5bb52a32a2f8fbd629">tempest-TestMinimumBasicScenario-1824455706</nova:project>
Nov 22 07:58:56 user nova-compute[74348]:       </nova:owner>
Nov 22 07:58:56 user nova-compute[74348]:       <nova:root type="image" uuid="4f886734-5ace-46df-b52c-e3caa804822c"/>
Nov 22 07:58:56 user nova-compute[74348]:       <nova:ports>
Nov 22 07:58:56 user nova-compute[74348]:         <nova:port uuid="25edb763-90ad-43e6-98c1-6baf85e723d5">
Nov 22 07:58:56 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 22 07:58:56 user nova-compute[74348]:         </nova:port>
Nov 22 07:58:56 user nova-compute[74348]:       </nova:ports>
Nov 22 07:58:56 user nova-compute[74348]:     </nova:instance>
Nov 22 07:58:56 user nova-compute[74348]:   </metadata>
Nov 22 07:58:56 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 07:58:56 user nova-compute[74348]:     <system>
Nov 22 07:58:56 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 07:58:56 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 07:58:56 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 07:58:56 user nova-compute[74348]:       <entry name="serial">a635cbbc-6b87-4877-80a8-bd4001c407c6</entry>
Nov 22 07:58:56 user nova-compute[74348]:       <entry name="uuid">a635cbbc-6b87-4877-80a8-bd4001c407c6</entry>
Nov 22 07:58:56 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 07:58:56 user nova-compute[74348]:     </system>
Nov 22 07:58:56 user nova-compute[74348]:   </sysinfo>
Nov 22 07:58:56 user nova-compute[74348]:   <os>
Nov 22 07:58:56 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 07:58:56 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 07:58:56 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 07:58:56 user nova-compute[74348]:   </os>
Nov 22 07:58:56 user nova-compute[74348]:   <features>
Nov 22 07:58:56 user nova-compute[74348]:     <acpi/>
Nov 22 07:58:56 user nova-compute[74348]:     <apic/>
Nov 22 07:58:56 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 07:58:56 user nova-compute[74348]:   </features>
Nov 22 07:58:56 user nova-compute[74348]:   <clock offset="utc">
Nov 22 07:58:56 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 07:58:56 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 07:58:56 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 07:58:56 user nova-compute[74348]:   </clock>
Nov 22 07:58:56 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 07:58:56 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 07:58:56 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 07:58:56 user nova-compute[74348]:   </cpu>
Nov 22 07:58:56 user nova-compute[74348]:   <devices>
Nov 22 07:58:56 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 07:58:56 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 07:58:56 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/a635cbbc-6b87-4877-80a8-bd4001c407c6/disk"/>
Nov 22 07:58:56 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 07:58:56 user nova-compute[74348]:     </disk>
Nov 22 07:58:56 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 07:58:56 user nova-compute[74348]:       <mac address="fa:16:3e:a5:2d:c8"/>
Nov 22 07:58:56 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:58:56 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 07:58:56 user nova-compute[74348]:       <target dev="tap25edb763-90"/>
Nov 22 07:58:56 user nova-compute[74348]:     </interface>
Nov 22 07:58:56 user nova-compute[74348]:     <serial type="pty">
Nov 22 07:58:56 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/a635cbbc-6b87-4877-80a8-bd4001c407c6/console.log" append="off"/>
Nov 22 07:58:56 user nova-compute[74348]:     </serial>
Nov 22 07:58:56 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 07:58:56 user nova-compute[74348]:     <video>
Nov 22 07:58:56 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:58:56 user nova-compute[74348]:     </video>
Nov 22 07:58:56 user nova-compute[74348]:     <rng model="virtio">
Nov 22 07:58:56 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 07:58:56 user nova-compute[74348]:     </rng>
Nov 22 07:58:56 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 07:58:56 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 07:58:56 user nova-compute[74348]:       <stats period="10"/>
Nov 22 07:58:56 user nova-compute[74348]:     </memballoon>
Nov 22 07:58:56 user nova-compute[74348]:   </devices>
Nov 22 07:58:56 user nova-compute[74348]: </domain>
Nov 22 07:58:56 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:58:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1710778813',display_name='tempest-TestMinimumBasicScenario-server-1710778813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1710778813',id=19,image_ref='4f886734-5ace-46df-b52c-e3caa804822c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPf9GX11OafuHoT9ofuhjFoeTzRRPmShTAJMsT9i8I5ORMZS0S45M55gXRkwQTzdVnPq3dOA8Rf2U6W4vgKlq0UG1bzKFpjnmYUsgpcIBDzhWNaz3dJyseDrhmQvEX4BQw==',key_name='tempest-TestMinimumBasicScenario-1841491850',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d76d03d17cc4e5bb52a32a2f8fbd629',ramdisk_id='',reservation_id='r-9lpz0te2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f886734-5ace-46df-b52c-e3caa804822c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1824455706',owner_user_name='tempest-TestMinimumBasicScenario-1824455706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:58:55Z,user_data=None,user_id='cbd1eed03be64a42b8ba9d0200b10692',uuid=a635cbbc-6b87-4877-80a8-bd4001c407c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25edb763-90ad-43e6-98c1-6baf85e723d5", "address": "fa:16:3e:a5:2d:c8", "network": {"id": "442abc57-45e5-4cd7-878e-979afa78c421", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1395369508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d76d03d17cc4e5bb52a32a2f8fbd629", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25edb763-90", "ovs_interfaceid": "25edb763-90ad-43e6-98c1-6baf85e723d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Converting VIF {"id": "25edb763-90ad-43e6-98c1-6baf85e723d5", "address": "fa:16:3e:a5:2d:c8", "network": {"id": "442abc57-45e5-4cd7-878e-979afa78c421", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1395369508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d76d03d17cc4e5bb52a32a2f8fbd629", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25edb763-90", "ovs_interfaceid": "25edb763-90ad-43e6-98c1-6baf85e723d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:2d:c8,bridge_name='br-int',has_traffic_filtering=True,id=25edb763-90ad-43e6-98c1-6baf85e723d5,network=Network(442abc57-45e5-4cd7-878e-979afa78c421),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25edb763-90') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG os_vif [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:2d:c8,bridge_name='br-int',has_traffic_filtering=True,id=25edb763-90ad-43e6-98c1-6baf85e723d5,network=Network(442abc57-45e5-4cd7-878e-979afa78c421),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25edb763-90') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '22677d9b-4595-5d29-8e86-11f9820cf040', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25edb763-90, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap25edb763-90, col_values=(('qos', UUID('c49b6cc7-1001-4d2c-9411-ecebcbba9826')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap25edb763-90, col_values=(('external_ids', {'iface-id': '25edb763-90ad-43e6-98c1-6baf85e723d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:2d:c8', 'vm-uuid': 'a635cbbc-6b87-4877-80a8-bd4001c407c6'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:56 user nova-compute[74348]: INFO os_vif [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:2d:c8,bridge_name='br-int',has_traffic_filtering=True,id=25edb763-90ad-43e6-98c1-6baf85e723d5,network=Network(442abc57-45e5-4cd7-878e-979afa78c421),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25edb763-90')
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] No VIF found with MAC fa:16:3e:a5:2d:c8, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.network.neutron [req-4ef43aec-6cda-4689-a6df-6e81fa5ddfbc req-3c6c6494-ebc8-4500-9b2e-072dfc98e87e service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Updated VIF entry in instance network info cache for port 25edb763-90ad-43e6-98c1-6baf85e723d5. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG nova.network.neutron [req-4ef43aec-6cda-4689-a6df-6e81fa5ddfbc req-3c6c6494-ebc8-4500-9b2e-072dfc98e87e service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Updating instance_info_cache with network_info: [{"id": "25edb763-90ad-43e6-98c1-6baf85e723d5", "address": "fa:16:3e:a5:2d:c8", "network": {"id": "442abc57-45e5-4cd7-878e-979afa78c421", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1395369508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d76d03d17cc4e5bb52a32a2f8fbd629", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25edb763-90", "ovs_interfaceid": "25edb763-90ad-43e6-98c1-6baf85e723d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:58:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4ef43aec-6cda-4689-a6df-6e81fa5ddfbc req-3c6c6494-ebc8-4500-9b2e-072dfc98e87e service nova] Releasing lock "refresh_cache-a635cbbc-6b87-4877-80a8-bd4001c407c6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:58:57 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 07:58:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RoQzpAmu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 07:58:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.464s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:58:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] <== connect_volume: return (1466ms) {'type': 'block', 'scsi_wwn': '26331326434623339', 'path': '/dev/sdc'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:58:57 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331326434623339', 'path': '/dev/sdc'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 07:58:57 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2131516711',display_name='tempest-ServerActionsTestOtherB-server-2131516711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2131516711',id=4,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNk1MOJm11bQ93eU1QYv8ji0a1vxy2ayCOX/9R0SEaykivxTwmzY2ykLPWhT+1BMkwgumhcTt15jzBxURGp9c6w0OYjMGs9IXzcm5BaMYRSciSb/BXxgpEqQZEDxBbmLrQ==',key_name='tempest-keypair-1880925410',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:57:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='beaa9566ba2842d49f843dbddc59854d',ramdisk_id='',reservation_id='r-0nqnkret',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-849589705',owner_user_name='tempest-ServerActionsTestOtherB-849589705-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T07:58:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3b62e16105c4210bfc24e71c09ede28',uuid=e36789b1-45e6-40f7-ba97-8962cb116a39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "address": "fa:16:3e:a7:50:2a", "network": {"id": "8a783b63-dae2-41eb-a00a-5cf8e94a5412", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872095489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beaa9566ba2842d49f843dbddc59854d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap618bd526-89", "ovs_interfaceid": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 07:58:57 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Converting VIF {"id": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "address": "fa:16:3e:a7:50:2a", "network": {"id": "8a783b63-dae2-41eb-a00a-5cf8e94a5412", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872095489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beaa9566ba2842d49f843dbddc59854d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap618bd526-89", "ovs_interfaceid": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:58:57 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:50:2a,bridge_name='br-int',has_traffic_filtering=True,id=618bd526-892d-4dfb-8ba6-f65e83e3f467,network=Network(8a783b63-dae2-41eb-a00a-5cf8e94a5412),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap618bd526-89') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:58:57 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] End _get_guest_xml xml=<domain type="kvm">
Nov 22 07:58:57 user nova-compute[74348]:   <uuid>e36789b1-45e6-40f7-ba97-8962cb116a39</uuid>
Nov 22 07:58:57 user nova-compute[74348]:   <name>instance-00000004</name>
Nov 22 07:58:57 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 07:58:57 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 07:58:57 user nova-compute[74348]:   <metadata>
Nov 22 07:58:57 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 07:58:57 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 07:58:57 user nova-compute[74348]:       <nova:name>tempest-ServerActionsTestOtherB-server-2131516711</nova:name>
Nov 22 07:58:57 user nova-compute[74348]:       <nova:creationTime>2023-11-22 07:58:56</nova:creationTime>
Nov 22 07:58:57 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 07:58:57 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 07:58:57 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 07:58:57 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 07:58:57 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 07:58:57 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 07:58:57 user nova-compute[74348]:       </nova:flavor>
Nov 22 07:58:57 user nova-compute[74348]:       <nova:owner>
Nov 22 07:58:57 user nova-compute[74348]:         <nova:user uuid="a3b62e16105c4210bfc24e71c09ede28">tempest-ServerActionsTestOtherB-849589705-project-member</nova:user>
Nov 22 07:58:57 user nova-compute[74348]:         <nova:project uuid="beaa9566ba2842d49f843dbddc59854d">tempest-ServerActionsTestOtherB-849589705</nova:project>
Nov 22 07:58:57 user nova-compute[74348]:       </nova:owner>
Nov 22 07:58:57 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 07:58:57 user nova-compute[74348]:       <nova:ports>
Nov 22 07:58:57 user nova-compute[74348]:         <nova:port uuid="618bd526-892d-4dfb-8ba6-f65e83e3f467">
Nov 22 07:58:57 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 22 07:58:57 user nova-compute[74348]:         </nova:port>
Nov 22 07:58:57 user nova-compute[74348]:       </nova:ports>
Nov 22 07:58:57 user nova-compute[74348]:     </nova:instance>
Nov 22 07:58:57 user nova-compute[74348]:   </metadata>
Nov 22 07:58:57 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 07:58:57 user nova-compute[74348]:     <system>
Nov 22 07:58:57 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 07:58:57 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 07:58:57 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 07:58:57 user nova-compute[74348]:       <entry name="serial">e36789b1-45e6-40f7-ba97-8962cb116a39</entry>
Nov 22 07:58:57 user nova-compute[74348]:       <entry name="uuid">e36789b1-45e6-40f7-ba97-8962cb116a39</entry>
Nov 22 07:58:57 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 07:58:57 user nova-compute[74348]:     </system>
Nov 22 07:58:57 user nova-compute[74348]:   </sysinfo>
Nov 22 07:58:57 user nova-compute[74348]:   <os>
Nov 22 07:58:57 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 07:58:57 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 07:58:57 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 07:58:57 user nova-compute[74348]:   </os>
Nov 22 07:58:57 user nova-compute[74348]:   <features>
Nov 22 07:58:57 user nova-compute[74348]:     <acpi/>
Nov 22 07:58:57 user nova-compute[74348]:     <apic/>
Nov 22 07:58:57 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 07:58:57 user nova-compute[74348]:   </features>
Nov 22 07:58:57 user nova-compute[74348]:   <clock offset="utc">
Nov 22 07:58:57 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 07:58:57 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 07:58:57 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 07:58:57 user nova-compute[74348]:   </clock>
Nov 22 07:58:57 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 07:58:57 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 07:58:57 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 07:58:57 user nova-compute[74348]:   </cpu>
Nov 22 07:58:57 user nova-compute[74348]:   <devices>
Nov 22 07:58:57 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 07:58:57 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 07:58:57 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk"/>
Nov 22 07:58:57 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 07:58:57 user nova-compute[74348]:     </disk>
Nov 22 07:58:57 user nova-compute[74348]:     <disk type="block" device="disk">
Nov 22 07:58:57 user nova-compute[74348]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 07:58:57 user nova-compute[74348]:       <source dev="/dev/sdc"/>
Nov 22 07:58:57 user nova-compute[74348]:       <target dev="vdb" bus="virtio"/>
Nov 22 07:58:57 user nova-compute[74348]:       <serial>d39d80c0-03af-4337-8739-906a6e6a5730</serial>
Nov 22 07:58:57 user nova-compute[74348]:     </disk>
Nov 22 07:58:57 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 07:58:57 user nova-compute[74348]:       <mac address="fa:16:3e:a7:50:2a"/>
Nov 22 07:58:57 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:58:57 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 07:58:57 user nova-compute[74348]:       <target dev="tap618bd526-89"/>
Nov 22 07:58:57 user nova-compute[74348]:     </interface>
Nov 22 07:58:57 user nova-compute[74348]:     <serial type="pty">
Nov 22 07:58:57 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/console.log" append="off"/>
Nov 22 07:58:57 user nova-compute[74348]:     </serial>
Nov 22 07:58:57 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 07:58:57 user nova-compute[74348]:     <video>
Nov 22 07:58:57 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:58:57 user nova-compute[74348]:     </video>
Nov 22 07:58:57 user nova-compute[74348]:     <rng model="virtio">
Nov 22 07:58:57 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 07:58:57 user nova-compute[74348]:     </rng>
Nov 22 07:58:57 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 07:58:57 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 07:58:57 user nova-compute[74348]:       <stats period="10"/>
Nov 22 07:58:57 user nova-compute[74348]:     </memballoon>
Nov 22 07:58:57 user nova-compute[74348]:   </devices>
Nov 22 07:58:57 user nova-compute[74348]: </domain>
Nov 22 07:58:57 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 07:58:57 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2131516711',display_name='tempest-ServerActionsTestOtherB-server-2131516711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2131516711',id=4,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNk1MOJm11bQ93eU1QYv8ji0a1vxy2ayCOX/9R0SEaykivxTwmzY2ykLPWhT+1BMkwgumhcTt15jzBxURGp9c6w0OYjMGs9IXzcm5BaMYRSciSb/BXxgpEqQZEDxBbmLrQ==',key_name='tempest-keypair-1880925410',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:57:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='beaa9566ba2842d49f843dbddc59854d',ramdisk_id='',reservation_id='r-0nqnkret',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-849589705',owner_user_name='tempest-ServerActionsTestOtherB-849589705-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T07:58:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3b62e16105c4210bfc24e71c09ede28',uuid=e36789b1-45e6-40f7-ba97-8962cb116a39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "address": "fa:16:3e:a7:50:2a", "network": {"id": "8a783b63-dae2-41eb-a00a-5cf8e94a5412", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872095489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beaa9566ba2842d49f843dbddc59854d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap618bd526-89", "ovs_interfaceid": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 07:58:57 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Converting VIF {"id": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "address": "fa:16:3e:a7:50:2a", "network": {"id": "8a783b63-dae2-41eb-a00a-5cf8e94a5412", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872095489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beaa9566ba2842d49f843dbddc59854d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap618bd526-89", "ovs_interfaceid": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:58:57 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:50:2a,bridge_name='br-int',has_traffic_filtering=True,id=618bd526-892d-4dfb-8ba6-f65e83e3f467,network=Network(8a783b63-dae2-41eb-a00a-5cf8e94a5412),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap618bd526-89') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:58:57 user nova-compute[74348]: DEBUG os_vif [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:50:2a,bridge_name='br-int',has_traffic_filtering=True,id=618bd526-892d-4dfb-8ba6-f65e83e3f467,network=Network(8a783b63-dae2-41eb-a00a-5cf8e94a5412),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap618bd526-89') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 07:58:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:58:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 07:58:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3dbd3f92-55f5-5042-88ab-15741eaa68d0', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:58:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:58:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap618bd526-89, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:58:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap618bd526-89, col_values=(('qos', UUID('9b99fa73-9d7a-4ec6-9f72-d4bc1d8e3c0c')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:58:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap618bd526-89, col_values=(('external_ids', {'iface-id': '618bd526-892d-4dfb-8ba6-f65e83e3f467', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:50:2a', 'vm-uuid': 'e36789b1-45e6-40f7-ba97-8962cb116a39'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:58:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:58:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:57 user nova-compute[74348]: INFO os_vif [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:50:2a,bridge_name='br-int',has_traffic_filtering=True,id=618bd526-892d-4dfb-8ba6-f65e83e3f467,network=Network(8a783b63-dae2-41eb-a00a-5cf8e94a5412),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap618bd526-89')
Nov 22 07:58:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:58 user nova-compute[74348]: DEBUG nova.compute.manager [req-a4597ae4-aa72-4ad8-a160-6da6771913f6 req-5b746324-fb21-4dbd-ba67-3569a3aefbb1 service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Received event network-vif-plugged-25edb763-90ad-43e6-98c1-6baf85e723d5 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:58:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a4597ae4-aa72-4ad8-a160-6da6771913f6 req-5b746324-fb21-4dbd-ba67-3569a3aefbb1 service nova] Acquiring lock "a635cbbc-6b87-4877-80a8-bd4001c407c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:58:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a4597ae4-aa72-4ad8-a160-6da6771913f6 req-5b746324-fb21-4dbd-ba67-3569a3aefbb1 service nova] Lock "a635cbbc-6b87-4877-80a8-bd4001c407c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:58:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a4597ae4-aa72-4ad8-a160-6da6771913f6 req-5b746324-fb21-4dbd-ba67-3569a3aefbb1 service nova] Lock "a635cbbc-6b87-4877-80a8-bd4001c407c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:58:58 user nova-compute[74348]: DEBUG nova.compute.manager [req-a4597ae4-aa72-4ad8-a160-6da6771913f6 req-5b746324-fb21-4dbd-ba67-3569a3aefbb1 service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] No waiting events found dispatching network-vif-plugged-25edb763-90ad-43e6-98c1-6baf85e723d5 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:58:58 user nova-compute[74348]: WARNING nova.compute.manager [req-a4597ae4-aa72-4ad8-a160-6da6771913f6 req-5b746324-fb21-4dbd-ba67-3569a3aefbb1 service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Received unexpected event network-vif-plugged-25edb763-90ad-43e6-98c1-6baf85e723d5 for instance with vm_state building and task_state spawning.
Nov 22 07:58:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:59 user nova-compute[74348]: DEBUG nova.compute.manager [req-cc24dff7-91f1-4c13-b36a-2f75fad3db69 req-102754fe-7fef-4eef-bc9e-4f97f37de7fb service nova] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Received event network-changed-e8c429ee-f5b4-4cf5-935c-5d4631b369e3 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:58:59 user nova-compute[74348]: DEBUG nova.compute.manager [req-cc24dff7-91f1-4c13-b36a-2f75fad3db69 req-102754fe-7fef-4eef-bc9e-4f97f37de7fb service nova] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Refreshing instance network info cache due to event network-changed-e8c429ee-f5b4-4cf5-935c-5d4631b369e3. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:58:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-cc24dff7-91f1-4c13-b36a-2f75fad3db69 req-102754fe-7fef-4eef-bc9e-4f97f37de7fb service nova] Acquiring lock "refresh_cache-9c36455f-5fd6-4813-9c44-499e3742ed39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:58:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-cc24dff7-91f1-4c13-b36a-2f75fad3db69 req-102754fe-7fef-4eef-bc9e-4f97f37de7fb service nova] Acquired lock "refresh_cache-9c36455f-5fd6-4813-9c44-499e3742ed39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:58:59 user nova-compute[74348]: DEBUG nova.network.neutron [req-cc24dff7-91f1-4c13-b36a-2f75fad3db69 req-102754fe-7fef-4eef-bc9e-4f97f37de7fb service nova] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Refreshing network info cache for port e8c429ee-f5b4-4cf5-935c-5d4631b369e3 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:58:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:58:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:00 user nova-compute[74348]: DEBUG nova.network.neutron [req-cc24dff7-91f1-4c13-b36a-2f75fad3db69 req-102754fe-7fef-4eef-bc9e-4f97f37de7fb service nova] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Updated VIF entry in instance network info cache for port e8c429ee-f5b4-4cf5-935c-5d4631b369e3. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 07:59:00 user nova-compute[74348]: DEBUG nova.network.neutron [req-cc24dff7-91f1-4c13-b36a-2f75fad3db69 req-102754fe-7fef-4eef-bc9e-4f97f37de7fb service nova] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Updating instance_info_cache with network_info: [{"id": "e8c429ee-f5b4-4cf5-935c-5d4631b369e3", "address": "fa:16:3e:87:e1:4c", "network": {"id": "c405fff5-285f-47eb-8bae-867c6393edf2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-368785799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8780c23b60e4abe85276f2d71c591b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c429ee-f5", "ovs_interfaceid": "e8c429ee-f5b4-4cf5-935c-5d4631b369e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:59:00 user nova-compute[74348]: DEBUG nova.compute.manager [req-733c7193-909b-4334-b441-caa2db7d5888 req-e6626f5a-e78e-42a1-b846-1de697429a69 service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Received event network-vif-plugged-618bd526-892d-4dfb-8ba6-f65e83e3f467 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:59:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-733c7193-909b-4334-b441-caa2db7d5888 req-e6626f5a-e78e-42a1-b846-1de697429a69 service nova] Acquiring lock "e36789b1-45e6-40f7-ba97-8962cb116a39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:59:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-733c7193-909b-4334-b441-caa2db7d5888 req-e6626f5a-e78e-42a1-b846-1de697429a69 service nova] Lock "e36789b1-45e6-40f7-ba97-8962cb116a39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:59:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-733c7193-909b-4334-b441-caa2db7d5888 req-e6626f5a-e78e-42a1-b846-1de697429a69 service nova] Lock "e36789b1-45e6-40f7-ba97-8962cb116a39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:59:00 user nova-compute[74348]: DEBUG nova.compute.manager [req-733c7193-909b-4334-b441-caa2db7d5888 req-e6626f5a-e78e-42a1-b846-1de697429a69 service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] No waiting events found dispatching network-vif-plugged-618bd526-892d-4dfb-8ba6-f65e83e3f467 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:59:00 user nova-compute[74348]: WARNING nova.compute.manager [req-733c7193-909b-4334-b441-caa2db7d5888 req-e6626f5a-e78e-42a1-b846-1de697429a69 service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Received unexpected event network-vif-plugged-618bd526-892d-4dfb-8ba6-f65e83e3f467 for instance with vm_state resized and task_state resize_reverting.
Nov 22 07:59:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-cc24dff7-91f1-4c13-b36a-2f75fad3db69 req-102754fe-7fef-4eef-bc9e-4f97f37de7fb service nova] Releasing lock "refresh_cache-9c36455f-5fd6-4813-9c44-499e3742ed39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:59:00 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:00 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:00 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:00 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:00 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:00 user nova-compute[74348]: DEBUG nova.compute.manager [req-b9b5af45-69e7-4616-be31-9a0faeb35aa7 req-7071c390-98e2-434d-a371-fef7174e2941 service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Received event network-vif-plugged-25edb763-90ad-43e6-98c1-6baf85e723d5 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:59:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b9b5af45-69e7-4616-be31-9a0faeb35aa7 req-7071c390-98e2-434d-a371-fef7174e2941 service nova] Acquiring lock "a635cbbc-6b87-4877-80a8-bd4001c407c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:59:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b9b5af45-69e7-4616-be31-9a0faeb35aa7 req-7071c390-98e2-434d-a371-fef7174e2941 service nova] Lock "a635cbbc-6b87-4877-80a8-bd4001c407c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:59:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b9b5af45-69e7-4616-be31-9a0faeb35aa7 req-7071c390-98e2-434d-a371-fef7174e2941 service nova] Lock "a635cbbc-6b87-4877-80a8-bd4001c407c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:59:00 user nova-compute[74348]: DEBUG nova.compute.manager [req-b9b5af45-69e7-4616-be31-9a0faeb35aa7 req-7071c390-98e2-434d-a371-fef7174e2941 service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] No waiting events found dispatching network-vif-plugged-25edb763-90ad-43e6-98c1-6baf85e723d5 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:59:00 user nova-compute[74348]: WARNING nova.compute.manager [req-b9b5af45-69e7-4616-be31-9a0faeb35aa7 req-7071c390-98e2-434d-a371-fef7174e2941 service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Received unexpected event network-vif-plugged-25edb763-90ad-43e6-98c1-6baf85e723d5 for instance with vm_state building and task_state spawning.
Nov 22 07:59:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c01936f7-76f0-4213-a42d-7f0ce5a5048f tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Acquiring lock "bcedb385-b72a-49c2-b363-cf6da5804b60" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:59:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c01936f7-76f0-4213-a42d-7f0ce5a5048f tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lock "bcedb385-b72a-49c2-b363-cf6da5804b60" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:59:02 user nova-compute[74348]: INFO nova.compute.manager [None req-c01936f7-76f0-4213-a42d-7f0ce5a5048f tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Detaching volume 53b1125a-70bf-4535-950d-89a82c099803
Nov 22 07:59:02 user nova-compute[74348]: DEBUG nova.compute.manager [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 07:59:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 07:59:02 user nova-compute[74348]: DEBUG nova.compute.manager [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 07:59:02 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Instance spawned successfully.
Nov 22 07:59:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 07:59:02 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Instance running successfully.
Nov 22 07:59:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] finish_revert_migration finished successfully. {{(pid=74348) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 22 07:59:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:59:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:59:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:59:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:59:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:59:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:59:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Acquiring lock "9c36455f-5fd6-4813-9c44-499e3742ed39" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:59:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lock "9c36455f-5fd6-4813-9c44-499e3742ed39" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:59:02 user nova-compute[74348]: INFO nova.virt.block_device [None req-c01936f7-76f0-4213-a42d-7f0ce5a5048f tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Attempting to driver detach volume 53b1125a-70bf-4535-950d-89a82c099803 from mountpoint /dev/vdb
Nov 22 07:59:02 user nova-compute[74348]: DEBUG nova.compute.manager [req-3420da8b-d8ef-4084-83d2-d74dfbd8c01f req-6e720e37-d99b-4eab-a253-e73de7c6407f service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Received event network-vif-plugged-618bd526-892d-4dfb-8ba6-f65e83e3f467 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:59:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3420da8b-d8ef-4084-83d2-d74dfbd8c01f req-6e720e37-d99b-4eab-a253-e73de7c6407f service nova] Acquiring lock "e36789b1-45e6-40f7-ba97-8962cb116a39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:59:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3420da8b-d8ef-4084-83d2-d74dfbd8c01f req-6e720e37-d99b-4eab-a253-e73de7c6407f service nova] Lock "e36789b1-45e6-40f7-ba97-8962cb116a39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:59:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3420da8b-d8ef-4084-83d2-d74dfbd8c01f req-6e720e37-d99b-4eab-a253-e73de7c6407f service nova] Lock "e36789b1-45e6-40f7-ba97-8962cb116a39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:59:02 user nova-compute[74348]: DEBUG nova.compute.manager [req-3420da8b-d8ef-4084-83d2-d74dfbd8c01f req-6e720e37-d99b-4eab-a253-e73de7c6407f service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] No waiting events found dispatching network-vif-plugged-618bd526-892d-4dfb-8ba6-f65e83e3f467 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:59:02 user nova-compute[74348]: WARNING nova.compute.manager [req-3420da8b-d8ef-4084-83d2-d74dfbd8c01f req-6e720e37-d99b-4eab-a253-e73de7c6407f service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Received unexpected event network-vif-plugged-618bd526-892d-4dfb-8ba6-f65e83e3f467 for instance with vm_state resized and task_state resize_reverting.
Nov 22 07:59:02 user nova-compute[74348]: DEBUG nova.objects.instance [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lazy-loading 'flavor' on Instance uuid 9c36455f-5fd6-4813-9c44-499e3742ed39 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:59:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-c01936f7-76f0-4213-a42d-7f0ce5a5048f tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Attempting to detach device vdb from instance bcedb385-b72a-49c2-b363-cf6da5804b60 from the persistent domain config. {{(pid=74348) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 07:59:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-c01936f7-76f0-4213-a42d-7f0ce5a5048f tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 07:59:02 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 07:59:02 user nova-compute[74348]:   <source dev="/dev/sdb"/>
Nov 22 07:59:02 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 07:59:02 user nova-compute[74348]:   <serial>53b1125a-70bf-4535-950d-89a82c099803</serial>
Nov 22 07:59:02 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 07:59:02 user nova-compute[74348]: </disk>
Nov 22 07:59:02 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 07:59:02 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-c01936f7-76f0-4213-a42d-7f0ce5a5048f tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Successfully detached device vdb from instance bcedb385-b72a-49c2-b363-cf6da5804b60 from the persistent domain config.
Nov 22 07:59:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-c01936f7-76f0-4213-a42d-7f0ce5a5048f tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bcedb385-b72a-49c2-b363-cf6da5804b60 from the live domain config. {{(pid=74348) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 07:59:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-c01936f7-76f0-4213-a42d-7f0ce5a5048f tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 07:59:02 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 07:59:02 user nova-compute[74348]:   <source dev="/dev/sdb"/>
Nov 22 07:59:02 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 07:59:02 user nova-compute[74348]:   <serial>53b1125a-70bf-4535-950d-89a82c099803</serial>
Nov 22 07:59:02 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 07:59:02 user nova-compute[74348]: </disk>
Nov 22 07:59:02 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 07:59:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lock "9c36455f-5fd6-4813-9c44-499e3742ed39" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.117s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:59:02 user nova-compute[74348]: INFO nova.compute.manager [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Took 7.98 seconds to spawn the instance on the hypervisor.
Nov 22 07:59:02 user nova-compute[74348]: DEBUG nova.compute.manager [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 07:59:02 user nova-compute[74348]: INFO nova.compute.manager [None req-2fe8d713-181f-4111-835a-8806582d025b tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Updating instance to original state: 'active'
Nov 22 07:59:02 user nova-compute[74348]: INFO nova.compute.manager [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Took 8.82 seconds to build instance.
Nov 22 07:59:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8e5584fd-bc17-4c9c-9cf4-1ad32efa1da5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "a635cbbc-6b87-4877-80a8-bd4001c407c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.039s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:59:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Acquiring lock "9c36455f-5fd6-4813-9c44-499e3742ed39" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:59:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lock "9c36455f-5fd6-4813-9c44-499e3742ed39" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:59:02 user nova-compute[74348]: INFO nova.compute.manager [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Attaching volume 3a0277d6-74d4-4f6c-89e5-a01585797825 to /dev/vdb
Nov 22 07:59:03 user nova-compute[74348]: DEBUG os_brick.utils [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:59:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:03 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4915ea-5761-4adf-ae29-12de0877cc09]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:59:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:03 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[879621f6-3ae4-4446-bc62-7a9f49980859]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:59:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-c01936f7-76f0-4213-a42d-7f0ce5a5048f tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bcedb385-b72a-49c2-b363-cf6da5804b60 {{(pid=74348) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 07:59:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:03 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[15435408-9033-4f1a-9266-8d5dfbc4b72d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:59:03 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3af076-2fde-4210-8a93-bd5852204c29]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:59:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 07:59:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 07:59:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 07:59:03 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 07:59:03 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d842053a-5eae-4903-b54c-c4ba2cc7a7f6]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:59:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 07:59:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 07:59:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 07:59:03 user nova-compute[74348]: DEBUG os_brick.utils [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:59:03 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Updating existing volume attachment record: 954d1b25-eecd-4d64-9da5-eabe746268f9 {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 07:59:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CdIofBXk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:59:10 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:59:10 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:59:10 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:59:10 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:59:10 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 07:59:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825 -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed7cbd0-42e9-468d-ab9d-e736019dcec7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 07:59:10 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825 -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98cc090-b835-454f-85c5-cbe8c63b077a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825] added
Nov 22 07:59:10 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fd4634-5ece-4ff2-91ab-9271f94587e1]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[886c924e-8a10-42f9-bea5-55e89bc39cf1]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CdIofBXk {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CdIofBXk" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2226b064-be3e-421c-bc36-8ffefb11d453]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CdIofBXk'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3dcff5b-dca7-4a1b-a520-545930e48155]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bef3778-f05c-4db7-b89a-43176e9a887b]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)
Nov 22 07:59:10 user nova-compute[74348]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 07:59:10 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)
Nov 22 07:59:10 user nova-compute[74348]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 07:59:10 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825 -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[38256df3-d3e5-45cc-a3a8-1e8eb1349e10]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825, portal: 172.16.0.220,3260]
Nov 22 07:59:10 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825, portal: 172.16.0.220,3260] successful.
Nov 22 07:59:10 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22fcaa8-0778-4a85-912f-2da0af0af80a]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d5d881-b5d4-4adf-946f-51f0da39b73c]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)
Nov 22 07:59:10 user nova-compute[74348]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 07:59:10 user nova-compute[74348]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825 (non-flash)
Nov 22 07:59:10 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)
Nov 22 07:59:10 user nova-compute[74348]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 07:59:10 user nova-compute[74348]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825 (non-flash)
Nov 22 07:59:10 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[467363f8-2624-461d-85dd-3cfbf3e8ba89]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 07:59:10 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CdIofBXk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 07:59:11 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:59:11 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '23966313939656536', 'path': '/dev/sdd'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:59:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966313939656536', 'path': '/dev/sdd'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 07:59:11 user nova-compute[74348]: DEBUG nova.objects.instance [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lazy-loading 'flavor' on Instance uuid 9c36455f-5fd6-4813-9c44-499e3742ed39 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:59:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 07:59:11 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 07:59:11 user nova-compute[74348]:   <source dev="/dev/sdd"/>
Nov 22 07:59:11 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 07:59:11 user nova-compute[74348]:   <serial>3a0277d6-74d4-4f6c-89e5-a01585797825</serial>
Nov 22 07:59:11 user nova-compute[74348]: </disk>
Nov 22 07:59:11 user nova-compute[74348]:  {{(pid=74348) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 07:59:12 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:59:12 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:59:12 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] No VIF found with MAC fa:16:3e:87:e1:4c, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 07:59:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b5cdd6a9-a507-48af-a907-da96386ffd35 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lock "9c36455f-5fd6-4813-9c44-499e3742ed39" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.298s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:59:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "2eaecc2f-f6fe-4171-b445-55c3a2d33760" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:59:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "2eaecc2f-f6fe-4171-b445-55c3a2d33760" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:59:13 user nova-compute[74348]: DEBUG nova.compute.manager [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 07:59:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-5d99962b-345d-4093-8cac-b60b911a4618 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Acquiring lock "9c36455f-5fd6-4813-9c44-499e3742ed39" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:59:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-5d99962b-345d-4093-8cac-b60b911a4618 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lock "9c36455f-5fd6-4813-9c44-499e3742ed39" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:59:13 user nova-compute[74348]: INFO nova.compute.manager [None req-5d99962b-345d-4093-8cac-b60b911a4618 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Detaching volume 3a0277d6-74d4-4f6c-89e5-a01585797825
Nov 22 07:59:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:59:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:59:13 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 07:59:13 user nova-compute[74348]: INFO nova.compute.claims [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Claim successful on node user
Nov 22 07:59:13 user nova-compute[74348]: INFO nova.virt.block_device [None req-5d99962b-345d-4093-8cac-b60b911a4618 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Attempting to driver detach volume 3a0277d6-74d4-4f6c-89e5-a01585797825 from mountpoint /dev/vdb
Nov 22 07:59:13 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-5d99962b-345d-4093-8cac-b60b911a4618 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Attempting to detach device vdb from instance 9c36455f-5fd6-4813-9c44-499e3742ed39 from the persistent domain config. {{(pid=74348) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 07:59:13 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-5d99962b-345d-4093-8cac-b60b911a4618 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 07:59:13 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 07:59:13 user nova-compute[74348]:   <source dev="/dev/sdd"/>
Nov 22 07:59:13 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 07:59:13 user nova-compute[74348]:   <serial>3a0277d6-74d4-4f6c-89e5-a01585797825</serial>
Nov 22 07:59:13 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 07:59:13 user nova-compute[74348]: </disk>
Nov 22 07:59:13 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 07:59:13 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-5d99962b-345d-4093-8cac-b60b911a4618 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Successfully detached device vdb from instance 9c36455f-5fd6-4813-9c44-499e3742ed39 from the persistent domain config.
Nov 22 07:59:13 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-5d99962b-345d-4093-8cac-b60b911a4618 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9c36455f-5fd6-4813-9c44-499e3742ed39 from the live domain config. {{(pid=74348) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 07:59:13 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-5d99962b-345d-4093-8cac-b60b911a4618 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 07:59:13 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 07:59:13 user nova-compute[74348]:   <source dev="/dev/sdd"/>
Nov 22 07:59:13 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 07:59:13 user nova-compute[74348]:   <serial>3a0277d6-74d4-4f6c-89e5-a01585797825</serial>
Nov 22 07:59:13 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 07:59:13 user nova-compute[74348]: </disk>
Nov 22 07:59:13 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 07:59:14 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:59:14 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:59:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-5d99962b-345d-4093-8cac-b60b911a4618 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9c36455f-5fd6-4813-9c44-499e3742ed39 {{(pid=74348) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 07:59:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.566s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:59:14 user nova-compute[74348]: DEBUG nova.compute.manager [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 07:59:14 user nova-compute[74348]: DEBUG nova.compute.manager [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 07:59:14 user nova-compute[74348]: DEBUG nova.network.neutron [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 07:59:14 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 07:59:14 user nova-compute[74348]: DEBUG nova.compute.manager [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 07:59:14 user nova-compute[74348]: DEBUG nova.policy [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f8eca17e3a564220b3b07af4eddadaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569146bb9b04838ad8044260da6ad58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 07:59:14 user nova-compute[74348]: DEBUG nova.compute.manager [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 07:59:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 07:59:14 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Creating image(s)
Nov 22 07:59:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "/opt/stack/data/nova/instances/2eaecc2f-f6fe-4171-b445-55c3a2d33760/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:59:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "/opt/stack/data/nova/instances/2eaecc2f-f6fe-4171-b445-55c3a2d33760/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:59:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "/opt/stack/data/nova/instances/2eaecc2f-f6fe-4171-b445-55c3a2d33760/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:59:14 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3fe8e140-0d20-4f74-adee-5bc3f3d7e383 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquiring lock "5f3bbae3-babf-44d2-96da-c459fb77d9c7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:59:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3fe8e140-0d20-4f74-adee-5bc3f3d7e383 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "5f3bbae3-babf-44d2-96da-c459fb77d9c7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:59:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3fe8e140-0d20-4f74-adee-5bc3f3d7e383 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquiring lock "5f3bbae3-babf-44d2-96da-c459fb77d9c7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:59:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3fe8e140-0d20-4f74-adee-5bc3f3d7e383 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "5f3bbae3-babf-44d2-96da-c459fb77d9c7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:59:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3fe8e140-0d20-4f74-adee-5bc3f3d7e383 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "5f3bbae3-babf-44d2-96da-c459fb77d9c7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:59:14 user nova-compute[74348]: INFO nova.compute.manager [None req-3fe8e140-0d20-4f74-adee-5bc3f3d7e383 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Terminating instance
Nov 22 07:59:14 user nova-compute[74348]: DEBUG nova.compute.manager [None req-3fe8e140-0d20-4f74-adee-5bc3f3d7e383 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 07:59:14 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.191s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:59:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:59:14 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.281s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/2eaecc2f-f6fe-4171-b445-55c3a2d33760/disk 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:15 user nova-compute[74348]: DEBUG nova.compute.manager [req-69a788a1-97f0-4c73-93ae-ef9621e1bdb9 req-76c4524e-9958-44bd-9c73-73ecd90798ff service nova] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Received event network-vif-unplugged-094232d9-8ec1-401f-8908-2a698a5385bb {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:59:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-69a788a1-97f0-4c73-93ae-ef9621e1bdb9 req-76c4524e-9958-44bd-9c73-73ecd90798ff service nova] Acquiring lock "5f3bbae3-babf-44d2-96da-c459fb77d9c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:59:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-69a788a1-97f0-4c73-93ae-ef9621e1bdb9 req-76c4524e-9958-44bd-9c73-73ecd90798ff service nova] Lock "5f3bbae3-babf-44d2-96da-c459fb77d9c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:59:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-69a788a1-97f0-4c73-93ae-ef9621e1bdb9 req-76c4524e-9958-44bd-9c73-73ecd90798ff service nova] Lock "5f3bbae3-babf-44d2-96da-c459fb77d9c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:59:15 user nova-compute[74348]: DEBUG nova.compute.manager [req-69a788a1-97f0-4c73-93ae-ef9621e1bdb9 req-76c4524e-9958-44bd-9c73-73ecd90798ff service nova] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] No waiting events found dispatching network-vif-unplugged-094232d9-8ec1-401f-8908-2a698a5385bb {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:59:15 user nova-compute[74348]: DEBUG nova.compute.manager [req-69a788a1-97f0-4c73-93ae-ef9621e1bdb9 req-76c4524e-9958-44bd-9c73-73ecd90798ff service nova] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Received event network-vif-unplugged-094232d9-8ec1-401f-8908-2a698a5385bb for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 07:59:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/2eaecc2f-f6fe-4171-b445-55c3a2d33760/disk 1073741824" returned: 0 in 0.086s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.373s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:59:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.248s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:15 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2eaecc2f-f6fe-4171-b445-55c3a2d33760/disk. size=1073741824 {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 07:59:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaecc2f-f6fe-4171-b445-55c3a2d33760/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:15 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Instance destroyed successfully.
Nov 22 07:59:15 user nova-compute[74348]: DEBUG nova.objects.instance [None req-3fe8e140-0d20-4f74-adee-5bc3f3d7e383 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lazy-loading 'resources' on Instance uuid 5f3bbae3-babf-44d2-96da-c459fb77d9c7 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:59:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-3fe8e140-0d20-4f74-adee-5bc3f3d7e383 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-22T07:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1450258036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1450258036',id=5,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1mtconRFrvBaGaD9CZoZHOYetItLhh+X0u+WBLx8FOzUxBxl1z1yZwHXr7/IGky0lzZ93nU+B2OiX2u0QzHbm4aEnwCi0/69yJ8ttWXpalWyUQuVbL5dlCSEydwFRPsA==',key_name='tempest-keypair-784392895',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:56:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='444367658c0241d0b5b377a73fedb52b',ramdisk_id='',reservation_id='r-7t8ojxyu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1610098589',owner_user_name='tempest-AttachVolumeShelveTestJSON-1610098589-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T07:56:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e8ce0d767724228bfd6cf3a4afad00d',uuid=5f3bbae3-babf-44d2-96da-c459fb77d9c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "094232d9-8ec1-401f-8908-2a698a5385bb", "address": "fa:16:3e:db:2f:02", "network": {"id": "4ef640bb-4a2f-4f98-8b01-b5df87fcb35a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1216437312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444367658c0241d0b5b377a73fedb52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap094232d9-8e", "ovs_interfaceid": "094232d9-8ec1-401f-8908-2a698a5385bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 07:59:15 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-3fe8e140-0d20-4f74-adee-5bc3f3d7e383 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Converting VIF {"id": "094232d9-8ec1-401f-8908-2a698a5385bb", "address": "fa:16:3e:db:2f:02", "network": {"id": "4ef640bb-4a2f-4f98-8b01-b5df87fcb35a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1216437312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444367658c0241d0b5b377a73fedb52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap094232d9-8e", "ovs_interfaceid": "094232d9-8ec1-401f-8908-2a698a5385bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:59:15 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-3fe8e140-0d20-4f74-adee-5bc3f3d7e383 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:2f:02,bridge_name='br-int',has_traffic_filtering=True,id=094232d9-8ec1-401f-8908-2a698a5385bb,network=Network(4ef640bb-4a2f-4f98-8b01-b5df87fcb35a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap094232d9-8e') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:59:15 user nova-compute[74348]: DEBUG os_vif [None req-3fe8e140-0d20-4f74-adee-5bc3f3d7e383 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:2f:02,bridge_name='br-int',has_traffic_filtering=True,id=094232d9-8ec1-401f-8908-2a698a5385bb,network=Network(4ef640bb-4a2f-4f98-8b01-b5df87fcb35a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap094232d9-8e') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 07:59:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap094232d9-8e, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:59:15 user nova-compute[74348]: DEBUG nova.network.neutron [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Successfully created port: 5a641519-9d0f-47c5-b1e3-e96f2a4411a2 {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 07:59:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:59:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaecc2f-f6fe-4171-b445-55c3a2d33760/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d4a7c737-bfdc-4ed5-94f8-889b204e2354) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:59:15 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Cannot resize image /opt/stack/data/nova/instances/2eaecc2f-f6fe-4171-b445-55c3a2d33760/disk to a smaller size. {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 07:59:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 07:59:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Ensure instance console log exists: /opt/stack/data/nova/instances/2eaecc2f-f6fe-4171-b445-55c3a2d33760/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 07:59:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:59:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:59:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:59:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:59:15 user nova-compute[74348]: INFO os_vif [None req-3fe8e140-0d20-4f74-adee-5bc3f3d7e383 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:2f:02,bridge_name='br-int',has_traffic_filtering=True,id=094232d9-8ec1-401f-8908-2a698a5385bb,network=Network(4ef640bb-4a2f-4f98-8b01-b5df87fcb35a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap094232d9-8e')
Nov 22 07:59:15 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-3fe8e140-0d20-4f74-adee-5bc3f3d7e383 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Deleting instance files /opt/stack/data/nova/instances/5f3bbae3-babf-44d2-96da-c459fb77d9c7_del
Nov 22 07:59:15 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-3fe8e140-0d20-4f74-adee-5bc3f3d7e383 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Deletion of /opt/stack/data/nova/instances/5f3bbae3-babf-44d2-96da-c459fb77d9c7_del complete
Nov 22 07:59:15 user nova-compute[74348]: INFO nova.compute.manager [None req-3fe8e140-0d20-4f74-adee-5bc3f3d7e383 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Took 1.06 seconds to destroy the instance on the hypervisor.
Nov 22 07:59:15 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-3fe8e140-0d20-4f74-adee-5bc3f3d7e383 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 07:59:15 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 07:59:15 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 07:59:16 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._sync_power_states {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:59:16 user nova-compute[74348]: WARNING nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] While synchronizing instance power states, found 10 instances in the database and 8 instances on the hypervisor.
Nov 22 07:59:16 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Triggering sync for uuid 059bde4a-c5c9-45ab-9b4a-c969c74a6083 {{(pid=74348) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 07:59:16 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Triggering sync for uuid bcedb385-b72a-49c2-b363-cf6da5804b60 {{(pid=74348) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 07:59:16 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Triggering sync for uuid e36789b1-45e6-40f7-ba97-8962cb116a39 {{(pid=74348) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 07:59:16 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Triggering sync for uuid 5f3bbae3-babf-44d2-96da-c459fb77d9c7 {{(pid=74348) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 07:59:16 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Triggering sync for uuid 9c36455f-5fd6-4813-9c44-499e3742ed39 {{(pid=74348) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 07:59:16 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Triggering sync for uuid 765f8c47-c042-4430-8d35-07926ad693fe {{(pid=74348) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 07:59:16 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Triggering sync for uuid 84fd55a1-d62e-4191-923e-b5bf7cb47490 {{(pid=74348) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 07:59:16 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Triggering sync for uuid 053355df-8b23-48fa-a0e1-9750314d72d5 {{(pid=74348) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 07:59:16 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Triggering sync for uuid a635cbbc-6b87-4877-80a8-bd4001c407c6 {{(pid=74348) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 07:59:16 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Triggering sync for uuid 2eaecc2f-f6fe-4171-b445-55c3a2d33760 {{(pid=74348) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 07:59:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "059bde4a-c5c9-45ab-9b4a-c969c74a6083" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:59:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "059bde4a-c5c9-45ab-9b4a-c969c74a6083" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:59:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "bcedb385-b72a-49c2-b363-cf6da5804b60" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:59:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "e36789b1-45e6-40f7-ba97-8962cb116a39" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:59:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "e36789b1-45e6-40f7-ba97-8962cb116a39" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:59:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "5f3bbae3-babf-44d2-96da-c459fb77d9c7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:59:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "9c36455f-5fd6-4813-9c44-499e3742ed39" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:59:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "765f8c47-c042-4430-8d35-07926ad693fe" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:59:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "765f8c47-c042-4430-8d35-07926ad693fe" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:59:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "84fd55a1-d62e-4191-923e-b5bf7cb47490" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:59:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "84fd55a1-d62e-4191-923e-b5bf7cb47490" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:59:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "053355df-8b23-48fa-a0e1-9750314d72d5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:59:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "053355df-8b23-48fa-a0e1-9750314d72d5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:59:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "a635cbbc-6b87-4877-80a8-bd4001c407c6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:59:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "a635cbbc-6b87-4877-80a8-bd4001c407c6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:59:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "2eaecc2f-f6fe-4171-b445-55c3a2d33760" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:59:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "053355df-8b23-48fa-a0e1-9750314d72d5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:59:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "e36789b1-45e6-40f7-ba97-8962cb116a39" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:59:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "765f8c47-c042-4430-8d35-07926ad693fe" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:59:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "059bde4a-c5c9-45ab-9b4a-c969c74a6083" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.104s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:59:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "a635cbbc-6b87-4877-80a8-bd4001c407c6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:59:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "84fd55a1-d62e-4191-923e-b5bf7cb47490" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG nova.compute.manager [req-87177512-1d3c-42f5-ac48-0e7f6025d455 req-9ace5048-020e-47be-943d-fc2232c8cdbf service nova] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Received event network-vif-plugged-094232d9-8ec1-401f-8908-2a698a5385bb {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-87177512-1d3c-42f5-ac48-0e7f6025d455 req-9ace5048-020e-47be-943d-fc2232c8cdbf service nova] Acquiring lock "5f3bbae3-babf-44d2-96da-c459fb77d9c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-87177512-1d3c-42f5-ac48-0e7f6025d455 req-9ace5048-020e-47be-943d-fc2232c8cdbf service nova] Lock "5f3bbae3-babf-44d2-96da-c459fb77d9c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-87177512-1d3c-42f5-ac48-0e7f6025d455 req-9ace5048-020e-47be-943d-fc2232c8cdbf service nova] Lock "5f3bbae3-babf-44d2-96da-c459fb77d9c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG nova.compute.manager [req-87177512-1d3c-42f5-ac48-0e7f6025d455 req-9ace5048-020e-47be-943d-fc2232c8cdbf service nova] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] No waiting events found dispatching network-vif-plugged-094232d9-8ec1-401f-8908-2a698a5385bb {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:59:17 user nova-compute[74348]: WARNING nova.compute.manager [req-87177512-1d3c-42f5-ac48-0e7f6025d455 req-9ace5048-020e-47be-943d-fc2232c8cdbf service nova] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Received unexpected event network-vif-plugged-094232d9-8ec1-401f-8908-2a698a5385bb for instance with vm_state active and task_state deleting.
Nov 22 07:59:17 user nova-compute[74348]: DEBUG nova.network.neutron [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Successfully updated port: 5a641519-9d0f-47c5-b1e3-e96f2a4411a2 {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "refresh_cache-2eaecc2f-f6fe-4171-b445-55c3a2d33760" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquired lock "refresh_cache-2eaecc2f-f6fe-4171-b445-55c3a2d33760" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG nova.network.neutron [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG nova.compute.manager [req-ffd2513f-c39b-4a34-b5b5-76dab2c3c25d req-51e900b3-897f-4317-af08-18e45919445f service nova] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Received event network-changed-5a641519-9d0f-47c5-b1e3-e96f2a4411a2 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG nova.compute.manager [req-ffd2513f-c39b-4a34-b5b5-76dab2c3c25d req-51e900b3-897f-4317-af08-18e45919445f service nova] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Refreshing instance network info cache due to event network-changed-5a641519-9d0f-47c5-b1e3-e96f2a4411a2. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-ffd2513f-c39b-4a34-b5b5-76dab2c3c25d req-51e900b3-897f-4317-af08-18e45919445f service nova] Acquiring lock "refresh_cache-2eaecc2f-f6fe-4171-b445-55c3a2d33760" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG nova.network.neutron [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:59:17 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Took 1.84 seconds to deallocate network for instance.
Nov 22 07:59:17 user nova-compute[74348]: DEBUG nova.network.neutron [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Updating instance_info_cache with network_info: [{"id": "5a641519-9d0f-47c5-b1e3-e96f2a4411a2", "address": "fa:16:3e:83:76:22", "network": {"id": "5c50496a-0882-415b-8115-ddf7b65516a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-531638472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f569146bb9b04838ad8044260da6ad58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a641519-9d", "ovs_interfaceid": "5a641519-9d0f-47c5-b1e3-e96f2a4411a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3fe8e140-0d20-4f74-adee-5bc3f3d7e383 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3fe8e140-0d20-4f74-adee-5bc3f3d7e383 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Releasing lock "refresh_cache-2eaecc2f-f6fe-4171-b445-55c3a2d33760" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG nova.compute.manager [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Instance network_info: |[{"id": "5a641519-9d0f-47c5-b1e3-e96f2a4411a2", "address": "fa:16:3e:83:76:22", "network": {"id": "5c50496a-0882-415b-8115-ddf7b65516a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-531638472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f569146bb9b04838ad8044260da6ad58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a641519-9d", "ovs_interfaceid": "5a641519-9d0f-47c5-b1e3-e96f2a4411a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-ffd2513f-c39b-4a34-b5b5-76dab2c3c25d req-51e900b3-897f-4317-af08-18e45919445f service nova] Acquired lock "refresh_cache-2eaecc2f-f6fe-4171-b445-55c3a2d33760" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG nova.network.neutron [req-ffd2513f-c39b-4a34-b5b5-76dab2c3c25d req-51e900b3-897f-4317-af08-18e45919445f service nova] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Refreshing network info cache for port 5a641519-9d0f-47c5-b1e3-e96f2a4411a2 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Start _get_guest_xml network_info=[{"id": "5a641519-9d0f-47c5-b1e3-e96f2a4411a2", "address": "fa:16:3e:83:76:22", "network": {"id": "5c50496a-0882-415b-8115-ddf7b65516a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-531638472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f569146bb9b04838ad8044260da6ad58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a641519-9d", "ovs_interfaceid": "5a641519-9d0f-47c5-b1e3-e96f2a4411a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 07:59:17 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:59:17 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:59:17 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:59:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1662067517',display_name='tempest-AttachVolumeNegativeTest-server-1662067517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1662067517',id=20,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALLnl6Qi+tRyKbEAdtWrSjCGanzsFeT+ZZCdakMyGU2h2qCJ+InmCQMqNnLiLCpVgsAmjS6E1VXJZtM7iR3ROFY+QbRCKXQKGnt6Jt/lH6UnZEH91MY//izQY6xFDsJHw==',key_name='tempest-keypair-827972638',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f569146bb9b04838ad8044260da6ad58',ramdisk_id='',reservation_id='r-bui2q035',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1606364171',owner_user_name='tempest-AttachVolumeNegativeTest-1606364171-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:59:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8eca17e3a564220b3b07af4eddadaca',uuid=2eaecc2f-f6fe-4171-b445-55c3a2d33760,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a641519-9d0f-47c5-b1e3-e96f2a4411a2", "address": "fa:16:3e:83:76:22", "network": {"id": "5c50496a-0882-415b-8115-ddf7b65516a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-531638472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f569146bb9b04838ad8044260da6ad58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a641519-9d", "ovs_interfaceid": "5a641519-9d0f-47c5-b1e3-e96f2a4411a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Converting VIF {"id": "5a641519-9d0f-47c5-b1e3-e96f2a4411a2", "address": "fa:16:3e:83:76:22", "network": {"id": "5c50496a-0882-415b-8115-ddf7b65516a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-531638472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f569146bb9b04838ad8044260da6ad58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a641519-9d", "ovs_interfaceid": "5a641519-9d0f-47c5-b1e3-e96f2a4411a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:76:22,bridge_name='br-int',has_traffic_filtering=True,id=5a641519-9d0f-47c5-b1e3-e96f2a4411a2,network=Network(5c50496a-0882-415b-8115-ddf7b65516a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a641519-9d') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG nova.objects.instance [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lazy-loading 'pci_devices' on Instance uuid 2eaecc2f-f6fe-4171-b445-55c3a2d33760 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] End _get_guest_xml xml=<domain type="kvm">
Nov 22 07:59:17 user nova-compute[74348]:   <uuid>2eaecc2f-f6fe-4171-b445-55c3a2d33760</uuid>
Nov 22 07:59:17 user nova-compute[74348]:   <name>instance-00000014</name>
Nov 22 07:59:17 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 07:59:17 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 07:59:17 user nova-compute[74348]:   <metadata>
Nov 22 07:59:17 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 07:59:17 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 07:59:17 user nova-compute[74348]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1662067517</nova:name>
Nov 22 07:59:17 user nova-compute[74348]:       <nova:creationTime>2023-11-22 07:59:17</nova:creationTime>
Nov 22 07:59:17 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 07:59:17 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 07:59:17 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 07:59:17 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 07:59:17 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 07:59:17 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 07:59:17 user nova-compute[74348]:       </nova:flavor>
Nov 22 07:59:17 user nova-compute[74348]:       <nova:owner>
Nov 22 07:59:17 user nova-compute[74348]:         <nova:user uuid="f8eca17e3a564220b3b07af4eddadaca">tempest-AttachVolumeNegativeTest-1606364171-project-member</nova:user>
Nov 22 07:59:17 user nova-compute[74348]:         <nova:project uuid="f569146bb9b04838ad8044260da6ad58">tempest-AttachVolumeNegativeTest-1606364171</nova:project>
Nov 22 07:59:17 user nova-compute[74348]:       </nova:owner>
Nov 22 07:59:17 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 07:59:17 user nova-compute[74348]:       <nova:ports>
Nov 22 07:59:17 user nova-compute[74348]:         <nova:port uuid="5a641519-9d0f-47c5-b1e3-e96f2a4411a2">
Nov 22 07:59:17 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 22 07:59:17 user nova-compute[74348]:         </nova:port>
Nov 22 07:59:17 user nova-compute[74348]:       </nova:ports>
Nov 22 07:59:17 user nova-compute[74348]:     </nova:instance>
Nov 22 07:59:17 user nova-compute[74348]:   </metadata>
Nov 22 07:59:17 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 07:59:17 user nova-compute[74348]:     <system>
Nov 22 07:59:17 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 07:59:17 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 07:59:17 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 07:59:17 user nova-compute[74348]:       <entry name="serial">2eaecc2f-f6fe-4171-b445-55c3a2d33760</entry>
Nov 22 07:59:17 user nova-compute[74348]:       <entry name="uuid">2eaecc2f-f6fe-4171-b445-55c3a2d33760</entry>
Nov 22 07:59:17 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 07:59:17 user nova-compute[74348]:     </system>
Nov 22 07:59:17 user nova-compute[74348]:   </sysinfo>
Nov 22 07:59:17 user nova-compute[74348]:   <os>
Nov 22 07:59:17 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 07:59:17 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 07:59:17 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 07:59:17 user nova-compute[74348]:   </os>
Nov 22 07:59:17 user nova-compute[74348]:   <features>
Nov 22 07:59:17 user nova-compute[74348]:     <acpi/>
Nov 22 07:59:17 user nova-compute[74348]:     <apic/>
Nov 22 07:59:17 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 07:59:17 user nova-compute[74348]:   </features>
Nov 22 07:59:17 user nova-compute[74348]:   <clock offset="utc">
Nov 22 07:59:17 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 07:59:17 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 07:59:17 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 07:59:17 user nova-compute[74348]:   </clock>
Nov 22 07:59:17 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 07:59:17 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 07:59:17 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 07:59:17 user nova-compute[74348]:   </cpu>
Nov 22 07:59:17 user nova-compute[74348]:   <devices>
Nov 22 07:59:17 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 07:59:17 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 07:59:17 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/2eaecc2f-f6fe-4171-b445-55c3a2d33760/disk"/>
Nov 22 07:59:17 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 07:59:17 user nova-compute[74348]:     </disk>
Nov 22 07:59:17 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 07:59:17 user nova-compute[74348]:       <mac address="fa:16:3e:83:76:22"/>
Nov 22 07:59:17 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:59:17 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 07:59:17 user nova-compute[74348]:       <target dev="tap5a641519-9d"/>
Nov 22 07:59:17 user nova-compute[74348]:     </interface>
Nov 22 07:59:17 user nova-compute[74348]:     <serial type="pty">
Nov 22 07:59:17 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/2eaecc2f-f6fe-4171-b445-55c3a2d33760/console.log" append="off"/>
Nov 22 07:59:17 user nova-compute[74348]:     </serial>
Nov 22 07:59:17 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 07:59:17 user nova-compute[74348]:     <video>
Nov 22 07:59:17 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 07:59:17 user nova-compute[74348]:     </video>
Nov 22 07:59:17 user nova-compute[74348]:     <rng model="virtio">
Nov 22 07:59:17 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 07:59:17 user nova-compute[74348]:     </rng>
Nov 22 07:59:17 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 07:59:17 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 07:59:17 user nova-compute[74348]:       <stats period="10"/>
Nov 22 07:59:17 user nova-compute[74348]:     </memballoon>
Nov 22 07:59:17 user nova-compute[74348]:   </devices>
Nov 22 07:59:17 user nova-compute[74348]: </domain>
Nov 22 07:59:17 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:59:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1662067517',display_name='tempest-AttachVolumeNegativeTest-server-1662067517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1662067517',id=20,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALLnl6Qi+tRyKbEAdtWrSjCGanzsFeT+ZZCdakMyGU2h2qCJ+InmCQMqNnLiLCpVgsAmjS6E1VXJZtM7iR3ROFY+QbRCKXQKGnt6Jt/lH6UnZEH91MY//izQY6xFDsJHw==',key_name='tempest-keypair-827972638',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f569146bb9b04838ad8044260da6ad58',ramdisk_id='',reservation_id='r-bui2q035',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1606364171',owner_user_name='tempest-AttachVolumeNegativeTest-1606364171-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T07:59:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8eca17e3a564220b3b07af4eddadaca',uuid=2eaecc2f-f6fe-4171-b445-55c3a2d33760,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a641519-9d0f-47c5-b1e3-e96f2a4411a2", "address": "fa:16:3e:83:76:22", "network": {"id": "5c50496a-0882-415b-8115-ddf7b65516a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-531638472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f569146bb9b04838ad8044260da6ad58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a641519-9d", "ovs_interfaceid": "5a641519-9d0f-47c5-b1e3-e96f2a4411a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Converting VIF {"id": "5a641519-9d0f-47c5-b1e3-e96f2a4411a2", "address": "fa:16:3e:83:76:22", "network": {"id": "5c50496a-0882-415b-8115-ddf7b65516a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-531638472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f569146bb9b04838ad8044260da6ad58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a641519-9d", "ovs_interfaceid": "5a641519-9d0f-47c5-b1e3-e96f2a4411a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:76:22,bridge_name='br-int',has_traffic_filtering=True,id=5a641519-9d0f-47c5-b1e3-e96f2a4411a2,network=Network(5c50496a-0882-415b-8115-ddf7b65516a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a641519-9d') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG os_vif [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:76:22,bridge_name='br-int',has_traffic_filtering=True,id=5a641519-9d0f-47c5-b1e3-e96f2a4411a2,network=Network(5c50496a-0882-415b-8115-ddf7b65516a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a641519-9d') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a9abe031-fa96-5938-b6df-e6bd4cb14df6', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a641519-9d, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5a641519-9d, col_values=(('qos', UUID('b161a320-3135-4d4b-a402-5bec981be022')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5a641519-9d, col_values=(('external_ids', {'iface-id': '5a641519-9d0f-47c5-b1e3-e96f2a4411a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:76:22', 'vm-uuid': '2eaecc2f-f6fe-4171-b445-55c3a2d33760'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:59:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:17 user nova-compute[74348]: INFO os_vif [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:76:22,bridge_name='br-int',has_traffic_filtering=True,id=5a641519-9d0f-47c5-b1e3-e96f2a4411a2,network=Network(5c50496a-0882-415b-8115-ddf7b65516a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a641519-9d')
Nov 22 07:59:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 07:59:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] No VIF found with MAC fa:16:3e:83:76:22, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 07:59:18 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-3fe8e140-0d20-4f74-adee-5bc3f3d7e383 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:59:18 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-3fe8e140-0d20-4f74-adee-5bc3f3d7e383 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:59:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3fe8e140-0d20-4f74-adee-5bc3f3d7e383 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.560s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:59:18 user nova-compute[74348]: DEBUG nova.network.neutron [req-ffd2513f-c39b-4a34-b5b5-76dab2c3c25d req-51e900b3-897f-4317-af08-18e45919445f service nova] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Updated VIF entry in instance network info cache for port 5a641519-9d0f-47c5-b1e3-e96f2a4411a2. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 07:59:18 user nova-compute[74348]: DEBUG nova.network.neutron [req-ffd2513f-c39b-4a34-b5b5-76dab2c3c25d req-51e900b3-897f-4317-af08-18e45919445f service nova] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Updating instance_info_cache with network_info: [{"id": "5a641519-9d0f-47c5-b1e3-e96f2a4411a2", "address": "fa:16:3e:83:76:22", "network": {"id": "5c50496a-0882-415b-8115-ddf7b65516a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-531638472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f569146bb9b04838ad8044260da6ad58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a641519-9d", "ovs_interfaceid": "5a641519-9d0f-47c5-b1e3-e96f2a4411a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:59:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-ffd2513f-c39b-4a34-b5b5-76dab2c3c25d req-51e900b3-897f-4317-af08-18e45919445f service nova] Releasing lock "refresh_cache-2eaecc2f-f6fe-4171-b445-55c3a2d33760" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:59:18 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-3fe8e140-0d20-4f74-adee-5bc3f3d7e383 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Deleted allocations for instance 5f3bbae3-babf-44d2-96da-c459fb77d9c7
Nov 22 07:59:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3fe8e140-0d20-4f74-adee-5bc3f3d7e383 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "5f3bbae3-babf-44d2-96da-c459fb77d9c7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.831s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:59:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "5f3bbae3-babf-44d2-96da-c459fb77d9c7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.999s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:59:18 user nova-compute[74348]: INFO nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 22 07:59:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "5f3bbae3-babf-44d2-96da-c459fb77d9c7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:59:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:19 user nova-compute[74348]: DEBUG nova.compute.manager [req-9f1eb466-a7cb-479e-9f84-24acdc3addb9 req-33b49dbd-0abb-4b7d-bdaa-da94bb90bf46 service nova] [instance: 5f3bbae3-babf-44d2-96da-c459fb77d9c7] Received event network-vif-deleted-094232d9-8ec1-401f-8908-2a698a5385bb {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:59:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:19 user nova-compute[74348]: DEBUG nova.compute.manager [req-1dd5c795-6ba2-41cf-a22d-d8f6f3dab5ad req-b21c1382-a440-4837-ae5e-0b2657ed7d36 service nova] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Received event network-vif-plugged-5a641519-9d0f-47c5-b1e3-e96f2a4411a2 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:59:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-1dd5c795-6ba2-41cf-a22d-d8f6f3dab5ad req-b21c1382-a440-4837-ae5e-0b2657ed7d36 service nova] Acquiring lock "2eaecc2f-f6fe-4171-b445-55c3a2d33760-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:59:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-1dd5c795-6ba2-41cf-a22d-d8f6f3dab5ad req-b21c1382-a440-4837-ae5e-0b2657ed7d36 service nova] Lock "2eaecc2f-f6fe-4171-b445-55c3a2d33760-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:59:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-1dd5c795-6ba2-41cf-a22d-d8f6f3dab5ad req-b21c1382-a440-4837-ae5e-0b2657ed7d36 service nova] Lock "2eaecc2f-f6fe-4171-b445-55c3a2d33760-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:59:19 user nova-compute[74348]: DEBUG nova.compute.manager [req-1dd5c795-6ba2-41cf-a22d-d8f6f3dab5ad req-b21c1382-a440-4837-ae5e-0b2657ed7d36 service nova] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] No waiting events found dispatching network-vif-plugged-5a641519-9d0f-47c5-b1e3-e96f2a4411a2 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:59:19 user nova-compute[74348]: WARNING nova.compute.manager [req-1dd5c795-6ba2-41cf-a22d-d8f6f3dab5ad req-b21c1382-a440-4837-ae5e-0b2657ed7d36 service nova] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Received unexpected event network-vif-plugged-5a641519-9d0f-47c5-b1e3-e96f2a4411a2 for instance with vm_state building and task_state spawning.
Nov 22 07:59:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:21 user nova-compute[74348]: DEBUG nova.compute.manager [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 07:59:21 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 07:59:21 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Instance spawned successfully.
Nov 22 07:59:21 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 07:59:21 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:59:21 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:59:21 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:59:21 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:59:21 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:59:21 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 07:59:21 user nova-compute[74348]: DEBUG nova.compute.manager [req-59b6be6a-f5e6-44b2-ae3c-dbc5c6cca507 req-e409b36a-5476-4a10-a632-7bcf0f2f4314 service nova] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Received event network-vif-plugged-5a641519-9d0f-47c5-b1e3-e96f2a4411a2 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:59:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-59b6be6a-f5e6-44b2-ae3c-dbc5c6cca507 req-e409b36a-5476-4a10-a632-7bcf0f2f4314 service nova] Acquiring lock "2eaecc2f-f6fe-4171-b445-55c3a2d33760-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:59:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-59b6be6a-f5e6-44b2-ae3c-dbc5c6cca507 req-e409b36a-5476-4a10-a632-7bcf0f2f4314 service nova] Lock "2eaecc2f-f6fe-4171-b445-55c3a2d33760-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:59:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-59b6be6a-f5e6-44b2-ae3c-dbc5c6cca507 req-e409b36a-5476-4a10-a632-7bcf0f2f4314 service nova] Lock "2eaecc2f-f6fe-4171-b445-55c3a2d33760-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:59:21 user nova-compute[74348]: DEBUG nova.compute.manager [req-59b6be6a-f5e6-44b2-ae3c-dbc5c6cca507 req-e409b36a-5476-4a10-a632-7bcf0f2f4314 service nova] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] No waiting events found dispatching network-vif-plugged-5a641519-9d0f-47c5-b1e3-e96f2a4411a2 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:59:21 user nova-compute[74348]: WARNING nova.compute.manager [req-59b6be6a-f5e6-44b2-ae3c-dbc5c6cca507 req-e409b36a-5476-4a10-a632-7bcf0f2f4314 service nova] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Received unexpected event network-vif-plugged-5a641519-9d0f-47c5-b1e3-e96f2a4411a2 for instance with vm_state building and task_state spawning.
Nov 22 07:59:21 user nova-compute[74348]: INFO nova.compute.manager [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Took 7.24 seconds to spawn the instance on the hypervisor.
Nov 22 07:59:21 user nova-compute[74348]: DEBUG nova.compute.manager [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 07:59:21 user nova-compute[74348]: INFO nova.compute.manager [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Took 8.23 seconds to build instance.
Nov 22 07:59:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-cbdc027c-66f8-4787-8b44-cd43c838d134 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "2eaecc2f-f6fe-4171-b445-55c3a2d33760" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.362s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:59:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "2eaecc2f-f6fe-4171-b445-55c3a2d33760" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.441s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:59:21 user nova-compute[74348]: INFO nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 22 07:59:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "2eaecc2f-f6fe-4171-b445-55c3a2d33760" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:59:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:23 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-c01936f7-76f0-4213-a42d-7f0ce5a5048f tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bcedb385-b72a-49c2-b363-cf6da5804b60 is timed out.
Nov 22 07:59:23 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-c01936f7-76f0-4213-a42d-7f0ce5a5048f tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Successfully detached device vdb from instance bcedb385-b72a-49c2-b363-cf6da5804b60 from the live domain config.
Nov 22 07:59:23 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c01936f7-76f0-4213-a42d-7f0ce5a5048f tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01936f7-76f0-4213-a42d-7f0ce5a5048f tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kOYubGxc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:59:23 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-c01936f7-76f0-4213-a42d-7f0ce5a5048f tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:59:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-c01936f7-76f0-4213-a42d-7f0ce5a5048f tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-c01936f7-76f0-4213-a42d-7f0ce5a5048f tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d5dcda-e19d-4834-893a-a4538e13ae94]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01936f7-76f0-4213-a42d-7f0ce5a5048f tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 07:59:23 user nova-compute[74348]: No targets found.
Nov 22 07:59:23 user nova-compute[74348]: iSNS:
Nov 22 07:59:23 user nova-compute[74348]: No targets found.
Nov 22 07:59:23 user nova-compute[74348]: STATIC:
Nov 22 07:59:23 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825
Nov 22 07:59:23 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:59:23 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:59:23 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730
Nov 22 07:59:23 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:59:23 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:59:23 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803
Nov 22 07:59:23 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:59:23 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:59:23 user nova-compute[74348]: FIRMWARE:
Nov 22 07:59:23 user nova-compute[74348]: No targets found.
Nov 22 07:59:23 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01936f7-76f0-4213-a42d-7f0ce5a5048f tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 07:59:23 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 07:59:23 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01936f7-76f0-4213-a42d-7f0ce5a5048f tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e04221c-4f78-4522-81a8-a7eaa51f8251]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85d0d87-297b-4391-8cb4-1e27b3be8e70]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01936f7-76f0-4213-a42d-7f0ce5a5048f tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)
Nov 22 07:59:23 user nova-compute[74348]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 07:59:23 user nova-compute[74348]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825 (non-flash)
Nov 22 07:59:23 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01936f7-76f0-4213-a42d-7f0ce5a5048f tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 (non-flash)
Nov 22 07:59:23 user nova-compute[74348]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 07:59:23 user nova-compute[74348]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825 (non-flash)
Nov 22 07:59:23 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01936f7-76f0-4213-a42d-7f0ce5a5048f tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f225510e0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803'): ({'sdb'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-c01936f7-76f0-4213-a42d-7f0ce5a5048f tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Removing single pathed devices sdb {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[097840ef-9af7-4862-ab36-3ac099ae76a6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6991e5c9-dcb3-4ccf-a81e-f8fe44ba7300]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-c01936f7-76f0-4213-a42d-7f0ce5a5048f tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Flushing IO for device /dev/sdb {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf019d74-1f32-4764-89d2-090447b4b394]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-c01936f7-76f0-4213-a42d-7f0ce5a5048f tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7df7bc4-5279-42e8-bf81-ad16d95389ed]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-c01936f7-76f0-4213-a42d-7f0ce5a5048f tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-c01936f7-76f0-4213-a42d-7f0ce5a5048f tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] SCSI volumes sdb have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01936f7-76f0-4213-a42d-7f0ce5a5048f tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[df75dfa7-0298-4586-93a4-1ce48b6af332]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01936f7-76f0-4213-a42d-7f0ce5a5048f tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8bf214-b3c8-4793-b1ef-af0b01da78fd]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01936f7-76f0-4213-a42d-7f0ce5a5048f tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803, portal: 172.16.0.220,3260]
Nov 22 07:59:23 user nova-compute[74348]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803, portal: 172.16.0.220,3260] successful.
Nov 22 07:59:23 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b1125a-70bf-4535-950d-89a82c099803 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c693be-122a-4511-acb7-0b696fda80aa]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01936f7-76f0-4213-a42d-7f0ce5a5048f tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-c01936f7-76f0-4213-a42d-7f0ce5a5048f tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01936f7-76f0-4213-a42d-7f0ce5a5048f tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] <== disconnect_volume: return (329ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c01936f7-76f0-4213-a42d-7f0ce5a5048f tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 07:59:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:24 user nova-compute[74348]: DEBUG nova.objects.instance [None req-c01936f7-76f0-4213-a42d-7f0ce5a5048f tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lazy-loading 'flavor' on Instance uuid bcedb385-b72a-49c2-b363-cf6da5804b60 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:59:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c01936f7-76f0-4213-a42d-7f0ce5a5048f tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lock "bcedb385-b72a-49c2-b363-cf6da5804b60" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.123s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:59:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "bcedb385-b72a-49c2-b363-cf6da5804b60" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 8.097s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:59:24 user nova-compute[74348]: DEBUG nova.compute.manager [None req-78c7e561-d865-40e9-aed8-54a158b1d8c5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 07:59:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "bcedb385-b72a-49c2-b363-cf6da5804b60" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:59:24 user nova-compute[74348]: INFO nova.compute.manager [None req-78c7e561-d865-40e9-aed8-54a158b1d8c5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] instance snapshotting
Nov 22 07:59:24 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-78c7e561-d865-40e9-aed8-54a158b1d8c5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Beginning live snapshot process
Nov 22 07:59:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-78c7e561-d865-40e9-aed8-54a158b1d8c5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json -f qcow2 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-78c7e561-d865-40e9-aed8-54a158b1d8c5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json -f qcow2" returned: 0 in 0.191s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-78c7e561-d865-40e9-aed8-54a158b1d8c5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json -f qcow2 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-78c7e561-d865-40e9-aed8-54a158b1d8c5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json -f qcow2" returned: 0 in 0.192s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-78c7e561-d865-40e9-aed8-54a158b1d8c5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-78c7e561-d865-40e9-aed8-54a158b1d8c5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.186s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-78c7e561-d865-40e9-aed8-54a158b1d8c5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpf35zxgxd/feb318f24c8047aebe76fd9129f802a7.delta 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-78c7e561-d865-40e9-aed8-54a158b1d8c5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpf35zxgxd/feb318f24c8047aebe76fd9129f802a7.delta 1073741824" returned: 0 in 0.053s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:25 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-78c7e561-d865-40e9-aed8-54a158b1d8c5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 22 07:59:26 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-78c7e561-d865-40e9-aed8-54a158b1d8c5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74348) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 07:59:26 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-78c7e561-d865-40e9-aed8-54a158b1d8c5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] COPY block job progress, current cursor: 17170432 final cursor: 75497472 {{(pid=74348) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 07:59:27 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-78c7e561-d865-40e9-aed8-54a158b1d8c5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74348) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 07:59:27 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-78c7e561-d865-40e9-aed8-54a158b1d8c5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 22 07:59:27 user nova-compute[74348]: DEBUG nova.privsep.utils [None req-78c7e561-d865-40e9-aed8-54a158b1d8c5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74348) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 07:59:27 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-78c7e561-d865-40e9-aed8-54a158b1d8c5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpf35zxgxd/feb318f24c8047aebe76fd9129f802a7.delta /opt/stack/data/nova/instances/snapshots/tmpf35zxgxd/feb318f24c8047aebe76fd9129f802a7 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:28 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-78c7e561-d865-40e9-aed8-54a158b1d8c5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpf35zxgxd/feb318f24c8047aebe76fd9129f802a7.delta /opt/stack/data/nova/instances/snapshots/tmpf35zxgxd/feb318f24c8047aebe76fd9129f802a7" returned: 0 in 0.965s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:28 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-78c7e561-d865-40e9-aed8-54a158b1d8c5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Snapshot extracted, beginning image upload
Nov 22 07:59:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:29 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:59:29 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 07:59:29 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Rebuilding the list of instances to heal {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 07:59:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-059bde4a-c5c9-45ab-9b4a-c969c74a6083" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 07:59:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-059bde4a-c5c9-45ab-9b4a-c969c74a6083" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 07:59:29 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 07:59:29 user nova-compute[74348]: DEBUG nova.objects.instance [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lazy-loading 'info_cache' on Instance uuid 059bde4a-c5c9-45ab-9b4a-c969c74a6083 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:59:30 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Updating instance_info_cache with network_info: [{"id": "06aa6370-ccfd-4a76-86ca-7bbfad795beb", "address": "fa:16:3e:0d:49:2d", "network": {"id": "7f692ef6-9a86-4aba-a055-8877d70394ba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1993883418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee2e6be4a484d32bac3fda2043aa23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06aa6370-cc", "ovs_interfaceid": "06aa6370-ccfd-4a76-86ca-7bbfad795beb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:59:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-059bde4a-c5c9-45ab-9b4a-c969c74a6083" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 07:59:30 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 07:59:31 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-78c7e561-d865-40e9-aed8-54a158b1d8c5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Snapshot image upload complete
Nov 22 07:59:31 user nova-compute[74348]: INFO nova.compute.manager [None req-78c7e561-d865-40e9-aed8-54a158b1d8c5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Took 6.58 seconds to snapshot the instance on the hypervisor.
Nov 22 07:59:32 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:59:32 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:59:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:33 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:59:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:34 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-5d99962b-345d-4093-8cac-b60b911a4618 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9c36455f-5fd6-4813-9c44-499e3742ed39 is timed out.
Nov 22 07:59:34 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-5d99962b-345d-4093-8cac-b60b911a4618 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Successfully detached device vdb from instance 9c36455f-5fd6-4813-9c44-499e3742ed39 from the live domain config.
Nov 22 07:59:34 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d99962b-345d-4093-8cac-b60b911a4618 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d99962b-345d-4093-8cac-b60b911a4618 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CdIofBXk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 07:59:34 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-5d99962b-345d-4093-8cac-b60b911a4618 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 07:59:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-5d99962b-345d-4093-8cac-b60b911a4618 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-5d99962b-345d-4093-8cac-b60b911a4618 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0928d794-6dad-4d83-9282-5f2d26a7d1cb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed5e2126-d278-4e64-b81b-2c8bc245bd6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b394aebb-5cbf-401a-ab28-9f6befd93ce4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d99962b-345d-4093-8cac-b60b911a4618 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 07:59:34 user nova-compute[74348]: No targets found.
Nov 22 07:59:34 user nova-compute[74348]: iSNS:
Nov 22 07:59:34 user nova-compute[74348]: No targets found.
Nov 22 07:59:34 user nova-compute[74348]: STATIC:
Nov 22 07:59:34 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825
Nov 22 07:59:34 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:59:34 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:59:34 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:ed5e2126-d278-4e64-b81b-2c8bc245bd6f
Nov 22 07:59:34 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:59:34 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:59:34 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730
Nov 22 07:59:34 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:59:34 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:59:34 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:b394aebb-5cbf-401a-ab28-9f6befd93ce4
Nov 22 07:59:34 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 07:59:34 user nova-compute[74348]:                 Iface Name: default
Nov 22 07:59:34 user nova-compute[74348]: FIRMWARE:
Nov 22 07:59:34 user nova-compute[74348]: No targets found.
Nov 22 07:59:34 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d99962b-345d-4093-8cac-b60b911a4618 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 07:59:34 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 07:59:34 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d99962b-345d-4093-8cac-b60b911a4618 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcafc144-938c-45ff-918f-5a35fc5e0f52]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b394aebb-5cbf-401a-ab28-9f6befd93ce4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed5e2126-d278-4e64-b81b-2c8bc245bd6f\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3ff173-5d3b-4cb8-883b-6f4b66d0298a]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed5e2126-d278-4e64-b81b-2c8bc245bd6f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b394aebb-5cbf-401a-ab28-9f6befd93ce4 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d99962b-345d-4093-8cac-b60b911a4618 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 07:59:34 user nova-compute[74348]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825 (non-flash)
Nov 22 07:59:34 user nova-compute[74348]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed5e2126-d278-4e64-b81b-2c8bc245bd6f (non-flash)
Nov 22 07:59:34 user nova-compute[74348]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b394aebb-5cbf-401a-ab28-9f6befd93ce4 (non-flash)
Nov 22 07:59:34 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d99962b-345d-4093-8cac-b60b911a4618 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 07:59:34 user nova-compute[74348]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825 (non-flash)
Nov 22 07:59:34 user nova-compute[74348]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed5e2126-d278-4e64-b81b-2c8bc245bd6f (non-flash)
Nov 22 07:59:34 user nova-compute[74348]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b394aebb-5cbf-401a-ab28-9f6befd93ce4 (non-flash)
Nov 22 07:59:34 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d99962b-345d-4093-8cac-b60b911a4618 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f224c494ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825'): ({'sdd'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-5d99962b-345d-4093-8cac-b60b911a4618 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Removing single pathed devices sdd {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7316c2-11ca-4c35-9549-c36b8d3b7f77]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.039s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9c2e4a-d3b1-48fb-8ae8-acf9f1b2e878]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-5d99962b-345d-4093-8cac-b60b911a4618 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Flushing IO for device /dev/sdd {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d560ee6-472b-492d-969e-01ccd36d6bce]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-5d99962b-345d-4093-8cac-b60b911a4618 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b260cb-eda0-4bb2-9650-93fc12531be6]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-5d99962b-345d-4093-8cac-b60b911a4618 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-5d99962b-345d-4093-8cac-b60b911a4618 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] SCSI volumes sdd have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d99962b-345d-4093-8cac-b60b911a4618 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59ccff4-840b-4955-8686-5f72863d8087]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d99962b-345d-4093-8cac-b60b911a4618 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825 -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d251c7-d332-4ad5-b679-e15fad29bc07]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d99962b-345d-4093-8cac-b60b911a4618 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825, portal: 172.16.0.220,3260]
Nov 22 07:59:34 user nova-compute[74348]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825, portal: 172.16.0.220,3260] successful.
Nov 22 07:59:34 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825 -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a0277d6-74d4-4f6c-89e5-a01585797825 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[99690798-1f18-4b04-8648-34e5cf1d101d]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d99962b-345d-4093-8cac-b60b911a4618 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-5d99962b-345d-4093-8cac-b60b911a4618 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d99962b-345d-4093-8cac-b60b911a4618 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] <== disconnect_volume: return (362ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d99962b-345d-4093-8cac-b60b911a4618 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/053355df-8b23-48fa-a0e1-9750314d72d5/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/053355df-8b23-48fa-a0e1-9750314d72d5/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/053355df-8b23-48fa-a0e1-9750314d72d5/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/053355df-8b23-48fa-a0e1-9750314d72d5/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:35 user nova-compute[74348]: DEBUG nova.objects.instance [None req-5d99962b-345d-4093-8cac-b60b911a4618 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lazy-loading 'flavor' on Instance uuid 9c36455f-5fd6-4813-9c44-499e3742ed39 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:59:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-5d99962b-345d-4093-8cac-b60b911a4618 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lock "9c36455f-5fd6-4813-9c44-499e3742ed39" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.008s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:59:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "9c36455f-5fd6-4813-9c44-499e3742ed39" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 19.123s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:59:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "9c36455f-5fd6-4813-9c44-499e3742ed39" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:59:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059bde4a-c5c9-45ab-9b4a-c969c74a6083/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059bde4a-c5c9-45ab-9b4a-c969c74a6083/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059bde4a-c5c9-45ab-9b4a-c969c74a6083/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059bde4a-c5c9-45ab-9b4a-c969c74a6083/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84fd55a1-d62e-4191-923e-b5bf7cb47490/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84fd55a1-d62e-4191-923e-b5bf7cb47490/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84fd55a1-d62e-4191-923e-b5bf7cb47490/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84fd55a1-d62e-4191-923e-b5bf7cb47490/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c36455f-5fd6-4813-9c44-499e3742ed39/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c36455f-5fd6-4813-9c44-499e3742ed39/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c36455f-5fd6-4813-9c44-499e3742ed39/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c36455f-5fd6-4813-9c44-499e3742ed39/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:37 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 07:59:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a635cbbc-6b87-4877-80a8-bd4001c407c6/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a635cbbc-6b87-4877-80a8-bd4001c407c6/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a635cbbc-6b87-4877-80a8-bd4001c407c6/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a635cbbc-6b87-4877-80a8-bd4001c407c6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaecc2f-f6fe-4171-b445-55c3a2d33760/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaecc2f-f6fe-4171-b445-55c3a2d33760/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaecc2f-f6fe-4171-b445-55c3a2d33760/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 07:59:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaecc2f-f6fe-4171-b445-55c3a2d33760/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 07:59:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:38 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:59:38 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 07:59:38 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=7348MB free_disk=24.97887420654297GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 07:59:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:59:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:59:39 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 059bde4a-c5c9-45ab-9b4a-c969c74a6083 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:59:39 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance bcedb385-b72a-49c2-b363-cf6da5804b60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:59:39 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance e36789b1-45e6-40f7-ba97-8962cb116a39 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:59:39 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 9c36455f-5fd6-4813-9c44-499e3742ed39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:59:39 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 765f8c47-c042-4430-8d35-07926ad693fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:59:39 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 84fd55a1-d62e-4191-923e-b5bf7cb47490 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:59:39 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 053355df-8b23-48fa-a0e1-9750314d72d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:59:39 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance a635cbbc-6b87-4877-80a8-bd4001c407c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:59:39 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 2eaecc2f-f6fe-4171-b445-55c3a2d33760 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 07:59:39 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 07:59:39 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 07:59:39 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:59:39 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:59:39 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 07:59:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.583s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:59:40 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:59:40 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 07:59:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7a3b1f5f-ff83-4143-9f6f-209fa9dee42d tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Acquiring lock "bcedb385-b72a-49c2-b363-cf6da5804b60" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:59:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7a3b1f5f-ff83-4143-9f6f-209fa9dee42d tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lock "bcedb385-b72a-49c2-b363-cf6da5804b60" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:59:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7a3b1f5f-ff83-4143-9f6f-209fa9dee42d tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Acquiring lock "bcedb385-b72a-49c2-b363-cf6da5804b60-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:59:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7a3b1f5f-ff83-4143-9f6f-209fa9dee42d tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lock "bcedb385-b72a-49c2-b363-cf6da5804b60-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:59:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7a3b1f5f-ff83-4143-9f6f-209fa9dee42d tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lock "bcedb385-b72a-49c2-b363-cf6da5804b60-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:59:53 user nova-compute[74348]: INFO nova.compute.manager [None req-7a3b1f5f-ff83-4143-9f6f-209fa9dee42d tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Terminating instance
Nov 22 07:59:53 user nova-compute[74348]: DEBUG nova.compute.manager [None req-7a3b1f5f-ff83-4143-9f6f-209fa9dee42d tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 07:59:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:53 user nova-compute[74348]: DEBUG nova.compute.manager [req-ab1fb8db-6122-481a-8b5e-2ebc3ea53e3f req-080e2867-127c-43e4-a429-b2910a01603f service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Received event network-vif-unplugged-07295502-d217-400f-8b56-9ff1ccd600cf {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:59:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-ab1fb8db-6122-481a-8b5e-2ebc3ea53e3f req-080e2867-127c-43e4-a429-b2910a01603f service nova] Acquiring lock "bcedb385-b72a-49c2-b363-cf6da5804b60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:59:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-ab1fb8db-6122-481a-8b5e-2ebc3ea53e3f req-080e2867-127c-43e4-a429-b2910a01603f service nova] Lock "bcedb385-b72a-49c2-b363-cf6da5804b60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:59:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-ab1fb8db-6122-481a-8b5e-2ebc3ea53e3f req-080e2867-127c-43e4-a429-b2910a01603f service nova] Lock "bcedb385-b72a-49c2-b363-cf6da5804b60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:59:53 user nova-compute[74348]: DEBUG nova.compute.manager [req-ab1fb8db-6122-481a-8b5e-2ebc3ea53e3f req-080e2867-127c-43e4-a429-b2910a01603f service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] No waiting events found dispatching network-vif-unplugged-07295502-d217-400f-8b56-9ff1ccd600cf {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:59:53 user nova-compute[74348]: DEBUG nova.compute.manager [req-ab1fb8db-6122-481a-8b5e-2ebc3ea53e3f req-080e2867-127c-43e4-a429-b2910a01603f service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Received event network-vif-unplugged-07295502-d217-400f-8b56-9ff1ccd600cf for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 07:59:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:53 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Instance destroyed successfully.
Nov 22 07:59:53 user nova-compute[74348]: DEBUG nova.objects.instance [None req-7a3b1f5f-ff83-4143-9f6f-209fa9dee42d tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lazy-loading 'resources' on Instance uuid bcedb385-b72a-49c2-b363-cf6da5804b60 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 07:59:53 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-7a3b1f5f-ff83-4143-9f6f-209fa9dee42d tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:52:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1265518421',display_name='tempest-ServerStableDeviceRescueTest-server-1265518421',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1265518421',id=3,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnGejlUCbU+TZ721uJZEGmLnTNVCBBM879Xewcu8isegoAWEt+xTskGWpM7X241rS86tQTNpoTmY80QMBL/L0CKb2yd4AKlvcL5MuFfyK4GKM1PMiVB7vqffS9ETA8vQg==',key_name='tempest-keypair-1916933864',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:56:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f52a21c1ef18473aa64c139de7b920ab',ramdisk_id='',reservation_id='r-hqpjdyae',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1621342321',owner_user_name='tempest-ServerStableDeviceRescueTest-1621342321-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T07:58:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7feabb30a9c14a209ad4fc962ef29481',uuid=bcedb385-b72a-49c2-b363-cf6da5804b60,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07295502-d217-400f-8b56-9ff1ccd600cf", "address": "fa:16:3e:50:0c:08", "network": {"id": "fd2e1dc2-9099-48b4-b56d-bc5d09c892fe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1689843295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52a21c1ef18473aa64c139de7b920ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07295502-d2", "ovs_interfaceid": "07295502-d217-400f-8b56-9ff1ccd600cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 07:59:53 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-7a3b1f5f-ff83-4143-9f6f-209fa9dee42d tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Converting VIF {"id": "07295502-d217-400f-8b56-9ff1ccd600cf", "address": "fa:16:3e:50:0c:08", "network": {"id": "fd2e1dc2-9099-48b4-b56d-bc5d09c892fe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1689843295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52a21c1ef18473aa64c139de7b920ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07295502-d2", "ovs_interfaceid": "07295502-d217-400f-8b56-9ff1ccd600cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 07:59:53 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-7a3b1f5f-ff83-4143-9f6f-209fa9dee42d tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:0c:08,bridge_name='br-int',has_traffic_filtering=True,id=07295502-d217-400f-8b56-9ff1ccd600cf,network=Network(fd2e1dc2-9099-48b4-b56d-bc5d09c892fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07295502-d2') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 07:59:53 user nova-compute[74348]: DEBUG os_vif [None req-7a3b1f5f-ff83-4143-9f6f-209fa9dee42d tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:0c:08,bridge_name='br-int',has_traffic_filtering=True,id=07295502-d217-400f-8b56-9ff1ccd600cf,network=Network(fd2e1dc2-9099-48b4-b56d-bc5d09c892fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07295502-d2') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 07:59:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap07295502-d2, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:59:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0ff8e10b-5dd7-4458-a7c4-aa8255219e10) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 07:59:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 07:59:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 07:59:53 user nova-compute[74348]: INFO os_vif [None req-7a3b1f5f-ff83-4143-9f6f-209fa9dee42d tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:0c:08,bridge_name='br-int',has_traffic_filtering=True,id=07295502-d217-400f-8b56-9ff1ccd600cf,network=Network(fd2e1dc2-9099-48b4-b56d-bc5d09c892fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07295502-d2')
Nov 22 07:59:53 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-7a3b1f5f-ff83-4143-9f6f-209fa9dee42d tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Deleting instance files /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60_del
Nov 22 07:59:53 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-7a3b1f5f-ff83-4143-9f6f-209fa9dee42d tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Deletion of /opt/stack/data/nova/instances/bcedb385-b72a-49c2-b363-cf6da5804b60_del complete
Nov 22 07:59:53 user nova-compute[74348]: INFO nova.compute.manager [None req-7a3b1f5f-ff83-4143-9f6f-209fa9dee42d tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 22 07:59:53 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-7a3b1f5f-ff83-4143-9f6f-209fa9dee42d tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 07:59:53 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 07:59:53 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 07:59:55 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:59:55 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Took 1.14 seconds to deallocate network for instance.
Nov 22 07:59:55 user nova-compute[74348]: DEBUG nova.compute.manager [req-fe6d11c7-8ba6-43e5-b3ed-54b24789da24 req-f29d4995-b97f-448f-a778-858acddb0f44 service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Received event network-vif-deleted-07295502-d217-400f-8b56-9ff1ccd600cf {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:59:55 user nova-compute[74348]: INFO nova.compute.manager [req-fe6d11c7-8ba6-43e5-b3ed-54b24789da24 req-f29d4995-b97f-448f-a778-858acddb0f44 service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Neutron deleted interface 07295502-d217-400f-8b56-9ff1ccd600cf; detaching it from the instance and deleting it from the info cache
Nov 22 07:59:55 user nova-compute[74348]: DEBUG nova.network.neutron [req-fe6d11c7-8ba6-43e5-b3ed-54b24789da24 req-f29d4995-b97f-448f-a778-858acddb0f44 service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 07:59:55 user nova-compute[74348]: DEBUG nova.compute.manager [req-fe6d11c7-8ba6-43e5-b3ed-54b24789da24 req-f29d4995-b97f-448f-a778-858acddb0f44 service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Detach interface failed, port_id=07295502-d217-400f-8b56-9ff1ccd600cf, reason: Instance bcedb385-b72a-49c2-b363-cf6da5804b60 could not be found. {{(pid=74348) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 07:59:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7a3b1f5f-ff83-4143-9f6f-209fa9dee42d tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:59:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7a3b1f5f-ff83-4143-9f6f-209fa9dee42d tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:59:55 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-7a3b1f5f-ff83-4143-9f6f-209fa9dee42d tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 07:59:55 user nova-compute[74348]: DEBUG nova.compute.manager [req-f75ac906-1c33-4801-bc67-65ac06662f1e req-9838bec2-29d6-411f-9033-0ebea909df04 service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Received event network-vif-plugged-07295502-d217-400f-8b56-9ff1ccd600cf {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 07:59:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f75ac906-1c33-4801-bc67-65ac06662f1e req-9838bec2-29d6-411f-9033-0ebea909df04 service nova] Acquiring lock "bcedb385-b72a-49c2-b363-cf6da5804b60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 07:59:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f75ac906-1c33-4801-bc67-65ac06662f1e req-9838bec2-29d6-411f-9033-0ebea909df04 service nova] Lock "bcedb385-b72a-49c2-b363-cf6da5804b60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 07:59:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f75ac906-1c33-4801-bc67-65ac06662f1e req-9838bec2-29d6-411f-9033-0ebea909df04 service nova] Lock "bcedb385-b72a-49c2-b363-cf6da5804b60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:59:55 user nova-compute[74348]: DEBUG nova.compute.manager [req-f75ac906-1c33-4801-bc67-65ac06662f1e req-9838bec2-29d6-411f-9033-0ebea909df04 service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] No waiting events found dispatching network-vif-plugged-07295502-d217-400f-8b56-9ff1ccd600cf {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 07:59:55 user nova-compute[74348]: WARNING nova.compute.manager [req-f75ac906-1c33-4801-bc67-65ac06662f1e req-9838bec2-29d6-411f-9033-0ebea909df04 service nova] [instance: bcedb385-b72a-49c2-b363-cf6da5804b60] Received unexpected event network-vif-plugged-07295502-d217-400f-8b56-9ff1ccd600cf for instance with vm_state deleted and task_state None.
Nov 22 07:59:55 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-7a3b1f5f-ff83-4143-9f6f-209fa9dee42d tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 07:59:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7a3b1f5f-ff83-4143-9f6f-209fa9dee42d tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:59:55 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-7a3b1f5f-ff83-4143-9f6f-209fa9dee42d tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Deleted allocations for instance bcedb385-b72a-49c2-b363-cf6da5804b60
Nov 22 07:59:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7a3b1f5f-ff83-4143-9f6f-209fa9dee42d tempest-ServerStableDeviceRescueTest-1621342321 tempest-ServerStableDeviceRescueTest-1621342321-project-member] Lock "bcedb385-b72a-49c2-b363-cf6da5804b60" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.537s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 07:59:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:00:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:00:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:00:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:00:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Acquiring lock "a07ac785-23f6-4e92-9e7f-7de496dd0954" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:00:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lock "a07ac785-23f6-4e92-9e7f-7de496dd0954" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:00:04 user nova-compute[74348]: DEBUG nova.compute.manager [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 08:00:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:00:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:00:04 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 08:00:04 user nova-compute[74348]: INFO nova.compute.claims [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Claim successful on node user
Nov 22 08:00:05 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:00:05 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:00:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.425s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:00:05 user nova-compute[74348]: DEBUG nova.compute.manager [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 08:00:05 user nova-compute[74348]: DEBUG nova.compute.manager [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 08:00:05 user nova-compute[74348]: DEBUG nova.network.neutron [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 08:00:05 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 08:00:05 user nova-compute[74348]: DEBUG nova.compute.manager [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 08:00:05 user nova-compute[74348]: DEBUG nova.policy [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9d4446ab7daa45fa8c843c2d991de43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8780c23b60e4abe85276f2d71c591b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 08:00:05 user nova-compute[74348]: DEBUG nova.compute.manager [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 08:00:05 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 08:00:05 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Creating image(s)
Nov 22 08:00:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Acquiring lock "/opt/stack/data/nova/instances/a07ac785-23f6-4e92-9e7f-7de496dd0954/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:00:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lock "/opt/stack/data/nova/instances/a07ac785-23f6-4e92-9e7f-7de496dd0954/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:00:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lock "/opt/stack/data/nova/instances/a07ac785-23f6-4e92-9e7f-7de496dd0954/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:00:05 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:05 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.184s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Acquiring lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:00:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:00:05 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.180s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/a07ac785-23f6-4e92-9e7f-7de496dd0954/disk 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/a07ac785-23f6-4e92-9e7f-7de496dd0954/disk 1073741824" returned: 0 in 0.049s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:00:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.169s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:06 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a07ac785-23f6-4e92-9e7f-7de496dd0954/disk. size=1073741824 {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 08:00:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a07ac785-23f6-4e92-9e7f-7de496dd0954/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:06 user nova-compute[74348]: DEBUG nova.network.neutron [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Successfully created port: ef5eac53-c84f-4b04-b142-34cba2ed8eb2 {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 08:00:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a07ac785-23f6-4e92-9e7f-7de496dd0954/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:06 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Cannot resize image /opt/stack/data/nova/instances/a07ac785-23f6-4e92-9e7f-7de496dd0954/disk to a smaller size. {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 08:00:06 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 08:00:06 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Ensure instance console log exists: /opt/stack/data/nova/instances/a07ac785-23f6-4e92-9e7f-7de496dd0954/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 08:00:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:00:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:00:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG nova.network.neutron [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Successfully updated port: ef5eac53-c84f-4b04-b142-34cba2ed8eb2 {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Acquiring lock "refresh_cache-a07ac785-23f6-4e92-9e7f-7de496dd0954" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Acquired lock "refresh_cache-a07ac785-23f6-4e92-9e7f-7de496dd0954" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG nova.network.neutron [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG nova.compute.manager [req-30c6264e-6e82-4432-a183-ba954884ea0c req-903f5f1a-f1f1-4690-bb48-c223c6659d93 service nova] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Received event network-changed-ef5eac53-c84f-4b04-b142-34cba2ed8eb2 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG nova.compute.manager [req-30c6264e-6e82-4432-a183-ba954884ea0c req-903f5f1a-f1f1-4690-bb48-c223c6659d93 service nova] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Refreshing instance network info cache due to event network-changed-ef5eac53-c84f-4b04-b142-34cba2ed8eb2. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-30c6264e-6e82-4432-a183-ba954884ea0c req-903f5f1a-f1f1-4690-bb48-c223c6659d93 service nova] Acquiring lock "refresh_cache-a07ac785-23f6-4e92-9e7f-7de496dd0954" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG nova.network.neutron [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG nova.network.neutron [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Updating instance_info_cache with network_info: [{"id": "ef5eac53-c84f-4b04-b142-34cba2ed8eb2", "address": "fa:16:3e:70:e8:31", "network": {"id": "c405fff5-285f-47eb-8bae-867c6393edf2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-368785799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8780c23b60e4abe85276f2d71c591b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef5eac53-c8", "ovs_interfaceid": "ef5eac53-c84f-4b04-b142-34cba2ed8eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Releasing lock "refresh_cache-a07ac785-23f6-4e92-9e7f-7de496dd0954" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG nova.compute.manager [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Instance network_info: |[{"id": "ef5eac53-c84f-4b04-b142-34cba2ed8eb2", "address": "fa:16:3e:70:e8:31", "network": {"id": "c405fff5-285f-47eb-8bae-867c6393edf2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-368785799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8780c23b60e4abe85276f2d71c591b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef5eac53-c8", "ovs_interfaceid": "ef5eac53-c84f-4b04-b142-34cba2ed8eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-30c6264e-6e82-4432-a183-ba954884ea0c req-903f5f1a-f1f1-4690-bb48-c223c6659d93 service nova] Acquired lock "refresh_cache-a07ac785-23f6-4e92-9e7f-7de496dd0954" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG nova.network.neutron [req-30c6264e-6e82-4432-a183-ba954884ea0c req-903f5f1a-f1f1-4690-bb48-c223c6659d93 service nova] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Refreshing network info cache for port ef5eac53-c84f-4b04-b142-34cba2ed8eb2 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Start _get_guest_xml network_info=[{"id": "ef5eac53-c84f-4b04-b142-34cba2ed8eb2", "address": "fa:16:3e:70:e8:31", "network": {"id": "c405fff5-285f-47eb-8bae-867c6393edf2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-368785799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8780c23b60e4abe85276f2d71c591b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef5eac53-c8", "ovs_interfaceid": "ef5eac53-c84f-4b04-b142-34cba2ed8eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 08:00:07 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:00:07 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:00:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:00:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-249378103',display_name='tempest-VolumesAdminNegativeTest-server-249378103',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-249378103',id=21,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8780c23b60e4abe85276f2d71c591b0',ramdisk_id='',reservation_id='r-fdwzomz0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1341066445',owner_user_name='tempest-VolumesAdminNegativeTest-1341066445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:00:06Z,user_data=None,user_id='9d4446ab7daa45fa8c843c2d991de43f',uuid=a07ac785-23f6-4e92-9e7f-7de496dd0954,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef5eac53-c84f-4b04-b142-34cba2ed8eb2", "address": "fa:16:3e:70:e8:31", "network": {"id": "c405fff5-285f-47eb-8bae-867c6393edf2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-368785799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8780c23b60e4abe85276f2d71c591b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef5eac53-c8", "ovs_interfaceid": "ef5eac53-c84f-4b04-b142-34cba2ed8eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Converting VIF {"id": "ef5eac53-c84f-4b04-b142-34cba2ed8eb2", "address": "fa:16:3e:70:e8:31", "network": {"id": "c405fff5-285f-47eb-8bae-867c6393edf2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-368785799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8780c23b60e4abe85276f2d71c591b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef5eac53-c8", "ovs_interfaceid": "ef5eac53-c84f-4b04-b142-34cba2ed8eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:e8:31,bridge_name='br-int',has_traffic_filtering=True,id=ef5eac53-c84f-4b04-b142-34cba2ed8eb2,network=Network(c405fff5-285f-47eb-8bae-867c6393edf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef5eac53-c8') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG nova.objects.instance [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lazy-loading 'pci_devices' on Instance uuid a07ac785-23f6-4e92-9e7f-7de496dd0954 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] End _get_guest_xml xml=<domain type="kvm">
Nov 22 08:00:07 user nova-compute[74348]:   <uuid>a07ac785-23f6-4e92-9e7f-7de496dd0954</uuid>
Nov 22 08:00:07 user nova-compute[74348]:   <name>instance-00000015</name>
Nov 22 08:00:07 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 08:00:07 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 08:00:07 user nova-compute[74348]:   <metadata>
Nov 22 08:00:07 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 08:00:07 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 08:00:07 user nova-compute[74348]:       <nova:name>tempest-VolumesAdminNegativeTest-server-249378103</nova:name>
Nov 22 08:00:07 user nova-compute[74348]:       <nova:creationTime>2023-11-22 08:00:07</nova:creationTime>
Nov 22 08:00:07 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 08:00:07 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 08:00:07 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 08:00:07 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 08:00:07 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 08:00:07 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 08:00:07 user nova-compute[74348]:       </nova:flavor>
Nov 22 08:00:07 user nova-compute[74348]:       <nova:owner>
Nov 22 08:00:07 user nova-compute[74348]:         <nova:user uuid="9d4446ab7daa45fa8c843c2d991de43f">tempest-VolumesAdminNegativeTest-1341066445-project-member</nova:user>
Nov 22 08:00:07 user nova-compute[74348]:         <nova:project uuid="a8780c23b60e4abe85276f2d71c591b0">tempest-VolumesAdminNegativeTest-1341066445</nova:project>
Nov 22 08:00:07 user nova-compute[74348]:       </nova:owner>
Nov 22 08:00:07 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 08:00:07 user nova-compute[74348]:       <nova:ports>
Nov 22 08:00:07 user nova-compute[74348]:         <nova:port uuid="ef5eac53-c84f-4b04-b142-34cba2ed8eb2">
Nov 22 08:00:07 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 22 08:00:07 user nova-compute[74348]:         </nova:port>
Nov 22 08:00:07 user nova-compute[74348]:       </nova:ports>
Nov 22 08:00:07 user nova-compute[74348]:     </nova:instance>
Nov 22 08:00:07 user nova-compute[74348]:   </metadata>
Nov 22 08:00:07 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 08:00:07 user nova-compute[74348]:     <system>
Nov 22 08:00:07 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 08:00:07 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 08:00:07 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 08:00:07 user nova-compute[74348]:       <entry name="serial">a07ac785-23f6-4e92-9e7f-7de496dd0954</entry>
Nov 22 08:00:07 user nova-compute[74348]:       <entry name="uuid">a07ac785-23f6-4e92-9e7f-7de496dd0954</entry>
Nov 22 08:00:07 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 08:00:07 user nova-compute[74348]:     </system>
Nov 22 08:00:07 user nova-compute[74348]:   </sysinfo>
Nov 22 08:00:07 user nova-compute[74348]:   <os>
Nov 22 08:00:07 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 08:00:07 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 08:00:07 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 08:00:07 user nova-compute[74348]:   </os>
Nov 22 08:00:07 user nova-compute[74348]:   <features>
Nov 22 08:00:07 user nova-compute[74348]:     <acpi/>
Nov 22 08:00:07 user nova-compute[74348]:     <apic/>
Nov 22 08:00:07 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 08:00:07 user nova-compute[74348]:   </features>
Nov 22 08:00:07 user nova-compute[74348]:   <clock offset="utc">
Nov 22 08:00:07 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 08:00:07 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 08:00:07 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 08:00:07 user nova-compute[74348]:   </clock>
Nov 22 08:00:07 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 08:00:07 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 08:00:07 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 08:00:07 user nova-compute[74348]:   </cpu>
Nov 22 08:00:07 user nova-compute[74348]:   <devices>
Nov 22 08:00:07 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 08:00:07 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 08:00:07 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/a07ac785-23f6-4e92-9e7f-7de496dd0954/disk"/>
Nov 22 08:00:07 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 08:00:07 user nova-compute[74348]:     </disk>
Nov 22 08:00:07 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 08:00:07 user nova-compute[74348]:       <mac address="fa:16:3e:70:e8:31"/>
Nov 22 08:00:07 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:00:07 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 08:00:07 user nova-compute[74348]:       <target dev="tapef5eac53-c8"/>
Nov 22 08:00:07 user nova-compute[74348]:     </interface>
Nov 22 08:00:07 user nova-compute[74348]:     <serial type="pty">
Nov 22 08:00:07 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/a07ac785-23f6-4e92-9e7f-7de496dd0954/console.log" append="off"/>
Nov 22 08:00:07 user nova-compute[74348]:     </serial>
Nov 22 08:00:07 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 08:00:07 user nova-compute[74348]:     <video>
Nov 22 08:00:07 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:00:07 user nova-compute[74348]:     </video>
Nov 22 08:00:07 user nova-compute[74348]:     <rng model="virtio">
Nov 22 08:00:07 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 08:00:07 user nova-compute[74348]:     </rng>
Nov 22 08:00:07 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 08:00:07 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 08:00:07 user nova-compute[74348]:       <stats period="10"/>
Nov 22 08:00:07 user nova-compute[74348]:     </memballoon>
Nov 22 08:00:07 user nova-compute[74348]:   </devices>
Nov 22 08:00:07 user nova-compute[74348]: </domain>
Nov 22 08:00:07 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:00:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-249378103',display_name='tempest-VolumesAdminNegativeTest-server-249378103',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-249378103',id=21,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8780c23b60e4abe85276f2d71c591b0',ramdisk_id='',reservation_id='r-fdwzomz0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1341066445',owner_user_name='tempest-VolumesAdminNegativeTest-1341066445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:00:06Z,user_data=None,user_id='9d4446ab7daa45fa8c843c2d991de43f',uuid=a07ac785-23f6-4e92-9e7f-7de496dd0954,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef5eac53-c84f-4b04-b142-34cba2ed8eb2", "address": "fa:16:3e:70:e8:31", "network": {"id": "c405fff5-285f-47eb-8bae-867c6393edf2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-368785799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8780c23b60e4abe85276f2d71c591b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef5eac53-c8", "ovs_interfaceid": "ef5eac53-c84f-4b04-b142-34cba2ed8eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Converting VIF {"id": "ef5eac53-c84f-4b04-b142-34cba2ed8eb2", "address": "fa:16:3e:70:e8:31", "network": {"id": "c405fff5-285f-47eb-8bae-867c6393edf2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-368785799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8780c23b60e4abe85276f2d71c591b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef5eac53-c8", "ovs_interfaceid": "ef5eac53-c84f-4b04-b142-34cba2ed8eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:e8:31,bridge_name='br-int',has_traffic_filtering=True,id=ef5eac53-c84f-4b04-b142-34cba2ed8eb2,network=Network(c405fff5-285f-47eb-8bae-867c6393edf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef5eac53-c8') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG os_vif [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:e8:31,bridge_name='br-int',has_traffic_filtering=True,id=ef5eac53-c84f-4b04-b142-34cba2ed8eb2,network=Network(c405fff5-285f-47eb-8bae-867c6393edf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef5eac53-c8') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '636f9d29-c4f8-5e8e-bb05-0e1b57f84c4b', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef5eac53-c8, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapef5eac53-c8, col_values=(('qos', UUID('be1865a0-c307-42a1-896a-7116fe0f7826')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapef5eac53-c8, col_values=(('external_ids', {'iface-id': 'ef5eac53-c84f-4b04-b142-34cba2ed8eb2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:e8:31', 'vm-uuid': 'a07ac785-23f6-4e92-9e7f-7de496dd0954'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:07 user nova-compute[74348]: INFO os_vif [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:e8:31,bridge_name='br-int',has_traffic_filtering=True,id=ef5eac53-c84f-4b04-b142-34cba2ed8eb2,network=Network(c405fff5-285f-47eb-8bae-867c6393edf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef5eac53-c8')
Nov 22 08:00:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] No VIF found with MAC fa:16:3e:70:e8:31, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG nova.network.neutron [req-30c6264e-6e82-4432-a183-ba954884ea0c req-903f5f1a-f1f1-4690-bb48-c223c6659d93 service nova] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Updated VIF entry in instance network info cache for port ef5eac53-c84f-4b04-b142-34cba2ed8eb2. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG nova.network.neutron [req-30c6264e-6e82-4432-a183-ba954884ea0c req-903f5f1a-f1f1-4690-bb48-c223c6659d93 service nova] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Updating instance_info_cache with network_info: [{"id": "ef5eac53-c84f-4b04-b142-34cba2ed8eb2", "address": "fa:16:3e:70:e8:31", "network": {"id": "c405fff5-285f-47eb-8bae-867c6393edf2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-368785799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8780c23b60e4abe85276f2d71c591b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef5eac53-c8", "ovs_interfaceid": "ef5eac53-c84f-4b04-b142-34cba2ed8eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:00:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-30c6264e-6e82-4432-a183-ba954884ea0c req-903f5f1a-f1f1-4690-bb48-c223c6659d93 service nova] Releasing lock "refresh_cache-a07ac785-23f6-4e92-9e7f-7de496dd0954" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:00:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquiring lock "3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:00:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:00:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:09 user nova-compute[74348]: DEBUG nova.compute.manager [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 08:00:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:00:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:00:09 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 08:00:09 user nova-compute[74348]: INFO nova.compute.claims [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Claim successful on node user
Nov 22 08:00:09 user nova-compute[74348]: DEBUG nova.compute.manager [req-ca70b98d-61da-48cb-9bb6-2563e767122f req-8c9a6da4-da3d-4bfc-a807-c0d905dfad29 service nova] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Received event network-vif-plugged-ef5eac53-c84f-4b04-b142-34cba2ed8eb2 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:00:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-ca70b98d-61da-48cb-9bb6-2563e767122f req-8c9a6da4-da3d-4bfc-a807-c0d905dfad29 service nova] Acquiring lock "a07ac785-23f6-4e92-9e7f-7de496dd0954-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:00:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-ca70b98d-61da-48cb-9bb6-2563e767122f req-8c9a6da4-da3d-4bfc-a807-c0d905dfad29 service nova] Lock "a07ac785-23f6-4e92-9e7f-7de496dd0954-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:00:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-ca70b98d-61da-48cb-9bb6-2563e767122f req-8c9a6da4-da3d-4bfc-a807-c0d905dfad29 service nova] Lock "a07ac785-23f6-4e92-9e7f-7de496dd0954-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:00:09 user nova-compute[74348]: DEBUG nova.compute.manager [req-ca70b98d-61da-48cb-9bb6-2563e767122f req-8c9a6da4-da3d-4bfc-a807-c0d905dfad29 service nova] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] No waiting events found dispatching network-vif-plugged-ef5eac53-c84f-4b04-b142-34cba2ed8eb2 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:00:09 user nova-compute[74348]: WARNING nova.compute.manager [req-ca70b98d-61da-48cb-9bb6-2563e767122f req-8c9a6da4-da3d-4bfc-a807-c0d905dfad29 service nova] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Received unexpected event network-vif-plugged-ef5eac53-c84f-4b04-b142-34cba2ed8eb2 for instance with vm_state building and task_state spawning.
Nov 22 08:00:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Acquiring lock "84fd55a1-d62e-4191-923e-b5bf7cb47490" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:00:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Lock "84fd55a1-d62e-4191-923e-b5bf7cb47490" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:00:09 user nova-compute[74348]: DEBUG nova.objects.instance [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Lazy-loading 'flavor' on Instance uuid 84fd55a1-d62e-4191-923e-b5bf7cb47490 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:00:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Lock "84fd55a1-d62e-4191-923e-b5bf7cb47490" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.131s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:00:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Acquiring lock "84fd55a1-d62e-4191-923e-b5bf7cb47490" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:00:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Lock "84fd55a1-d62e-4191-923e-b5bf7cb47490" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:00:09 user nova-compute[74348]: INFO nova.compute.manager [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Attaching volume 1635ad62-17bf-4a7a-a485-609ebc1b39f1 to /dev/vdb
Nov 22 08:00:09 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:00:09 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:00:09 user nova-compute[74348]: DEBUG os_brick.utils [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:00:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:09 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[58463f91-8c0c-44e1-b885-e6184d177d31]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.586s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:00:09 user nova-compute[74348]: DEBUG nova.compute.manager [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 08:00:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:09 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db88155-dad9-4dcf-bb50-24bb115b4fd5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:09 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5a8b0f-6eca-4348-a9ae-46af8f2f38c5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:09 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb5b48d-e9df-41a2-8caf-b3992ae3f605]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:00:09 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 08:00:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:09 user nova-compute[74348]: DEBUG nova.compute.manager [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 08:00:09 user nova-compute[74348]: DEBUG nova.network.neutron [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 08:00:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:00:09 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 08:00:09 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31c1dd0-58dd-4016-a936-11e0032a971d]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:09 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 08:00:09 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 08:00:09 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 08:00:09 user nova-compute[74348]: DEBUG os_brick.utils [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:00:09 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Updating existing volume attachment record: c5b4a4f6-c1f6-4c00-8791-6aa28a60587d {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 08:00:09 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 08:00:09 user nova-compute[74348]: DEBUG nova.compute.manager [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 08:00:10 user nova-compute[74348]: DEBUG nova.policy [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2e8ce0d767724228bfd6cf3a4afad00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444367658c0241d0b5b377a73fedb52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 08:00:10 user nova-compute[74348]: DEBUG nova.compute.manager [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 08:00:10 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 08:00:10 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Creating image(s)
Nov 22 08:00:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquiring lock "/opt/stack/data/nova/instances/3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:00:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "/opt/stack/data/nova/instances/3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:00:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "/opt/stack/data/nova/instances/3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:00:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.215s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquiring lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:00:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:00:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.196s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0/disk 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0/disk 1073741824" returned: 0 in 0.058s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:00:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:10 user nova-compute[74348]: DEBUG nova.network.neutron [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Successfully created port: 6c9d4040-2941-469b-b602-69cc8b6e879b {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 08:00:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.228s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:10 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0/disk. size=1073741824 {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 08:00:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Cannot resize image /opt/stack/data/nova/instances/3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0/disk to a smaller size. {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Ensure instance console log exists: /opt/stack/data/nova/instances/3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.compute.manager [req-47ab0908-6563-4b59-981b-4009a2b77263 req-f103714c-be25-4d3e-8c09-e2322a726e59 service nova] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Received event network-vif-plugged-ef5eac53-c84f-4b04-b142-34cba2ed8eb2 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-47ab0908-6563-4b59-981b-4009a2b77263 req-f103714c-be25-4d3e-8c09-e2322a726e59 service nova] Acquiring lock "a07ac785-23f6-4e92-9e7f-7de496dd0954-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-47ab0908-6563-4b59-981b-4009a2b77263 req-f103714c-be25-4d3e-8c09-e2322a726e59 service nova] Lock "a07ac785-23f6-4e92-9e7f-7de496dd0954-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-47ab0908-6563-4b59-981b-4009a2b77263 req-f103714c-be25-4d3e-8c09-e2322a726e59 service nova] Lock "a07ac785-23f6-4e92-9e7f-7de496dd0954-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.compute.manager [req-47ab0908-6563-4b59-981b-4009a2b77263 req-f103714c-be25-4d3e-8c09-e2322a726e59 service nova] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] No waiting events found dispatching network-vif-plugged-ef5eac53-c84f-4b04-b142-34cba2ed8eb2 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:00:11 user nova-compute[74348]: WARNING nova.compute.manager [req-47ab0908-6563-4b59-981b-4009a2b77263 req-f103714c-be25-4d3e-8c09-e2322a726e59 service nova] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Received unexpected event network-vif-plugged-ef5eac53-c84f-4b04-b142-34cba2ed8eb2 for instance with vm_state building and task_state spawning.
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.compute.manager [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 08:00:11 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Instance spawned successfully.
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.network.neutron [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Successfully updated port: 6c9d4040-2941-469b-b602-69cc8b6e879b {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquiring lock "refresh_cache-3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquired lock "refresh_cache-3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.network.neutron [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.compute.manager [req-480238c1-0198-46fd-8b47-6c040ba99dfb req-4d2f61f8-66b1-448c-8da9-0fa9c9aa313b service nova] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Received event network-changed-6c9d4040-2941-469b-b602-69cc8b6e879b {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.compute.manager [req-480238c1-0198-46fd-8b47-6c040ba99dfb req-4d2f61f8-66b1-448c-8da9-0fa9c9aa313b service nova] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Refreshing instance network info cache due to event network-changed-6c9d4040-2941-469b-b602-69cc8b6e879b. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-480238c1-0198-46fd-8b47-6c040ba99dfb req-4d2f61f8-66b1-448c-8da9-0fa9c9aa313b service nova] Acquiring lock "refresh_cache-3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.network.neutron [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 08:00:11 user nova-compute[74348]: INFO nova.compute.manager [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Took 5.97 seconds to spawn the instance on the hypervisor.
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.compute.manager [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:00:11 user nova-compute[74348]: INFO nova.compute.manager [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Took 6.75 seconds to build instance.
Nov 22 08:00:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c5688450-abb1-499d-9b82-dfcab6e48292 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lock "a07ac785-23f6-4e92-9e7f-7de496dd0954" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.888s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.network.neutron [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Updating instance_info_cache with network_info: [{"id": "6c9d4040-2941-469b-b602-69cc8b6e879b", "address": "fa:16:3e:b0:44:f3", "network": {"id": "4ef640bb-4a2f-4f98-8b01-b5df87fcb35a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1216437312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444367658c0241d0b5b377a73fedb52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9d4040-29", "ovs_interfaceid": "6c9d4040-2941-469b-b602-69cc8b6e879b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Releasing lock "refresh_cache-3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.compute.manager [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Instance network_info: |[{"id": "6c9d4040-2941-469b-b602-69cc8b6e879b", "address": "fa:16:3e:b0:44:f3", "network": {"id": "4ef640bb-4a2f-4f98-8b01-b5df87fcb35a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1216437312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444367658c0241d0b5b377a73fedb52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9d4040-29", "ovs_interfaceid": "6c9d4040-2941-469b-b602-69cc8b6e879b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-480238c1-0198-46fd-8b47-6c040ba99dfb req-4d2f61f8-66b1-448c-8da9-0fa9c9aa313b service nova] Acquired lock "refresh_cache-3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.network.neutron [req-480238c1-0198-46fd-8b47-6c040ba99dfb req-4d2f61f8-66b1-448c-8da9-0fa9c9aa313b service nova] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Refreshing network info cache for port 6c9d4040-2941-469b-b602-69cc8b6e879b {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Start _get_guest_xml network_info=[{"id": "6c9d4040-2941-469b-b602-69cc8b6e879b", "address": "fa:16:3e:b0:44:f3", "network": {"id": "4ef640bb-4a2f-4f98-8b01-b5df87fcb35a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1216437312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444367658c0241d0b5b377a73fedb52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9d4040-29", "ovs_interfaceid": "6c9d4040-2941-469b-b602-69cc8b6e879b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 08:00:11 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:00:11 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:00:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-335042483',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-335042483',id=22,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHPUs6p+/jls1RPfIFV5xXa9y76RX5cEwthTUZNcmPfI6OBMJxFWtX95JSXaEnXQjIlzA5fswFbK+8eLhdSOUct5GBpwfuknlt+F7shfIItWr4KCKRAfovZkkd27ju+WQ==',key_name='tempest-keypair-1302414391',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='444367658c0241d0b5b377a73fedb52b',ramdisk_id='',reservation_id='r-ihwqqxt1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1610098589',owner_user_name='tempest-AttachVolumeShelveTestJSON-1610098589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:00:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e8ce0d767724228bfd6cf3a4afad00d',uuid=3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c9d4040-2941-469b-b602-69cc8b6e879b", "address": "fa:16:3e:b0:44:f3", "network": {"id": "4ef640bb-4a2f-4f98-8b01-b5df87fcb35a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1216437312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444367658c0241d0b5b377a73fedb52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9d4040-29", "ovs_interfaceid": "6c9d4040-2941-469b-b602-69cc8b6e879b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Converting VIF {"id": "6c9d4040-2941-469b-b602-69cc8b6e879b", "address": "fa:16:3e:b0:44:f3", "network": {"id": "4ef640bb-4a2f-4f98-8b01-b5df87fcb35a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1216437312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444367658c0241d0b5b377a73fedb52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9d4040-29", "ovs_interfaceid": "6c9d4040-2941-469b-b602-69cc8b6e879b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:44:f3,bridge_name='br-int',has_traffic_filtering=True,id=6c9d4040-2941-469b-b602-69cc8b6e879b,network=Network(4ef640bb-4a2f-4f98-8b01-b5df87fcb35a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9d4040-29') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.objects.instance [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] End _get_guest_xml xml=<domain type="kvm">
Nov 22 08:00:11 user nova-compute[74348]:   <uuid>3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0</uuid>
Nov 22 08:00:11 user nova-compute[74348]:   <name>instance-00000016</name>
Nov 22 08:00:11 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 08:00:11 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 08:00:11 user nova-compute[74348]:   <metadata>
Nov 22 08:00:11 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 08:00:11 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 08:00:11 user nova-compute[74348]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-335042483</nova:name>
Nov 22 08:00:11 user nova-compute[74348]:       <nova:creationTime>2023-11-22 08:00:11</nova:creationTime>
Nov 22 08:00:11 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 08:00:11 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 08:00:11 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 08:00:11 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 08:00:11 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 08:00:11 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 08:00:11 user nova-compute[74348]:       </nova:flavor>
Nov 22 08:00:11 user nova-compute[74348]:       <nova:owner>
Nov 22 08:00:11 user nova-compute[74348]:         <nova:user uuid="2e8ce0d767724228bfd6cf3a4afad00d">tempest-AttachVolumeShelveTestJSON-1610098589-project-member</nova:user>
Nov 22 08:00:11 user nova-compute[74348]:         <nova:project uuid="444367658c0241d0b5b377a73fedb52b">tempest-AttachVolumeShelveTestJSON-1610098589</nova:project>
Nov 22 08:00:11 user nova-compute[74348]:       </nova:owner>
Nov 22 08:00:11 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 08:00:11 user nova-compute[74348]:       <nova:ports>
Nov 22 08:00:11 user nova-compute[74348]:         <nova:port uuid="6c9d4040-2941-469b-b602-69cc8b6e879b">
Nov 22 08:00:11 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 22 08:00:11 user nova-compute[74348]:         </nova:port>
Nov 22 08:00:11 user nova-compute[74348]:       </nova:ports>
Nov 22 08:00:11 user nova-compute[74348]:     </nova:instance>
Nov 22 08:00:11 user nova-compute[74348]:   </metadata>
Nov 22 08:00:11 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 08:00:11 user nova-compute[74348]:     <system>
Nov 22 08:00:11 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 08:00:11 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 08:00:11 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 08:00:11 user nova-compute[74348]:       <entry name="serial">3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0</entry>
Nov 22 08:00:11 user nova-compute[74348]:       <entry name="uuid">3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0</entry>
Nov 22 08:00:11 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 08:00:11 user nova-compute[74348]:     </system>
Nov 22 08:00:11 user nova-compute[74348]:   </sysinfo>
Nov 22 08:00:11 user nova-compute[74348]:   <os>
Nov 22 08:00:11 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 08:00:11 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 08:00:11 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 08:00:11 user nova-compute[74348]:   </os>
Nov 22 08:00:11 user nova-compute[74348]:   <features>
Nov 22 08:00:11 user nova-compute[74348]:     <acpi/>
Nov 22 08:00:11 user nova-compute[74348]:     <apic/>
Nov 22 08:00:11 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 08:00:11 user nova-compute[74348]:   </features>
Nov 22 08:00:11 user nova-compute[74348]:   <clock offset="utc">
Nov 22 08:00:11 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 08:00:11 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 08:00:11 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 08:00:11 user nova-compute[74348]:   </clock>
Nov 22 08:00:11 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 08:00:11 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 08:00:11 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 08:00:11 user nova-compute[74348]:   </cpu>
Nov 22 08:00:11 user nova-compute[74348]:   <devices>
Nov 22 08:00:11 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 08:00:11 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 08:00:11 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0/disk"/>
Nov 22 08:00:11 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 08:00:11 user nova-compute[74348]:     </disk>
Nov 22 08:00:11 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 08:00:11 user nova-compute[74348]:       <mac address="fa:16:3e:b0:44:f3"/>
Nov 22 08:00:11 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:00:11 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 08:00:11 user nova-compute[74348]:       <target dev="tap6c9d4040-29"/>
Nov 22 08:00:11 user nova-compute[74348]:     </interface>
Nov 22 08:00:11 user nova-compute[74348]:     <serial type="pty">
Nov 22 08:00:11 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0/console.log" append="off"/>
Nov 22 08:00:11 user nova-compute[74348]:     </serial>
Nov 22 08:00:11 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 08:00:11 user nova-compute[74348]:     <video>
Nov 22 08:00:11 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:00:11 user nova-compute[74348]:     </video>
Nov 22 08:00:11 user nova-compute[74348]:     <rng model="virtio">
Nov 22 08:00:11 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 08:00:11 user nova-compute[74348]:     </rng>
Nov 22 08:00:11 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 08:00:11 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 08:00:11 user nova-compute[74348]:       <stats period="10"/>
Nov 22 08:00:11 user nova-compute[74348]:     </memballoon>
Nov 22 08:00:11 user nova-compute[74348]:   </devices>
Nov 22 08:00:11 user nova-compute[74348]: </domain>
Nov 22 08:00:11 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:00:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-335042483',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-335042483',id=22,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHPUs6p+/jls1RPfIFV5xXa9y76RX5cEwthTUZNcmPfI6OBMJxFWtX95JSXaEnXQjIlzA5fswFbK+8eLhdSOUct5GBpwfuknlt+F7shfIItWr4KCKRAfovZkkd27ju+WQ==',key_name='tempest-keypair-1302414391',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='444367658c0241d0b5b377a73fedb52b',ramdisk_id='',reservation_id='r-ihwqqxt1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1610098589',owner_user_name='tempest-AttachVolumeShelveTestJSON-1610098589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:00:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e8ce0d767724228bfd6cf3a4afad00d',uuid=3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c9d4040-2941-469b-b602-69cc8b6e879b", "address": "fa:16:3e:b0:44:f3", "network": {"id": "4ef640bb-4a2f-4f98-8b01-b5df87fcb35a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1216437312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444367658c0241d0b5b377a73fedb52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9d4040-29", "ovs_interfaceid": "6c9d4040-2941-469b-b602-69cc8b6e879b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Converting VIF {"id": "6c9d4040-2941-469b-b602-69cc8b6e879b", "address": "fa:16:3e:b0:44:f3", "network": {"id": "4ef640bb-4a2f-4f98-8b01-b5df87fcb35a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1216437312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444367658c0241d0b5b377a73fedb52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9d4040-29", "ovs_interfaceid": "6c9d4040-2941-469b-b602-69cc8b6e879b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:44:f3,bridge_name='br-int',has_traffic_filtering=True,id=6c9d4040-2941-469b-b602-69cc8b6e879b,network=Network(4ef640bb-4a2f-4f98-8b01-b5df87fcb35a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9d4040-29') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG os_vif [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:44:f3,bridge_name='br-int',has_traffic_filtering=True,id=6c9d4040-2941-469b-b602-69cc8b6e879b,network=Network(4ef640bb-4a2f-4f98-8b01-b5df87fcb35a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9d4040-29') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd6dde906-d518-5e9b-8156-c21321983f80', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c9d4040-29, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6c9d4040-29, col_values=(('qos', UUID('fbd6a911-8e1a-4984-a59f-b901651338e6')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6c9d4040-29, col_values=(('external_ids', {'iface-id': '6c9d4040-2941-469b-b602-69cc8b6e879b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:44:f3', 'vm-uuid': '3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:00:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:12 user nova-compute[74348]: INFO os_vif [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:44:f3,bridge_name='br-int',has_traffic_filtering=True,id=6c9d4040-2941-469b-b602-69cc8b6e879b,network=Network(4ef640bb-4a2f-4f98-8b01-b5df87fcb35a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9d4040-29')
Nov 22 08:00:12 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:00:12 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] No VIF found with MAC fa:16:3e:b0:44:f3, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:00:12 user nova-compute[74348]: DEBUG nova.network.neutron [req-480238c1-0198-46fd-8b47-6c040ba99dfb req-4d2f61f8-66b1-448c-8da9-0fa9c9aa313b service nova] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Updated VIF entry in instance network info cache for port 6c9d4040-2941-469b-b602-69cc8b6e879b. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:00:12 user nova-compute[74348]: DEBUG nova.network.neutron [req-480238c1-0198-46fd-8b47-6c040ba99dfb req-4d2f61f8-66b1-448c-8da9-0fa9c9aa313b service nova] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Updating instance_info_cache with network_info: [{"id": "6c9d4040-2941-469b-b602-69cc8b6e879b", "address": "fa:16:3e:b0:44:f3", "network": {"id": "4ef640bb-4a2f-4f98-8b01-b5df87fcb35a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1216437312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444367658c0241d0b5b377a73fedb52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9d4040-29", "ovs_interfaceid": "6c9d4040-2941-469b-b602-69cc8b6e879b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:00:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-480238c1-0198-46fd-8b47-6c040ba99dfb req-4d2f61f8-66b1-448c-8da9-0fa9c9aa313b service nova] Releasing lock "refresh_cache-3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:00:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:13 user nova-compute[74348]: DEBUG nova.compute.manager [req-c4bf6f6d-58f3-46c0-90e6-be8e4909dee1 req-56419377-38ce-4005-aef9-d2833b4e654f service nova] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Received event network-vif-plugged-6c9d4040-2941-469b-b602-69cc8b6e879b {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:00:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c4bf6f6d-58f3-46c0-90e6-be8e4909dee1 req-56419377-38ce-4005-aef9-d2833b4e654f service nova] Acquiring lock "3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:00:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c4bf6f6d-58f3-46c0-90e6-be8e4909dee1 req-56419377-38ce-4005-aef9-d2833b4e654f service nova] Lock "3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:00:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c4bf6f6d-58f3-46c0-90e6-be8e4909dee1 req-56419377-38ce-4005-aef9-d2833b4e654f service nova] Lock "3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:00:13 user nova-compute[74348]: DEBUG nova.compute.manager [req-c4bf6f6d-58f3-46c0-90e6-be8e4909dee1 req-56419377-38ce-4005-aef9-d2833b4e654f service nova] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] No waiting events found dispatching network-vif-plugged-6c9d4040-2941-469b-b602-69cc8b6e879b {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:00:13 user nova-compute[74348]: WARNING nova.compute.manager [req-c4bf6f6d-58f3-46c0-90e6-be8e4909dee1 req-56419377-38ce-4005-aef9-d2833b4e654f service nova] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Received unexpected event network-vif-plugged-6c9d4040-2941-469b-b602-69cc8b6e879b for instance with vm_state building and task_state spawning.
Nov 22 08:00:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:15 user nova-compute[74348]: DEBUG nova.compute.manager [req-5cb67639-edb2-4b97-a1ec-2cbd8c6e6c37 req-611438a0-e0ce-4442-906d-35c949fd95e7 service nova] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Received event network-vif-plugged-6c9d4040-2941-469b-b602-69cc8b6e879b {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:00:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-5cb67639-edb2-4b97-a1ec-2cbd8c6e6c37 req-611438a0-e0ce-4442-906d-35c949fd95e7 service nova] Acquiring lock "3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:00:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-5cb67639-edb2-4b97-a1ec-2cbd8c6e6c37 req-611438a0-e0ce-4442-906d-35c949fd95e7 service nova] Lock "3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:00:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-5cb67639-edb2-4b97-a1ec-2cbd8c6e6c37 req-611438a0-e0ce-4442-906d-35c949fd95e7 service nova] Lock "3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:00:15 user nova-compute[74348]: DEBUG nova.compute.manager [req-5cb67639-edb2-4b97-a1ec-2cbd8c6e6c37 req-611438a0-e0ce-4442-906d-35c949fd95e7 service nova] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] No waiting events found dispatching network-vif-plugged-6c9d4040-2941-469b-b602-69cc8b6e879b {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:00:15 user nova-compute[74348]: WARNING nova.compute.manager [req-5cb67639-edb2-4b97-a1ec-2cbd8c6e6c37 req-611438a0-e0ce-4442-906d-35c949fd95e7 service nova] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Received unexpected event network-vif-plugged-6c9d4040-2941-469b-b602-69cc8b6e879b for instance with vm_state building and task_state spawning.
Nov 22 08:00:15 user nova-compute[74348]: DEBUG nova.compute.manager [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 08:00:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 08:00:15 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Instance spawned successfully.
Nov 22 08:00:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 08:00:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:00:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:00:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:00:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:00:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:00:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:00:16 user nova-compute[74348]: INFO nova.compute.manager [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Took 5.96 seconds to spawn the instance on the hypervisor.
Nov 22 08:00:16 user nova-compute[74348]: DEBUG nova.compute.manager [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:00:16 user nova-compute[74348]: INFO nova.compute.manager [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Took 7.00 seconds to build instance.
Nov 22 08:00:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e9337d55-3840-426f-bd2e-7fe47dd32a9f tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.136s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:00:16 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 08:00:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sPQfhIiS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:00:16 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:00:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:00:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:00:16 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:00:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:00:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:00:16 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 08:00:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1 -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e9114d-2bbb-4b7b-96d4-5f35a8d53614]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 08:00:16 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:00:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f791ec1-ca22-4e6c-b5ab-624fd2a8f468]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1] added
Nov 22 08:00:16 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:00:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e2007d-b762-4a13-a492-3ee46d095321]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:00:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[040f45bc-12ab-4369-9b56-a16dacf0c41c]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:00:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sPQfhIiS {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sPQfhIiS" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:17 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fb69b9-889e-4edc-bd02-baa4ccdcb2b1]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:17 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sPQfhIiS'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:00:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:17 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cde966-864f-473d-9ce6-c08e12dac3e2]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:17 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:00:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:17 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e19697-dbf8-4541-816a-09b7ef8795fd]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:17 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 08:00:17 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:00:17 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 08:00:17 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:00:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1 -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:17 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a5180e-b1de-4eaa-bd7d-3b4178b62444]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:17 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1, portal: 172.16.0.220,3260]
Nov 22 08:00:17 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1, portal: 172.16.0.220,3260] successful.
Nov 22 08:00:17 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:00:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:17 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1151e2ba-f616-4778-bda3-de07917c421c]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:17 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:00:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:17 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[458e03d1-db7a-485b-b8b2-19069d11e2f1]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:17 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 08:00:17 user nova-compute[74348]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1 (non-flash)
Nov 22 08:00:17 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:00:17 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 08:00:17 user nova-compute[74348]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1 (non-flash)
Nov 22 08:00:17 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:00:17 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:00:17 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 08:00:17 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 08:00:17 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 08:00:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:17 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[802588ff-a742-4e17-ada2-975d759c605b]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:17 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:00:17 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sPQfhIiS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 08:00:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-45e44060-4261-4c84-b734-31bc1679fe14 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Acquiring lock "053355df-8b23-48fa-a0e1-9750314d72d5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:00:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-45e44060-4261-4c84-b734-31bc1679fe14 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Lock "053355df-8b23-48fa-a0e1-9750314d72d5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:00:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-45e44060-4261-4c84-b734-31bc1679fe14 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Acquiring lock "053355df-8b23-48fa-a0e1-9750314d72d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:00:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-45e44060-4261-4c84-b734-31bc1679fe14 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Lock "053355df-8b23-48fa-a0e1-9750314d72d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:00:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-45e44060-4261-4c84-b734-31bc1679fe14 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Lock "053355df-8b23-48fa-a0e1-9750314d72d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:00:17 user nova-compute[74348]: INFO nova.compute.manager [None req-45e44060-4261-4c84-b734-31bc1679fe14 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Terminating instance
Nov 22 08:00:17 user nova-compute[74348]: DEBUG nova.compute.manager [None req-45e44060-4261-4c84-b734-31bc1679fe14 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 08:00:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:18 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:00:18 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '26533343062643461', 'path': '/dev/sdb'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:00:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533343062643461', 'path': '/dev/sdb'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 08:00:18 user nova-compute[74348]: DEBUG nova.objects.instance [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Lazy-loading 'flavor' on Instance uuid 84fd55a1-d62e-4191-923e-b5bf7cb47490 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:00:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 08:00:18 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:00:18 user nova-compute[74348]:   <source dev="/dev/sdb"/>
Nov 22 08:00:18 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:00:18 user nova-compute[74348]:   <serial>1635ad62-17bf-4a7a-a485-609ebc1b39f1</serial>
Nov 22 08:00:18 user nova-compute[74348]: </disk>
Nov 22 08:00:18 user nova-compute[74348]:  {{(pid=74348) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 08:00:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:18 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Instance destroyed successfully.
Nov 22 08:00:18 user nova-compute[74348]: DEBUG nova.objects.instance [None req-45e44060-4261-4c84-b734-31bc1679fe14 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Lazy-loading 'resources' on Instance uuid 053355df-8b23-48fa-a0e1-9750314d72d5 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:00:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-45e44060-4261-4c84-b734-31bc1679fe14 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:58:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-111861990',display_name='tempest-VolumesNegativeTest-instance-111861990',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-111861990',id=18,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:58:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7f1c8d1a7445415a94870492c19da491',ramdisk_id='',reservation_id='r-kbseapqb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-2144577195',owner_user_name='tempest-VolumesNegativeTest-2144577195-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T07:58:36Z,user_data=None,user_id='9fea00e1160641538d279d94d11e1861',uuid=053355df-8b23-48fa-a0e1-9750314d72d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85ddecaf-c55f-42ec-8138-ce602da0b898", "address": "fa:16:3e:d2:3b:90", "network": {"id": "31e6da15-f021-49a0-8962-09b5c0d46129", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "648389b0c2f64438bdce146d4d816370", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ddecaf-c5", "ovs_interfaceid": "85ddecaf-c55f-42ec-8138-ce602da0b898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:00:18 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-45e44060-4261-4c84-b734-31bc1679fe14 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Converting VIF {"id": "85ddecaf-c55f-42ec-8138-ce602da0b898", "address": "fa:16:3e:d2:3b:90", "network": {"id": "31e6da15-f021-49a0-8962-09b5c0d46129", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "648389b0c2f64438bdce146d4d816370", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ddecaf-c5", "ovs_interfaceid": "85ddecaf-c55f-42ec-8138-ce602da0b898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:00:18 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-45e44060-4261-4c84-b734-31bc1679fe14 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:3b:90,bridge_name='br-int',has_traffic_filtering=True,id=85ddecaf-c55f-42ec-8138-ce602da0b898,network=Network(31e6da15-f021-49a0-8962-09b5c0d46129),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ddecaf-c5') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:00:18 user nova-compute[74348]: DEBUG os_vif [None req-45e44060-4261-4c84-b734-31bc1679fe14 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:3b:90,bridge_name='br-int',has_traffic_filtering=True,id=85ddecaf-c55f-42ec-8138-ce602da0b898,network=Network(31e6da15-f021-49a0-8962-09b5c0d46129),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ddecaf-c5') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:00:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85ddecaf-c5, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:00:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:00:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d4d884a5-4ad3-4b0e-af35-adcf463d3f36) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:00:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:00:18 user nova-compute[74348]: INFO os_vif [None req-45e44060-4261-4c84-b734-31bc1679fe14 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:3b:90,bridge_name='br-int',has_traffic_filtering=True,id=85ddecaf-c55f-42ec-8138-ce602da0b898,network=Network(31e6da15-f021-49a0-8962-09b5c0d46129),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ddecaf-c5')
Nov 22 08:00:18 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-45e44060-4261-4c84-b734-31bc1679fe14 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Deleting instance files /opt/stack/data/nova/instances/053355df-8b23-48fa-a0e1-9750314d72d5_del
Nov 22 08:00:18 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-45e44060-4261-4c84-b734-31bc1679fe14 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Deletion of /opt/stack/data/nova/instances/053355df-8b23-48fa-a0e1-9750314d72d5_del complete
Nov 22 08:00:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:00:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:00:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] No VIF found with MAC fa:16:3e:5b:e5:05, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:00:19 user nova-compute[74348]: INFO nova.compute.manager [None req-45e44060-4261-4c84-b734-31bc1679fe14 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Took 1.29 seconds to destroy the instance on the hypervisor.
Nov 22 08:00:19 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-45e44060-4261-4c84-b734-31bc1679fe14 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 08:00:19 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 08:00:19 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 08:00:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b2da4297-5da7-476b-8ea1-ee4335dc0096 tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Lock "84fd55a1-d62e-4191-923e-b5bf7cb47490" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.469s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:00:19 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:00:19 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Took 0.55 seconds to deallocate network for instance.
Nov 22 08:00:19 user nova-compute[74348]: DEBUG nova.compute.manager [req-be73f058-5364-468c-94cc-dd70436cee7f req-e9c564ac-3853-4bcc-91be-91add3f5852a service nova] [instance: 053355df-8b23-48fa-a0e1-9750314d72d5] Received event network-vif-deleted-85ddecaf-c55f-42ec-8138-ce602da0b898 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:00:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-45e44060-4261-4c84-b734-31bc1679fe14 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:00:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-45e44060-4261-4c84-b734-31bc1679fe14 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:00:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Acquiring lock "84fd55a1-d62e-4191-923e-b5bf7cb47490" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:00:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Lock "84fd55a1-d62e-4191-923e-b5bf7cb47490" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:00:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Acquiring lock "84fd55a1-d62e-4191-923e-b5bf7cb47490-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:00:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Lock "84fd55a1-d62e-4191-923e-b5bf7cb47490-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:00:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Lock "84fd55a1-d62e-4191-923e-b5bf7cb47490-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:00:19 user nova-compute[74348]: INFO nova.compute.manager [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Terminating instance
Nov 22 08:00:19 user nova-compute[74348]: DEBUG nova.compute.manager [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 08:00:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:20 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-45e44060-4261-4c84-b734-31bc1679fe14 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:00:20 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-45e44060-4261-4c84-b734-31bc1679fe14 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:00:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-45e44060-4261-4c84-b734-31bc1679fe14 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.596s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:00:20 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-45e44060-4261-4c84-b734-31bc1679fe14 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Deleted allocations for instance 053355df-8b23-48fa-a0e1-9750314d72d5
Nov 22 08:00:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-45e44060-4261-4c84-b734-31bc1679fe14 tempest-VolumesNegativeTest-2144577195 tempest-VolumesNegativeTest-2144577195-project-member] Lock "053355df-8b23-48fa-a0e1-9750314d72d5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.669s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:00:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:20 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Instance destroyed successfully.
Nov 22 08:00:20 user nova-compute[74348]: DEBUG nova.objects.instance [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Lazy-loading 'resources' on Instance uuid 84fd55a1-d62e-4191-923e-b5bf7cb47490 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:00:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:58:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1710593216',display_name='tempest-DeleteServersTestJSON-server-1710593216',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1710593216',id=17,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:58:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a98fce8c0dad44e4a3eed3886fa5defc',ramdisk_id='',reservation_id='r-fihgnmmm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1803229756',owner_user_name='tempest-DeleteServersTestJSON-1803229756-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T07:58:25Z,user_data=None,user_id='f6622dc18fbf43928613859e101d3ca9',uuid=84fd55a1-d62e-4191-923e-b5bf7cb47490,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a74a748c-17ee-4a29-b4da-175f7e2dec75", "address": "fa:16:3e:5b:e5:05", "network": {"id": "9687a505-bb8c-4081-a331-cfd06e876714", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1471469940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a98fce8c0dad44e4a3eed3886fa5defc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74a748c-17", "ovs_interfaceid": "a74a748c-17ee-4a29-b4da-175f7e2dec75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:00:20 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Converting VIF {"id": "a74a748c-17ee-4a29-b4da-175f7e2dec75", "address": "fa:16:3e:5b:e5:05", "network": {"id": "9687a505-bb8c-4081-a331-cfd06e876714", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1471469940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a98fce8c0dad44e4a3eed3886fa5defc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74a748c-17", "ovs_interfaceid": "a74a748c-17ee-4a29-b4da-175f7e2dec75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:00:20 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:e5:05,bridge_name='br-int',has_traffic_filtering=True,id=a74a748c-17ee-4a29-b4da-175f7e2dec75,network=Network(9687a505-bb8c-4081-a331-cfd06e876714),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa74a748c-17') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:00:20 user nova-compute[74348]: DEBUG os_vif [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:e5:05,bridge_name='br-int',has_traffic_filtering=True,id=a74a748c-17ee-4a29-b4da-175f7e2dec75,network=Network(9687a505-bb8c-4081-a331-cfd06e876714),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa74a748c-17') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:00:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa74a748c-17, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f414d97e-dddc-4678-81fa-45bcb818addf) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:00:21 user nova-compute[74348]: INFO os_vif [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:e5:05,bridge_name='br-int',has_traffic_filtering=True,id=a74a748c-17ee-4a29-b4da-175f7e2dec75,network=Network(9687a505-bb8c-4081-a331-cfd06e876714),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa74a748c-17')
Nov 22 08:00:21 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sPQfhIiS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:00:21 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:00:21 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4323f3fa-3097-4c3a-855f-45fa065fb376]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 08:00:21 user nova-compute[74348]: No targets found.
Nov 22 08:00:21 user nova-compute[74348]: iSNS:
Nov 22 08:00:21 user nova-compute[74348]: No targets found.
Nov 22 08:00:21 user nova-compute[74348]: STATIC:
Nov 22 08:00:21 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1
Nov 22 08:00:21 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:00:21 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:00:21 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730
Nov 22 08:00:21 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:00:21 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:00:21 user nova-compute[74348]: FIRMWARE:
Nov 22 08:00:21 user nova-compute[74348]: No targets found.
Nov 22 08:00:21 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 08:00:21 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 08:00:21 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb15fe6-6f72-4fcd-927f-5d73d509d5b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f2b7f3-bda5-4821-a072-41bf3823cfbf]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 08:00:21 user nova-compute[74348]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1 (non-flash)
Nov 22 08:00:21 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 08:00:21 user nova-compute[74348]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1 (non-flash)
Nov 22 08:00:21 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f224c2409d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1'): ({'sdb'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Removing single pathed devices sdb {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[87721964-202c-4a4b-b0a8-36a940b31378]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96824ed-27ef-47f4-af2e-cd03ba10d798]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Flushing IO for device /dev/sdb {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0e04ac-37d3-4a07-96be-69a66162b3b4]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[55cf6e4c-d206-4b12-b3f3-1e0acefc2852]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] SCSI volumes sdb have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[db44ea80-c12d-4de1-95dc-9195ee0586a9]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1 -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d76cfb0-76a1-44f1-9f14-3e0ef0253726]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1, portal: 172.16.0.220,3260]
Nov 22 08:00:21 user nova-compute[74348]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1, portal: 172.16.0.220,3260] successful.
Nov 22 08:00:21 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1 -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1635ad62-17bf-4a7a-a485-609ebc1b39f1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3f476b-76d9-4462-b569-4cf676a26ba5]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] <== disconnect_volume: return (334ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 08:00:21 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Deleting instance files /opt/stack/data/nova/instances/84fd55a1-d62e-4191-923e-b5bf7cb47490_del
Nov 22 08:00:21 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Deletion of /opt/stack/data/nova/instances/84fd55a1-d62e-4191-923e-b5bf7cb47490_del complete
Nov 22 08:00:21 user nova-compute[74348]: INFO nova.compute.manager [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Took 1.79 seconds to destroy the instance on the hypervisor.
Nov 22 08:00:21 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG nova.compute.manager [req-a703bc43-c553-4270-84b1-6f6d0b5841c3 req-70c3b702-3be5-4971-9502-10ab2531ffa4 service nova] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Received event network-vif-unplugged-a74a748c-17ee-4a29-b4da-175f7e2dec75 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a703bc43-c553-4270-84b1-6f6d0b5841c3 req-70c3b702-3be5-4971-9502-10ab2531ffa4 service nova] Acquiring lock "84fd55a1-d62e-4191-923e-b5bf7cb47490-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a703bc43-c553-4270-84b1-6f6d0b5841c3 req-70c3b702-3be5-4971-9502-10ab2531ffa4 service nova] Lock "84fd55a1-d62e-4191-923e-b5bf7cb47490-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a703bc43-c553-4270-84b1-6f6d0b5841c3 req-70c3b702-3be5-4971-9502-10ab2531ffa4 service nova] Lock "84fd55a1-d62e-4191-923e-b5bf7cb47490-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG nova.compute.manager [req-a703bc43-c553-4270-84b1-6f6d0b5841c3 req-70c3b702-3be5-4971-9502-10ab2531ffa4 service nova] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] No waiting events found dispatching network-vif-unplugged-a74a748c-17ee-4a29-b4da-175f7e2dec75 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG nova.compute.manager [req-a703bc43-c553-4270-84b1-6f6d0b5841c3 req-70c3b702-3be5-4971-9502-10ab2531ffa4 service nova] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Received event network-vif-unplugged-a74a748c-17ee-4a29-b4da-175f7e2dec75 for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG nova.compute.manager [req-a703bc43-c553-4270-84b1-6f6d0b5841c3 req-70c3b702-3be5-4971-9502-10ab2531ffa4 service nova] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Received event network-vif-plugged-a74a748c-17ee-4a29-b4da-175f7e2dec75 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a703bc43-c553-4270-84b1-6f6d0b5841c3 req-70c3b702-3be5-4971-9502-10ab2531ffa4 service nova] Acquiring lock "84fd55a1-d62e-4191-923e-b5bf7cb47490-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a703bc43-c553-4270-84b1-6f6d0b5841c3 req-70c3b702-3be5-4971-9502-10ab2531ffa4 service nova] Lock "84fd55a1-d62e-4191-923e-b5bf7cb47490-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a703bc43-c553-4270-84b1-6f6d0b5841c3 req-70c3b702-3be5-4971-9502-10ab2531ffa4 service nova] Lock "84fd55a1-d62e-4191-923e-b5bf7cb47490-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:00:21 user nova-compute[74348]: DEBUG nova.compute.manager [req-a703bc43-c553-4270-84b1-6f6d0b5841c3 req-70c3b702-3be5-4971-9502-10ab2531ffa4 service nova] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] No waiting events found dispatching network-vif-plugged-a74a748c-17ee-4a29-b4da-175f7e2dec75 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:00:21 user nova-compute[74348]: WARNING nova.compute.manager [req-a703bc43-c553-4270-84b1-6f6d0b5841c3 req-70c3b702-3be5-4971-9502-10ab2531ffa4 service nova] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Received unexpected event network-vif-plugged-a74a748c-17ee-4a29-b4da-175f7e2dec75 for instance with vm_state active and task_state deleting.
Nov 22 08:00:22 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:00:22 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Took 0.54 seconds to deallocate network for instance.
Nov 22 08:00:22 user nova-compute[74348]: INFO nova.compute.manager [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Took 0.80 seconds to detach 1 volumes for instance.
Nov 22 08:00:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:00:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:00:23 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:00:23 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:00:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.310s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:00:23 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Deleted allocations for instance 84fd55a1-d62e-4191-923e-b5bf7cb47490
Nov 22 08:00:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9c9f9136-22ef-4419-b412-5d7641f986cb tempest-DeleteServersTestJSON-1803229756 tempest-DeleteServersTestJSON-1803229756-project-member] Lock "84fd55a1-d62e-4191-923e-b5bf7cb47490" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.669s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:00:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:23 user nova-compute[74348]: DEBUG nova.compute.manager [req-e4b777ef-a6fc-4c88-85e1-651f5527a24d req-5652aa98-52b2-4fba-a87a-6f95f8466d98 service nova] [instance: 84fd55a1-d62e-4191-923e-b5bf7cb47490] Received event network-vif-deleted-a74a748c-17ee-4a29-b4da-175f7e2dec75 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:00:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Acquiring lock "74cb3261-4f66-4d23-9e88-3c7bd53cfb01" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:00:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Lock "74cb3261-4f66-4d23-9e88-3c7bd53cfb01" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:00:25 user nova-compute[74348]: DEBUG nova.compute.manager [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 08:00:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:00:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:00:25 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 08:00:25 user nova-compute[74348]: INFO nova.compute.claims [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Claim successful on node user
Nov 22 08:00:25 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:00:25 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:00:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.414s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:00:25 user nova-compute[74348]: DEBUG nova.compute.manager [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 08:00:25 user nova-compute[74348]: DEBUG nova.compute.manager [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 08:00:25 user nova-compute[74348]: DEBUG nova.network.neutron [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 08:00:25 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 08:00:25 user nova-compute[74348]: DEBUG nova.policy [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '03aac0b5680c431592326486b1d030b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ac02b435a54124b9b8cfc3afeb9e57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 08:00:25 user nova-compute[74348]: DEBUG nova.compute.manager [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 08:00:25 user nova-compute[74348]: DEBUG nova.compute.manager [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 08:00:25 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 08:00:25 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Creating image(s)
Nov 22 08:00:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Acquiring lock "/opt/stack/data/nova/instances/74cb3261-4f66-4d23-9e88-3c7bd53cfb01/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:00:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Lock "/opt/stack/data/nova/instances/74cb3261-4f66-4d23-9e88-3c7bd53cfb01/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:00:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Lock "/opt/stack/data/nova/instances/74cb3261-4f66-4d23-9e88-3c7bd53cfb01/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:00:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:26 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.212s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Acquiring lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:00:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:00:26 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:26 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:26 user nova-compute[74348]: DEBUG nova.network.neutron [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Successfully created port: a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 08:00:26 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.217s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:26 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/74cb3261-4f66-4d23-9e88-3c7bd53cfb01/disk 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:26 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/74cb3261-4f66-4d23-9e88-3c7bd53cfb01/disk 1073741824" returned: 0 in 0.047s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:00:26 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:26 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.169s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:26 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Checking if we can resize image /opt/stack/data/nova/instances/74cb3261-4f66-4d23-9e88-3c7bd53cfb01/disk. size=1073741824 {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 08:00:26 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74cb3261-4f66-4d23-9e88-3c7bd53cfb01/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:26 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74cb3261-4f66-4d23-9e88-3c7bd53cfb01/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:26 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Cannot resize image /opt/stack/data/nova/instances/74cb3261-4f66-4d23-9e88-3c7bd53cfb01/disk to a smaller size. {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 08:00:26 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 08:00:26 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Ensure instance console log exists: /opt/stack/data/nova/instances/74cb3261-4f66-4d23-9e88-3c7bd53cfb01/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 08:00:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:00:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:00:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:00:26 user nova-compute[74348]: DEBUG nova.network.neutron [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Successfully updated port: a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 08:00:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Acquiring lock "refresh_cache-74cb3261-4f66-4d23-9e88-3c7bd53cfb01" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:00:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Acquired lock "refresh_cache-74cb3261-4f66-4d23-9e88-3c7bd53cfb01" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:00:26 user nova-compute[74348]: DEBUG nova.network.neutron [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:00:26 user nova-compute[74348]: DEBUG nova.compute.manager [req-b0a6fe38-5fc0-40f2-82be-19dd26435e29 req-5af33e2e-8a32-4d67-9fe2-d76f2edf37b7 service nova] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Received event network-changed-a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:00:26 user nova-compute[74348]: DEBUG nova.compute.manager [req-b0a6fe38-5fc0-40f2-82be-19dd26435e29 req-5af33e2e-8a32-4d67-9fe2-d76f2edf37b7 service nova] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Refreshing instance network info cache due to event network-changed-a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:00:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b0a6fe38-5fc0-40f2-82be-19dd26435e29 req-5af33e2e-8a32-4d67-9fe2-d76f2edf37b7 service nova] Acquiring lock "refresh_cache-74cb3261-4f66-4d23-9e88-3c7bd53cfb01" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG nova.network.neutron [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG nova.network.neutron [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Updating instance_info_cache with network_info: [{"id": "a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d", "address": "fa:16:3e:74:b9:e6", "network": {"id": "58371390-13da-4593-a6f1-32b2c60f5e7d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2101379319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ac02b435a54124b9b8cfc3afeb9e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6dc4fff-0d", "ovs_interfaceid": "a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Releasing lock "refresh_cache-74cb3261-4f66-4d23-9e88-3c7bd53cfb01" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG nova.compute.manager [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Instance network_info: |[{"id": "a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d", "address": "fa:16:3e:74:b9:e6", "network": {"id": "58371390-13da-4593-a6f1-32b2c60f5e7d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2101379319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ac02b435a54124b9b8cfc3afeb9e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6dc4fff-0d", "ovs_interfaceid": "a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b0a6fe38-5fc0-40f2-82be-19dd26435e29 req-5af33e2e-8a32-4d67-9fe2-d76f2edf37b7 service nova] Acquired lock "refresh_cache-74cb3261-4f66-4d23-9e88-3c7bd53cfb01" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG nova.network.neutron [req-b0a6fe38-5fc0-40f2-82be-19dd26435e29 req-5af33e2e-8a32-4d67-9fe2-d76f2edf37b7 service nova] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Refreshing network info cache for port a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Start _get_guest_xml network_info=[{"id": "a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d", "address": "fa:16:3e:74:b9:e6", "network": {"id": "58371390-13da-4593-a6f1-32b2c60f5e7d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2101379319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ac02b435a54124b9b8cfc3afeb9e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6dc4fff-0d", "ovs_interfaceid": "a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 08:00:27 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:00:27 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:00:27 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:00:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1458749919',display_name='tempest-VolumesActionsTest-instance-1458749919',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1458749919',id=23,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9ac02b435a54124b9b8cfc3afeb9e57',ramdisk_id='',reservation_id='r-f3zqe1ht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1791306803',owner_user_name='tempest-VolumesActionsTest-1791306803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:00:26Z,user_data=None,user_id='03aac0b5680c431592326486b1d030b9',uuid=74cb3261-4f66-4d23-9e88-3c7bd53cfb01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d", "address": "fa:16:3e:74:b9:e6", "network": {"id": "58371390-13da-4593-a6f1-32b2c60f5e7d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2101379319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ac02b435a54124b9b8cfc3afeb9e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6dc4fff-0d", "ovs_interfaceid": "a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Converting VIF {"id": "a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d", "address": "fa:16:3e:74:b9:e6", "network": {"id": "58371390-13da-4593-a6f1-32b2c60f5e7d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2101379319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ac02b435a54124b9b8cfc3afeb9e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6dc4fff-0d", "ovs_interfaceid": "a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:b9:e6,bridge_name='br-int',has_traffic_filtering=True,id=a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d,network=Network(58371390-13da-4593-a6f1-32b2c60f5e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6dc4fff-0d') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG nova.objects.instance [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Lazy-loading 'pci_devices' on Instance uuid 74cb3261-4f66-4d23-9e88-3c7bd53cfb01 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] End _get_guest_xml xml=<domain type="kvm">
Nov 22 08:00:27 user nova-compute[74348]:   <uuid>74cb3261-4f66-4d23-9e88-3c7bd53cfb01</uuid>
Nov 22 08:00:27 user nova-compute[74348]:   <name>instance-00000017</name>
Nov 22 08:00:27 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 08:00:27 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 08:00:27 user nova-compute[74348]:   <metadata>
Nov 22 08:00:27 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 08:00:27 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 08:00:27 user nova-compute[74348]:       <nova:name>tempest-VolumesActionsTest-instance-1458749919</nova:name>
Nov 22 08:00:27 user nova-compute[74348]:       <nova:creationTime>2023-11-22 08:00:27</nova:creationTime>
Nov 22 08:00:27 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 08:00:27 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 08:00:27 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 08:00:27 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 08:00:27 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 08:00:27 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 08:00:27 user nova-compute[74348]:       </nova:flavor>
Nov 22 08:00:27 user nova-compute[74348]:       <nova:owner>
Nov 22 08:00:27 user nova-compute[74348]:         <nova:user uuid="03aac0b5680c431592326486b1d030b9">tempest-VolumesActionsTest-1791306803-project-member</nova:user>
Nov 22 08:00:27 user nova-compute[74348]:         <nova:project uuid="d9ac02b435a54124b9b8cfc3afeb9e57">tempest-VolumesActionsTest-1791306803</nova:project>
Nov 22 08:00:27 user nova-compute[74348]:       </nova:owner>
Nov 22 08:00:27 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 08:00:27 user nova-compute[74348]:       <nova:ports>
Nov 22 08:00:27 user nova-compute[74348]:         <nova:port uuid="a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d">
Nov 22 08:00:27 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 22 08:00:27 user nova-compute[74348]:         </nova:port>
Nov 22 08:00:27 user nova-compute[74348]:       </nova:ports>
Nov 22 08:00:27 user nova-compute[74348]:     </nova:instance>
Nov 22 08:00:27 user nova-compute[74348]:   </metadata>
Nov 22 08:00:27 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 08:00:27 user nova-compute[74348]:     <system>
Nov 22 08:00:27 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 08:00:27 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 08:00:27 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 08:00:27 user nova-compute[74348]:       <entry name="serial">74cb3261-4f66-4d23-9e88-3c7bd53cfb01</entry>
Nov 22 08:00:27 user nova-compute[74348]:       <entry name="uuid">74cb3261-4f66-4d23-9e88-3c7bd53cfb01</entry>
Nov 22 08:00:27 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 08:00:27 user nova-compute[74348]:     </system>
Nov 22 08:00:27 user nova-compute[74348]:   </sysinfo>
Nov 22 08:00:27 user nova-compute[74348]:   <os>
Nov 22 08:00:27 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 08:00:27 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 08:00:27 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 08:00:27 user nova-compute[74348]:   </os>
Nov 22 08:00:27 user nova-compute[74348]:   <features>
Nov 22 08:00:27 user nova-compute[74348]:     <acpi/>
Nov 22 08:00:27 user nova-compute[74348]:     <apic/>
Nov 22 08:00:27 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 08:00:27 user nova-compute[74348]:   </features>
Nov 22 08:00:27 user nova-compute[74348]:   <clock offset="utc">
Nov 22 08:00:27 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 08:00:27 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 08:00:27 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 08:00:27 user nova-compute[74348]:   </clock>
Nov 22 08:00:27 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 08:00:27 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 08:00:27 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 08:00:27 user nova-compute[74348]:   </cpu>
Nov 22 08:00:27 user nova-compute[74348]:   <devices>
Nov 22 08:00:27 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 08:00:27 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 08:00:27 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/74cb3261-4f66-4d23-9e88-3c7bd53cfb01/disk"/>
Nov 22 08:00:27 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 08:00:27 user nova-compute[74348]:     </disk>
Nov 22 08:00:27 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 08:00:27 user nova-compute[74348]:       <mac address="fa:16:3e:74:b9:e6"/>
Nov 22 08:00:27 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:00:27 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 08:00:27 user nova-compute[74348]:       <target dev="tapa6dc4fff-0d"/>
Nov 22 08:00:27 user nova-compute[74348]:     </interface>
Nov 22 08:00:27 user nova-compute[74348]:     <serial type="pty">
Nov 22 08:00:27 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/74cb3261-4f66-4d23-9e88-3c7bd53cfb01/console.log" append="off"/>
Nov 22 08:00:27 user nova-compute[74348]:     </serial>
Nov 22 08:00:27 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 08:00:27 user nova-compute[74348]:     <video>
Nov 22 08:00:27 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:00:27 user nova-compute[74348]:     </video>
Nov 22 08:00:27 user nova-compute[74348]:     <rng model="virtio">
Nov 22 08:00:27 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 08:00:27 user nova-compute[74348]:     </rng>
Nov 22 08:00:27 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 08:00:27 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 08:00:27 user nova-compute[74348]:       <stats period="10"/>
Nov 22 08:00:27 user nova-compute[74348]:     </memballoon>
Nov 22 08:00:27 user nova-compute[74348]:   </devices>
Nov 22 08:00:27 user nova-compute[74348]: </domain>
Nov 22 08:00:27 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:00:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1458749919',display_name='tempest-VolumesActionsTest-instance-1458749919',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1458749919',id=23,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9ac02b435a54124b9b8cfc3afeb9e57',ramdisk_id='',reservation_id='r-f3zqe1ht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1791306803',owner_user_name='tempest-VolumesActionsTest-1791306803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:00:26Z,user_data=None,user_id='03aac0b5680c431592326486b1d030b9',uuid=74cb3261-4f66-4d23-9e88-3c7bd53cfb01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d", "address": "fa:16:3e:74:b9:e6", "network": {"id": "58371390-13da-4593-a6f1-32b2c60f5e7d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2101379319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ac02b435a54124b9b8cfc3afeb9e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6dc4fff-0d", "ovs_interfaceid": "a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Converting VIF {"id": "a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d", "address": "fa:16:3e:74:b9:e6", "network": {"id": "58371390-13da-4593-a6f1-32b2c60f5e7d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2101379319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ac02b435a54124b9b8cfc3afeb9e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6dc4fff-0d", "ovs_interfaceid": "a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:b9:e6,bridge_name='br-int',has_traffic_filtering=True,id=a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d,network=Network(58371390-13da-4593-a6f1-32b2c60f5e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6dc4fff-0d') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG os_vif [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:b9:e6,bridge_name='br-int',has_traffic_filtering=True,id=a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d,network=Network(58371390-13da-4593-a6f1-32b2c60f5e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6dc4fff-0d') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6fc093dd-88a5-58d2-9189-66a300114ef4', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6dc4fff-0d, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa6dc4fff-0d, col_values=(('qos', UUID('14f2d455-c141-464b-ad46-4da16152c296')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa6dc4fff-0d, col_values=(('external_ids', {'iface-id': 'a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:b9:e6', 'vm-uuid': '74cb3261-4f66-4d23-9e88-3c7bd53cfb01'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:27 user nova-compute[74348]: INFO os_vif [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:b9:e6,bridge_name='br-int',has_traffic_filtering=True,id=a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d,network=Network(58371390-13da-4593-a6f1-32b2c60f5e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6dc4fff-0d')
Nov 22 08:00:27 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] No VIF found with MAC fa:16:3e:74:b9:e6, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG nova.network.neutron [req-b0a6fe38-5fc0-40f2-82be-19dd26435e29 req-5af33e2e-8a32-4d67-9fe2-d76f2edf37b7 service nova] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Updated VIF entry in instance network info cache for port a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG nova.network.neutron [req-b0a6fe38-5fc0-40f2-82be-19dd26435e29 req-5af33e2e-8a32-4d67-9fe2-d76f2edf37b7 service nova] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Updating instance_info_cache with network_info: [{"id": "a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d", "address": "fa:16:3e:74:b9:e6", "network": {"id": "58371390-13da-4593-a6f1-32b2c60f5e7d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2101379319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ac02b435a54124b9b8cfc3afeb9e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6dc4fff-0d", "ovs_interfaceid": "a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:00:27 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b0a6fe38-5fc0-40f2-82be-19dd26435e29 req-5af33e2e-8a32-4d67-9fe2-d76f2edf37b7 service nova] Releasing lock "refresh_cache-74cb3261-4f66-4d23-9e88-3c7bd53cfb01" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:00:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:28 user nova-compute[74348]: DEBUG nova.compute.manager [req-cc88847d-6696-44e1-91c5-589d32189e69 req-19ba0e8f-758c-4855-bab6-9b4b6c4fe12c service nova] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Received event network-vif-plugged-a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:00:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-cc88847d-6696-44e1-91c5-589d32189e69 req-19ba0e8f-758c-4855-bab6-9b4b6c4fe12c service nova] Acquiring lock "74cb3261-4f66-4d23-9e88-3c7bd53cfb01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:00:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-cc88847d-6696-44e1-91c5-589d32189e69 req-19ba0e8f-758c-4855-bab6-9b4b6c4fe12c service nova] Lock "74cb3261-4f66-4d23-9e88-3c7bd53cfb01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:00:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-cc88847d-6696-44e1-91c5-589d32189e69 req-19ba0e8f-758c-4855-bab6-9b4b6c4fe12c service nova] Lock "74cb3261-4f66-4d23-9e88-3c7bd53cfb01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:00:28 user nova-compute[74348]: DEBUG nova.compute.manager [req-cc88847d-6696-44e1-91c5-589d32189e69 req-19ba0e8f-758c-4855-bab6-9b4b6c4fe12c service nova] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] No waiting events found dispatching network-vif-plugged-a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:00:28 user nova-compute[74348]: WARNING nova.compute.manager [req-cc88847d-6696-44e1-91c5-589d32189e69 req-19ba0e8f-758c-4855-bab6-9b4b6c4fe12c service nova] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Received unexpected event network-vif-plugged-a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d for instance with vm_state building and task_state spawning.
Nov 22 08:00:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:31 user nova-compute[74348]: DEBUG nova.compute.manager [req-729cdd37-97f3-4763-8fad-fdbc46d5efdb req-161c30be-ceec-4ff3-a83d-64527e28278f service nova] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Received event network-vif-plugged-a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:00:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-729cdd37-97f3-4763-8fad-fdbc46d5efdb req-161c30be-ceec-4ff3-a83d-64527e28278f service nova] Acquiring lock "74cb3261-4f66-4d23-9e88-3c7bd53cfb01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:00:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-729cdd37-97f3-4763-8fad-fdbc46d5efdb req-161c30be-ceec-4ff3-a83d-64527e28278f service nova] Lock "74cb3261-4f66-4d23-9e88-3c7bd53cfb01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:00:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-729cdd37-97f3-4763-8fad-fdbc46d5efdb req-161c30be-ceec-4ff3-a83d-64527e28278f service nova] Lock "74cb3261-4f66-4d23-9e88-3c7bd53cfb01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:00:31 user nova-compute[74348]: DEBUG nova.compute.manager [req-729cdd37-97f3-4763-8fad-fdbc46d5efdb req-161c30be-ceec-4ff3-a83d-64527e28278f service nova] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] No waiting events found dispatching network-vif-plugged-a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:00:31 user nova-compute[74348]: WARNING nova.compute.manager [req-729cdd37-97f3-4763-8fad-fdbc46d5efdb req-161c30be-ceec-4ff3-a83d-64527e28278f service nova] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Received unexpected event network-vif-plugged-a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d for instance with vm_state building and task_state spawning.
Nov 22 08:00:31 user nova-compute[74348]: DEBUG nova.compute.manager [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 08:00:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 08:00:31 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Instance spawned successfully.
Nov 22 08:00:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 08:00:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:00:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:00:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:00:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:00:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:00:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:00:31 user nova-compute[74348]: INFO nova.compute.manager [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Took 5.31 seconds to spawn the instance on the hypervisor.
Nov 22 08:00:31 user nova-compute[74348]: DEBUG nova.compute.manager [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:00:31 user nova-compute[74348]: INFO nova.compute.manager [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Took 6.17 seconds to build instance.
Nov 22 08:00:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2bfb3300-033f-45be-ba06-508d9300faba tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Lock "74cb3261-4f66-4d23-9e88-3c7bd53cfb01" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.286s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:00:31 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:00:31 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:00:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-e36789b1-45e6-40f7-ba97-8962cb116a39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:00:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-e36789b1-45e6-40f7-ba97-8962cb116a39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:00:31 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 08:00:32 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Updating instance_info_cache with network_info: [{"id": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "address": "fa:16:3e:a7:50:2a", "network": {"id": "8a783b63-dae2-41eb-a00a-5cf8e94a5412", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872095489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beaa9566ba2842d49f843dbddc59854d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap618bd526-89", "ovs_interfaceid": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:00:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-e36789b1-45e6-40f7-ba97-8962cb116a39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:00:32 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 08:00:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:00:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:00:33 user nova-compute[74348]: DEBUG nova.compute.manager [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 08:00:33 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:00:33 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:00:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:00:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:00:33 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 08:00:33 user nova-compute[74348]: INFO nova.compute.claims [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Claim successful on node user
Nov 22 08:00:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:34 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:00:34 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:00:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.586s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:00:34 user nova-compute[74348]: DEBUG nova.compute.manager [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 08:00:34 user nova-compute[74348]: DEBUG nova.compute.manager [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 08:00:34 user nova-compute[74348]: DEBUG nova.network.neutron [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 08:00:34 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 08:00:34 user nova-compute[74348]: DEBUG nova.compute.manager [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 08:00:34 user nova-compute[74348]: INFO nova.virt.block_device [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Booting with blank volume at /dev/vda
Nov 22 08:00:34 user nova-compute[74348]: DEBUG nova.policy [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1d5c8274eca14965b6cbfe22110f904d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31d898cdc69494a8825e8d93a0d04bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 08:00:34 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:00:34 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:00:34 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:00:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:00:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:00:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:00:34 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:00:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c36455f-5fd6-4813-9c44-499e3742ed39/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:35 user nova-compute[74348]: DEBUG nova.network.neutron [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Successfully created port: 72e5b044-9d3b-412d-9a20-408387fb6fe6 {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 08:00:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c36455f-5fd6-4813-9c44-499e3742ed39/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c36455f-5fd6-4813-9c44-499e3742ed39/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c36455f-5fd6-4813-9c44-499e3742ed39/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059bde4a-c5c9-45ab-9b4a-c969c74a6083/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059bde4a-c5c9-45ab-9b4a-c969c74a6083/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059bde4a-c5c9-45ab-9b4a-c969c74a6083/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059bde4a-c5c9-45ab-9b4a-c969c74a6083/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:36 user nova-compute[74348]: DEBUG nova.network.neutron [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Successfully updated port: 72e5b044-9d3b-412d-9a20-408387fb6fe6 {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 08:00:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74cb3261-4f66-4d23-9e88-3c7bd53cfb01/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:36 user nova-compute[74348]: DEBUG nova.compute.manager [req-192dd141-876a-4cfd-ae02-b9182479d602 req-88ff3960-3c75-4474-84a0-bc0435a6dba8 service nova] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Received event network-changed-72e5b044-9d3b-412d-9a20-408387fb6fe6 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:00:36 user nova-compute[74348]: DEBUG nova.compute.manager [req-192dd141-876a-4cfd-ae02-b9182479d602 req-88ff3960-3c75-4474-84a0-bc0435a6dba8 service nova] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Refreshing instance network info cache due to event network-changed-72e5b044-9d3b-412d-9a20-408387fb6fe6. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:00:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-192dd141-876a-4cfd-ae02-b9182479d602 req-88ff3960-3c75-4474-84a0-bc0435a6dba8 service nova] Acquiring lock "refresh_cache-b8f84c0b-fab5-4900-bf65-270c9c06baf8" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:00:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-192dd141-876a-4cfd-ae02-b9182479d602 req-88ff3960-3c75-4474-84a0-bc0435a6dba8 service nova] Acquired lock "refresh_cache-b8f84c0b-fab5-4900-bf65-270c9c06baf8" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:00:36 user nova-compute[74348]: DEBUG nova.network.neutron [req-192dd141-876a-4cfd-ae02-b9182479d602 req-88ff3960-3c75-4474-84a0-bc0435a6dba8 service nova] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Refreshing network info cache for port 72e5b044-9d3b-412d-9a20-408387fb6fe6 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:00:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "refresh_cache-b8f84c0b-fab5-4900-bf65-270c9c06baf8" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:00:36 user nova-compute[74348]: DEBUG nova.network.neutron [req-192dd141-876a-4cfd-ae02-b9182479d602 req-88ff3960-3c75-4474-84a0-bc0435a6dba8 service nova] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 08:00:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74cb3261-4f66-4d23-9e88-3c7bd53cfb01/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74cb3261-4f66-4d23-9e88-3c7bd53cfb01/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74cb3261-4f66-4d23-9e88-3c7bd53cfb01/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:36 user nova-compute[74348]: DEBUG nova.network.neutron [req-192dd141-876a-4cfd-ae02-b9182479d602 req-88ff3960-3c75-4474-84a0-bc0435a6dba8 service nova] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:00:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-192dd141-876a-4cfd-ae02-b9182479d602 req-88ff3960-3c75-4474-84a0-bc0435a6dba8 service nova] Releasing lock "refresh_cache-b8f84c0b-fab5-4900-bf65-270c9c06baf8" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:00:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquired lock "refresh_cache-b8f84c0b-fab5-4900-bf65-270c9c06baf8" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:00:36 user nova-compute[74348]: DEBUG nova.network.neutron [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:00:36 user nova-compute[74348]: DEBUG nova.network.neutron [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 08:00:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:00:36 user nova-compute[74348]: DEBUG nova.network.neutron [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Updating instance_info_cache with network_info: [{"id": "72e5b044-9d3b-412d-9a20-408387fb6fe6", "address": "fa:16:3e:5d:93:c7", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e5b044-9d", "ovs_interfaceid": "72e5b044-9d3b-412d-9a20-408387fb6fe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:00:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaecc2f-f6fe-4171-b445-55c3a2d33760/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Releasing lock "refresh_cache-b8f84c0b-fab5-4900-bf65-270c9c06baf8" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:00:36 user nova-compute[74348]: DEBUG nova.compute.manager [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Instance network_info: |[{"id": "72e5b044-9d3b-412d-9a20-408387fb6fe6", "address": "fa:16:3e:5d:93:c7", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e5b044-9d", "ovs_interfaceid": "72e5b044-9d3b-412d-9a20-408387fb6fe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 08:00:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaecc2f-f6fe-4171-b445-55c3a2d33760/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaecc2f-f6fe-4171-b445-55c3a2d33760/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaecc2f-f6fe-4171-b445-55c3a2d33760/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a635cbbc-6b87-4877-80a8-bd4001c407c6/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:37 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a635cbbc-6b87-4877-80a8-bd4001c407c6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a635cbbc-6b87-4877-80a8-bd4001c407c6/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a635cbbc-6b87-4877-80a8-bd4001c407c6/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a07ac785-23f6-4e92-9e7f-7de496dd0954/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a07ac785-23f6-4e92-9e7f-7de496dd0954/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a07ac785-23f6-4e92-9e7f-7de496dd0954/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a07ac785-23f6-4e92-9e7f-7de496dd0954/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:38 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:00:38 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:00:38 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=7570MB free_disk=25.06399154663086GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:00:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:00:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:00:38 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 059bde4a-c5c9-45ab-9b4a-c969c74a6083 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:00:38 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance e36789b1-45e6-40f7-ba97-8962cb116a39 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:00:38 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 9c36455f-5fd6-4813-9c44-499e3742ed39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:00:38 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 765f8c47-c042-4430-8d35-07926ad693fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:00:38 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance a635cbbc-6b87-4877-80a8-bd4001c407c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:00:38 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 2eaecc2f-f6fe-4171-b445-55c3a2d33760 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:00:38 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance a07ac785-23f6-4e92-9e7f-7de496dd0954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:00:38 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:00:38 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 74cb3261-4f66-4d23-9e88-3c7bd53cfb01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:00:38 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance b8f84c0b-fab5-4900-bf65-270c9c06baf8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:00:38 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:00:38 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:00:39 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:00:39 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:00:39 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:00:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.449s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:00:40 user nova-compute[74348]: DEBUG os_brick.utils [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:00:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:40 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ba6cb2-48d9-4e80-83aa-82ca24633184]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:40 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[784e2169-bcb9-4835-bc1d-c246799926ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:40 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52c5869-68f5-43b2-84bd-dd5486c4a921]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:40 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77ff670-b2de-4860-8d14-54d1100f4a22]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:00:40 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 08:00:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:00:40 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 08:00:40 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e82e08d-baec-4e57-a2fa-bb0a93d2aef1]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:40 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 08:00:40 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 08:00:40 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 08:00:40 user nova-compute[74348]: DEBUG os_brick.utils [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:00:40 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Updating existing volume attachment record: bf76742b-ee21-43e4-b7c3-fbaafe60ea45 {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 08:00:40 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:00:40 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:00:40 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:00:40 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:00:40 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:00:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG nova.compute.manager [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 08:00:46 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Creating image(s)
Nov 22 08:00:46 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Did not create local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Ensure instance console log exists: /opt/stack/data/nova/instances/b8f84c0b-fab5-4900-bf65-270c9c06baf8/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Start _get_guest_xml network_info=[{"id": "72e5b044-9d3b-412d-9a20-408387fb6fe6", "address": "fa:16:3e:5d:93:c7", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e5b044-9d", "ovs_interfaceid": "72e5b044-9d3b-412d-9a20-408387fb6fe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nVWumQGy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b8f84c0b-fab5-4900-bf65-270c9c06baf8', 'attached_at': '', 'detached_at': '', 'volume_id': '75590810-f559-484b-947e-9e6f1397e7f8', 'serial': '75590810-f559-484b-947e-9e6f1397e7f8'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'bf76742b-ee21-43e4-b7c3-fbaafe60ea45', 'volume_type': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 08:00:46 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:00:46 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:00:46 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nVWumQGy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:00:46 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:00:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:00:46 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:00:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:00:46 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 08:00:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3cf604-ecee-4af6-baf3-d0a7f60bb508]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 08:00:46 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bcd16a-c5a0-42a5-a96b-d6a4d28fb084]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8] added
Nov 22 08:00:46 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5c2c65-c5c5-4b10-8a6a-459313f87f28]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[970db3b5-2730-48ae-8e7f-7e36ca707543]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nVWumQGy {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nVWumQGy" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a95e8cc-719b-4b62-a6ef-3e3cd58414eb]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nVWumQGy'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b0e6cc-eb02-4a0e-a34e-96ab3546395f]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[568d2e57-e399-49d2-8865-6fef39f80ebd]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 08:00:46 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 08:00:46 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 -p 172.16.0.220:3260 --login" returned: 0 in 0.102s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab48bd4b-2adc-434d-ac6d-0e464ec62b35]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8, portal: 172.16.0.220,3260]
Nov 22 08:00:46 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8, portal: 172.16.0.220,3260] successful.
Nov 22 08:00:46 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a72a6c-beff-44c8-bc51-9f7bc44e0e60]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b6b9ef-eb95-42f9-9721-1f47ad008fbb]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 08:00:46 user nova-compute[74348]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:00:46 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 08:00:46 user nova-compute[74348]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:00:46 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a895443d-798e-433f-9851-ade972f77c91]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:00:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nVWumQGy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Acquiring lock "a635cbbc-6b87-4877-80a8-bd4001c407c6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "a635cbbc-6b87-4877-80a8-bd4001c407c6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG nova.objects.instance [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lazy-loading 'flavor' on Instance uuid a635cbbc-6b87-4877-80a8-bd4001c407c6 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "a635cbbc-6b87-4877-80a8-bd4001c407c6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Acquiring lock "a635cbbc-6b87-4877-80a8-bd4001c407c6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "a635cbbc-6b87-4877-80a8-bd4001c407c6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:00:47 user nova-compute[74348]: INFO nova.compute.manager [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Attaching volume 12828237-e920-4f6e-bcaf-2b0443407daa to /dev/vdb
Nov 22 08:00:47 user nova-compute[74348]: DEBUG os_brick.utils [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc515f7a-5104-4a86-a1b2-7c88c062f0e5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee267eb-8e24-44b1-b92a-42a69a3a3a5a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d5bb72-ff3a-4e0f-af7e-b0c69047b0ed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[91194773-03e9-4a31-9bda-594c98e08a59]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:00:47 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 08:00:47 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5ba833-eb59-4117-95da-743b39ffd5d6]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG os_brick.utils [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Updating existing volume attachment record: 55979a67-4f2e-4b4a-8263-6184b3f45258 {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23662633762623831', 'path': '/dev/sdb'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662633762623831', 'path': '/dev/sdb'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:00:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1945716787',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1945716787',id=24,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a31d898cdc69494a8825e8d93a0d04bc',ramdisk_id='',reservation_id='r-9nke1bun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-502521972',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:00:34Z,user_data=None,user_id='1d5c8274eca14965b6cbfe22110f904d',uuid=b8f84c0b-fab5-4900-bf65-270c9c06baf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72e5b044-9d3b-412d-9a20-408387fb6fe6", "address": "fa:16:3e:5d:93:c7", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e5b044-9d", "ovs_interfaceid": "72e5b044-9d3b-412d-9a20-408387fb6fe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Converting VIF {"id": "72e5b044-9d3b-412d-9a20-408387fb6fe6", "address": "fa:16:3e:5d:93:c7", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e5b044-9d", "ovs_interfaceid": "72e5b044-9d3b-412d-9a20-408387fb6fe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:93:c7,bridge_name='br-int',has_traffic_filtering=True,id=72e5b044-9d3b-412d-9a20-408387fb6fe6,network=Network(6fe60468-191c-4d84-8dce-55c056f88936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72e5b044-9d') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG nova.objects.instance [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lazy-loading 'pci_devices' on Instance uuid b8f84c0b-fab5-4900-bf65-270c9c06baf8 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] End _get_guest_xml xml=<domain type="kvm">
Nov 22 08:00:47 user nova-compute[74348]:   <uuid>b8f84c0b-fab5-4900-bf65-270c9c06baf8</uuid>
Nov 22 08:00:47 user nova-compute[74348]:   <name>instance-00000018</name>
Nov 22 08:00:47 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 08:00:47 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 08:00:47 user nova-compute[74348]:   <metadata>
Nov 22 08:00:47 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 08:00:47 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 08:00:47 user nova-compute[74348]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1945716787</nova:name>
Nov 22 08:00:47 user nova-compute[74348]:       <nova:creationTime>2023-11-22 08:00:46</nova:creationTime>
Nov 22 08:00:47 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 08:00:47 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 08:00:47 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 08:00:47 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 08:00:47 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 08:00:47 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 08:00:47 user nova-compute[74348]:       </nova:flavor>
Nov 22 08:00:47 user nova-compute[74348]:       <nova:owner>
Nov 22 08:00:47 user nova-compute[74348]:         <nova:user uuid="1d5c8274eca14965b6cbfe22110f904d">tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member</nova:user>
Nov 22 08:00:47 user nova-compute[74348]:         <nova:project uuid="a31d898cdc69494a8825e8d93a0d04bc">tempest-ServerBootFromVolumeStableRescueTest-502521972</nova:project>
Nov 22 08:00:47 user nova-compute[74348]:       </nova:owner>
Nov 22 08:00:47 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 08:00:47 user nova-compute[74348]:       <nova:ports>
Nov 22 08:00:47 user nova-compute[74348]:         <nova:port uuid="72e5b044-9d3b-412d-9a20-408387fb6fe6">
Nov 22 08:00:47 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 22 08:00:47 user nova-compute[74348]:         </nova:port>
Nov 22 08:00:47 user nova-compute[74348]:       </nova:ports>
Nov 22 08:00:47 user nova-compute[74348]:     </nova:instance>
Nov 22 08:00:47 user nova-compute[74348]:   </metadata>
Nov 22 08:00:47 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 08:00:47 user nova-compute[74348]:     <system>
Nov 22 08:00:47 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 08:00:47 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 08:00:47 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 08:00:47 user nova-compute[74348]:       <entry name="serial">b8f84c0b-fab5-4900-bf65-270c9c06baf8</entry>
Nov 22 08:00:47 user nova-compute[74348]:       <entry name="uuid">b8f84c0b-fab5-4900-bf65-270c9c06baf8</entry>
Nov 22 08:00:47 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 08:00:47 user nova-compute[74348]:     </system>
Nov 22 08:00:47 user nova-compute[74348]:   </sysinfo>
Nov 22 08:00:47 user nova-compute[74348]:   <os>
Nov 22 08:00:47 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 08:00:47 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 08:00:47 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 08:00:47 user nova-compute[74348]:   </os>
Nov 22 08:00:47 user nova-compute[74348]:   <features>
Nov 22 08:00:47 user nova-compute[74348]:     <acpi/>
Nov 22 08:00:47 user nova-compute[74348]:     <apic/>
Nov 22 08:00:47 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 08:00:47 user nova-compute[74348]:   </features>
Nov 22 08:00:47 user nova-compute[74348]:   <clock offset="utc">
Nov 22 08:00:47 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 08:00:47 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 08:00:47 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 08:00:47 user nova-compute[74348]:   </clock>
Nov 22 08:00:47 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 08:00:47 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 08:00:47 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 08:00:47 user nova-compute[74348]:   </cpu>
Nov 22 08:00:47 user nova-compute[74348]:   <devices>
Nov 22 08:00:47 user nova-compute[74348]:     <disk type="block" device="disk">
Nov 22 08:00:47 user nova-compute[74348]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:00:47 user nova-compute[74348]:       <source dev="/dev/sdb"/>
Nov 22 08:00:47 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 08:00:47 user nova-compute[74348]:       <serial>75590810-f559-484b-947e-9e6f1397e7f8</serial>
Nov 22 08:00:47 user nova-compute[74348]:     </disk>
Nov 22 08:00:47 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 08:00:47 user nova-compute[74348]:       <mac address="fa:16:3e:5d:93:c7"/>
Nov 22 08:00:47 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:00:47 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 08:00:47 user nova-compute[74348]:       <target dev="tap72e5b044-9d"/>
Nov 22 08:00:47 user nova-compute[74348]:     </interface>
Nov 22 08:00:47 user nova-compute[74348]:     <serial type="pty">
Nov 22 08:00:47 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/b8f84c0b-fab5-4900-bf65-270c9c06baf8/console.log" append="off"/>
Nov 22 08:00:47 user nova-compute[74348]:     </serial>
Nov 22 08:00:47 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 08:00:47 user nova-compute[74348]:     <video>
Nov 22 08:00:47 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:00:47 user nova-compute[74348]:     </video>
Nov 22 08:00:47 user nova-compute[74348]:     <rng model="virtio">
Nov 22 08:00:47 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 08:00:47 user nova-compute[74348]:     </rng>
Nov 22 08:00:47 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 08:00:47 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 08:00:47 user nova-compute[74348]:       <stats period="10"/>
Nov 22 08:00:47 user nova-compute[74348]:     </memballoon>
Nov 22 08:00:47 user nova-compute[74348]:   </devices>
Nov 22 08:00:47 user nova-compute[74348]: </domain>
Nov 22 08:00:47 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:00:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1945716787',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1945716787',id=24,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a31d898cdc69494a8825e8d93a0d04bc',ramdisk_id='',reservation_id='r-9nke1bun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-502521972',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:00:34Z,user_data=None,user_id='1d5c8274eca14965b6cbfe22110f904d',uuid=b8f84c0b-fab5-4900-bf65-270c9c06baf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72e5b044-9d3b-412d-9a20-408387fb6fe6", "address": "fa:16:3e:5d:93:c7", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e5b044-9d", "ovs_interfaceid": "72e5b044-9d3b-412d-9a20-408387fb6fe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Converting VIF {"id": "72e5b044-9d3b-412d-9a20-408387fb6fe6", "address": "fa:16:3e:5d:93:c7", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e5b044-9d", "ovs_interfaceid": "72e5b044-9d3b-412d-9a20-408387fb6fe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:93:c7,bridge_name='br-int',has_traffic_filtering=True,id=72e5b044-9d3b-412d-9a20-408387fb6fe6,network=Network(6fe60468-191c-4d84-8dce-55c056f88936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72e5b044-9d') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG os_vif [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:93:c7,bridge_name='br-int',has_traffic_filtering=True,id=72e5b044-9d3b-412d-9a20-408387fb6fe6,network=Network(6fe60468-191c-4d84-8dce-55c056f88936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72e5b044-9d') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5a13287e-fc21-5c13-a659-93526d02ec2a', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72e5b044-9d, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap72e5b044-9d, col_values=(('qos', UUID('a04ce15b-9bb2-4f03-8a41-53f4f43881b4')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap72e5b044-9d, col_values=(('external_ids', {'iface-id': '72e5b044-9d3b-412d-9a20-408387fb6fe6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:93:c7', 'vm-uuid': 'b8f84c0b-fab5-4900-bf65-270c9c06baf8'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:00:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:47 user nova-compute[74348]: INFO os_vif [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:93:c7,bridge_name='br-int',has_traffic_filtering=True,id=72e5b044-9d3b-412d-9a20-408387fb6fe6,network=Network(6fe60468-191c-4d84-8dce-55c056f88936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72e5b044-9d')
Nov 22 08:00:48 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:00:48 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] No VIF found with MAC fa:16:3e:5d:93:c7, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:00:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:49 user nova-compute[74348]: DEBUG nova.compute.manager [req-272fd476-10c7-4d86-a38a-67f75f875f42 req-8369a2bc-ef39-4102-a528-9b9b1a77a20f service nova] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Received event network-vif-plugged-72e5b044-9d3b-412d-9a20-408387fb6fe6 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:00:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-272fd476-10c7-4d86-a38a-67f75f875f42 req-8369a2bc-ef39-4102-a528-9b9b1a77a20f service nova] Acquiring lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:00:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-272fd476-10c7-4d86-a38a-67f75f875f42 req-8369a2bc-ef39-4102-a528-9b9b1a77a20f service nova] Lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:00:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-272fd476-10c7-4d86-a38a-67f75f875f42 req-8369a2bc-ef39-4102-a528-9b9b1a77a20f service nova] Lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:00:49 user nova-compute[74348]: DEBUG nova.compute.manager [req-272fd476-10c7-4d86-a38a-67f75f875f42 req-8369a2bc-ef39-4102-a528-9b9b1a77a20f service nova] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] No waiting events found dispatching network-vif-plugged-72e5b044-9d3b-412d-9a20-408387fb6fe6 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:00:49 user nova-compute[74348]: WARNING nova.compute.manager [req-272fd476-10c7-4d86-a38a-67f75f875f42 req-8369a2bc-ef39-4102-a528-9b9b1a77a20f service nova] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Received unexpected event network-vif-plugged-72e5b044-9d3b-412d-9a20-408387fb6fe6 for instance with vm_state building and task_state spawning.
Nov 22 08:00:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:50 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:51 user nova-compute[74348]: DEBUG nova.compute.manager [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 08:00:51 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 08:00:51 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Instance spawned successfully.
Nov 22 08:00:51 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 08:00:51 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:00:51 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:00:51 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:00:51 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:00:51 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:00:51 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:00:51 user nova-compute[74348]: DEBUG nova.compute.manager [req-0d43158b-5614-4959-84de-b7f1ea608e7e req-cfcb00e6-1823-4e9f-9811-2077502a8e0f service nova] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Received event network-vif-plugged-72e5b044-9d3b-412d-9a20-408387fb6fe6 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:00:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-0d43158b-5614-4959-84de-b7f1ea608e7e req-cfcb00e6-1823-4e9f-9811-2077502a8e0f service nova] Acquiring lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:00:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-0d43158b-5614-4959-84de-b7f1ea608e7e req-cfcb00e6-1823-4e9f-9811-2077502a8e0f service nova] Lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:00:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-0d43158b-5614-4959-84de-b7f1ea608e7e req-cfcb00e6-1823-4e9f-9811-2077502a8e0f service nova] Lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:00:51 user nova-compute[74348]: DEBUG nova.compute.manager [req-0d43158b-5614-4959-84de-b7f1ea608e7e req-cfcb00e6-1823-4e9f-9811-2077502a8e0f service nova] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] No waiting events found dispatching network-vif-plugged-72e5b044-9d3b-412d-9a20-408387fb6fe6 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:00:51 user nova-compute[74348]: WARNING nova.compute.manager [req-0d43158b-5614-4959-84de-b7f1ea608e7e req-cfcb00e6-1823-4e9f-9811-2077502a8e0f service nova] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Received unexpected event network-vif-plugged-72e5b044-9d3b-412d-9a20-408387fb6fe6 for instance with vm_state building and task_state spawning.
Nov 22 08:00:51 user nova-compute[74348]: INFO nova.compute.manager [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Took 5.18 seconds to spawn the instance on the hypervisor.
Nov 22 08:00:51 user nova-compute[74348]: DEBUG nova.compute.manager [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:00:51 user nova-compute[74348]: INFO nova.compute.manager [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Took 18.14 seconds to build instance.
Nov 22 08:00:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8dd20106-b76b-49ff-b2ab-e9163592f4e9 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.328s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:00:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cgaEthyr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:00:53 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:00:53 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:00:53 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:00:53 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:00:53 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 08:00:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[780ddc89-eeb3-4ee3-8931-d31f7ffbde50]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 08:00:53 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2672310-d64f-4e0c-a208-fd8db2c17c32]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa] added
Nov 22 08:00:53 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[26945cd6-6167-48cd-84cf-5de372d1c8c8]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[606b05a4-f2a0-4f07-b65f-efe183716e54]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cgaEthyr {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cgaEthyr" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34cea6b-be69-4219-802b-9524c86fa2e4]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cgaEthyr'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b59f82-281c-4d33-b8ab-6b48a7be0013]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2c3010-443d-4894-a1ac-d6683fc5a9f3]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 08:00:53 user nova-compute[74348]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:00:53 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 08:00:53 user nova-compute[74348]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:00:53 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e954438-c0a3-4cd0-878c-d7b88503d661]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa, portal: 172.16.0.220,3260]
Nov 22 08:00:53 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa, portal: 172.16.0.220,3260] successful.
Nov 22 08:00:53 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[324113c3-16d5-4dd2-aa01-d89a2d95d6fa]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fad5df-854b-44f5-a3d7-5a11b93ee27b]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 08:00:53 user nova-compute[74348]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:00:53 user nova-compute[74348]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa (non-flash)
Nov 22 08:00:53 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 08:00:53 user nova-compute[74348]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:00:53 user nova-compute[74348]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa (non-flash)
Nov 22 08:00:53 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] HCTL ('35', '-', '-', 0) found on session 28 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19f6fda-b3e5-4f17-878c-449b3b8d92b6]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:00:53 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cgaEthyr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 08:00:55 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:00:55 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '26139366233306663', 'path': '/dev/sdd'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:00:55 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139366233306663', 'path': '/dev/sdd'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 08:00:55 user nova-compute[74348]: DEBUG nova.objects.instance [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lazy-loading 'flavor' on Instance uuid a635cbbc-6b87-4877-80a8-bd4001c407c6 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:00:55 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 08:00:55 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:00:55 user nova-compute[74348]:   <source dev="/dev/sdd"/>
Nov 22 08:00:55 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:00:55 user nova-compute[74348]:   <serial>12828237-e920-4f6e-bcaf-2b0443407daa</serial>
Nov 22 08:00:55 user nova-compute[74348]: </disk>
Nov 22 08:00:55 user nova-compute[74348]:  {{(pid=74348) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 08:00:55 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:55 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:00:55 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:00:55 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] No VIF found with MAC fa:16:3e:a5:2d:c8, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:00:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ed0f6389-994c-4fe0-9c83-897f51c7e1f5 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "a635cbbc-6b87-4877-80a8-bd4001c407c6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.187s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:00:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:00:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquiring lock "37c93c2a-1397-4b04-aef1-5068218ad9fd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:00:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "37c93c2a-1397-4b04-aef1-5068218ad9fd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:00:59 user nova-compute[74348]: DEBUG nova.compute.manager [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 08:00:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:00:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:00:59 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 08:00:59 user nova-compute[74348]: INFO nova.compute.claims [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Claim successful on node user
Nov 22 08:01:00 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:01:00 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:01:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.475s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:01:00 user nova-compute[74348]: DEBUG nova.compute.manager [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 08:01:00 user nova-compute[74348]: DEBUG nova.compute.manager [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 08:01:00 user nova-compute[74348]: DEBUG nova.network.neutron [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 08:01:00 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 08:01:00 user nova-compute[74348]: DEBUG nova.compute.manager [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 08:01:00 user nova-compute[74348]: DEBUG nova.policy [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae8c7082420f4b85a9009ff82296d8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d1a2eb68ef4c0aa5ef081fe10877a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 08:01:00 user nova-compute[74348]: DEBUG nova.compute.manager [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 08:01:00 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 08:01:00 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Creating image(s)
Nov 22 08:01:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquiring lock "/opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:01:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "/opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:01:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "/opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:01:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.238s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquiring lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:01:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:01:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.313s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk 1073741824" returned: 0 in 0.085s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.407s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:01:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.185s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:01 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Checking if we can resize image /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk. size=1073741824 {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 08:01:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:01 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Cannot resize image /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk to a smaller size. {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 08:01:01 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 08:01:01 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Ensure instance console log exists: /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 08:01:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:01:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:01:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:01:02 user nova-compute[74348]: DEBUG nova.network.neutron [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Successfully created port: acc2d56f-6884-403d-b2e5-2eb64c40047f {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 08:01:02 user nova-compute[74348]: DEBUG nova.compute.manager [req-0c35607b-d921-43b5-be13-d146396417c4 req-9ef29573-7fea-4379-b2f8-71688a3628ac service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Received event network-changed-25edb763-90ad-43e6-98c1-6baf85e723d5 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:01:02 user nova-compute[74348]: DEBUG nova.compute.manager [req-0c35607b-d921-43b5-be13-d146396417c4 req-9ef29573-7fea-4379-b2f8-71688a3628ac service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Refreshing instance network info cache due to event network-changed-25edb763-90ad-43e6-98c1-6baf85e723d5. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:01:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-0c35607b-d921-43b5-be13-d146396417c4 req-9ef29573-7fea-4379-b2f8-71688a3628ac service nova] Acquiring lock "refresh_cache-a635cbbc-6b87-4877-80a8-bd4001c407c6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:01:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-0c35607b-d921-43b5-be13-d146396417c4 req-9ef29573-7fea-4379-b2f8-71688a3628ac service nova] Acquired lock "refresh_cache-a635cbbc-6b87-4877-80a8-bd4001c407c6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:01:02 user nova-compute[74348]: DEBUG nova.network.neutron [req-0c35607b-d921-43b5-be13-d146396417c4 req-9ef29573-7fea-4379-b2f8-71688a3628ac service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Refreshing network info cache for port 25edb763-90ad-43e6-98c1-6baf85e723d5 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:01:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG nova.network.neutron [req-0c35607b-d921-43b5-be13-d146396417c4 req-9ef29573-7fea-4379-b2f8-71688a3628ac service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Updated VIF entry in instance network info cache for port 25edb763-90ad-43e6-98c1-6baf85e723d5. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG nova.network.neutron [req-0c35607b-d921-43b5-be13-d146396417c4 req-9ef29573-7fea-4379-b2f8-71688a3628ac service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Updating instance_info_cache with network_info: [{"id": "25edb763-90ad-43e6-98c1-6baf85e723d5", "address": "fa:16:3e:a5:2d:c8", "network": {"id": "442abc57-45e5-4cd7-878e-979afa78c421", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1395369508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d76d03d17cc4e5bb52a32a2f8fbd629", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25edb763-90", "ovs_interfaceid": "25edb763-90ad-43e6-98c1-6baf85e723d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG nova.network.neutron [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Successfully updated port: acc2d56f-6884-403d-b2e5-2eb64c40047f {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-0c35607b-d921-43b5-be13-d146396417c4 req-9ef29573-7fea-4379-b2f8-71688a3628ac service nova] Releasing lock "refresh_cache-a635cbbc-6b87-4877-80a8-bd4001c407c6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquiring lock "refresh_cache-37c93c2a-1397-4b04-aef1-5068218ad9fd" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquired lock "refresh_cache-37c93c2a-1397-4b04-aef1-5068218ad9fd" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG nova.network.neutron [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG nova.network.neutron [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG nova.network.neutron [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Updating instance_info_cache with network_info: [{"id": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "address": "fa:16:3e:62:f2:83", "network": {"id": "606a7c22-1285-47e8-bfa0-f09dbd7cb9ac", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-63336037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d1a2eb68ef4c0aa5ef081fe10877a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc2d56f-68", "ovs_interfaceid": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Releasing lock "refresh_cache-37c93c2a-1397-4b04-aef1-5068218ad9fd" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG nova.compute.manager [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Instance network_info: |[{"id": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "address": "fa:16:3e:62:f2:83", "network": {"id": "606a7c22-1285-47e8-bfa0-f09dbd7cb9ac", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-63336037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d1a2eb68ef4c0aa5ef081fe10877a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc2d56f-68", "ovs_interfaceid": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Start _get_guest_xml network_info=[{"id": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "address": "fa:16:3e:62:f2:83", "network": {"id": "606a7c22-1285-47e8-bfa0-f09dbd7cb9ac", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-63336037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d1a2eb68ef4c0aa5ef081fe10877a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc2d56f-68", "ovs_interfaceid": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 08:01:03 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:01:03 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:01:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:00:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1956019398',display_name='tempest-AttachVolumeTestJSON-server-1956019398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1956019398',id=25,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwMcyh7MC6umn3uaanqgBLVw0olRPhsYeJZiuWM01oPuW2lMJM3v/uqqmw2CyNdCKwv23YM7ilvhBeMmJnwDV2ZnrEjaT/V3wGmEnZHbCJZSu5Yo+sT9JeBTaahsZul6Q==',key_name='tempest-keypair-1490397787',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2d1a2eb68ef4c0aa5ef081fe10877a9',ramdisk_id='',reservation_id='r-37qth7ay',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-608656879',owner_user_name='tempest-AttachVolumeTestJSON-608656879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:01:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae8c7082420f4b85a9009ff82296d8cb',uuid=37c93c2a-1397-4b04-aef1-5068218ad9fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "address": "fa:16:3e:62:f2:83", "network": {"id": "606a7c22-1285-47e8-bfa0-f09dbd7cb9ac", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-63336037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d1a2eb68ef4c0aa5ef081fe10877a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc2d56f-68", "ovs_interfaceid": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Converting VIF {"id": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "address": "fa:16:3e:62:f2:83", "network": {"id": "606a7c22-1285-47e8-bfa0-f09dbd7cb9ac", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-63336037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d1a2eb68ef4c0aa5ef081fe10877a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc2d56f-68", "ovs_interfaceid": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:f2:83,bridge_name='br-int',has_traffic_filtering=True,id=acc2d56f-6884-403d-b2e5-2eb64c40047f,network=Network(606a7c22-1285-47e8-bfa0-f09dbd7cb9ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc2d56f-68') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG nova.objects.instance [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lazy-loading 'pci_devices' on Instance uuid 37c93c2a-1397-4b04-aef1-5068218ad9fd {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] End _get_guest_xml xml=<domain type="kvm">
Nov 22 08:01:03 user nova-compute[74348]:   <uuid>37c93c2a-1397-4b04-aef1-5068218ad9fd</uuid>
Nov 22 08:01:03 user nova-compute[74348]:   <name>instance-00000019</name>
Nov 22 08:01:03 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 08:01:03 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 08:01:03 user nova-compute[74348]:   <metadata>
Nov 22 08:01:03 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 08:01:03 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 08:01:03 user nova-compute[74348]:       <nova:name>tempest-AttachVolumeTestJSON-server-1956019398</nova:name>
Nov 22 08:01:03 user nova-compute[74348]:       <nova:creationTime>2023-11-22 08:01:03</nova:creationTime>
Nov 22 08:01:03 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 08:01:03 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 08:01:03 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 08:01:03 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 08:01:03 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 08:01:03 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 08:01:03 user nova-compute[74348]:       </nova:flavor>
Nov 22 08:01:03 user nova-compute[74348]:       <nova:owner>
Nov 22 08:01:03 user nova-compute[74348]:         <nova:user uuid="ae8c7082420f4b85a9009ff82296d8cb">tempest-AttachVolumeTestJSON-608656879-project-member</nova:user>
Nov 22 08:01:03 user nova-compute[74348]:         <nova:project uuid="e2d1a2eb68ef4c0aa5ef081fe10877a9">tempest-AttachVolumeTestJSON-608656879</nova:project>
Nov 22 08:01:03 user nova-compute[74348]:       </nova:owner>
Nov 22 08:01:03 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 08:01:03 user nova-compute[74348]:       <nova:ports>
Nov 22 08:01:03 user nova-compute[74348]:         <nova:port uuid="acc2d56f-6884-403d-b2e5-2eb64c40047f">
Nov 22 08:01:03 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 22 08:01:03 user nova-compute[74348]:         </nova:port>
Nov 22 08:01:03 user nova-compute[74348]:       </nova:ports>
Nov 22 08:01:03 user nova-compute[74348]:     </nova:instance>
Nov 22 08:01:03 user nova-compute[74348]:   </metadata>
Nov 22 08:01:03 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 08:01:03 user nova-compute[74348]:     <system>
Nov 22 08:01:03 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 08:01:03 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 08:01:03 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 08:01:03 user nova-compute[74348]:       <entry name="serial">37c93c2a-1397-4b04-aef1-5068218ad9fd</entry>
Nov 22 08:01:03 user nova-compute[74348]:       <entry name="uuid">37c93c2a-1397-4b04-aef1-5068218ad9fd</entry>
Nov 22 08:01:03 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 08:01:03 user nova-compute[74348]:     </system>
Nov 22 08:01:03 user nova-compute[74348]:   </sysinfo>
Nov 22 08:01:03 user nova-compute[74348]:   <os>
Nov 22 08:01:03 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 08:01:03 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 08:01:03 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 08:01:03 user nova-compute[74348]:   </os>
Nov 22 08:01:03 user nova-compute[74348]:   <features>
Nov 22 08:01:03 user nova-compute[74348]:     <acpi/>
Nov 22 08:01:03 user nova-compute[74348]:     <apic/>
Nov 22 08:01:03 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 08:01:03 user nova-compute[74348]:   </features>
Nov 22 08:01:03 user nova-compute[74348]:   <clock offset="utc">
Nov 22 08:01:03 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 08:01:03 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 08:01:03 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 08:01:03 user nova-compute[74348]:   </clock>
Nov 22 08:01:03 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 08:01:03 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 08:01:03 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 08:01:03 user nova-compute[74348]:   </cpu>
Nov 22 08:01:03 user nova-compute[74348]:   <devices>
Nov 22 08:01:03 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 08:01:03 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 08:01:03 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk"/>
Nov 22 08:01:03 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 08:01:03 user nova-compute[74348]:     </disk>
Nov 22 08:01:03 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 08:01:03 user nova-compute[74348]:       <mac address="fa:16:3e:62:f2:83"/>
Nov 22 08:01:03 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:01:03 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 08:01:03 user nova-compute[74348]:       <target dev="tapacc2d56f-68"/>
Nov 22 08:01:03 user nova-compute[74348]:     </interface>
Nov 22 08:01:03 user nova-compute[74348]:     <serial type="pty">
Nov 22 08:01:03 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/console.log" append="off"/>
Nov 22 08:01:03 user nova-compute[74348]:     </serial>
Nov 22 08:01:03 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 08:01:03 user nova-compute[74348]:     <video>
Nov 22 08:01:03 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:01:03 user nova-compute[74348]:     </video>
Nov 22 08:01:03 user nova-compute[74348]:     <rng model="virtio">
Nov 22 08:01:03 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 08:01:03 user nova-compute[74348]:     </rng>
Nov 22 08:01:03 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 08:01:03 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 08:01:03 user nova-compute[74348]:       <stats period="10"/>
Nov 22 08:01:03 user nova-compute[74348]:     </memballoon>
Nov 22 08:01:03 user nova-compute[74348]:   </devices>
Nov 22 08:01:03 user nova-compute[74348]: </domain>
Nov 22 08:01:03 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:00:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1956019398',display_name='tempest-AttachVolumeTestJSON-server-1956019398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1956019398',id=25,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwMcyh7MC6umn3uaanqgBLVw0olRPhsYeJZiuWM01oPuW2lMJM3v/uqqmw2CyNdCKwv23YM7ilvhBeMmJnwDV2ZnrEjaT/V3wGmEnZHbCJZSu5Yo+sT9JeBTaahsZul6Q==',key_name='tempest-keypair-1490397787',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2d1a2eb68ef4c0aa5ef081fe10877a9',ramdisk_id='',reservation_id='r-37qth7ay',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-608656879',owner_user_name='tempest-AttachVolumeTestJSON-608656879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:01:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae8c7082420f4b85a9009ff82296d8cb',uuid=37c93c2a-1397-4b04-aef1-5068218ad9fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "address": "fa:16:3e:62:f2:83", "network": {"id": "606a7c22-1285-47e8-bfa0-f09dbd7cb9ac", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-63336037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d1a2eb68ef4c0aa5ef081fe10877a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc2d56f-68", "ovs_interfaceid": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Converting VIF {"id": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "address": "fa:16:3e:62:f2:83", "network": {"id": "606a7c22-1285-47e8-bfa0-f09dbd7cb9ac", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-63336037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d1a2eb68ef4c0aa5ef081fe10877a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc2d56f-68", "ovs_interfaceid": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:f2:83,bridge_name='br-int',has_traffic_filtering=True,id=acc2d56f-6884-403d-b2e5-2eb64c40047f,network=Network(606a7c22-1285-47e8-bfa0-f09dbd7cb9ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc2d56f-68') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG os_vif [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:f2:83,bridge_name='br-int',has_traffic_filtering=True,id=acc2d56f-6884-403d-b2e5-2eb64c40047f,network=Network(606a7c22-1285-47e8-bfa0-f09dbd7cb9ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc2d56f-68') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4a180c9d-5588-5a6b-b08e-82b4a489dd60', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapacc2d56f-68, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapacc2d56f-68, col_values=(('qos', UUID('3edc90a9-436a-45ea-ae1d-3d715d5a8849')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapacc2d56f-68, col_values=(('external_ids', {'iface-id': 'acc2d56f-6884-403d-b2e5-2eb64c40047f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:f2:83', 'vm-uuid': '37c93c2a-1397-4b04-aef1-5068218ad9fd'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:01:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:03 user nova-compute[74348]: INFO os_vif [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:f2:83,bridge_name='br-int',has_traffic_filtering=True,id=acc2d56f-6884-403d-b2e5-2eb64c40047f,network=Network(606a7c22-1285-47e8-bfa0-f09dbd7cb9ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc2d56f-68')
Nov 22 08:01:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:01:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] No VIF found with MAC fa:16:3e:62:f2:83, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:01:04 user nova-compute[74348]: DEBUG nova.compute.manager [req-925978da-0acd-49ce-9662-35cbe10c8075 req-df103be5-2357-488c-b9e0-a35e7999297a service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Received event network-changed-acc2d56f-6884-403d-b2e5-2eb64c40047f {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:01:04 user nova-compute[74348]: DEBUG nova.compute.manager [req-925978da-0acd-49ce-9662-35cbe10c8075 req-df103be5-2357-488c-b9e0-a35e7999297a service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Refreshing instance network info cache due to event network-changed-acc2d56f-6884-403d-b2e5-2eb64c40047f. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:01:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-925978da-0acd-49ce-9662-35cbe10c8075 req-df103be5-2357-488c-b9e0-a35e7999297a service nova] Acquiring lock "refresh_cache-37c93c2a-1397-4b04-aef1-5068218ad9fd" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:01:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-925978da-0acd-49ce-9662-35cbe10c8075 req-df103be5-2357-488c-b9e0-a35e7999297a service nova] Acquired lock "refresh_cache-37c93c2a-1397-4b04-aef1-5068218ad9fd" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:01:04 user nova-compute[74348]: DEBUG nova.network.neutron [req-925978da-0acd-49ce-9662-35cbe10c8075 req-df103be5-2357-488c-b9e0-a35e7999297a service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Refreshing network info cache for port acc2d56f-6884-403d-b2e5-2eb64c40047f {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:01:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:05 user nova-compute[74348]: DEBUG nova.network.neutron [req-925978da-0acd-49ce-9662-35cbe10c8075 req-df103be5-2357-488c-b9e0-a35e7999297a service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Updated VIF entry in instance network info cache for port acc2d56f-6884-403d-b2e5-2eb64c40047f. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:01:05 user nova-compute[74348]: DEBUG nova.network.neutron [req-925978da-0acd-49ce-9662-35cbe10c8075 req-df103be5-2357-488c-b9e0-a35e7999297a service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Updating instance_info_cache with network_info: [{"id": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "address": "fa:16:3e:62:f2:83", "network": {"id": "606a7c22-1285-47e8-bfa0-f09dbd7cb9ac", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-63336037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d1a2eb68ef4c0aa5ef081fe10877a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc2d56f-68", "ovs_interfaceid": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:01:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-925978da-0acd-49ce-9662-35cbe10c8075 req-df103be5-2357-488c-b9e0-a35e7999297a service nova] Releasing lock "refresh_cache-37c93c2a-1397-4b04-aef1-5068218ad9fd" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:01:05 user nova-compute[74348]: DEBUG nova.compute.manager [req-101dbf49-2fd2-449f-8926-e62546edb467 req-d4acd12c-0a3f-438d-8c39-2c32fa9ee96f service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Received event network-vif-plugged-acc2d56f-6884-403d-b2e5-2eb64c40047f {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:01:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-101dbf49-2fd2-449f-8926-e62546edb467 req-d4acd12c-0a3f-438d-8c39-2c32fa9ee96f service nova] Acquiring lock "37c93c2a-1397-4b04-aef1-5068218ad9fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:01:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-101dbf49-2fd2-449f-8926-e62546edb467 req-d4acd12c-0a3f-438d-8c39-2c32fa9ee96f service nova] Lock "37c93c2a-1397-4b04-aef1-5068218ad9fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:01:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-101dbf49-2fd2-449f-8926-e62546edb467 req-d4acd12c-0a3f-438d-8c39-2c32fa9ee96f service nova] Lock "37c93c2a-1397-4b04-aef1-5068218ad9fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:01:05 user nova-compute[74348]: DEBUG nova.compute.manager [req-101dbf49-2fd2-449f-8926-e62546edb467 req-d4acd12c-0a3f-438d-8c39-2c32fa9ee96f service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] No waiting events found dispatching network-vif-plugged-acc2d56f-6884-403d-b2e5-2eb64c40047f {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:01:05 user nova-compute[74348]: WARNING nova.compute.manager [req-101dbf49-2fd2-449f-8926-e62546edb467 req-d4acd12c-0a3f-438d-8c39-2c32fa9ee96f service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Received unexpected event network-vif-plugged-acc2d56f-6884-403d-b2e5-2eb64c40047f for instance with vm_state building and task_state spawning.
Nov 22 08:01:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:06 user nova-compute[74348]: DEBUG nova.compute.manager [req-c0e19703-4cab-4f5f-8c61-e14872859090 req-862f9a73-9155-4ee7-bb3d-69b6d86fa0d2 service nova] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Received event network-changed-5a641519-9d0f-47c5-b1e3-e96f2a4411a2 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:01:06 user nova-compute[74348]: DEBUG nova.compute.manager [req-c0e19703-4cab-4f5f-8c61-e14872859090 req-862f9a73-9155-4ee7-bb3d-69b6d86fa0d2 service nova] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Refreshing instance network info cache due to event network-changed-5a641519-9d0f-47c5-b1e3-e96f2a4411a2. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:01:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c0e19703-4cab-4f5f-8c61-e14872859090 req-862f9a73-9155-4ee7-bb3d-69b6d86fa0d2 service nova] Acquiring lock "refresh_cache-2eaecc2f-f6fe-4171-b445-55c3a2d33760" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:01:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c0e19703-4cab-4f5f-8c61-e14872859090 req-862f9a73-9155-4ee7-bb3d-69b6d86fa0d2 service nova] Acquired lock "refresh_cache-2eaecc2f-f6fe-4171-b445-55c3a2d33760" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:01:06 user nova-compute[74348]: DEBUG nova.network.neutron [req-c0e19703-4cab-4f5f-8c61-e14872859090 req-862f9a73-9155-4ee7-bb3d-69b6d86fa0d2 service nova] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Refreshing network info cache for port 5a641519-9d0f-47c5-b1e3-e96f2a4411a2 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG nova.network.neutron [req-c0e19703-4cab-4f5f-8c61-e14872859090 req-862f9a73-9155-4ee7-bb3d-69b6d86fa0d2 service nova] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Updated VIF entry in instance network info cache for port 5a641519-9d0f-47c5-b1e3-e96f2a4411a2. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG nova.network.neutron [req-c0e19703-4cab-4f5f-8c61-e14872859090 req-862f9a73-9155-4ee7-bb3d-69b6d86fa0d2 service nova] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Updating instance_info_cache with network_info: [{"id": "5a641519-9d0f-47c5-b1e3-e96f2a4411a2", "address": "fa:16:3e:83:76:22", "network": {"id": "5c50496a-0882-415b-8115-ddf7b65516a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-531638472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f569146bb9b04838ad8044260da6ad58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a641519-9d", "ovs_interfaceid": "5a641519-9d0f-47c5-b1e3-e96f2a4411a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c0e19703-4cab-4f5f-8c61-e14872859090 req-862f9a73-9155-4ee7-bb3d-69b6d86fa0d2 service nova] Releasing lock "refresh_cache-2eaecc2f-f6fe-4171-b445-55c3a2d33760" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG nova.compute.manager [req-c0e19703-4cab-4f5f-8c61-e14872859090 req-862f9a73-9155-4ee7-bb3d-69b6d86fa0d2 service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Received event network-changed-25edb763-90ad-43e6-98c1-6baf85e723d5 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG nova.compute.manager [req-c0e19703-4cab-4f5f-8c61-e14872859090 req-862f9a73-9155-4ee7-bb3d-69b6d86fa0d2 service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Refreshing instance network info cache due to event network-changed-25edb763-90ad-43e6-98c1-6baf85e723d5. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c0e19703-4cab-4f5f-8c61-e14872859090 req-862f9a73-9155-4ee7-bb3d-69b6d86fa0d2 service nova] Acquiring lock "refresh_cache-a635cbbc-6b87-4877-80a8-bd4001c407c6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c0e19703-4cab-4f5f-8c61-e14872859090 req-862f9a73-9155-4ee7-bb3d-69b6d86fa0d2 service nova] Acquired lock "refresh_cache-a635cbbc-6b87-4877-80a8-bd4001c407c6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG nova.network.neutron [req-c0e19703-4cab-4f5f-8c61-e14872859090 req-862f9a73-9155-4ee7-bb3d-69b6d86fa0d2 service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Refreshing network info cache for port 25edb763-90ad-43e6-98c1-6baf85e723d5 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG nova.compute.manager [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 08:01:07 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Instance spawned successfully.
Nov 22 08:01:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "2eaecc2f-f6fe-4171-b445-55c3a2d33760" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "2eaecc2f-f6fe-4171-b445-55c3a2d33760" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG nova.objects.instance [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lazy-loading 'flavor' on Instance uuid 2eaecc2f-f6fe-4171-b445-55c3a2d33760 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "2eaecc2f-f6fe-4171-b445-55c3a2d33760" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG nova.network.neutron [req-c0e19703-4cab-4f5f-8c61-e14872859090 req-862f9a73-9155-4ee7-bb3d-69b6d86fa0d2 service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Updated VIF entry in instance network info cache for port 25edb763-90ad-43e6-98c1-6baf85e723d5. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG nova.network.neutron [req-c0e19703-4cab-4f5f-8c61-e14872859090 req-862f9a73-9155-4ee7-bb3d-69b6d86fa0d2 service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Updating instance_info_cache with network_info: [{"id": "25edb763-90ad-43e6-98c1-6baf85e723d5", "address": "fa:16:3e:a5:2d:c8", "network": {"id": "442abc57-45e5-4cd7-878e-979afa78c421", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1395369508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d76d03d17cc4e5bb52a32a2f8fbd629", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25edb763-90", "ovs_interfaceid": "25edb763-90ad-43e6-98c1-6baf85e723d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c0e19703-4cab-4f5f-8c61-e14872859090 req-862f9a73-9155-4ee7-bb3d-69b6d86fa0d2 service nova] Releasing lock "refresh_cache-a635cbbc-6b87-4877-80a8-bd4001c407c6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG nova.compute.manager [req-3128673b-0464-4f85-907d-8a9de07515b2 req-7fe6d3a0-6932-4475-9f56-2fd60dce1258 service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Received event network-vif-plugged-acc2d56f-6884-403d-b2e5-2eb64c40047f {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3128673b-0464-4f85-907d-8a9de07515b2 req-7fe6d3a0-6932-4475-9f56-2fd60dce1258 service nova] Acquiring lock "37c93c2a-1397-4b04-aef1-5068218ad9fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3128673b-0464-4f85-907d-8a9de07515b2 req-7fe6d3a0-6932-4475-9f56-2fd60dce1258 service nova] Lock "37c93c2a-1397-4b04-aef1-5068218ad9fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3128673b-0464-4f85-907d-8a9de07515b2 req-7fe6d3a0-6932-4475-9f56-2fd60dce1258 service nova] Lock "37c93c2a-1397-4b04-aef1-5068218ad9fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG nova.compute.manager [req-3128673b-0464-4f85-907d-8a9de07515b2 req-7fe6d3a0-6932-4475-9f56-2fd60dce1258 service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] No waiting events found dispatching network-vif-plugged-acc2d56f-6884-403d-b2e5-2eb64c40047f {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:01:07 user nova-compute[74348]: WARNING nova.compute.manager [req-3128673b-0464-4f85-907d-8a9de07515b2 req-7fe6d3a0-6932-4475-9f56-2fd60dce1258 service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Received unexpected event network-vif-plugged-acc2d56f-6884-403d-b2e5-2eb64c40047f for instance with vm_state building and task_state spawning.
Nov 22 08:01:07 user nova-compute[74348]: INFO nova.compute.manager [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Took 7.16 seconds to spawn the instance on the hypervisor.
Nov 22 08:01:07 user nova-compute[74348]: DEBUG nova.compute.manager [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "2eaecc2f-f6fe-4171-b445-55c3a2d33760" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "2eaecc2f-f6fe-4171-b445-55c3a2d33760" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:01:07 user nova-compute[74348]: INFO nova.compute.manager [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Attaching volume 60beede2-e7bf-4c48-bd23-f4b27780f6f2 to /dev/vdb
Nov 22 08:01:07 user nova-compute[74348]: INFO nova.compute.manager [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Took 8.02 seconds to build instance.
Nov 22 08:01:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-99f2d55c-b9d1-4f21-b321-b113ec8537bb tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "37c93c2a-1397-4b04-aef1-5068218ad9fd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.127s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG os_brick.utils [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8c6824-3112-459d-b852-a4c5f8da6380]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6974190b-1186-4e7e-9cc7-52a5de7bdbdd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79ea290-b1c4-4e9f-968d-801482d16aba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1914eadf-fc6b-491d-ad0d-2c4e5251c651]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:01:07 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 08:01:07 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4f7e64-6c78-4fd5-b0c7-b374d9e018cf]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG os_brick.utils [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:01:07 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Updating existing volume attachment record: adb43027-4230-4267-a736-39f20c9abb3d {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 08:01:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Acquiring lock "a635cbbc-6b87-4877-80a8-bd4001c407c6" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:01:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "a635cbbc-6b87-4877-80a8-bd4001c407c6" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:01:09 user nova-compute[74348]: INFO nova.compute.manager [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Rebooting instance
Nov 22 08:01:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Acquiring lock "refresh_cache-a635cbbc-6b87-4877-80a8-bd4001c407c6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:01:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Acquired lock "refresh_cache-a635cbbc-6b87-4877-80a8-bd4001c407c6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:01:09 user nova-compute[74348]: DEBUG nova.network.neutron [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:01:10 user nova-compute[74348]: DEBUG nova.network.neutron [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Updating instance_info_cache with network_info: [{"id": "25edb763-90ad-43e6-98c1-6baf85e723d5", "address": "fa:16:3e:a5:2d:c8", "network": {"id": "442abc57-45e5-4cd7-878e-979afa78c421", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1395369508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d76d03d17cc4e5bb52a32a2f8fbd629", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25edb763-90", "ovs_interfaceid": "25edb763-90ad-43e6-98c1-6baf85e723d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:01:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Releasing lock "refresh_cache-a635cbbc-6b87-4877-80a8-bd4001c407c6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:01:10 user nova-compute[74348]: DEBUG nova.compute.manager [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:01:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG nova.compute.manager [req-d6970610-7846-4729-91d0-d19d61934cba req-6384f6d5-3ba8-4aa1-bdd9-15ec8b9f96fb service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Received event network-vif-unplugged-25edb763-90ad-43e6-98c1-6baf85e723d5 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d6970610-7846-4729-91d0-d19d61934cba req-6384f6d5-3ba8-4aa1-bdd9-15ec8b9f96fb service nova] Acquiring lock "a635cbbc-6b87-4877-80a8-bd4001c407c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d6970610-7846-4729-91d0-d19d61934cba req-6384f6d5-3ba8-4aa1-bdd9-15ec8b9f96fb service nova] Lock "a635cbbc-6b87-4877-80a8-bd4001c407c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d6970610-7846-4729-91d0-d19d61934cba req-6384f6d5-3ba8-4aa1-bdd9-15ec8b9f96fb service nova] Lock "a635cbbc-6b87-4877-80a8-bd4001c407c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG nova.compute.manager [req-d6970610-7846-4729-91d0-d19d61934cba req-6384f6d5-3ba8-4aa1-bdd9-15ec8b9f96fb service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] No waiting events found dispatching network-vif-unplugged-25edb763-90ad-43e6-98c1-6baf85e723d5 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:01:11 user nova-compute[74348]: WARNING nova.compute.manager [req-d6970610-7846-4729-91d0-d19d61934cba req-6384f6d5-3ba8-4aa1-bdd9-15ec8b9f96fb service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Received unexpected event network-vif-unplugged-25edb763-90ad-43e6-98c1-6baf85e723d5 for instance with vm_state active and task_state reboot_started_hard.
Nov 22 08:01:11 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Instance destroyed successfully.
Nov 22 08:01:11 user nova-compute[74348]: DEBUG nova.objects.instance [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lazy-loading 'resources' on Instance uuid a635cbbc-6b87-4877-80a8-bd4001c407c6 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:58:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1710778813',display_name='tempest-TestMinimumBasicScenario-server-1710778813',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1710778813',id=19,image_ref='4f886734-5ace-46df-b52c-e3caa804822c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPf9GX11OafuHoT9ofuhjFoeTzRRPmShTAJMsT9i8I5ORMZS0S45M55gXRkwQTzdVnPq3dOA8Rf2U6W4vgKlq0UG1bzKFpjnmYUsgpcIBDzhWNaz3dJyseDrhmQvEX4BQw==',key_name='tempest-TestMinimumBasicScenario-1841491850',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:59:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d76d03d17cc4e5bb52a32a2f8fbd629',ramdisk_id='',reservation_id='r-9lpz0te2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f886734-5ace-46df-b52c-e3caa804822c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1824455706',owner_user_name='tempest-TestMinimumBasicScenario-1824455706-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T08:01:11Z,user_data=None,user_id='cbd1eed03be64a42b8ba9d0200b10692',uuid=a635cbbc-6b87-4877-80a8-bd4001c407c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25edb763-90ad-43e6-98c1-6baf85e723d5", "address": "fa:16:3e:a5:2d:c8", "network": {"id": "442abc57-45e5-4cd7-878e-979afa78c421", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1395369508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d76d03d17cc4e5bb52a32a2f8fbd629", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25edb763-90", "ovs_interfaceid": "25edb763-90ad-43e6-98c1-6baf85e723d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Converting VIF {"id": "25edb763-90ad-43e6-98c1-6baf85e723d5", "address": "fa:16:3e:a5:2d:c8", "network": {"id": "442abc57-45e5-4cd7-878e-979afa78c421", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1395369508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d76d03d17cc4e5bb52a32a2f8fbd629", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25edb763-90", "ovs_interfaceid": "25edb763-90ad-43e6-98c1-6baf85e723d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:2d:c8,bridge_name='br-int',has_traffic_filtering=True,id=25edb763-90ad-43e6-98c1-6baf85e723d5,network=Network(442abc57-45e5-4cd7-878e-979afa78c421),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25edb763-90') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG os_vif [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:2d:c8,bridge_name='br-int',has_traffic_filtering=True,id=25edb763-90ad-43e6-98c1-6baf85e723d5,network=Network(442abc57-45e5-4cd7-878e-979afa78c421),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25edb763-90') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25edb763-90, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c49b6cc7-1001-4d2c-9411-ecebcbba9826) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:11 user nova-compute[74348]: INFO os_vif [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:2d:c8,bridge_name='br-int',has_traffic_filtering=True,id=25edb763-90ad-43e6-98c1-6baf85e723d5,network=Network(442abc57-45e5-4cd7-878e-979afa78c421),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25edb763-90')
Nov 22 08:01:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cgaEthyr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:01:11 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:01:11 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ef64dd-e191-4392-bbb6-7388994fdb91]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 08:01:11 user nova-compute[74348]: No targets found.
Nov 22 08:01:11 user nova-compute[74348]: iSNS:
Nov 22 08:01:11 user nova-compute[74348]: No targets found.
Nov 22 08:01:11 user nova-compute[74348]: STATIC:
Nov 22 08:01:11 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8
Nov 22 08:01:11 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:01:11 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:01:11 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa
Nov 22 08:01:11 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:01:11 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:01:11 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730
Nov 22 08:01:11 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:01:11 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:01:11 user nova-compute[74348]: FIRMWARE:
Nov 22 08:01:11 user nova-compute[74348]: No targets found.
Nov 22 08:01:11 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 08:01:11 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 08:01:11 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca447f20-705f-4b49-972c-c9ca9ac33dbe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f52b222-fa94-4458-9d49-b86d23ca69bb]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 08:01:11 user nova-compute[74348]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:01:11 user nova-compute[74348]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa (non-flash)
Nov 22 08:01:11 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 08:01:11 user nova-compute[74348]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:01:11 user nova-compute[74348]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa (non-flash)
Nov 22 08:01:11 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f224c3b3640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa'): ({'sdd'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Removing single pathed devices sdd {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b552cdc8-ee8c-458f-9920-aa046f541405]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c0e9e8-afd9-48f3-a139-e83bf2322e28]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Flushing IO for device /dev/sdd {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd33b0e-662a-4440-8c7c-832d0bd6dc5e]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[11dc2047-d029-453a-b5fa-d90829e45b3d]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] SCSI volumes sdd have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0bbaa3e-b4f3-4839-a3c2-3a97746b3a7e]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:01:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa -p 172.16.0.220:3260 --logout" returned: 0 in 0.111s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44619f4-cfca-4bf1-886d-13b19a6f45af]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa, portal: 172.16.0.220,3260]
Nov 22 08:01:12 user nova-compute[74348]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa, portal: 172.16.0.220,3260] successful.
Nov 22 08:01:12 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26d2698-a06a-4811-86c5-52935d047e8a]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] <== disconnect_volume: return (405ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Start _get_guest_xml network_info=[{"id": "25edb763-90ad-43e6-98c1-6baf85e723d5", "address": "fa:16:3e:a5:2d:c8", "network": {"id": "442abc57-45e5-4cd7-878e-979afa78c421", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1395369508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d76d03d17cc4e5bb52a32a2f8fbd629", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25edb763-90", "ovs_interfaceid": "25edb763-90ad-43e6-98c1-6baf85e723d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4f886734-5ace-46df-b52c-e3caa804822c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '4f886734-5ace-46df-b52c-e3caa804822c'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cgaEthyr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'a635cbbc-6b87-4877-80a8-bd4001c407c6', 'attached_at': '', 'detached_at': '', 'volume_id': '12828237-e920-4f6e-bcaf-2b0443407daa', 'serial': '12828237-e920-4f6e-bcaf-2b0443407daa'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'attachment_id': '55979a67-4f2e-4b4a-8263-6184b3f45258', 'volume_type': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 08:01:12 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:01:12 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:01:12 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4f886734-5ace-46df-b52c-e3caa804822c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG nova.objects.instance [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lazy-loading 'vcpu_model' on Instance uuid a635cbbc-6b87-4877-80a8-bd4001c407c6 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG nova.objects.base [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Object Instance<a635cbbc-6b87-4877-80a8-bd4001c407c6> lazy-loaded attributes: resources,vcpu_model {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cgaEthyr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:01:12 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:01:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:01:12 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:01:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:01:12 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 08:01:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3071527d-b8dd-4027-8409-6febe0241e48]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 08:01:12 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaacfd5e-45a2-442c-be1c-2b36de930b53]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa] added
Nov 22 08:01:12 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ff9a59-1fd6-49c6-8c28-bf9a3e0c19a4]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa965c4-1d8a-4384-8cbc-72f6f704301e]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cgaEthyr {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cgaEthyr" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[472097dc-33e2-49c7-be96-3272fd1afafd]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cgaEthyr'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae89ac2c-5417-4938-a050-c2696344786c]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df07c50-0915-452e-a9d2-ad913bce61bc]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 08:01:12 user nova-compute[74348]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:01:12 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 08:01:12 user nova-compute[74348]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:01:12 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db1c592-7040-4e02-86af-0b2bf345e05b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa, portal: 172.16.0.220,3260]
Nov 22 08:01:12 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa, portal: 172.16.0.220,3260] successful.
Nov 22 08:01:12 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f2f30a-d8bc-4975-9b03-1092b53cf0f9]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6e47ec-659f-4f81-b14c-e3ce97d4a4d4]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 08:01:12 user nova-compute[74348]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:01:12 user nova-compute[74348]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa (non-flash)
Nov 22 08:01:12 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 08:01:12 user nova-compute[74348]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:01:12 user nova-compute[74348]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa (non-flash)
Nov 22 08:01:12 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e5a5d0-71da-47cf-b2ee-a236249baf1e]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:01:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cgaEthyr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 08:01:13 user nova-compute[74348]: DEBUG nova.compute.manager [req-a1f8d203-b30e-44e0-a20f-063e07775b70 req-8345ddc1-cf11-43c1-a3b3-849912c51baf service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Received event network-vif-plugged-25edb763-90ad-43e6-98c1-6baf85e723d5 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:01:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a1f8d203-b30e-44e0-a20f-063e07775b70 req-8345ddc1-cf11-43c1-a3b3-849912c51baf service nova] Acquiring lock "a635cbbc-6b87-4877-80a8-bd4001c407c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:01:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a1f8d203-b30e-44e0-a20f-063e07775b70 req-8345ddc1-cf11-43c1-a3b3-849912c51baf service nova] Lock "a635cbbc-6b87-4877-80a8-bd4001c407c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:01:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a1f8d203-b30e-44e0-a20f-063e07775b70 req-8345ddc1-cf11-43c1-a3b3-849912c51baf service nova] Lock "a635cbbc-6b87-4877-80a8-bd4001c407c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:01:13 user nova-compute[74348]: DEBUG nova.compute.manager [req-a1f8d203-b30e-44e0-a20f-063e07775b70 req-8345ddc1-cf11-43c1-a3b3-849912c51baf service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] No waiting events found dispatching network-vif-plugged-25edb763-90ad-43e6-98c1-6baf85e723d5 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:01:13 user nova-compute[74348]: WARNING nova.compute.manager [req-a1f8d203-b30e-44e0-a20f-063e07775b70 req-8345ddc1-cf11-43c1-a3b3-849912c51baf service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Received unexpected event network-vif-plugged-25edb763-90ad-43e6-98c1-6baf85e723d5 for instance with vm_state active and task_state reboot_started_hard.
Nov 22 08:01:13 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:01:13 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '26139366233306663', 'path': '/dev/sdd'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:01:13 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139366233306663', 'path': '/dev/sdd'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 08:01:13 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:58:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1710778813',display_name='tempest-TestMinimumBasicScenario-server-1710778813',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1710778813',id=19,image_ref='4f886734-5ace-46df-b52c-e3caa804822c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPf9GX11OafuHoT9ofuhjFoeTzRRPmShTAJMsT9i8I5ORMZS0S45M55gXRkwQTzdVnPq3dOA8Rf2U6W4vgKlq0UG1bzKFpjnmYUsgpcIBDzhWNaz3dJyseDrhmQvEX4BQw==',key_name='tempest-TestMinimumBasicScenario-1841491850',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:59:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d76d03d17cc4e5bb52a32a2f8fbd629',ramdisk_id='',reservation_id='r-9lpz0te2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f886734-5ace-46df-b52c-e3caa804822c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1824455706',owner_user_name='tempest-TestMinimumBasicScenario-1824455706-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T08:01:11Z,user_data=None,user_id='cbd1eed03be64a42b8ba9d0200b10692',uuid=a635cbbc-6b87-4877-80a8-bd4001c407c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25edb763-90ad-43e6-98c1-6baf85e723d5", "address": "fa:16:3e:a5:2d:c8", "network": {"id": "442abc57-45e5-4cd7-878e-979afa78c421", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1395369508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d76d03d17cc4e5bb52a32a2f8fbd629", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25edb763-90", "ovs_interfaceid": "25edb763-90ad-43e6-98c1-6baf85e723d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 08:01:13 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Converting VIF {"id": "25edb763-90ad-43e6-98c1-6baf85e723d5", "address": "fa:16:3e:a5:2d:c8", "network": {"id": "442abc57-45e5-4cd7-878e-979afa78c421", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1395369508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d76d03d17cc4e5bb52a32a2f8fbd629", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25edb763-90", "ovs_interfaceid": "25edb763-90ad-43e6-98c1-6baf85e723d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:01:13 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:2d:c8,bridge_name='br-int',has_traffic_filtering=True,id=25edb763-90ad-43e6-98c1-6baf85e723d5,network=Network(442abc57-45e5-4cd7-878e-979afa78c421),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25edb763-90') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:01:13 user nova-compute[74348]: DEBUG nova.objects.instance [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lazy-loading 'pci_devices' on Instance uuid a635cbbc-6b87-4877-80a8-bd4001c407c6 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:01:13 user nova-compute[74348]: DEBUG nova.objects.base [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Object Instance<a635cbbc-6b87-4877-80a8-bd4001c407c6> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:01:13 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] End _get_guest_xml xml=<domain type="kvm">
Nov 22 08:01:13 user nova-compute[74348]:   <uuid>a635cbbc-6b87-4877-80a8-bd4001c407c6</uuid>
Nov 22 08:01:13 user nova-compute[74348]:   <name>instance-00000013</name>
Nov 22 08:01:13 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 08:01:13 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 08:01:13 user nova-compute[74348]:   <metadata>
Nov 22 08:01:13 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 08:01:13 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 08:01:13 user nova-compute[74348]:       <nova:name>tempest-TestMinimumBasicScenario-server-1710778813</nova:name>
Nov 22 08:01:13 user nova-compute[74348]:       <nova:creationTime>2023-11-22 08:01:12</nova:creationTime>
Nov 22 08:01:13 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 08:01:13 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 08:01:13 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 08:01:13 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 08:01:13 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 08:01:13 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 08:01:13 user nova-compute[74348]:       </nova:flavor>
Nov 22 08:01:13 user nova-compute[74348]:       <nova:owner>
Nov 22 08:01:13 user nova-compute[74348]:         <nova:user uuid="cbd1eed03be64a42b8ba9d0200b10692">tempest-TestMinimumBasicScenario-1824455706-project-member</nova:user>
Nov 22 08:01:13 user nova-compute[74348]:         <nova:project uuid="0d76d03d17cc4e5bb52a32a2f8fbd629">tempest-TestMinimumBasicScenario-1824455706</nova:project>
Nov 22 08:01:13 user nova-compute[74348]:       </nova:owner>
Nov 22 08:01:13 user nova-compute[74348]:       <nova:root type="image" uuid="4f886734-5ace-46df-b52c-e3caa804822c"/>
Nov 22 08:01:13 user nova-compute[74348]:       <nova:ports>
Nov 22 08:01:13 user nova-compute[74348]:         <nova:port uuid="25edb763-90ad-43e6-98c1-6baf85e723d5">
Nov 22 08:01:13 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 22 08:01:13 user nova-compute[74348]:         </nova:port>
Nov 22 08:01:13 user nova-compute[74348]:       </nova:ports>
Nov 22 08:01:13 user nova-compute[74348]:     </nova:instance>
Nov 22 08:01:13 user nova-compute[74348]:   </metadata>
Nov 22 08:01:13 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 08:01:13 user nova-compute[74348]:     <system>
Nov 22 08:01:13 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 08:01:13 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 08:01:13 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 08:01:13 user nova-compute[74348]:       <entry name="serial">a635cbbc-6b87-4877-80a8-bd4001c407c6</entry>
Nov 22 08:01:13 user nova-compute[74348]:       <entry name="uuid">a635cbbc-6b87-4877-80a8-bd4001c407c6</entry>
Nov 22 08:01:13 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 08:01:13 user nova-compute[74348]:     </system>
Nov 22 08:01:13 user nova-compute[74348]:   </sysinfo>
Nov 22 08:01:13 user nova-compute[74348]:   <os>
Nov 22 08:01:13 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 08:01:13 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 08:01:13 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 08:01:13 user nova-compute[74348]:   </os>
Nov 22 08:01:13 user nova-compute[74348]:   <features>
Nov 22 08:01:13 user nova-compute[74348]:     <acpi/>
Nov 22 08:01:13 user nova-compute[74348]:     <apic/>
Nov 22 08:01:13 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 08:01:13 user nova-compute[74348]:   </features>
Nov 22 08:01:13 user nova-compute[74348]:   <clock offset="utc">
Nov 22 08:01:13 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 08:01:13 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 08:01:13 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 08:01:13 user nova-compute[74348]:   </clock>
Nov 22 08:01:13 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 08:01:13 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 08:01:13 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 08:01:13 user nova-compute[74348]:   </cpu>
Nov 22 08:01:13 user nova-compute[74348]:   <devices>
Nov 22 08:01:13 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 08:01:13 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 08:01:13 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/a635cbbc-6b87-4877-80a8-bd4001c407c6/disk"/>
Nov 22 08:01:13 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 08:01:13 user nova-compute[74348]:     </disk>
Nov 22 08:01:13 user nova-compute[74348]:     <disk type="block" device="disk">
Nov 22 08:01:13 user nova-compute[74348]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:01:13 user nova-compute[74348]:       <source dev="/dev/sdd"/>
Nov 22 08:01:13 user nova-compute[74348]:       <target dev="vdb" bus="virtio"/>
Nov 22 08:01:13 user nova-compute[74348]:       <serial>12828237-e920-4f6e-bcaf-2b0443407daa</serial>
Nov 22 08:01:13 user nova-compute[74348]:     </disk>
Nov 22 08:01:13 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 08:01:13 user nova-compute[74348]:       <mac address="fa:16:3e:a5:2d:c8"/>
Nov 22 08:01:13 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:01:13 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 08:01:13 user nova-compute[74348]:       <target dev="tap25edb763-90"/>
Nov 22 08:01:13 user nova-compute[74348]:     </interface>
Nov 22 08:01:13 user nova-compute[74348]:     <serial type="pty">
Nov 22 08:01:13 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/a635cbbc-6b87-4877-80a8-bd4001c407c6/console.log" append="off"/>
Nov 22 08:01:13 user nova-compute[74348]:     </serial>
Nov 22 08:01:13 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 08:01:13 user nova-compute[74348]:     <video>
Nov 22 08:01:13 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:01:13 user nova-compute[74348]:     </video>
Nov 22 08:01:13 user nova-compute[74348]:     <rng model="virtio">
Nov 22 08:01:13 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 08:01:13 user nova-compute[74348]:     </rng>
Nov 22 08:01:13 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 08:01:13 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 08:01:13 user nova-compute[74348]:       <stats period="10"/>
Nov 22 08:01:13 user nova-compute[74348]:     </memballoon>
Nov 22 08:01:13 user nova-compute[74348]:   </devices>
Nov 22 08:01:13 user nova-compute[74348]: </domain>
Nov 22 08:01:13 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 08:01:13 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a635cbbc-6b87-4877-80a8-bd4001c407c6/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:13 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a635cbbc-6b87-4877-80a8-bd4001c407c6/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:13 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a635cbbc-6b87-4877-80a8-bd4001c407c6/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:13 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a635cbbc-6b87-4877-80a8-bd4001c407c6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:13 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:01:13 user nova-compute[74348]: DEBUG nova.objects.instance [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lazy-loading 'trusted_certs' on Instance uuid a635cbbc-6b87-4877-80a8-bd4001c407c6 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:01:13 user nova-compute[74348]: DEBUG nova.objects.base [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Object Instance<a635cbbc-6b87-4877-80a8-bd4001c407c6> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:01:13 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7a5e4adbbfeb9a70d9166224120b3b8d8eb4b0b --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:14 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7a5e4adbbfeb9a70d9166224120b3b8d8eb4b0b --force-share --output=json" returned: 0 in 0.206s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:14 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a635cbbc-6b87-4877-80a8-bd4001c407c6/disk. size=1073741824 {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 08:01:14 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a635cbbc-6b87-4877-80a8-bd4001c407c6/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:14 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a635cbbc-6b87-4877-80a8-bd4001c407c6/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:14 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Cannot resize image /opt/stack/data/nova/instances/a635cbbc-6b87-4877-80a8-bd4001c407c6/disk to a smaller size. {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 08:01:14 user nova-compute[74348]: DEBUG nova.objects.instance [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lazy-loading 'migration_context' on Instance uuid a635cbbc-6b87-4877-80a8-bd4001c407c6 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:01:14 user nova-compute[74348]: DEBUG nova.objects.base [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Object Instance<a635cbbc-6b87-4877-80a8-bd4001c407c6> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:01:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:58:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1710778813',display_name='tempest-TestMinimumBasicScenario-server-1710778813',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1710778813',id=19,image_ref='4f886734-5ace-46df-b52c-e3caa804822c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPf9GX11OafuHoT9ofuhjFoeTzRRPmShTAJMsT9i8I5ORMZS0S45M55gXRkwQTzdVnPq3dOA8Rf2U6W4vgKlq0UG1bzKFpjnmYUsgpcIBDzhWNaz3dJyseDrhmQvEX4BQw==',key_name='tempest-TestMinimumBasicScenario-1841491850',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:59:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='0d76d03d17cc4e5bb52a32a2f8fbd629',ramdisk_id='',reservation_id='r-9lpz0te2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f886734-5ace-46df-b52c-e3caa804822c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1824455706',owner_user_name='tempest-TestMinimumBasicScenario-1824455706-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:01:11Z,user_data=None,user_id='cbd1eed03be64a42b8ba9d0200b10692',uuid=a635cbbc-6b87-4877-80a8-bd4001c407c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25edb763-90ad-43e6-98c1-6baf85e723d5", "address": "fa:16:3e:a5:2d:c8", "network": {"id": "442abc57-45e5-4cd7-878e-979afa78c421", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1395369508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d76d03d17cc4e5bb52a32a2f8fbd629", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25edb763-90", "ovs_interfaceid": "25edb763-90ad-43e6-98c1-6baf85e723d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 08:01:14 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Converting VIF {"id": "25edb763-90ad-43e6-98c1-6baf85e723d5", "address": "fa:16:3e:a5:2d:c8", "network": {"id": "442abc57-45e5-4cd7-878e-979afa78c421", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1395369508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d76d03d17cc4e5bb52a32a2f8fbd629", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25edb763-90", "ovs_interfaceid": "25edb763-90ad-43e6-98c1-6baf85e723d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:01:14 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:2d:c8,bridge_name='br-int',has_traffic_filtering=True,id=25edb763-90ad-43e6-98c1-6baf85e723d5,network=Network(442abc57-45e5-4cd7-878e-979afa78c421),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25edb763-90') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:01:14 user nova-compute[74348]: DEBUG os_vif [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:2d:c8,bridge_name='br-int',has_traffic_filtering=True,id=25edb763-90ad-43e6-98c1-6baf85e723d5,network=Network(442abc57-45e5-4cd7-878e-979afa78c421),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25edb763-90') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 08:01:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:01:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 08:01:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '22677d9b-4595-5d29-8e86-11f9820cf040', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:01:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:01:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25edb763-90, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:01:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap25edb763-90, col_values=(('qos', UUID('29961fa7-7d87-4dfb-af3e-5ccbe5fce57e')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:01:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap25edb763-90, col_values=(('external_ids', {'iface-id': '25edb763-90ad-43e6-98c1-6baf85e723d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:2d:c8', 'vm-uuid': 'a635cbbc-6b87-4877-80a8-bd4001c407c6'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:01:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:01:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:14 user nova-compute[74348]: INFO os_vif [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:2d:c8,bridge_name='br-int',has_traffic_filtering=True,id=25edb763-90ad-43e6-98c1-6baf85e723d5,network=Network(442abc57-45e5-4cd7-878e-979afa78c421),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25edb763-90')
Nov 22 08:01:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AbiPLNfe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:01:15 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:01:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:01:15 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:01:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:01:15 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 08:01:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2 -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[da125927-bd16-440a-8d4f-262cfec2592e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 08:01:15 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.035s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[829bdf2e-16a6-4dbd-a824-66b45461e594]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2] added
Nov 22 08:01:15 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c5582b-1613-4b26-bdbd-44a0c7589d2e]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9853c1a1-54b8-46cb-b91b-cb4bb0d43684]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AbiPLNfe {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AbiPLNfe" returned: 0 in 0.035s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6059125-f4e0-4bde-aa5d-3ef4a55dfb7f]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AbiPLNfe'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dec98f5-9ec3-42a3-813f-11e674d2ac34]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d911228-d761-49c8-937a-dc8edb57444e]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 08:01:15 user nova-compute[74348]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:01:15 user nova-compute[74348]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa (non-flash)
Nov 22 08:01:15 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 08:01:15 user nova-compute[74348]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:01:15 user nova-compute[74348]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa (non-flash)
Nov 22 08:01:15 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2 -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b26d6c-3e38-4da5-a6b7-d1276f45c765]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2, portal: 172.16.0.220,3260]
Nov 22 08:01:15 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2, portal: 172.16.0.220,3260] successful.
Nov 22 08:01:15 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d864793c-789e-4151-9e5c-cb982b6bce56]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e1e483-4044-438e-984b-7273e8dbcebd]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 08:01:15 user nova-compute[74348]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:01:15 user nova-compute[74348]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa (non-flash)
Nov 22 08:01:15 user nova-compute[74348]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2 (non-flash)
Nov 22 08:01:15 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 08:01:15 user nova-compute[74348]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:01:15 user nova-compute[74348]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa (non-flash)
Nov 22 08:01:15 user nova-compute[74348]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2 (non-flash)
Nov 22 08:01:15 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac47715-1f57-45ee-b756-c2cfdcc10747]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AbiPLNfe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:16 user nova-compute[74348]: DEBUG nova.compute.manager [req-8817fb64-3e3f-4ed1-b8dc-a588d53199a7 req-661d64a1-2262-40b6-8583-387a5a191dcf service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Received event network-vif-plugged-25edb763-90ad-43e6-98c1-6baf85e723d5 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:01:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-8817fb64-3e3f-4ed1-b8dc-a588d53199a7 req-661d64a1-2262-40b6-8583-387a5a191dcf service nova] Acquiring lock "a635cbbc-6b87-4877-80a8-bd4001c407c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:01:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-8817fb64-3e3f-4ed1-b8dc-a588d53199a7 req-661d64a1-2262-40b6-8583-387a5a191dcf service nova] Lock "a635cbbc-6b87-4877-80a8-bd4001c407c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:01:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-8817fb64-3e3f-4ed1-b8dc-a588d53199a7 req-661d64a1-2262-40b6-8583-387a5a191dcf service nova] Lock "a635cbbc-6b87-4877-80a8-bd4001c407c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:01:16 user nova-compute[74348]: DEBUG nova.compute.manager [req-8817fb64-3e3f-4ed1-b8dc-a588d53199a7 req-661d64a1-2262-40b6-8583-387a5a191dcf service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] No waiting events found dispatching network-vif-plugged-25edb763-90ad-43e6-98c1-6baf85e723d5 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:01:16 user nova-compute[74348]: WARNING nova.compute.manager [req-8817fb64-3e3f-4ed1-b8dc-a588d53199a7 req-661d64a1-2262-40b6-8583-387a5a191dcf service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Received unexpected event network-vif-plugged-25edb763-90ad-43e6-98c1-6baf85e723d5 for instance with vm_state active and task_state reboot_started_hard.
Nov 22 08:01:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.418s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:01:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] <== connect_volume: return (1421ms) {'type': 'block', 'scsi_wwn': '23431383537316339', 'path': '/dev/sde'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:01:16 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431383537316339', 'path': '/dev/sde'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 08:01:16 user nova-compute[74348]: DEBUG nova.objects.instance [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lazy-loading 'flavor' on Instance uuid 2eaecc2f-f6fe-4171-b445-55c3a2d33760 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:01:16 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 08:01:16 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:01:16 user nova-compute[74348]:   <source dev="/dev/sde"/>
Nov 22 08:01:16 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:01:16 user nova-compute[74348]:   <serial>60beede2-e7bf-4c48-bd23-f4b27780f6f2</serial>
Nov 22 08:01:16 user nova-compute[74348]: </disk>
Nov 22 08:01:16 user nova-compute[74348]:  {{(pid=74348) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 08:01:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:17 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:01:17 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:01:17 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] No VIF found with MAC fa:16:3e:83:76:22, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:01:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9fb4306c-4b65-4235-8e46-ec2a5f0715f3 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "2eaecc2f-f6fe-4171-b445-55c3a2d33760" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.646s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:01:18 user nova-compute[74348]: DEBUG nova.compute.manager [req-1b047c44-f188-4f2f-85a9-f9bf45a650f3 req-b717c185-bbdf-4542-b64d-eabdf9d25c44 service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Received event network-vif-plugged-25edb763-90ad-43e6-98c1-6baf85e723d5 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:01:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-1b047c44-f188-4f2f-85a9-f9bf45a650f3 req-b717c185-bbdf-4542-b64d-eabdf9d25c44 service nova] Acquiring lock "a635cbbc-6b87-4877-80a8-bd4001c407c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:01:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-1b047c44-f188-4f2f-85a9-f9bf45a650f3 req-b717c185-bbdf-4542-b64d-eabdf9d25c44 service nova] Lock "a635cbbc-6b87-4877-80a8-bd4001c407c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:01:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-1b047c44-f188-4f2f-85a9-f9bf45a650f3 req-b717c185-bbdf-4542-b64d-eabdf9d25c44 service nova] Lock "a635cbbc-6b87-4877-80a8-bd4001c407c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:01:18 user nova-compute[74348]: DEBUG nova.compute.manager [req-1b047c44-f188-4f2f-85a9-f9bf45a650f3 req-b717c185-bbdf-4542-b64d-eabdf9d25c44 service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] No waiting events found dispatching network-vif-plugged-25edb763-90ad-43e6-98c1-6baf85e723d5 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:01:18 user nova-compute[74348]: WARNING nova.compute.manager [req-1b047c44-f188-4f2f-85a9-f9bf45a650f3 req-b717c185-bbdf-4542-b64d-eabdf9d25c44 service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Received unexpected event network-vif-plugged-25edb763-90ad-43e6-98c1-6baf85e723d5 for instance with vm_state active and task_state reboot_started_hard.
Nov 22 08:01:18 user nova-compute[74348]: DEBUG nova.compute.manager [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 08:01:18 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Instance rebooted successfully.
Nov 22 08:01:18 user nova-compute[74348]: DEBUG nova.compute.manager [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:01:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8d34b892-ace9-46e5-8893-964a430d85b5 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "2eaecc2f-f6fe-4171-b445-55c3a2d33760" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:01:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8d34b892-ace9-46e5-8893-964a430d85b5 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "2eaecc2f-f6fe-4171-b445-55c3a2d33760" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:01:18 user nova-compute[74348]: INFO nova.compute.manager [None req-8d34b892-ace9-46e5-8893-964a430d85b5 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Detaching volume 60beede2-e7bf-4c48-bd23-f4b27780f6f2
Nov 22 08:01:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8a9bf2e5-be37-460d-abd7-e8f208203764 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "a635cbbc-6b87-4877-80a8-bd4001c407c6" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.764s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:01:18 user nova-compute[74348]: INFO nova.virt.block_device [None req-8d34b892-ace9-46e5-8893-964a430d85b5 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Attempting to driver detach volume 60beede2-e7bf-4c48-bd23-f4b27780f6f2 from mountpoint /dev/vdb
Nov 22 08:01:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8d34b892-ace9-46e5-8893-964a430d85b5 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Attempting to detach device vdb from instance 2eaecc2f-f6fe-4171-b445-55c3a2d33760 from the persistent domain config. {{(pid=74348) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 08:01:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-8d34b892-ace9-46e5-8893-964a430d85b5 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:01:18 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:01:18 user nova-compute[74348]:   <source dev="/dev/sde"/>
Nov 22 08:01:18 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:01:18 user nova-compute[74348]:   <serial>60beede2-e7bf-4c48-bd23-f4b27780f6f2</serial>
Nov 22 08:01:18 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 08:01:18 user nova-compute[74348]: </disk>
Nov 22 08:01:18 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:01:18 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-8d34b892-ace9-46e5-8893-964a430d85b5 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Successfully detached device vdb from instance 2eaecc2f-f6fe-4171-b445-55c3a2d33760 from the persistent domain config.
Nov 22 08:01:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8d34b892-ace9-46e5-8893-964a430d85b5 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2eaecc2f-f6fe-4171-b445-55c3a2d33760 from the live domain config. {{(pid=74348) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 08:01:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-8d34b892-ace9-46e5-8893-964a430d85b5 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:01:18 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:01:18 user nova-compute[74348]:   <source dev="/dev/sde"/>
Nov 22 08:01:18 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:01:18 user nova-compute[74348]:   <serial>60beede2-e7bf-4c48-bd23-f4b27780f6f2</serial>
Nov 22 08:01:18 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 08:01:18 user nova-compute[74348]: </disk>
Nov 22 08:01:18 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:01:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:19 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8d34b892-ace9-46e5-8893-964a430d85b5 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2eaecc2f-f6fe-4171-b445-55c3a2d33760 {{(pid=74348) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 08:01:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b8b80fa9-2ccc-445e-acbc-e057b2616b4a tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Acquiring lock "059bde4a-c5c9-45ab-9b4a-c969c74a6083" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:01:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b8b80fa9-2ccc-445e-acbc-e057b2616b4a tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Lock "059bde4a-c5c9-45ab-9b4a-c969c74a6083" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:01:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b8b80fa9-2ccc-445e-acbc-e057b2616b4a tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Acquiring lock "059bde4a-c5c9-45ab-9b4a-c969c74a6083-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:01:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b8b80fa9-2ccc-445e-acbc-e057b2616b4a tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Lock "059bde4a-c5c9-45ab-9b4a-c969c74a6083-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:01:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b8b80fa9-2ccc-445e-acbc-e057b2616b4a tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Lock "059bde4a-c5c9-45ab-9b4a-c969c74a6083-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:01:24 user nova-compute[74348]: INFO nova.compute.manager [None req-b8b80fa9-2ccc-445e-acbc-e057b2616b4a tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Terminating instance
Nov 22 08:01:24 user nova-compute[74348]: DEBUG nova.compute.manager [None req-b8b80fa9-2ccc-445e-acbc-e057b2616b4a tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 08:01:24 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:24 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:24 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:24 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:24 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:24 user nova-compute[74348]: DEBUG nova.compute.manager [req-e4a49449-f2e2-4bfe-b79a-57f6d2f158fc req-261a218f-79c8-4c34-ab96-0b9a62ee5a27 service nova] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Received event network-vif-unplugged-06aa6370-ccfd-4a76-86ca-7bbfad795beb {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:01:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e4a49449-f2e2-4bfe-b79a-57f6d2f158fc req-261a218f-79c8-4c34-ab96-0b9a62ee5a27 service nova] Acquiring lock "059bde4a-c5c9-45ab-9b4a-c969c74a6083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:01:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e4a49449-f2e2-4bfe-b79a-57f6d2f158fc req-261a218f-79c8-4c34-ab96-0b9a62ee5a27 service nova] Lock "059bde4a-c5c9-45ab-9b4a-c969c74a6083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:01:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e4a49449-f2e2-4bfe-b79a-57f6d2f158fc req-261a218f-79c8-4c34-ab96-0b9a62ee5a27 service nova] Lock "059bde4a-c5c9-45ab-9b4a-c969c74a6083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:01:24 user nova-compute[74348]: DEBUG nova.compute.manager [req-e4a49449-f2e2-4bfe-b79a-57f6d2f158fc req-261a218f-79c8-4c34-ab96-0b9a62ee5a27 service nova] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] No waiting events found dispatching network-vif-unplugged-06aa6370-ccfd-4a76-86ca-7bbfad795beb {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:01:24 user nova-compute[74348]: DEBUG nova.compute.manager [req-e4a49449-f2e2-4bfe-b79a-57f6d2f158fc req-261a218f-79c8-4c34-ab96-0b9a62ee5a27 service nova] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Received event network-vif-unplugged-06aa6370-ccfd-4a76-86ca-7bbfad795beb for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 08:01:24 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Instance destroyed successfully.
Nov 22 08:01:24 user nova-compute[74348]: DEBUG nova.objects.instance [None req-b8b80fa9-2ccc-445e-acbc-e057b2616b4a tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Lazy-loading 'resources' on Instance uuid 059bde4a-c5c9-45ab-9b4a-c969c74a6083 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:01:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-b8b80fa9-2ccc-445e-acbc-e057b2616b4a tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:52:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1797427382',display_name='tempest-ServersNegativeTestJSON-server-1797427382',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1797427382',id=1,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:52:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dee2e6be4a484d32bac3fda2043aa23d',ramdisk_id='',reservation_id='r-bj5rcocz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1255640261',owner_user_name='tempest-ServersNegativeTestJSON-1255640261-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T07:52:53Z,user_data=None,user_id='8d2925596cad453baed756b931a54586',uuid=059bde4a-c5c9-45ab-9b4a-c969c74a6083,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06aa6370-ccfd-4a76-86ca-7bbfad795beb", "address": "fa:16:3e:0d:49:2d", "network": {"id": "7f692ef6-9a86-4aba-a055-8877d70394ba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1993883418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee2e6be4a484d32bac3fda2043aa23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06aa6370-cc", "ovs_interfaceid": "06aa6370-ccfd-4a76-86ca-7bbfad795beb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:01:24 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-b8b80fa9-2ccc-445e-acbc-e057b2616b4a tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Converting VIF {"id": "06aa6370-ccfd-4a76-86ca-7bbfad795beb", "address": "fa:16:3e:0d:49:2d", "network": {"id": "7f692ef6-9a86-4aba-a055-8877d70394ba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1993883418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee2e6be4a484d32bac3fda2043aa23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06aa6370-cc", "ovs_interfaceid": "06aa6370-ccfd-4a76-86ca-7bbfad795beb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:01:24 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-b8b80fa9-2ccc-445e-acbc-e057b2616b4a tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:49:2d,bridge_name='br-int',has_traffic_filtering=True,id=06aa6370-ccfd-4a76-86ca-7bbfad795beb,network=Network(7f692ef6-9a86-4aba-a055-8877d70394ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06aa6370-cc') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:01:24 user nova-compute[74348]: DEBUG os_vif [None req-b8b80fa9-2ccc-445e-acbc-e057b2616b4a tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:49:2d,bridge_name='br-int',has_traffic_filtering=True,id=06aa6370-ccfd-4a76-86ca-7bbfad795beb,network=Network(7f692ef6-9a86-4aba-a055-8877d70394ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06aa6370-cc') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:01:24 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:24 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap06aa6370-cc, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:01:24 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:01:24 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:24 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=27d7ce62-e503-4fcf-a684-cae293b19664) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:01:24 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:01:25 user nova-compute[74348]: INFO os_vif [None req-b8b80fa9-2ccc-445e-acbc-e057b2616b4a tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:49:2d,bridge_name='br-int',has_traffic_filtering=True,id=06aa6370-ccfd-4a76-86ca-7bbfad795beb,network=Network(7f692ef6-9a86-4aba-a055-8877d70394ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06aa6370-cc')
Nov 22 08:01:25 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-b8b80fa9-2ccc-445e-acbc-e057b2616b4a tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Deleting instance files /opt/stack/data/nova/instances/059bde4a-c5c9-45ab-9b4a-c969c74a6083_del
Nov 22 08:01:25 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-b8b80fa9-2ccc-445e-acbc-e057b2616b4a tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Deletion of /opt/stack/data/nova/instances/059bde4a-c5c9-45ab-9b4a-c969c74a6083_del complete
Nov 22 08:01:25 user nova-compute[74348]: INFO nova.compute.manager [None req-b8b80fa9-2ccc-445e-acbc-e057b2616b4a tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 22 08:01:25 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-b8b80fa9-2ccc-445e-acbc-e057b2616b4a tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 08:01:25 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 08:01:25 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 08:01:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:25 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:01:25 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Took 0.77 seconds to deallocate network for instance.
Nov 22 08:01:25 user nova-compute[74348]: DEBUG nova.compute.manager [req-9b1f5c8b-1169-418e-ac3c-ba4441c448d7 req-cee64628-a175-4eca-8c23-615b20e0502d service nova] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Received event network-vif-deleted-06aa6370-ccfd-4a76-86ca-7bbfad795beb {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:01:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b8b80fa9-2ccc-445e-acbc-e057b2616b4a tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:01:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b8b80fa9-2ccc-445e-acbc-e057b2616b4a tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:01:26 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-b8b80fa9-2ccc-445e-acbc-e057b2616b4a tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:01:26 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-b8b80fa9-2ccc-445e-acbc-e057b2616b4a tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:01:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b8b80fa9-2ccc-445e-acbc-e057b2616b4a tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.502s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:01:26 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-b8b80fa9-2ccc-445e-acbc-e057b2616b4a tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Deleted allocations for instance 059bde4a-c5c9-45ab-9b4a-c969c74a6083
Nov 22 08:01:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b8b80fa9-2ccc-445e-acbc-e057b2616b4a tempest-ServersNegativeTestJSON-1255640261 tempest-ServersNegativeTestJSON-1255640261-project-member] Lock "059bde4a-c5c9-45ab-9b4a-c969c74a6083" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.479s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:01:26 user nova-compute[74348]: DEBUG nova.compute.manager [req-8108a37e-9973-4c74-944e-14da29b46a59 req-b9d51d60-b225-4a7e-9b5c-eaa7266e0b7c service nova] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Received event network-vif-plugged-06aa6370-ccfd-4a76-86ca-7bbfad795beb {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:01:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-8108a37e-9973-4c74-944e-14da29b46a59 req-b9d51d60-b225-4a7e-9b5c-eaa7266e0b7c service nova] Acquiring lock "059bde4a-c5c9-45ab-9b4a-c969c74a6083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:01:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-8108a37e-9973-4c74-944e-14da29b46a59 req-b9d51d60-b225-4a7e-9b5c-eaa7266e0b7c service nova] Lock "059bde4a-c5c9-45ab-9b4a-c969c74a6083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:01:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-8108a37e-9973-4c74-944e-14da29b46a59 req-b9d51d60-b225-4a7e-9b5c-eaa7266e0b7c service nova] Lock "059bde4a-c5c9-45ab-9b4a-c969c74a6083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:01:26 user nova-compute[74348]: DEBUG nova.compute.manager [req-8108a37e-9973-4c74-944e-14da29b46a59 req-b9d51d60-b225-4a7e-9b5c-eaa7266e0b7c service nova] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] No waiting events found dispatching network-vif-plugged-06aa6370-ccfd-4a76-86ca-7bbfad795beb {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:01:26 user nova-compute[74348]: WARNING nova.compute.manager [req-8108a37e-9973-4c74-944e-14da29b46a59 req-b9d51d60-b225-4a7e-9b5c-eaa7266e0b7c service nova] [instance: 059bde4a-c5c9-45ab-9b4a-c969c74a6083] Received unexpected event network-vif-plugged-06aa6370-ccfd-4a76-86ca-7bbfad795beb for instance with vm_state deleted and task_state None.
Nov 22 08:01:26 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "5006cff5-4b67-405d-b6b1-4c355f82d920" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:01:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "5006cff5-4b67-405d-b6b1-4c355f82d920" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:01:28 user nova-compute[74348]: DEBUG nova.compute.manager [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 08:01:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:01:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:01:28 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 08:01:28 user nova-compute[74348]: INFO nova.compute.claims [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Claim successful on node user
Nov 22 08:01:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:29 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:01:29 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:01:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.674s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:01:29 user nova-compute[74348]: DEBUG nova.compute.manager [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 08:01:29 user nova-compute[74348]: DEBUG nova.compute.manager [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 08:01:29 user nova-compute[74348]: DEBUG nova.network.neutron [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 08:01:29 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 08:01:29 user nova-compute[74348]: DEBUG nova.compute.manager [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 08:01:29 user nova-compute[74348]: DEBUG nova.policy [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '43550ccf30be49aba6ed6de2caf9ae1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62fda81543f461288e324458620d07c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 08:01:29 user nova-compute[74348]: DEBUG nova.compute.manager [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 08:01:29 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 08:01:29 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Creating image(s)
Nov 22 08:01:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "/opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:01:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "/opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:01:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "/opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:01:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.187s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:01:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:01:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.185s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk 1073741824" returned: 0 in 0.056s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:01:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.209s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:30 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk. size=1073741824 {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 08:01:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:30 user nova-compute[74348]: DEBUG nova.network.neutron [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Successfully created port: db42bd08-8f0c-4e24-82c6-579bed0476bf {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 08:01:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:30 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Cannot resize image /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk to a smaller size. {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 08:01:30 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 08:01:30 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Ensure instance console log exists: /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 08:01:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:01:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:01:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:01:30 user nova-compute[74348]: DEBUG nova.network.neutron [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Successfully updated port: db42bd08-8f0c-4e24-82c6-579bed0476bf {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "refresh_cache-5006cff5-4b67-405d-b6b1-4c355f82d920" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquired lock "refresh_cache-5006cff5-4b67-405d-b6b1-4c355f82d920" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG nova.network.neutron [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG nova.compute.manager [req-713ae59c-0a6e-46ed-be98-5b12ec266f95 req-a9d6cdde-2932-4fa0-b3ac-d9c5ef3838fb service nova] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Received event network-changed-db42bd08-8f0c-4e24-82c6-579bed0476bf {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG nova.compute.manager [req-713ae59c-0a6e-46ed-be98-5b12ec266f95 req-a9d6cdde-2932-4fa0-b3ac-d9c5ef3838fb service nova] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Refreshing instance network info cache due to event network-changed-db42bd08-8f0c-4e24-82c6-579bed0476bf. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-713ae59c-0a6e-46ed-be98-5b12ec266f95 req-a9d6cdde-2932-4fa0-b3ac-d9c5ef3838fb service nova] Acquiring lock "refresh_cache-5006cff5-4b67-405d-b6b1-4c355f82d920" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG nova.network.neutron [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG nova.network.neutron [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Updating instance_info_cache with network_info: [{"id": "db42bd08-8f0c-4e24-82c6-579bed0476bf", "address": "fa:16:3e:4e:f8:01", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb42bd08-8f", "ovs_interfaceid": "db42bd08-8f0c-4e24-82c6-579bed0476bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Releasing lock "refresh_cache-5006cff5-4b67-405d-b6b1-4c355f82d920" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG nova.compute.manager [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Instance network_info: |[{"id": "db42bd08-8f0c-4e24-82c6-579bed0476bf", "address": "fa:16:3e:4e:f8:01", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb42bd08-8f", "ovs_interfaceid": "db42bd08-8f0c-4e24-82c6-579bed0476bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-713ae59c-0a6e-46ed-be98-5b12ec266f95 req-a9d6cdde-2932-4fa0-b3ac-d9c5ef3838fb service nova] Acquired lock "refresh_cache-5006cff5-4b67-405d-b6b1-4c355f82d920" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG nova.network.neutron [req-713ae59c-0a6e-46ed-be98-5b12ec266f95 req-a9d6cdde-2932-4fa0-b3ac-d9c5ef3838fb service nova] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Refreshing network info cache for port db42bd08-8f0c-4e24-82c6-579bed0476bf {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Start _get_guest_xml network_info=[{"id": "db42bd08-8f0c-4e24-82c6-579bed0476bf", "address": "fa:16:3e:4e:f8:01", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb42bd08-8f", "ovs_interfaceid": "db42bd08-8f0c-4e24-82c6-579bed0476bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 08:01:31 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:01:31 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:01:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:01:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1936742078',display_name='tempest-ServerActionsTestOtherA-server-1936742078',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1936742078',id=26,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOnwiyyOG0pLFwcj345c4IzhM/kyBtQaUAH7E3RkvN6illtA9ZAkzh5oMECX0856YNQ2Mjloaz2SuvdsQL10sz9Itf7PAs6pZTbAEN/oI0ibl2evR0cUOwfMcOEuxLp2g==',key_name='tempest-keypair-1143468972',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d62fda81543f461288e324458620d07c',ramdisk_id='',reservation_id='r-o4samxtn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-90817446',owner_user_name='tempest-ServerActionsTestOtherA-90817446-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:01:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43550ccf30be49aba6ed6de2caf9ae1e',uuid=5006cff5-4b67-405d-b6b1-4c355f82d920,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db42bd08-8f0c-4e24-82c6-579bed0476bf", "address": "fa:16:3e:4e:f8:01", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb42bd08-8f", "ovs_interfaceid": "db42bd08-8f0c-4e24-82c6-579bed0476bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Converting VIF {"id": "db42bd08-8f0c-4e24-82c6-579bed0476bf", "address": "fa:16:3e:4e:f8:01", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb42bd08-8f", "ovs_interfaceid": "db42bd08-8f0c-4e24-82c6-579bed0476bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:f8:01,bridge_name='br-int',has_traffic_filtering=True,id=db42bd08-8f0c-4e24-82c6-579bed0476bf,network=Network(9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb42bd08-8f') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG nova.objects.instance [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lazy-loading 'pci_devices' on Instance uuid 5006cff5-4b67-405d-b6b1-4c355f82d920 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] End _get_guest_xml xml=<domain type="kvm">
Nov 22 08:01:31 user nova-compute[74348]:   <uuid>5006cff5-4b67-405d-b6b1-4c355f82d920</uuid>
Nov 22 08:01:31 user nova-compute[74348]:   <name>instance-0000001a</name>
Nov 22 08:01:31 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 08:01:31 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 08:01:31 user nova-compute[74348]:   <metadata>
Nov 22 08:01:31 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 08:01:31 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 08:01:31 user nova-compute[74348]:       <nova:name>tempest-ServerActionsTestOtherA-server-1936742078</nova:name>
Nov 22 08:01:31 user nova-compute[74348]:       <nova:creationTime>2023-11-22 08:01:31</nova:creationTime>
Nov 22 08:01:31 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 08:01:31 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 08:01:31 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 08:01:31 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 08:01:31 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 08:01:31 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 08:01:31 user nova-compute[74348]:       </nova:flavor>
Nov 22 08:01:31 user nova-compute[74348]:       <nova:owner>
Nov 22 08:01:31 user nova-compute[74348]:         <nova:user uuid="43550ccf30be49aba6ed6de2caf9ae1e">tempest-ServerActionsTestOtherA-90817446-project-member</nova:user>
Nov 22 08:01:31 user nova-compute[74348]:         <nova:project uuid="d62fda81543f461288e324458620d07c">tempest-ServerActionsTestOtherA-90817446</nova:project>
Nov 22 08:01:31 user nova-compute[74348]:       </nova:owner>
Nov 22 08:01:31 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 08:01:31 user nova-compute[74348]:       <nova:ports>
Nov 22 08:01:31 user nova-compute[74348]:         <nova:port uuid="db42bd08-8f0c-4e24-82c6-579bed0476bf">
Nov 22 08:01:31 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 22 08:01:31 user nova-compute[74348]:         </nova:port>
Nov 22 08:01:31 user nova-compute[74348]:       </nova:ports>
Nov 22 08:01:31 user nova-compute[74348]:     </nova:instance>
Nov 22 08:01:31 user nova-compute[74348]:   </metadata>
Nov 22 08:01:31 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 08:01:31 user nova-compute[74348]:     <system>
Nov 22 08:01:31 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 08:01:31 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 08:01:31 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 08:01:31 user nova-compute[74348]:       <entry name="serial">5006cff5-4b67-405d-b6b1-4c355f82d920</entry>
Nov 22 08:01:31 user nova-compute[74348]:       <entry name="uuid">5006cff5-4b67-405d-b6b1-4c355f82d920</entry>
Nov 22 08:01:31 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 08:01:31 user nova-compute[74348]:     </system>
Nov 22 08:01:31 user nova-compute[74348]:   </sysinfo>
Nov 22 08:01:31 user nova-compute[74348]:   <os>
Nov 22 08:01:31 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 08:01:31 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 08:01:31 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 08:01:31 user nova-compute[74348]:   </os>
Nov 22 08:01:31 user nova-compute[74348]:   <features>
Nov 22 08:01:31 user nova-compute[74348]:     <acpi/>
Nov 22 08:01:31 user nova-compute[74348]:     <apic/>
Nov 22 08:01:31 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 08:01:31 user nova-compute[74348]:   </features>
Nov 22 08:01:31 user nova-compute[74348]:   <clock offset="utc">
Nov 22 08:01:31 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 08:01:31 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 08:01:31 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 08:01:31 user nova-compute[74348]:   </clock>
Nov 22 08:01:31 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 08:01:31 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 08:01:31 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 08:01:31 user nova-compute[74348]:   </cpu>
Nov 22 08:01:31 user nova-compute[74348]:   <devices>
Nov 22 08:01:31 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 08:01:31 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 08:01:31 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk"/>
Nov 22 08:01:31 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 08:01:31 user nova-compute[74348]:     </disk>
Nov 22 08:01:31 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 08:01:31 user nova-compute[74348]:       <mac address="fa:16:3e:4e:f8:01"/>
Nov 22 08:01:31 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:01:31 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 08:01:31 user nova-compute[74348]:       <target dev="tapdb42bd08-8f"/>
Nov 22 08:01:31 user nova-compute[74348]:     </interface>
Nov 22 08:01:31 user nova-compute[74348]:     <serial type="pty">
Nov 22 08:01:31 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/console.log" append="off"/>
Nov 22 08:01:31 user nova-compute[74348]:     </serial>
Nov 22 08:01:31 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 08:01:31 user nova-compute[74348]:     <video>
Nov 22 08:01:31 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:01:31 user nova-compute[74348]:     </video>
Nov 22 08:01:31 user nova-compute[74348]:     <rng model="virtio">
Nov 22 08:01:31 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 08:01:31 user nova-compute[74348]:     </rng>
Nov 22 08:01:31 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 08:01:31 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 08:01:31 user nova-compute[74348]:       <stats period="10"/>
Nov 22 08:01:31 user nova-compute[74348]:     </memballoon>
Nov 22 08:01:31 user nova-compute[74348]:   </devices>
Nov 22 08:01:31 user nova-compute[74348]: </domain>
Nov 22 08:01:31 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:01:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1936742078',display_name='tempest-ServerActionsTestOtherA-server-1936742078',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1936742078',id=26,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOnwiyyOG0pLFwcj345c4IzhM/kyBtQaUAH7E3RkvN6illtA9ZAkzh5oMECX0856YNQ2Mjloaz2SuvdsQL10sz9Itf7PAs6pZTbAEN/oI0ibl2evR0cUOwfMcOEuxLp2g==',key_name='tempest-keypair-1143468972',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d62fda81543f461288e324458620d07c',ramdisk_id='',reservation_id='r-o4samxtn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-90817446',owner_user_name='tempest-ServerActionsTestOtherA-90817446-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:01:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43550ccf30be49aba6ed6de2caf9ae1e',uuid=5006cff5-4b67-405d-b6b1-4c355f82d920,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db42bd08-8f0c-4e24-82c6-579bed0476bf", "address": "fa:16:3e:4e:f8:01", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb42bd08-8f", "ovs_interfaceid": "db42bd08-8f0c-4e24-82c6-579bed0476bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Converting VIF {"id": "db42bd08-8f0c-4e24-82c6-579bed0476bf", "address": "fa:16:3e:4e:f8:01", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb42bd08-8f", "ovs_interfaceid": "db42bd08-8f0c-4e24-82c6-579bed0476bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:f8:01,bridge_name='br-int',has_traffic_filtering=True,id=db42bd08-8f0c-4e24-82c6-579bed0476bf,network=Network(9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb42bd08-8f') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG os_vif [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:f8:01,bridge_name='br-int',has_traffic_filtering=True,id=db42bd08-8f0c-4e24-82c6-579bed0476bf,network=Network(9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb42bd08-8f') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0549983c-f5ba-5eb8-8337-12eba7082dd2', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb42bd08-8f, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdb42bd08-8f, col_values=(('qos', UUID('f1c13b6f-9e67-4d9e-be07-89ae10640526')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdb42bd08-8f, col_values=(('external_ids', {'iface-id': 'db42bd08-8f0c-4e24-82c6-579bed0476bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:f8:01', 'vm-uuid': '5006cff5-4b67-405d-b6b1-4c355f82d920'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:31 user nova-compute[74348]: INFO os_vif [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:f8:01,bridge_name='br-int',has_traffic_filtering=True,id=db42bd08-8f0c-4e24-82c6-579bed0476bf,network=Network(9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb42bd08-8f')
Nov 22 08:01:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] No VIF found with MAC fa:16:3e:4e:f8:01, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG nova.network.neutron [req-713ae59c-0a6e-46ed-be98-5b12ec266f95 req-a9d6cdde-2932-4fa0-b3ac-d9c5ef3838fb service nova] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Updated VIF entry in instance network info cache for port db42bd08-8f0c-4e24-82c6-579bed0476bf. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG nova.network.neutron [req-713ae59c-0a6e-46ed-be98-5b12ec266f95 req-a9d6cdde-2932-4fa0-b3ac-d9c5ef3838fb service nova] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Updating instance_info_cache with network_info: [{"id": "db42bd08-8f0c-4e24-82c6-579bed0476bf", "address": "fa:16:3e:4e:f8:01", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb42bd08-8f", "ovs_interfaceid": "db42bd08-8f0c-4e24-82c6-579bed0476bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:01:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-713ae59c-0a6e-46ed-be98-5b12ec266f95 req-a9d6cdde-2932-4fa0-b3ac-d9c5ef3838fb service nova] Releasing lock "refresh_cache-5006cff5-4b67-405d-b6b1-4c355f82d920" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:01:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:33 user nova-compute[74348]: DEBUG nova.compute.manager [req-5ba7e6f0-f592-4834-8b5e-587eea5ddf0f req-b7d60930-efc9-4c22-812e-72b11f86b087 service nova] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Received event network-vif-plugged-db42bd08-8f0c-4e24-82c6-579bed0476bf {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:01:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-5ba7e6f0-f592-4834-8b5e-587eea5ddf0f req-b7d60930-efc9-4c22-812e-72b11f86b087 service nova] Acquiring lock "5006cff5-4b67-405d-b6b1-4c355f82d920-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:01:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-5ba7e6f0-f592-4834-8b5e-587eea5ddf0f req-b7d60930-efc9-4c22-812e-72b11f86b087 service nova] Lock "5006cff5-4b67-405d-b6b1-4c355f82d920-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:01:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-5ba7e6f0-f592-4834-8b5e-587eea5ddf0f req-b7d60930-efc9-4c22-812e-72b11f86b087 service nova] Lock "5006cff5-4b67-405d-b6b1-4c355f82d920-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:01:33 user nova-compute[74348]: DEBUG nova.compute.manager [req-5ba7e6f0-f592-4834-8b5e-587eea5ddf0f req-b7d60930-efc9-4c22-812e-72b11f86b087 service nova] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] No waiting events found dispatching network-vif-plugged-db42bd08-8f0c-4e24-82c6-579bed0476bf {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:01:33 user nova-compute[74348]: WARNING nova.compute.manager [req-5ba7e6f0-f592-4834-8b5e-587eea5ddf0f req-b7d60930-efc9-4c22-812e-72b11f86b087 service nova] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Received unexpected event network-vif-plugged-db42bd08-8f0c-4e24-82c6-579bed0476bf for instance with vm_state building and task_state spawning.
Nov 22 08:01:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:33 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:01:33 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:01:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-9c36455f-5fd6-4813-9c44-499e3742ed39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:01:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-9c36455f-5fd6-4813-9c44-499e3742ed39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:01:33 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 08:01:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:34 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Updating instance_info_cache with network_info: [{"id": "e8c429ee-f5b4-4cf5-935c-5d4631b369e3", "address": "fa:16:3e:87:e1:4c", "network": {"id": "c405fff5-285f-47eb-8bae-867c6393edf2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-368785799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8780c23b60e4abe85276f2d71c591b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c429ee-f5", "ovs_interfaceid": "e8c429ee-f5b4-4cf5-935c-5d4631b369e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:01:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-9c36455f-5fd6-4813-9c44-499e3742ed39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:01:34 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 08:01:34 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:01:34 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:01:35 user nova-compute[74348]: DEBUG nova.compute.manager [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 08:01:35 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 08:01:35 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Instance spawned successfully.
Nov 22 08:01:35 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 08:01:35 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:01:35 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:01:35 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:01:35 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:01:35 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:01:35 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:01:35 user nova-compute[74348]: INFO nova.compute.manager [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Took 5.59 seconds to spawn the instance on the hypervisor.
Nov 22 08:01:35 user nova-compute[74348]: DEBUG nova.compute.manager [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:01:35 user nova-compute[74348]: DEBUG nova.compute.manager [req-0c05a0cf-c643-463d-b91f-784cda52085a req-32f23c3c-d588-48ce-8b40-54717bf4582e service nova] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Received event network-vif-plugged-db42bd08-8f0c-4e24-82c6-579bed0476bf {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:01:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-0c05a0cf-c643-463d-b91f-784cda52085a req-32f23c3c-d588-48ce-8b40-54717bf4582e service nova] Acquiring lock "5006cff5-4b67-405d-b6b1-4c355f82d920-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:01:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-0c05a0cf-c643-463d-b91f-784cda52085a req-32f23c3c-d588-48ce-8b40-54717bf4582e service nova] Lock "5006cff5-4b67-405d-b6b1-4c355f82d920-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:01:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-0c05a0cf-c643-463d-b91f-784cda52085a req-32f23c3c-d588-48ce-8b40-54717bf4582e service nova] Lock "5006cff5-4b67-405d-b6b1-4c355f82d920-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:01:35 user nova-compute[74348]: DEBUG nova.compute.manager [req-0c05a0cf-c643-463d-b91f-784cda52085a req-32f23c3c-d588-48ce-8b40-54717bf4582e service nova] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] No waiting events found dispatching network-vif-plugged-db42bd08-8f0c-4e24-82c6-579bed0476bf {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:01:35 user nova-compute[74348]: WARNING nova.compute.manager [req-0c05a0cf-c643-463d-b91f-784cda52085a req-32f23c3c-d588-48ce-8b40-54717bf4582e service nova] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Received unexpected event network-vif-plugged-db42bd08-8f0c-4e24-82c6-579bed0476bf for instance with vm_state building and task_state spawning.
Nov 22 08:01:35 user nova-compute[74348]: INFO nova.compute.manager [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Took 6.60 seconds to build instance.
Nov 22 08:01:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-0405a14c-2900-4c0d-b21a-1a92f9072b41 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "5006cff5-4b67-405d-b6b1-4c355f82d920" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.692s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:01:35 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:01:35 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:01:35 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:01:35 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:01:35 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:01:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Acquiring lock "e36789b1-45e6-40f7-ba97-8962cb116a39" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:01:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lock "e36789b1-45e6-40f7-ba97-8962cb116a39" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:01:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Acquiring lock "e36789b1-45e6-40f7-ba97-8962cb116a39-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:01:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lock "e36789b1-45e6-40f7-ba97-8962cb116a39-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:01:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lock "e36789b1-45e6-40f7-ba97-8962cb116a39-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:01:35 user nova-compute[74348]: INFO nova.compute.manager [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Terminating instance
Nov 22 08:01:35 user nova-compute[74348]: DEBUG nova.compute.manager [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 08:01:35 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:35 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:35 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:35 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:36 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Instance destroyed successfully.
Nov 22 08:01:36 user nova-compute[74348]: DEBUG nova.objects.instance [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lazy-loading 'resources' on Instance uuid e36789b1-45e6-40f7-ba97-8962cb116a39 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2131516711',display_name='tempest-ServerActionsTestOtherB-server-2131516711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2131516711',id=4,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNk1MOJm11bQ93eU1QYv8ji0a1vxy2ayCOX/9R0SEaykivxTwmzY2ykLPWhT+1BMkwgumhcTt15jzBxURGp9c6w0OYjMGs9IXzcm5BaMYRSciSb/BXxgpEqQZEDxBbmLrQ==',key_name='tempest-keypair-1880925410',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:59:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='beaa9566ba2842d49f843dbddc59854d',ramdisk_id='',reservation_id='r-0nqnkret',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-849589705',owner_user_name='tempest-ServerActionsTestOtherB-849589705-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T07:59:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3b62e16105c4210bfc24e71c09ede28',uuid=e36789b1-45e6-40f7-ba97-8962cb116a39,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "address": "fa:16:3e:a7:50:2a", "network": {"id": "8a783b63-dae2-41eb-a00a-5cf8e94a5412", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872095489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beaa9566ba2842d49f843dbddc59854d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap618bd526-89", "ovs_interfaceid": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Converting VIF {"id": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "address": "fa:16:3e:a7:50:2a", "network": {"id": "8a783b63-dae2-41eb-a00a-5cf8e94a5412", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872095489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beaa9566ba2842d49f843dbddc59854d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap618bd526-89", "ovs_interfaceid": "618bd526-892d-4dfb-8ba6-f65e83e3f467", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:50:2a,bridge_name='br-int',has_traffic_filtering=True,id=618bd526-892d-4dfb-8ba6-f65e83e3f467,network=Network(8a783b63-dae2-41eb-a00a-5cf8e94a5412),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap618bd526-89') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG os_vif [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:50:2a,bridge_name='br-int',has_traffic_filtering=True,id=618bd526-892d-4dfb-8ba6-f65e83e3f467,network=Network(8a783b63-dae2-41eb-a00a-5cf8e94a5412),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap618bd526-89') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap618bd526-89, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9b99fa73-9d7a-4ec6-9f72-d4bc1d8e3c0c) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:01:36 user nova-compute[74348]: INFO os_vif [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:50:2a,bridge_name='br-int',has_traffic_filtering=True,id=618bd526-892d-4dfb-8ba6-f65e83e3f467,network=Network(8a783b63-dae2-41eb-a00a-5cf8e94a5412),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap618bd526-89')
Nov 22 08:01:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RoQzpAmu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:01:36 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:01:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a04586-afb1-4c01-8b6b-db46d6fa1470]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 08:01:36 user nova-compute[74348]: No targets found.
Nov 22 08:01:36 user nova-compute[74348]: iSNS:
Nov 22 08:01:36 user nova-compute[74348]: No targets found.
Nov 22 08:01:36 user nova-compute[74348]: STATIC:
Nov 22 08:01:36 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2
Nov 22 08:01:36 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:01:36 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:01:36 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8
Nov 22 08:01:36 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:01:36 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:01:36 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa
Nov 22 08:01:36 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:01:36 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:01:36 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730
Nov 22 08:01:36 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:01:36 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:01:36 user nova-compute[74348]: FIRMWARE:
Nov 22 08:01:36 user nova-compute[74348]: No targets found.
Nov 22 08:01:36 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 08:01:36 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 08:01:36 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9163b727-fdfe-4f88-9360-c1221b2479f3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[78730b17-b05f-4d4f-994c-b85dd8c82104]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 08:01:36 user nova-compute[74348]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:01:36 user nova-compute[74348]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa (non-flash)
Nov 22 08:01:36 user nova-compute[74348]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2 (non-flash)
Nov 22 08:01:36 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 (non-flash)
Nov 22 08:01:36 user nova-compute[74348]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:01:36 user nova-compute[74348]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa (non-flash)
Nov 22 08:01:36 user nova-compute[74348]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2 (non-flash)
Nov 22 08:01:36 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f224c3b23b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730'): ({'sdc'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Removing single pathed devices sdc {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[731e8892-1976-44c4-a536-241eafacbae0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[37046ece-a398-4667-adb6-16f7830aeb33]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Flushing IO for device /dev/sdc {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2e649a-2900-4aae-9698-7d93f10a0a68]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d00b4e-47f1-41d4-a91b-720cfd7ad10a]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] SCSI volumes sdc have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd927166-04d6-4544-8038-5486948abb70]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5b2114-86c6-43f6-bb7c-72ffdda07da5]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730, portal: 172.16.0.220,3260]
Nov 22 08:01:36 user nova-compute[74348]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730, portal: 172.16.0.220,3260] successful.
Nov 22 08:01:36 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d39d80c0-03af-4337-8739-906a6e6a5730 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ff705d-d338-459c-a663-841bc1f1569f]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] <== disconnect_volume: return (371ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 08:01:36 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Deleting instance files /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39_del
Nov 22 08:01:36 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Deletion of /opt/stack/data/nova/instances/e36789b1-45e6-40f7-ba97-8962cb116a39_del complete
Nov 22 08:01:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:37 user nova-compute[74348]: INFO nova.compute.manager [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Took 1.37 seconds to destroy the instance on the hypervisor.
Nov 22 08:01:37 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 08:01:37 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 08:01:37 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 08:01:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:37 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:01:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c36455f-5fd6-4813-9c44-499e3742ed39/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:37 user nova-compute[74348]: DEBUG nova.compute.manager [req-cf2bf826-ef1e-4ca0-b8ec-b995de265a60 req-604b15cd-cb74-4e71-98f3-0ba7571668d2 service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Received event network-vif-unplugged-618bd526-892d-4dfb-8ba6-f65e83e3f467 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:01:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-cf2bf826-ef1e-4ca0-b8ec-b995de265a60 req-604b15cd-cb74-4e71-98f3-0ba7571668d2 service nova] Acquiring lock "e36789b1-45e6-40f7-ba97-8962cb116a39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:01:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-cf2bf826-ef1e-4ca0-b8ec-b995de265a60 req-604b15cd-cb74-4e71-98f3-0ba7571668d2 service nova] Lock "e36789b1-45e6-40f7-ba97-8962cb116a39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:01:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-cf2bf826-ef1e-4ca0-b8ec-b995de265a60 req-604b15cd-cb74-4e71-98f3-0ba7571668d2 service nova] Lock "e36789b1-45e6-40f7-ba97-8962cb116a39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:01:37 user nova-compute[74348]: DEBUG nova.compute.manager [req-cf2bf826-ef1e-4ca0-b8ec-b995de265a60 req-604b15cd-cb74-4e71-98f3-0ba7571668d2 service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] No waiting events found dispatching network-vif-unplugged-618bd526-892d-4dfb-8ba6-f65e83e3f467 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:01:37 user nova-compute[74348]: DEBUG nova.compute.manager [req-cf2bf826-ef1e-4ca0-b8ec-b995de265a60 req-604b15cd-cb74-4e71-98f3-0ba7571668d2 service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Received event network-vif-unplugged-618bd526-892d-4dfb-8ba6-f65e83e3f467 for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 08:01:37 user nova-compute[74348]: DEBUG nova.compute.manager [req-cf2bf826-ef1e-4ca0-b8ec-b995de265a60 req-604b15cd-cb74-4e71-98f3-0ba7571668d2 service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Received event network-vif-plugged-618bd526-892d-4dfb-8ba6-f65e83e3f467 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:01:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-cf2bf826-ef1e-4ca0-b8ec-b995de265a60 req-604b15cd-cb74-4e71-98f3-0ba7571668d2 service nova] Acquiring lock "e36789b1-45e6-40f7-ba97-8962cb116a39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:01:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-cf2bf826-ef1e-4ca0-b8ec-b995de265a60 req-604b15cd-cb74-4e71-98f3-0ba7571668d2 service nova] Lock "e36789b1-45e6-40f7-ba97-8962cb116a39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:01:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-cf2bf826-ef1e-4ca0-b8ec-b995de265a60 req-604b15cd-cb74-4e71-98f3-0ba7571668d2 service nova] Lock "e36789b1-45e6-40f7-ba97-8962cb116a39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:01:37 user nova-compute[74348]: DEBUG nova.compute.manager [req-cf2bf826-ef1e-4ca0-b8ec-b995de265a60 req-604b15cd-cb74-4e71-98f3-0ba7571668d2 service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] No waiting events found dispatching network-vif-plugged-618bd526-892d-4dfb-8ba6-f65e83e3f467 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:01:37 user nova-compute[74348]: WARNING nova.compute.manager [req-cf2bf826-ef1e-4ca0-b8ec-b995de265a60 req-604b15cd-cb74-4e71-98f3-0ba7571668d2 service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Received unexpected event network-vif-plugged-618bd526-892d-4dfb-8ba6-f65e83e3f467 for instance with vm_state active and task_state deleting.
Nov 22 08:01:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Acquiring lock "266eb2ee-43a5-4fd2-86aa-9e915cbc7562" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:01:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "266eb2ee-43a5-4fd2-86aa-9e915cbc7562" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:01:37 user nova-compute[74348]: DEBUG nova.compute.manager [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 08:01:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c36455f-5fd6-4813-9c44-499e3742ed39/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c36455f-5fd6-4813-9c44-499e3742ed39/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:01:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:01:37 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 08:01:37 user nova-compute[74348]: INFO nova.compute.claims [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Claim successful on node user
Nov 22 08:01:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c36455f-5fd6-4813-9c44-499e3742ed39/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:37 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:01:37 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Took 0.83 seconds to deallocate network for instance.
Nov 22 08:01:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:38 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:01:38 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:01:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.741s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:01:38 user nova-compute[74348]: DEBUG nova.compute.manager [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 08:01:38 user nova-compute[74348]: DEBUG nova.compute.manager [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 08:01:38 user nova-compute[74348]: DEBUG nova.network.neutron [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 08:01:38 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 08:01:38 user nova-compute[74348]: DEBUG nova.compute.manager [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 08:01:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74cb3261-4f66-4d23-9e88-3c7bd53cfb01/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:38 user nova-compute[74348]: DEBUG nova.policy [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '932048022f98418b9ac1d99a356fa39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0496e87c6a468fab4258553c68b8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 08:01:38 user nova-compute[74348]: DEBUG nova.compute.manager [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 08:01:38 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 08:01:38 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Creating image(s)
Nov 22 08:01:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Acquiring lock "/opt/stack/data/nova/instances/266eb2ee-43a5-4fd2-86aa-9e915cbc7562/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:01:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "/opt/stack/data/nova/instances/266eb2ee-43a5-4fd2-86aa-9e915cbc7562/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:01:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "/opt/stack/data/nova/instances/266eb2ee-43a5-4fd2-86aa-9e915cbc7562/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:01:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74cb3261-4f66-4d23-9e88-3c7bd53cfb01/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74cb3261-4f66-4d23-9e88-3c7bd53cfb01/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.183s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Acquiring lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:01:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:01:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74cb3261-4f66-4d23-9e88-3c7bd53cfb01/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:38 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Error from libvirt while getting description of instance-00000004: [Error Code 42] Domain not found: no domain with matching uuid 'e36789b1-45e6-40f7-ba97-8962cb116a39' (instance-00000004): libvirt.libvirtError: Domain not found: no domain with matching uuid 'e36789b1-45e6-40f7-ba97-8962cb116a39' (instance-00000004)
Nov 22 08:01:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaecc2f-f6fe-4171-b445-55c3a2d33760/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:38 user nova-compute[74348]: INFO nova.compute.manager [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Took 0.98 seconds to detach 1 volumes for instance.
Nov 22 08:01:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.193s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/266eb2ee-43a5-4fd2-86aa-9e915cbc7562/disk 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/266eb2ee-43a5-4fd2-86aa-9e915cbc7562/disk 1073741824" returned: 0 in 0.068s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:01:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaecc2f-f6fe-4171-b445-55c3a2d33760/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaecc2f-f6fe-4171-b445-55c3a2d33760/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG nova.network.neutron [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Successfully created port: d73167a0-1952-4e39-8cc0-0a422a6927b3 {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 08:01:39 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-8d34b892-ace9-46e5-8893-964a430d85b5 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2eaecc2f-f6fe-4171-b445-55c3a2d33760 is timed out.
Nov 22 08:01:39 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-8d34b892-ace9-46e5-8893-964a430d85b5 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Successfully detached device vdb from instance 2eaecc2f-f6fe-4171-b445-55c3a2d33760 from the live domain config.
Nov 22 08:01:39 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d34b892-ace9-46e5-8893-964a430d85b5 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d34b892-ace9-46e5-8893-964a430d85b5 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AbiPLNfe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:01:39 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-8d34b892-ace9-46e5-8893-964a430d85b5 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:01:39 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-8d34b892-ace9-46e5-8893-964a430d85b5 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-8d34b892-ace9-46e5-8893-964a430d85b5 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f4564a-e32a-4547-9da0-41e0aaa6164c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d34b892-ace9-46e5-8893-964a430d85b5 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 08:01:39 user nova-compute[74348]: No targets found.
Nov 22 08:01:39 user nova-compute[74348]: iSNS:
Nov 22 08:01:39 user nova-compute[74348]: No targets found.
Nov 22 08:01:39 user nova-compute[74348]: STATIC:
Nov 22 08:01:39 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2
Nov 22 08:01:39 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:01:39 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:01:39 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8
Nov 22 08:01:39 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:01:39 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:01:39 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa
Nov 22 08:01:39 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:01:39 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:01:39 user nova-compute[74348]: FIRMWARE:
Nov 22 08:01:39 user nova-compute[74348]: No targets found.
Nov 22 08:01:39 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d34b892-ace9-46e5-8893-964a430d85b5 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 08:01:39 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 08:01:39 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d34b892-ace9-46e5-8893-964a430d85b5 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee2eff3-527c-4cfd-8077-3051f1c1b1ff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.214s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Checking if we can resize image /opt/stack/data/nova/instances/266eb2ee-43a5-4fd2-86aa-9e915cbc7562/disk. size=1073741824 {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266eb2ee-43a5-4fd2-86aa-9e915cbc7562/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[82683b5e-307d-4b61-a39a-6916d9d29163]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d34b892-ace9-46e5-8893-964a430d85b5 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:01:39 user nova-compute[74348]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa (non-flash)
Nov 22 08:01:39 user nova-compute[74348]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2 (non-flash)
Nov 22 08:01:39 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d34b892-ace9-46e5-8893-964a430d85b5 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:01:39 user nova-compute[74348]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa (non-flash)
Nov 22 08:01:39 user nova-compute[74348]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2 (non-flash)
Nov 22 08:01:39 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d34b892-ace9-46e5-8893-964a430d85b5 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f224c7130a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2'): ({'sde'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-8d34b892-ace9-46e5-8893-964a430d85b5 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Removing single pathed devices sde {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaecc2f-f6fe-4171-b445-55c3a2d33760/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a635cbbc-6b87-4877-80a8-bd4001c407c6/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb23a78-346d-4c15-9c99-c5f9ea453176]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c551d5ea-0707-4437-9c82-7e122c5373aa]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-8d34b892-ace9-46e5-8893-964a430d85b5 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Flushing IO for device /dev/sde {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e34689-9413-40f3-b1fa-dd885afd353d]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-8d34b892-ace9-46e5-8893-964a430d85b5 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG nova.compute.manager [req-cd3448eb-6166-45c1-8299-599eb6129930 req-0ae5dd3e-00aa-429c-9aa9-d2a601979cf3 service nova] [instance: e36789b1-45e6-40f7-ba97-8962cb116a39] Received event network-vif-deleted-618bd526-892d-4dfb-8ba6-f65e83e3f467 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f57237-776d-439d-8844-95f6c0d6eca7]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266eb2ee-43a5-4fd2-86aa-9e915cbc7562/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-8d34b892-ace9-46e5-8893-964a430d85b5 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-8d34b892-ace9-46e5-8893-964a430d85b5 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] SCSI volumes sde have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d34b892-ace9-46e5-8893-964a430d85b5 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Cannot resize image /opt/stack/data/nova/instances/266eb2ee-43a5-4fd2-86aa-9e915cbc7562/disk to a smaller size. {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Ensure instance console log exists: /opt/stack/data/nova/instances/266eb2ee-43a5-4fd2-86aa-9e915cbc7562/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e93ebf0-5bee-41fd-9cce-f439b9f237b8]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d34b892-ace9-46e5-8893-964a430d85b5 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2 -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a635cbbc-6b87-4877-80a8-bd4001c407c6/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a635cbbc-6b87-4877-80a8-bd4001c407c6/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ccdca91-415d-43b9-a9e2-be631d69ece1]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d34b892-ace9-46e5-8893-964a430d85b5 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2, portal: 172.16.0.220,3260]
Nov 22 08:01:39 user nova-compute[74348]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2, portal: 172.16.0.220,3260] successful.
Nov 22 08:01:39 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2 -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60beede2-e7bf-4c48-bd23-f4b27780f6f2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5948205-7612-41c4-a57c-7b42ef07de6a]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d34b892-ace9-46e5-8893-964a430d85b5 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-8d34b892-ace9-46e5-8893-964a430d85b5 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.447s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d34b892-ace9-46e5-8893-964a430d85b5 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] <== disconnect_volume: return (449ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d34b892-ace9-46e5-8893-964a430d85b5 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a635cbbc-6b87-4877-80a8-bd4001c407c6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.728s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:01:39 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Deleted allocations for instance e36789b1-45e6-40f7-ba97-8962cb116a39
Nov 22 08:01:39 user nova-compute[74348]: DEBUG nova.network.neutron [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Successfully updated port: d73167a0-1952-4e39-8cc0-0a422a6927b3 {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Acquiring lock "refresh_cache-266eb2ee-43a5-4fd2-86aa-9e915cbc7562" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Acquired lock "refresh_cache-266eb2ee-43a5-4fd2-86aa-9e915cbc7562" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG nova.network.neutron [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9782d778-a254-448f-9166-186599aaab93 tempest-ServerActionsTestOtherB-849589705 tempest-ServerActionsTestOtherB-849589705-project-member] Lock "e36789b1-45e6-40f7-ba97-8962cb116a39" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.275s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:01:39 user nova-compute[74348]: DEBUG nova.network.neutron [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 08:01:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a07ac785-23f6-4e92-9e7f-7de496dd0954/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a07ac785-23f6-4e92-9e7f-7de496dd0954/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a07ac785-23f6-4e92-9e7f-7de496dd0954/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:01:40 user nova-compute[74348]: DEBUG nova.objects.instance [None req-8d34b892-ace9-46e5-8893-964a430d85b5 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lazy-loading 'flavor' on Instance uuid 2eaecc2f-f6fe-4171-b445-55c3a2d33760 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:01:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8d34b892-ace9-46e5-8893-964a430d85b5 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "2eaecc2f-f6fe-4171-b445-55c3a2d33760" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.017s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:01:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a07ac785-23f6-4e92-9e7f-7de496dd0954/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:01:40 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:01:40 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:01:40 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=7472MB free_disk=25.01620864868164GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:01:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:01:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.network.neutron [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Updating instance_info_cache with network_info: [{"id": "d73167a0-1952-4e39-8cc0-0a422a6927b3", "address": "fa:16:3e:f8:90:9f", "network": {"id": "59f6f7a7-7076-40e9-8db7-944f89ecb7e5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1331190296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c0496e87c6a468fab4258553c68b8d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd73167a0-19", "ovs_interfaceid": "d73167a0-1952-4e39-8cc0-0a422a6927b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Releasing lock "refresh_cache-266eb2ee-43a5-4fd2-86aa-9e915cbc7562" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.compute.manager [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Instance network_info: |[{"id": "d73167a0-1952-4e39-8cc0-0a422a6927b3", "address": "fa:16:3e:f8:90:9f", "network": {"id": "59f6f7a7-7076-40e9-8db7-944f89ecb7e5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1331190296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c0496e87c6a468fab4258553c68b8d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd73167a0-19", "ovs_interfaceid": "d73167a0-1952-4e39-8cc0-0a422a6927b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Start _get_guest_xml network_info=[{"id": "d73167a0-1952-4e39-8cc0-0a422a6927b3", "address": "fa:16:3e:f8:90:9f", "network": {"id": "59f6f7a7-7076-40e9-8db7-944f89ecb7e5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1331190296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c0496e87c6a468fab4258553c68b8d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd73167a0-19", "ovs_interfaceid": "d73167a0-1952-4e39-8cc0-0a422a6927b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 08:01:41 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:01:41 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:01:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1512907752',display_name='tempest-VolumesSnapshotTestJSON-instance-1512907752',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1512907752',id=27,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLnC9VP7hgP3rr5137x76kYdOVi2S8U5ns95C69FZPFrPLSf2TLXbArkqFGwwjn8zN4qAiCxB/zmBHainFM54naC00wqyORSYl4ozKzDnyCaGZCoKBkkQQFfHgLAqJ05w==',key_name='tempest-keypair-1693709242',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c0496e87c6a468fab4258553c68b8d3',ramdisk_id='',reservation_id='r-nigfkf0w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-451679750',owner_user_name='tempest-VolumesSnapshotTestJSON-451679750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:01:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='932048022f98418b9ac1d99a356fa39d',uuid=266eb2ee-43a5-4fd2-86aa-9e915cbc7562,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d73167a0-1952-4e39-8cc0-0a422a6927b3", "address": "fa:16:3e:f8:90:9f", "network": {"id": "59f6f7a7-7076-40e9-8db7-944f89ecb7e5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1331190296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c0496e87c6a468fab4258553c68b8d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd73167a0-19", "ovs_interfaceid": "d73167a0-1952-4e39-8cc0-0a422a6927b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Converting VIF {"id": "d73167a0-1952-4e39-8cc0-0a422a6927b3", "address": "fa:16:3e:f8:90:9f", "network": {"id": "59f6f7a7-7076-40e9-8db7-944f89ecb7e5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1331190296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c0496e87c6a468fab4258553c68b8d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd73167a0-19", "ovs_interfaceid": "d73167a0-1952-4e39-8cc0-0a422a6927b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:90:9f,bridge_name='br-int',has_traffic_filtering=True,id=d73167a0-1952-4e39-8cc0-0a422a6927b3,network=Network(59f6f7a7-7076-40e9-8db7-944f89ecb7e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd73167a0-19') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.objects.instance [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lazy-loading 'pci_devices' on Instance uuid 266eb2ee-43a5-4fd2-86aa-9e915cbc7562 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 9c36455f-5fd6-4813-9c44-499e3742ed39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 765f8c47-c042-4430-8d35-07926ad693fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance a635cbbc-6b87-4877-80a8-bd4001c407c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 2eaecc2f-f6fe-4171-b445-55c3a2d33760 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance a07ac785-23f6-4e92-9e7f-7de496dd0954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 74cb3261-4f66-4d23-9e88-3c7bd53cfb01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance b8f84c0b-fab5-4900-bf65-270c9c06baf8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 37c93c2a-1397-4b04-aef1-5068218ad9fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 5006cff5-4b67-405d-b6b1-4c355f82d920 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 266eb2ee-43a5-4fd2-86aa-9e915cbc7562 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] End _get_guest_xml xml=<domain type="kvm">
Nov 22 08:01:41 user nova-compute[74348]:   <uuid>266eb2ee-43a5-4fd2-86aa-9e915cbc7562</uuid>
Nov 22 08:01:41 user nova-compute[74348]:   <name>instance-0000001b</name>
Nov 22 08:01:41 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 08:01:41 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 08:01:41 user nova-compute[74348]:   <metadata>
Nov 22 08:01:41 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 08:01:41 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 08:01:41 user nova-compute[74348]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1512907752</nova:name>
Nov 22 08:01:41 user nova-compute[74348]:       <nova:creationTime>2023-11-22 08:01:41</nova:creationTime>
Nov 22 08:01:41 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 08:01:41 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 08:01:41 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 08:01:41 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 08:01:41 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 08:01:41 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 08:01:41 user nova-compute[74348]:       </nova:flavor>
Nov 22 08:01:41 user nova-compute[74348]:       <nova:owner>
Nov 22 08:01:41 user nova-compute[74348]:         <nova:user uuid="932048022f98418b9ac1d99a356fa39d">tempest-VolumesSnapshotTestJSON-451679750-project-member</nova:user>
Nov 22 08:01:41 user nova-compute[74348]:         <nova:project uuid="6c0496e87c6a468fab4258553c68b8d3">tempest-VolumesSnapshotTestJSON-451679750</nova:project>
Nov 22 08:01:41 user nova-compute[74348]:       </nova:owner>
Nov 22 08:01:41 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 08:01:41 user nova-compute[74348]:       <nova:ports>
Nov 22 08:01:41 user nova-compute[74348]:         <nova:port uuid="d73167a0-1952-4e39-8cc0-0a422a6927b3">
Nov 22 08:01:41 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 22 08:01:41 user nova-compute[74348]:         </nova:port>
Nov 22 08:01:41 user nova-compute[74348]:       </nova:ports>
Nov 22 08:01:41 user nova-compute[74348]:     </nova:instance>
Nov 22 08:01:41 user nova-compute[74348]:   </metadata>
Nov 22 08:01:41 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 08:01:41 user nova-compute[74348]:     <system>
Nov 22 08:01:41 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 08:01:41 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 08:01:41 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 08:01:41 user nova-compute[74348]:       <entry name="serial">266eb2ee-43a5-4fd2-86aa-9e915cbc7562</entry>
Nov 22 08:01:41 user nova-compute[74348]:       <entry name="uuid">266eb2ee-43a5-4fd2-86aa-9e915cbc7562</entry>
Nov 22 08:01:41 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 08:01:41 user nova-compute[74348]:     </system>
Nov 22 08:01:41 user nova-compute[74348]:   </sysinfo>
Nov 22 08:01:41 user nova-compute[74348]:   <os>
Nov 22 08:01:41 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 08:01:41 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 08:01:41 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 08:01:41 user nova-compute[74348]:   </os>
Nov 22 08:01:41 user nova-compute[74348]:   <features>
Nov 22 08:01:41 user nova-compute[74348]:     <acpi/>
Nov 22 08:01:41 user nova-compute[74348]:     <apic/>
Nov 22 08:01:41 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 08:01:41 user nova-compute[74348]:   </features>
Nov 22 08:01:41 user nova-compute[74348]:   <clock offset="utc">
Nov 22 08:01:41 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 08:01:41 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 08:01:41 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 08:01:41 user nova-compute[74348]:   </clock>
Nov 22 08:01:41 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 08:01:41 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 08:01:41 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 08:01:41 user nova-compute[74348]:   </cpu>
Nov 22 08:01:41 user nova-compute[74348]:   <devices>
Nov 22 08:01:41 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 08:01:41 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 08:01:41 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/266eb2ee-43a5-4fd2-86aa-9e915cbc7562/disk"/>
Nov 22 08:01:41 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 08:01:41 user nova-compute[74348]:     </disk>
Nov 22 08:01:41 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 08:01:41 user nova-compute[74348]:       <mac address="fa:16:3e:f8:90:9f"/>
Nov 22 08:01:41 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:01:41 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 08:01:41 user nova-compute[74348]:       <target dev="tapd73167a0-19"/>
Nov 22 08:01:41 user nova-compute[74348]:     </interface>
Nov 22 08:01:41 user nova-compute[74348]:     <serial type="pty">
Nov 22 08:01:41 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/266eb2ee-43a5-4fd2-86aa-9e915cbc7562/console.log" append="off"/>
Nov 22 08:01:41 user nova-compute[74348]:     </serial>
Nov 22 08:01:41 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 08:01:41 user nova-compute[74348]:     <video>
Nov 22 08:01:41 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:01:41 user nova-compute[74348]:     </video>
Nov 22 08:01:41 user nova-compute[74348]:     <rng model="virtio">
Nov 22 08:01:41 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 08:01:41 user nova-compute[74348]:     </rng>
Nov 22 08:01:41 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 08:01:41 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 08:01:41 user nova-compute[74348]:       <stats period="10"/>
Nov 22 08:01:41 user nova-compute[74348]:     </memballoon>
Nov 22 08:01:41 user nova-compute[74348]:   </devices>
Nov 22 08:01:41 user nova-compute[74348]: </domain>
Nov 22 08:01:41 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:01:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1512907752',display_name='tempest-VolumesSnapshotTestJSON-instance-1512907752',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1512907752',id=27,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLnC9VP7hgP3rr5137x76kYdOVi2S8U5ns95C69FZPFrPLSf2TLXbArkqFGwwjn8zN4qAiCxB/zmBHainFM54naC00wqyORSYl4ozKzDnyCaGZCoKBkkQQFfHgLAqJ05w==',key_name='tempest-keypair-1693709242',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c0496e87c6a468fab4258553c68b8d3',ramdisk_id='',reservation_id='r-nigfkf0w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-451679750',owner_user_name='tempest-VolumesSnapshotTestJSON-451679750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:01:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='932048022f98418b9ac1d99a356fa39d',uuid=266eb2ee-43a5-4fd2-86aa-9e915cbc7562,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d73167a0-1952-4e39-8cc0-0a422a6927b3", "address": "fa:16:3e:f8:90:9f", "network": {"id": "59f6f7a7-7076-40e9-8db7-944f89ecb7e5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1331190296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c0496e87c6a468fab4258553c68b8d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd73167a0-19", "ovs_interfaceid": "d73167a0-1952-4e39-8cc0-0a422a6927b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Converting VIF {"id": "d73167a0-1952-4e39-8cc0-0a422a6927b3", "address": "fa:16:3e:f8:90:9f", "network": {"id": "59f6f7a7-7076-40e9-8db7-944f89ecb7e5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1331190296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c0496e87c6a468fab4258553c68b8d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd73167a0-19", "ovs_interfaceid": "d73167a0-1952-4e39-8cc0-0a422a6927b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:90:9f,bridge_name='br-int',has_traffic_filtering=True,id=d73167a0-1952-4e39-8cc0-0a422a6927b3,network=Network(59f6f7a7-7076-40e9-8db7-944f89ecb7e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd73167a0-19') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG os_vif [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:90:9f,bridge_name='br-int',has_traffic_filtering=True,id=d73167a0-1952-4e39-8cc0-0a422a6927b3,network=Network(59f6f7a7-7076-40e9-8db7-944f89ecb7e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd73167a0-19') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8a42eec3-21ed-5084-a815-aee6503a5549', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd73167a0-19, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd73167a0-19, col_values=(('qos', UUID('3a162c47-a50f-4998-a89f-402dfd27179e')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd73167a0-19, col_values=(('external_ids', {'iface-id': 'd73167a0-1952-4e39-8cc0-0a422a6927b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:90:9f', 'vm-uuid': '266eb2ee-43a5-4fd2-86aa-9e915cbc7562'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:41 user nova-compute[74348]: INFO os_vif [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:90:9f,bridge_name='br-int',has_traffic_filtering=True,id=d73167a0-1952-4e39-8cc0-0a422a6927b3,network=Network(59f6f7a7-7076-40e9-8db7-944f89ecb7e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd73167a0-19')
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] No VIF found with MAC fa:16:3e:f8:90:9f, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.compute.manager [req-9fd39dbc-82b2-4af5-86e9-6c3e85f94c9e req-d5a56607-719a-491a-ac79-96ae3b1bd880 service nova] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Received event network-changed-d73167a0-1952-4e39-8cc0-0a422a6927b3 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.compute.manager [req-9fd39dbc-82b2-4af5-86e9-6c3e85f94c9e req-d5a56607-719a-491a-ac79-96ae3b1bd880 service nova] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Refreshing instance network info cache due to event network-changed-d73167a0-1952-4e39-8cc0-0a422a6927b3. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9fd39dbc-82b2-4af5-86e9-6c3e85f94c9e req-d5a56607-719a-491a-ac79-96ae3b1bd880 service nova] Acquiring lock "refresh_cache-266eb2ee-43a5-4fd2-86aa-9e915cbc7562" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9fd39dbc-82b2-4af5-86e9-6c3e85f94c9e req-d5a56607-719a-491a-ac79-96ae3b1bd880 service nova] Acquired lock "refresh_cache-266eb2ee-43a5-4fd2-86aa-9e915cbc7562" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.network.neutron [req-9fd39dbc-82b2-4af5-86e9-6c3e85f94c9e req-d5a56607-719a-491a-ac79-96ae3b1bd880 service nova] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Refreshing network info cache for port d73167a0-1952-4e39-8cc0-0a422a6927b3 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.563s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.network.neutron [req-9fd39dbc-82b2-4af5-86e9-6c3e85f94c9e req-d5a56607-719a-491a-ac79-96ae3b1bd880 service nova] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Updated VIF entry in instance network info cache for port d73167a0-1952-4e39-8cc0-0a422a6927b3. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG nova.network.neutron [req-9fd39dbc-82b2-4af5-86e9-6c3e85f94c9e req-d5a56607-719a-491a-ac79-96ae3b1bd880 service nova] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Updating instance_info_cache with network_info: [{"id": "d73167a0-1952-4e39-8cc0-0a422a6927b3", "address": "fa:16:3e:f8:90:9f", "network": {"id": "59f6f7a7-7076-40e9-8db7-944f89ecb7e5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1331190296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c0496e87c6a468fab4258553c68b8d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd73167a0-19", "ovs_interfaceid": "d73167a0-1952-4e39-8cc0-0a422a6927b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:01:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9fd39dbc-82b2-4af5-86e9-6c3e85f94c9e req-d5a56607-719a-491a-ac79-96ae3b1bd880 service nova] Releasing lock "refresh_cache-266eb2ee-43a5-4fd2-86aa-9e915cbc7562" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:01:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:42 user nova-compute[74348]: DEBUG nova.compute.manager [req-d8d597f6-1035-41b1-a174-cfc465cedade req-eb6697d6-75de-4121-94f4-41ba584a87ec service nova] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Received event network-vif-plugged-d73167a0-1952-4e39-8cc0-0a422a6927b3 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:01:42 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d8d597f6-1035-41b1-a174-cfc465cedade req-eb6697d6-75de-4121-94f4-41ba584a87ec service nova] Acquiring lock "266eb2ee-43a5-4fd2-86aa-9e915cbc7562-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:01:42 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d8d597f6-1035-41b1-a174-cfc465cedade req-eb6697d6-75de-4121-94f4-41ba584a87ec service nova] Lock "266eb2ee-43a5-4fd2-86aa-9e915cbc7562-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:01:42 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d8d597f6-1035-41b1-a174-cfc465cedade req-eb6697d6-75de-4121-94f4-41ba584a87ec service nova] Lock "266eb2ee-43a5-4fd2-86aa-9e915cbc7562-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:01:42 user nova-compute[74348]: DEBUG nova.compute.manager [req-d8d597f6-1035-41b1-a174-cfc465cedade req-eb6697d6-75de-4121-94f4-41ba584a87ec service nova] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] No waiting events found dispatching network-vif-plugged-d73167a0-1952-4e39-8cc0-0a422a6927b3 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:01:42 user nova-compute[74348]: WARNING nova.compute.manager [req-d8d597f6-1035-41b1-a174-cfc465cedade req-eb6697d6-75de-4121-94f4-41ba584a87ec service nova] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Received unexpected event network-vif-plugged-d73167a0-1952-4e39-8cc0-0a422a6927b3 for instance with vm_state building and task_state spawning.
Nov 22 08:01:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:44 user nova-compute[74348]: DEBUG nova.compute.manager [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 08:01:44 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 08:01:44 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Instance spawned successfully.
Nov 22 08:01:44 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 08:01:44 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:01:44 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:01:44 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:01:44 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:01:44 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:01:44 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:01:44 user nova-compute[74348]: INFO nova.compute.manager [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Took 6.32 seconds to spawn the instance on the hypervisor.
Nov 22 08:01:44 user nova-compute[74348]: DEBUG nova.compute.manager [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:01:44 user nova-compute[74348]: DEBUG nova.compute.manager [req-52b71d87-3cc7-48c1-8e93-6ceac898cb42 req-d062fb2f-c2ab-441f-8410-cce23134a4f8 service nova] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Received event network-vif-plugged-d73167a0-1952-4e39-8cc0-0a422a6927b3 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:01:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-52b71d87-3cc7-48c1-8e93-6ceac898cb42 req-d062fb2f-c2ab-441f-8410-cce23134a4f8 service nova] Acquiring lock "266eb2ee-43a5-4fd2-86aa-9e915cbc7562-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:01:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-52b71d87-3cc7-48c1-8e93-6ceac898cb42 req-d062fb2f-c2ab-441f-8410-cce23134a4f8 service nova] Lock "266eb2ee-43a5-4fd2-86aa-9e915cbc7562-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:01:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-52b71d87-3cc7-48c1-8e93-6ceac898cb42 req-d062fb2f-c2ab-441f-8410-cce23134a4f8 service nova] Lock "266eb2ee-43a5-4fd2-86aa-9e915cbc7562-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:01:44 user nova-compute[74348]: DEBUG nova.compute.manager [req-52b71d87-3cc7-48c1-8e93-6ceac898cb42 req-d062fb2f-c2ab-441f-8410-cce23134a4f8 service nova] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] No waiting events found dispatching network-vif-plugged-d73167a0-1952-4e39-8cc0-0a422a6927b3 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:01:44 user nova-compute[74348]: WARNING nova.compute.manager [req-52b71d87-3cc7-48c1-8e93-6ceac898cb42 req-d062fb2f-c2ab-441f-8410-cce23134a4f8 service nova] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Received unexpected event network-vif-plugged-d73167a0-1952-4e39-8cc0-0a422a6927b3 for instance with vm_state building and task_state spawning.
Nov 22 08:01:44 user nova-compute[74348]: INFO nova.compute.manager [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Took 7.53 seconds to build instance.
Nov 22 08:01:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d5b1b1e1-4441-4925-9b43-8886b0ee27b4 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "266eb2ee-43a5-4fd2-86aa-9e915cbc7562" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.660s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:01:46 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:51 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:01:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:00 user nova-compute[74348]: DEBUG nova.compute.manager [req-d0674a16-1244-4863-a434-071b92b10e30 req-dd150020-7a6e-48bd-9655-09e4fdaee30b service nova] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Received event network-changed-6c9d4040-2941-469b-b602-69cc8b6e879b {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:02:00 user nova-compute[74348]: DEBUG nova.compute.manager [req-d0674a16-1244-4863-a434-071b92b10e30 req-dd150020-7a6e-48bd-9655-09e4fdaee30b service nova] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Refreshing instance network info cache due to event network-changed-6c9d4040-2941-469b-b602-69cc8b6e879b. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:02:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d0674a16-1244-4863-a434-071b92b10e30 req-dd150020-7a6e-48bd-9655-09e4fdaee30b service nova] Acquiring lock "refresh_cache-3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:02:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d0674a16-1244-4863-a434-071b92b10e30 req-dd150020-7a6e-48bd-9655-09e4fdaee30b service nova] Acquired lock "refresh_cache-3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:02:00 user nova-compute[74348]: DEBUG nova.network.neutron [req-d0674a16-1244-4863-a434-071b92b10e30 req-dd150020-7a6e-48bd-9655-09e4fdaee30b service nova] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Refreshing network info cache for port 6c9d4040-2941-469b-b602-69cc8b6e879b {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:02:00 user nova-compute[74348]: DEBUG nova.network.neutron [req-d0674a16-1244-4863-a434-071b92b10e30 req-dd150020-7a6e-48bd-9655-09e4fdaee30b service nova] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Updated VIF entry in instance network info cache for port 6c9d4040-2941-469b-b602-69cc8b6e879b. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:02:00 user nova-compute[74348]: DEBUG nova.network.neutron [req-d0674a16-1244-4863-a434-071b92b10e30 req-dd150020-7a6e-48bd-9655-09e4fdaee30b service nova] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Updating instance_info_cache with network_info: [{"id": "6c9d4040-2941-469b-b602-69cc8b6e879b", "address": "fa:16:3e:b0:44:f3", "network": {"id": "4ef640bb-4a2f-4f98-8b01-b5df87fcb35a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1216437312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444367658c0241d0b5b377a73fedb52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9d4040-29", "ovs_interfaceid": "6c9d4040-2941-469b-b602-69cc8b6e879b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:02:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d0674a16-1244-4863-a434-071b92b10e30 req-dd150020-7a6e-48bd-9655-09e4fdaee30b service nova] Releasing lock "refresh_cache-3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:02:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-786b40cb-6969-44bf-af89-fac6abd44e79 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Acquiring lock "a07ac785-23f6-4e92-9e7f-7de496dd0954" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-786b40cb-6969-44bf-af89-fac6abd44e79 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lock "a07ac785-23f6-4e92-9e7f-7de496dd0954" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-786b40cb-6969-44bf-af89-fac6abd44e79 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Acquiring lock "a07ac785-23f6-4e92-9e7f-7de496dd0954-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-786b40cb-6969-44bf-af89-fac6abd44e79 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lock "a07ac785-23f6-4e92-9e7f-7de496dd0954-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-786b40cb-6969-44bf-af89-fac6abd44e79 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lock "a07ac785-23f6-4e92-9e7f-7de496dd0954-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:00 user nova-compute[74348]: INFO nova.compute.manager [None req-786b40cb-6969-44bf-af89-fac6abd44e79 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Terminating instance
Nov 22 08:02:00 user nova-compute[74348]: DEBUG nova.compute.manager [None req-786b40cb-6969-44bf-af89-fac6abd44e79 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 08:02:00 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:00 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:01 user nova-compute[74348]: DEBUG nova.compute.manager [req-3601b2b8-3b5c-4039-860b-4fb1aaa94eb8 req-9a6fbadb-7941-4a77-8b3d-64fc13a71337 service nova] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Received event network-vif-unplugged-ef5eac53-c84f-4b04-b142-34cba2ed8eb2 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:02:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3601b2b8-3b5c-4039-860b-4fb1aaa94eb8 req-9a6fbadb-7941-4a77-8b3d-64fc13a71337 service nova] Acquiring lock "a07ac785-23f6-4e92-9e7f-7de496dd0954-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3601b2b8-3b5c-4039-860b-4fb1aaa94eb8 req-9a6fbadb-7941-4a77-8b3d-64fc13a71337 service nova] Lock "a07ac785-23f6-4e92-9e7f-7de496dd0954-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3601b2b8-3b5c-4039-860b-4fb1aaa94eb8 req-9a6fbadb-7941-4a77-8b3d-64fc13a71337 service nova] Lock "a07ac785-23f6-4e92-9e7f-7de496dd0954-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:01 user nova-compute[74348]: DEBUG nova.compute.manager [req-3601b2b8-3b5c-4039-860b-4fb1aaa94eb8 req-9a6fbadb-7941-4a77-8b3d-64fc13a71337 service nova] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] No waiting events found dispatching network-vif-unplugged-ef5eac53-c84f-4b04-b142-34cba2ed8eb2 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:02:01 user nova-compute[74348]: DEBUG nova.compute.manager [req-3601b2b8-3b5c-4039-860b-4fb1aaa94eb8 req-9a6fbadb-7941-4a77-8b3d-64fc13a71337 service nova] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Received event network-vif-unplugged-ef5eac53-c84f-4b04-b142-34cba2ed8eb2 for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 08:02:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:01 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Instance destroyed successfully.
Nov 22 08:02:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:01 user nova-compute[74348]: DEBUG nova.objects.instance [None req-786b40cb-6969-44bf-af89-fac6abd44e79 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lazy-loading 'resources' on Instance uuid a07ac785-23f6-4e92-9e7f-7de496dd0954 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:02:01 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-786b40cb-6969-44bf-af89-fac6abd44e79 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:00:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-249378103',display_name='tempest-VolumesAdminNegativeTest-server-249378103',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-249378103',id=21,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:00:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8780c23b60e4abe85276f2d71c591b0',ramdisk_id='',reservation_id='r-fdwzomz0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1341066445',owner_user_name='tempest-VolumesAdminNegativeTest-1341066445-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T08:00:12Z,user_data=None,user_id='9d4446ab7daa45fa8c843c2d991de43f',uuid=a07ac785-23f6-4e92-9e7f-7de496dd0954,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef5eac53-c84f-4b04-b142-34cba2ed8eb2", "address": "fa:16:3e:70:e8:31", "network": {"id": "c405fff5-285f-47eb-8bae-867c6393edf2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-368785799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8780c23b60e4abe85276f2d71c591b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef5eac53-c8", "ovs_interfaceid": "ef5eac53-c84f-4b04-b142-34cba2ed8eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:02:01 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-786b40cb-6969-44bf-af89-fac6abd44e79 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Converting VIF {"id": "ef5eac53-c84f-4b04-b142-34cba2ed8eb2", "address": "fa:16:3e:70:e8:31", "network": {"id": "c405fff5-285f-47eb-8bae-867c6393edf2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-368785799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8780c23b60e4abe85276f2d71c591b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef5eac53-c8", "ovs_interfaceid": "ef5eac53-c84f-4b04-b142-34cba2ed8eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:02:01 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-786b40cb-6969-44bf-af89-fac6abd44e79 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:e8:31,bridge_name='br-int',has_traffic_filtering=True,id=ef5eac53-c84f-4b04-b142-34cba2ed8eb2,network=Network(c405fff5-285f-47eb-8bae-867c6393edf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef5eac53-c8') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:02:01 user nova-compute[74348]: DEBUG os_vif [None req-786b40cb-6969-44bf-af89-fac6abd44e79 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:e8:31,bridge_name='br-int',has_traffic_filtering=True,id=ef5eac53-c84f-4b04-b142-34cba2ed8eb2,network=Network(c405fff5-285f-47eb-8bae-867c6393edf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef5eac53-c8') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:02:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef5eac53-c8, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:02:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:02:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=be1865a0-c307-42a1-896a-7116fe0f7826) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:02:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:01 user nova-compute[74348]: INFO os_vif [None req-786b40cb-6969-44bf-af89-fac6abd44e79 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:e8:31,bridge_name='br-int',has_traffic_filtering=True,id=ef5eac53-c84f-4b04-b142-34cba2ed8eb2,network=Network(c405fff5-285f-47eb-8bae-867c6393edf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef5eac53-c8')
Nov 22 08:02:01 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-786b40cb-6969-44bf-af89-fac6abd44e79 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Deleting instance files /opt/stack/data/nova/instances/a07ac785-23f6-4e92-9e7f-7de496dd0954_del
Nov 22 08:02:01 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-786b40cb-6969-44bf-af89-fac6abd44e79 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Deletion of /opt/stack/data/nova/instances/a07ac785-23f6-4e92-9e7f-7de496dd0954_del complete
Nov 22 08:02:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:01 user nova-compute[74348]: INFO nova.compute.manager [None req-786b40cb-6969-44bf-af89-fac6abd44e79 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 22 08:02:01 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-786b40cb-6969-44bf-af89-fac6abd44e79 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 08:02:01 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 08:02:01 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 08:02:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:02 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:02:02 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Took 0.66 seconds to deallocate network for instance.
Nov 22 08:02:02 user nova-compute[74348]: DEBUG nova.compute.manager [req-129d7384-c503-421e-b012-eaeba41f05bd req-4d980f4a-661b-46ac-bbd4-568fcf24e796 service nova] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Received event network-vif-deleted-ef5eac53-c84f-4b04-b142-34cba2ed8eb2 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:02:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-786b40cb-6969-44bf-af89-fac6abd44e79 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-786b40cb-6969-44bf-af89-fac6abd44e79 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:02 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-786b40cb-6969-44bf-af89-fac6abd44e79 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:02:02 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-786b40cb-6969-44bf-af89-fac6abd44e79 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:02:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-786b40cb-6969-44bf-af89-fac6abd44e79 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.405s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:02 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-786b40cb-6969-44bf-af89-fac6abd44e79 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Deleted allocations for instance a07ac785-23f6-4e92-9e7f-7de496dd0954
Nov 22 08:02:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-786b40cb-6969-44bf-af89-fac6abd44e79 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lock "a07ac785-23f6-4e92-9e7f-7de496dd0954" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.202s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:03 user nova-compute[74348]: DEBUG nova.compute.manager [req-aeccaf57-9e48-4169-8fd7-7f155a485051 req-f91893cd-a355-4a06-ab04-4dd0beb3dedc service nova] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Received event network-vif-plugged-ef5eac53-c84f-4b04-b142-34cba2ed8eb2 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:02:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-aeccaf57-9e48-4169-8fd7-7f155a485051 req-f91893cd-a355-4a06-ab04-4dd0beb3dedc service nova] Acquiring lock "a07ac785-23f6-4e92-9e7f-7de496dd0954-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-aeccaf57-9e48-4169-8fd7-7f155a485051 req-f91893cd-a355-4a06-ab04-4dd0beb3dedc service nova] Lock "a07ac785-23f6-4e92-9e7f-7de496dd0954-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-aeccaf57-9e48-4169-8fd7-7f155a485051 req-f91893cd-a355-4a06-ab04-4dd0beb3dedc service nova] Lock "a07ac785-23f6-4e92-9e7f-7de496dd0954-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:03 user nova-compute[74348]: DEBUG nova.compute.manager [req-aeccaf57-9e48-4169-8fd7-7f155a485051 req-f91893cd-a355-4a06-ab04-4dd0beb3dedc service nova] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] No waiting events found dispatching network-vif-plugged-ef5eac53-c84f-4b04-b142-34cba2ed8eb2 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:02:03 user nova-compute[74348]: WARNING nova.compute.manager [req-aeccaf57-9e48-4169-8fd7-7f155a485051 req-f91893cd-a355-4a06-ab04-4dd0beb3dedc service nova] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Received unexpected event network-vif-plugged-ef5eac53-c84f-4b04-b142-34cba2ed8eb2 for instance with vm_state deleted and task_state None.
Nov 22 08:02:03 user nova-compute[74348]: DEBUG nova.compute.manager [req-aeccaf57-9e48-4169-8fd7-7f155a485051 req-f91893cd-a355-4a06-ab04-4dd0beb3dedc service nova] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Received event network-vif-plugged-ef5eac53-c84f-4b04-b142-34cba2ed8eb2 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:02:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-aeccaf57-9e48-4169-8fd7-7f155a485051 req-f91893cd-a355-4a06-ab04-4dd0beb3dedc service nova] Acquiring lock "a07ac785-23f6-4e92-9e7f-7de496dd0954-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-aeccaf57-9e48-4169-8fd7-7f155a485051 req-f91893cd-a355-4a06-ab04-4dd0beb3dedc service nova] Lock "a07ac785-23f6-4e92-9e7f-7de496dd0954-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-aeccaf57-9e48-4169-8fd7-7f155a485051 req-f91893cd-a355-4a06-ab04-4dd0beb3dedc service nova] Lock "a07ac785-23f6-4e92-9e7f-7de496dd0954-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:03 user nova-compute[74348]: DEBUG nova.compute.manager [req-aeccaf57-9e48-4169-8fd7-7f155a485051 req-f91893cd-a355-4a06-ab04-4dd0beb3dedc service nova] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] No waiting events found dispatching network-vif-plugged-ef5eac53-c84f-4b04-b142-34cba2ed8eb2 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:02:03 user nova-compute[74348]: WARNING nova.compute.manager [req-aeccaf57-9e48-4169-8fd7-7f155a485051 req-f91893cd-a355-4a06-ab04-4dd0beb3dedc service nova] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Received unexpected event network-vif-plugged-ef5eac53-c84f-4b04-b142-34cba2ed8eb2 for instance with vm_state deleted and task_state None.
Nov 22 08:02:03 user nova-compute[74348]: DEBUG nova.compute.manager [req-aeccaf57-9e48-4169-8fd7-7f155a485051 req-f91893cd-a355-4a06-ab04-4dd0beb3dedc service nova] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Received event network-vif-plugged-ef5eac53-c84f-4b04-b142-34cba2ed8eb2 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:02:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-aeccaf57-9e48-4169-8fd7-7f155a485051 req-f91893cd-a355-4a06-ab04-4dd0beb3dedc service nova] Acquiring lock "a07ac785-23f6-4e92-9e7f-7de496dd0954-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-aeccaf57-9e48-4169-8fd7-7f155a485051 req-f91893cd-a355-4a06-ab04-4dd0beb3dedc service nova] Lock "a07ac785-23f6-4e92-9e7f-7de496dd0954-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-aeccaf57-9e48-4169-8fd7-7f155a485051 req-f91893cd-a355-4a06-ab04-4dd0beb3dedc service nova] Lock "a07ac785-23f6-4e92-9e7f-7de496dd0954-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:03 user nova-compute[74348]: DEBUG nova.compute.manager [req-aeccaf57-9e48-4169-8fd7-7f155a485051 req-f91893cd-a355-4a06-ab04-4dd0beb3dedc service nova] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] No waiting events found dispatching network-vif-plugged-ef5eac53-c84f-4b04-b142-34cba2ed8eb2 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:02:03 user nova-compute[74348]: WARNING nova.compute.manager [req-aeccaf57-9e48-4169-8fd7-7f155a485051 req-f91893cd-a355-4a06-ab04-4dd0beb3dedc service nova] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Received unexpected event network-vif-plugged-ef5eac53-c84f-4b04-b142-34cba2ed8eb2 for instance with vm_state deleted and task_state None.
Nov 22 08:02:03 user nova-compute[74348]: DEBUG nova.compute.manager [req-aeccaf57-9e48-4169-8fd7-7f155a485051 req-f91893cd-a355-4a06-ab04-4dd0beb3dedc service nova] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Received event network-vif-plugged-ef5eac53-c84f-4b04-b142-34cba2ed8eb2 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:02:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-aeccaf57-9e48-4169-8fd7-7f155a485051 req-f91893cd-a355-4a06-ab04-4dd0beb3dedc service nova] Acquiring lock "a07ac785-23f6-4e92-9e7f-7de496dd0954-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-aeccaf57-9e48-4169-8fd7-7f155a485051 req-f91893cd-a355-4a06-ab04-4dd0beb3dedc service nova] Lock "a07ac785-23f6-4e92-9e7f-7de496dd0954-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-aeccaf57-9e48-4169-8fd7-7f155a485051 req-f91893cd-a355-4a06-ab04-4dd0beb3dedc service nova] Lock "a07ac785-23f6-4e92-9e7f-7de496dd0954-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:03 user nova-compute[74348]: DEBUG nova.compute.manager [req-aeccaf57-9e48-4169-8fd7-7f155a485051 req-f91893cd-a355-4a06-ab04-4dd0beb3dedc service nova] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] No waiting events found dispatching network-vif-plugged-ef5eac53-c84f-4b04-b142-34cba2ed8eb2 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:02:03 user nova-compute[74348]: WARNING nova.compute.manager [req-aeccaf57-9e48-4169-8fd7-7f155a485051 req-f91893cd-a355-4a06-ab04-4dd0beb3dedc service nova] [instance: a07ac785-23f6-4e92-9e7f-7de496dd0954] Received unexpected event network-vif-plugged-ef5eac53-c84f-4b04-b142-34cba2ed8eb2 for instance with vm_state deleted and task_state None.
Nov 22 08:02:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7579993a-5a46-4cdc-a8d0-25b7e1b34d47 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquiring lock "3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7579993a-5a46-4cdc-a8d0-25b7e1b34d47 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:03 user nova-compute[74348]: INFO nova.compute.manager [None req-7579993a-5a46-4cdc-a8d0-25b7e1b34d47 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Shelving
Nov 22 08:02:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:04 user nova-compute[74348]: DEBUG nova.compute.manager [req-6cdb2029-9500-4f86-9326-585abaf2cd1a req-25ecb1e3-ef41-4227-9925-bb4528c5130d service nova] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Received event network-vif-unplugged-6c9d4040-2941-469b-b602-69cc8b6e879b {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:02:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-6cdb2029-9500-4f86-9326-585abaf2cd1a req-25ecb1e3-ef41-4227-9925-bb4528c5130d service nova] Acquiring lock "3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-6cdb2029-9500-4f86-9326-585abaf2cd1a req-25ecb1e3-ef41-4227-9925-bb4528c5130d service nova] Lock "3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-6cdb2029-9500-4f86-9326-585abaf2cd1a req-25ecb1e3-ef41-4227-9925-bb4528c5130d service nova] Lock "3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:04 user nova-compute[74348]: DEBUG nova.compute.manager [req-6cdb2029-9500-4f86-9326-585abaf2cd1a req-25ecb1e3-ef41-4227-9925-bb4528c5130d service nova] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] No waiting events found dispatching network-vif-unplugged-6c9d4040-2941-469b-b602-69cc8b6e879b {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:02:04 user nova-compute[74348]: WARNING nova.compute.manager [req-6cdb2029-9500-4f86-9326-585abaf2cd1a req-25ecb1e3-ef41-4227-9925-bb4528c5130d service nova] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Received unexpected event network-vif-unplugged-6c9d4040-2941-469b-b602-69cc8b6e879b for instance with vm_state active and task_state shelving.
Nov 22 08:02:04 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Instance destroyed successfully.
Nov 22 08:02:04 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-7579993a-5a46-4cdc-a8d0-25b7e1b34d47 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Beginning cold snapshot process
Nov 22 08:02:04 user nova-compute[74348]: DEBUG nova.privsep.utils [None req-7579993a-5a46-4cdc-a8d0-25b7e1b34d47 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74348) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 08:02:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-7579993a-5a46-4cdc-a8d0-25b7e1b34d47 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0/disk /opt/stack/data/nova/instances/snapshots/tmpqjt4w968/a6a8ad3e030e4a3c8d690e48327d4a33 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:02:05 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-7579993a-5a46-4cdc-a8d0-25b7e1b34d47 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0/disk /opt/stack/data/nova/instances/snapshots/tmpqjt4w968/a6a8ad3e030e4a3c8d690e48327d4a33" returned: 0 in 1.133s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:02:05 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-7579993a-5a46-4cdc-a8d0-25b7e1b34d47 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Snapshot extracted, beginning image upload
Nov 22 08:02:06 user nova-compute[74348]: DEBUG nova.compute.manager [req-4e6b898c-9df5-4b0a-92de-09befb076234 req-4c80cf1b-6307-4ee3-9f73-b7f06a332b42 service nova] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Received event network-vif-plugged-6c9d4040-2941-469b-b602-69cc8b6e879b {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:02:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4e6b898c-9df5-4b0a-92de-09befb076234 req-4c80cf1b-6307-4ee3-9f73-b7f06a332b42 service nova] Acquiring lock "3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4e6b898c-9df5-4b0a-92de-09befb076234 req-4c80cf1b-6307-4ee3-9f73-b7f06a332b42 service nova] Lock "3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4e6b898c-9df5-4b0a-92de-09befb076234 req-4c80cf1b-6307-4ee3-9f73-b7f06a332b42 service nova] Lock "3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:06 user nova-compute[74348]: DEBUG nova.compute.manager [req-4e6b898c-9df5-4b0a-92de-09befb076234 req-4c80cf1b-6307-4ee3-9f73-b7f06a332b42 service nova] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] No waiting events found dispatching network-vif-plugged-6c9d4040-2941-469b-b602-69cc8b6e879b {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:02:06 user nova-compute[74348]: WARNING nova.compute.manager [req-4e6b898c-9df5-4b0a-92de-09befb076234 req-4c80cf1b-6307-4ee3-9f73-b7f06a332b42 service nova] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Received unexpected event network-vif-plugged-6c9d4040-2941-469b-b602-69cc8b6e879b for instance with vm_state active and task_state shelving_image_uploading.
Nov 22 08:02:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:08 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-7579993a-5a46-4cdc-a8d0-25b7e1b34d47 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Snapshot image upload complete
Nov 22 08:02:08 user nova-compute[74348]: DEBUG nova.compute.manager [None req-7579993a-5a46-4cdc-a8d0-25b7e1b34d47 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:02:08 user nova-compute[74348]: INFO nova.compute.manager [None req-7579993a-5a46-4cdc-a8d0-25b7e1b34d47 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Shelve offloading
Nov 22 08:02:08 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Instance destroyed successfully.
Nov 22 08:02:08 user nova-compute[74348]: DEBUG nova.compute.manager [None req-7579993a-5a46-4cdc-a8d0-25b7e1b34d47 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:02:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7579993a-5a46-4cdc-a8d0-25b7e1b34d47 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquiring lock "refresh_cache-3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:02:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7579993a-5a46-4cdc-a8d0-25b7e1b34d47 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquired lock "refresh_cache-3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:02:08 user nova-compute[74348]: DEBUG nova.network.neutron [None req-7579993a-5a46-4cdc-a8d0-25b7e1b34d47 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:02:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-14043515-dfec-4fff-aaae-63803d257c25 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "2eaecc2f-f6fe-4171-b445-55c3a2d33760" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-14043515-dfec-4fff-aaae-63803d257c25 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "2eaecc2f-f6fe-4171-b445-55c3a2d33760" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-14043515-dfec-4fff-aaae-63803d257c25 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "2eaecc2f-f6fe-4171-b445-55c3a2d33760-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-14043515-dfec-4fff-aaae-63803d257c25 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "2eaecc2f-f6fe-4171-b445-55c3a2d33760-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-14043515-dfec-4fff-aaae-63803d257c25 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "2eaecc2f-f6fe-4171-b445-55c3a2d33760-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:08 user nova-compute[74348]: INFO nova.compute.manager [None req-14043515-dfec-4fff-aaae-63803d257c25 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Terminating instance
Nov 22 08:02:08 user nova-compute[74348]: DEBUG nova.compute.manager [None req-14043515-dfec-4fff-aaae-63803d257c25 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 08:02:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:08 user nova-compute[74348]: DEBUG nova.network.neutron [None req-7579993a-5a46-4cdc-a8d0-25b7e1b34d47 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Updating instance_info_cache with network_info: [{"id": "6c9d4040-2941-469b-b602-69cc8b6e879b", "address": "fa:16:3e:b0:44:f3", "network": {"id": "4ef640bb-4a2f-4f98-8b01-b5df87fcb35a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1216437312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444367658c0241d0b5b377a73fedb52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9d4040-29", "ovs_interfaceid": "6c9d4040-2941-469b-b602-69cc8b6e879b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:02:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7579993a-5a46-4cdc-a8d0-25b7e1b34d47 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Releasing lock "refresh_cache-3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:02:09 user nova-compute[74348]: DEBUG nova.compute.manager [req-dad5c934-709a-4a89-bf4f-3947d2ef02a7 req-cd11f78b-0e3d-43b9-9712-2eb7b871a7f9 service nova] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Received event network-vif-unplugged-5a641519-9d0f-47c5-b1e3-e96f2a4411a2 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:02:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-dad5c934-709a-4a89-bf4f-3947d2ef02a7 req-cd11f78b-0e3d-43b9-9712-2eb7b871a7f9 service nova] Acquiring lock "2eaecc2f-f6fe-4171-b445-55c3a2d33760-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-dad5c934-709a-4a89-bf4f-3947d2ef02a7 req-cd11f78b-0e3d-43b9-9712-2eb7b871a7f9 service nova] Lock "2eaecc2f-f6fe-4171-b445-55c3a2d33760-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-dad5c934-709a-4a89-bf4f-3947d2ef02a7 req-cd11f78b-0e3d-43b9-9712-2eb7b871a7f9 service nova] Lock "2eaecc2f-f6fe-4171-b445-55c3a2d33760-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:09 user nova-compute[74348]: DEBUG nova.compute.manager [req-dad5c934-709a-4a89-bf4f-3947d2ef02a7 req-cd11f78b-0e3d-43b9-9712-2eb7b871a7f9 service nova] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] No waiting events found dispatching network-vif-unplugged-5a641519-9d0f-47c5-b1e3-e96f2a4411a2 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:02:09 user nova-compute[74348]: DEBUG nova.compute.manager [req-dad5c934-709a-4a89-bf4f-3947d2ef02a7 req-cd11f78b-0e3d-43b9-9712-2eb7b871a7f9 service nova] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Received event network-vif-unplugged-5a641519-9d0f-47c5-b1e3-e96f2a4411a2 for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 08:02:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:09 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Instance destroyed successfully.
Nov 22 08:02:09 user nova-compute[74348]: DEBUG nova.objects.instance [None req-14043515-dfec-4fff-aaae-63803d257c25 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lazy-loading 'resources' on Instance uuid 2eaecc2f-f6fe-4171-b445-55c3a2d33760 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:02:09 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-14043515-dfec-4fff-aaae-63803d257c25 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:59:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1662067517',display_name='tempest-AttachVolumeNegativeTest-server-1662067517',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1662067517',id=20,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALLnl6Qi+tRyKbEAdtWrSjCGanzsFeT+ZZCdakMyGU2h2qCJ+InmCQMqNnLiLCpVgsAmjS6E1VXJZtM7iR3ROFY+QbRCKXQKGnt6Jt/lH6UnZEH91MY//izQY6xFDsJHw==',key_name='tempest-keypair-827972638',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:59:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f569146bb9b04838ad8044260da6ad58',ramdisk_id='',reservation_id='r-bui2q035',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1606364171',owner_user_name='tempest-AttachVolumeNegativeTest-1606364171-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T07:59:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8eca17e3a564220b3b07af4eddadaca',uuid=2eaecc2f-f6fe-4171-b445-55c3a2d33760,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a641519-9d0f-47c5-b1e3-e96f2a4411a2", "address": "fa:16:3e:83:76:22", "network": {"id": "5c50496a-0882-415b-8115-ddf7b65516a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-531638472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f569146bb9b04838ad8044260da6ad58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a641519-9d", "ovs_interfaceid": "5a641519-9d0f-47c5-b1e3-e96f2a4411a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:02:09 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-14043515-dfec-4fff-aaae-63803d257c25 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Converting VIF {"id": "5a641519-9d0f-47c5-b1e3-e96f2a4411a2", "address": "fa:16:3e:83:76:22", "network": {"id": "5c50496a-0882-415b-8115-ddf7b65516a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-531638472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f569146bb9b04838ad8044260da6ad58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a641519-9d", "ovs_interfaceid": "5a641519-9d0f-47c5-b1e3-e96f2a4411a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:02:09 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-14043515-dfec-4fff-aaae-63803d257c25 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:76:22,bridge_name='br-int',has_traffic_filtering=True,id=5a641519-9d0f-47c5-b1e3-e96f2a4411a2,network=Network(5c50496a-0882-415b-8115-ddf7b65516a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a641519-9d') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:02:09 user nova-compute[74348]: DEBUG os_vif [None req-14043515-dfec-4fff-aaae-63803d257c25 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:76:22,bridge_name='br-int',has_traffic_filtering=True,id=5a641519-9d0f-47c5-b1e3-e96f2a4411a2,network=Network(5c50496a-0882-415b-8115-ddf7b65516a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a641519-9d') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:02:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a641519-9d, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:02:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:02:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b161a320-3135-4d4b-a402-5bec981be022) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:02:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:02:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:09 user nova-compute[74348]: INFO os_vif [None req-14043515-dfec-4fff-aaae-63803d257c25 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:76:22,bridge_name='br-int',has_traffic_filtering=True,id=5a641519-9d0f-47c5-b1e3-e96f2a4411a2,network=Network(5c50496a-0882-415b-8115-ddf7b65516a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a641519-9d')
Nov 22 08:02:09 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-14043515-dfec-4fff-aaae-63803d257c25 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Deleting instance files /opt/stack/data/nova/instances/2eaecc2f-f6fe-4171-b445-55c3a2d33760_del
Nov 22 08:02:09 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-14043515-dfec-4fff-aaae-63803d257c25 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Deletion of /opt/stack/data/nova/instances/2eaecc2f-f6fe-4171-b445-55c3a2d33760_del complete
Nov 22 08:02:09 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Instance destroyed successfully.
Nov 22 08:02:09 user nova-compute[74348]: DEBUG nova.objects.instance [None req-7579993a-5a46-4cdc-a8d0-25b7e1b34d47 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lazy-loading 'resources' on Instance uuid 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:02:09 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-7579993a-5a46-4cdc-a8d0-25b7e1b34d47 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:00:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-335042483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-335042483',id=22,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHPUs6p+/jls1RPfIFV5xXa9y76RX5cEwthTUZNcmPfI6OBMJxFWtX95JSXaEnXQjIlzA5fswFbK+8eLhdSOUct5GBpwfuknlt+F7shfIItWr4KCKRAfovZkkd27ju+WQ==',key_name='tempest-keypair-1302414391',keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:00:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='444367658c0241d0b5b377a73fedb52b',ramdisk_id='',reservation_id='r-ihwqqxt1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1610098589',owner_user_name='tempest-AttachVolumeShelveTestJSON-1610098589-project-member',shelved_at='2023-11-22T08:02:08.277750',shelved_host='user',shelved_image_id='9c823066-c0c6-4571-af4c-0788bb06b9ce'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T08:02:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e8ce0d767724228bfd6cf3a4afad00d',uuid=3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "6c9d4040-2941-469b-b602-69cc8b6e879b", "address": "fa:16:3e:b0:44:f3", "network": {"id": "4ef640bb-4a2f-4f98-8b01-b5df87fcb35a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1216437312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444367658c0241d0b5b377a73fedb52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9d4040-29", "ovs_interfaceid": "6c9d4040-2941-469b-b602-69cc8b6e879b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:02:09 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-7579993a-5a46-4cdc-a8d0-25b7e1b34d47 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Converting VIF {"id": "6c9d4040-2941-469b-b602-69cc8b6e879b", "address": "fa:16:3e:b0:44:f3", "network": {"id": "4ef640bb-4a2f-4f98-8b01-b5df87fcb35a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1216437312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444367658c0241d0b5b377a73fedb52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9d4040-29", "ovs_interfaceid": "6c9d4040-2941-469b-b602-69cc8b6e879b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:02:09 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-7579993a-5a46-4cdc-a8d0-25b7e1b34d47 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:44:f3,bridge_name='br-int',has_traffic_filtering=True,id=6c9d4040-2941-469b-b602-69cc8b6e879b,network=Network(4ef640bb-4a2f-4f98-8b01-b5df87fcb35a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9d4040-29') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:02:09 user nova-compute[74348]: DEBUG os_vif [None req-7579993a-5a46-4cdc-a8d0-25b7e1b34d47 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:44:f3,bridge_name='br-int',has_traffic_filtering=True,id=6c9d4040-2941-469b-b602-69cc8b6e879b,network=Network(4ef640bb-4a2f-4f98-8b01-b5df87fcb35a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9d4040-29') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:02:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c9d4040-29, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:02:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:09 user nova-compute[74348]: DEBUG nova.compute.manager [req-5fe1150b-8f29-49da-ac69-6899b39fe9a9 req-fc736161-a804-4510-bed8-05310bf36a3e service nova] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Received event network-changed-6c9d4040-2941-469b-b602-69cc8b6e879b {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:02:09 user nova-compute[74348]: DEBUG nova.compute.manager [req-5fe1150b-8f29-49da-ac69-6899b39fe9a9 req-fc736161-a804-4510-bed8-05310bf36a3e service nova] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Refreshing instance network info cache due to event network-changed-6c9d4040-2941-469b-b602-69cc8b6e879b. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:02:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-5fe1150b-8f29-49da-ac69-6899b39fe9a9 req-fc736161-a804-4510-bed8-05310bf36a3e service nova] Acquiring lock "refresh_cache-3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:02:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-5fe1150b-8f29-49da-ac69-6899b39fe9a9 req-fc736161-a804-4510-bed8-05310bf36a3e service nova] Acquired lock "refresh_cache-3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:02:09 user nova-compute[74348]: DEBUG nova.network.neutron [req-5fe1150b-8f29-49da-ac69-6899b39fe9a9 req-fc736161-a804-4510-bed8-05310bf36a3e service nova] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Refreshing network info cache for port 6c9d4040-2941-469b-b602-69cc8b6e879b {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:02:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:02:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fbd6a911-8e1a-4984-a59f-b901651338e6) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:02:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:02:09 user nova-compute[74348]: INFO os_vif [None req-7579993a-5a46-4cdc-a8d0-25b7e1b34d47 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:44:f3,bridge_name='br-int',has_traffic_filtering=True,id=6c9d4040-2941-469b-b602-69cc8b6e879b,network=Network(4ef640bb-4a2f-4f98-8b01-b5df87fcb35a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9d4040-29')
Nov 22 08:02:09 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-7579993a-5a46-4cdc-a8d0-25b7e1b34d47 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Deleting instance files /opt/stack/data/nova/instances/3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0_del
Nov 22 08:02:09 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-7579993a-5a46-4cdc-a8d0-25b7e1b34d47 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Deletion of /opt/stack/data/nova/instances/3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0_del complete
Nov 22 08:02:09 user nova-compute[74348]: INFO nova.compute.manager [None req-14043515-dfec-4fff-aaae-63803d257c25 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 22 08:02:09 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-14043515-dfec-4fff-aaae-63803d257c25 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 08:02:09 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 08:02:09 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 08:02:09 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-7579993a-5a46-4cdc-a8d0-25b7e1b34d47 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Deleted allocations for instance 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0
Nov 22 08:02:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7579993a-5a46-4cdc-a8d0-25b7e1b34d47 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7579993a-5a46-4cdc-a8d0-25b7e1b34d47 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:09 user nova-compute[74348]: DEBUG nova.objects.instance [None req-7579993a-5a46-4cdc-a8d0-25b7e1b34d47 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lazy-loading 'numa_topology' on Instance uuid 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:02:09 user nova-compute[74348]: DEBUG nova.objects.base [None req-7579993a-5a46-4cdc-a8d0-25b7e1b34d47 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Object Instance<3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0> lazy-loaded attributes: resources,numa_topology {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:02:10 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-7579993a-5a46-4cdc-a8d0-25b7e1b34d47 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:02:10 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-7579993a-5a46-4cdc-a8d0-25b7e1b34d47 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:02:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7579993a-5a46-4cdc-a8d0-25b7e1b34d47 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.457s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7579993a-5a46-4cdc-a8d0-25b7e1b34d47 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.424s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:10 user nova-compute[74348]: DEBUG nova.network.neutron [req-5fe1150b-8f29-49da-ac69-6899b39fe9a9 req-fc736161-a804-4510-bed8-05310bf36a3e service nova] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Updated VIF entry in instance network info cache for port 6c9d4040-2941-469b-b602-69cc8b6e879b. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:02:10 user nova-compute[74348]: DEBUG nova.network.neutron [req-5fe1150b-8f29-49da-ac69-6899b39fe9a9 req-fc736161-a804-4510-bed8-05310bf36a3e service nova] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Updating instance_info_cache with network_info: [{"id": "6c9d4040-2941-469b-b602-69cc8b6e879b", "address": "fa:16:3e:b0:44:f3", "network": {"id": "4ef640bb-4a2f-4f98-8b01-b5df87fcb35a", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1216437312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444367658c0241d0b5b377a73fedb52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap6c9d4040-29", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:02:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-5fe1150b-8f29-49da-ac69-6899b39fe9a9 req-fc736161-a804-4510-bed8-05310bf36a3e service nova] Releasing lock "refresh_cache-3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:02:10 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:02:10 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Took 1.07 seconds to deallocate network for instance.
Nov 22 08:02:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-14043515-dfec-4fff-aaae-63803d257c25 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-14043515-dfec-4fff-aaae-63803d257c25 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:11 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-14043515-dfec-4fff-aaae-63803d257c25 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:02:11 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-14043515-dfec-4fff-aaae-63803d257c25 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:02:11 user nova-compute[74348]: DEBUG nova.compute.manager [req-a1fdbac8-1f45-4e77-a493-c720b2e574a3 req-3c616b40-861a-4fcb-904b-d553879c6ed8 service nova] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Received event network-vif-plugged-5a641519-9d0f-47c5-b1e3-e96f2a4411a2 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:02:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a1fdbac8-1f45-4e77-a493-c720b2e574a3 req-3c616b40-861a-4fcb-904b-d553879c6ed8 service nova] Acquiring lock "2eaecc2f-f6fe-4171-b445-55c3a2d33760-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a1fdbac8-1f45-4e77-a493-c720b2e574a3 req-3c616b40-861a-4fcb-904b-d553879c6ed8 service nova] Lock "2eaecc2f-f6fe-4171-b445-55c3a2d33760-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a1fdbac8-1f45-4e77-a493-c720b2e574a3 req-3c616b40-861a-4fcb-904b-d553879c6ed8 service nova] Lock "2eaecc2f-f6fe-4171-b445-55c3a2d33760-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:11 user nova-compute[74348]: DEBUG nova.compute.manager [req-a1fdbac8-1f45-4e77-a493-c720b2e574a3 req-3c616b40-861a-4fcb-904b-d553879c6ed8 service nova] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] No waiting events found dispatching network-vif-plugged-5a641519-9d0f-47c5-b1e3-e96f2a4411a2 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:02:11 user nova-compute[74348]: WARNING nova.compute.manager [req-a1fdbac8-1f45-4e77-a493-c720b2e574a3 req-3c616b40-861a-4fcb-904b-d553879c6ed8 service nova] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Received unexpected event network-vif-plugged-5a641519-9d0f-47c5-b1e3-e96f2a4411a2 for instance with vm_state deleted and task_state None.
Nov 22 08:02:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-14043515-dfec-4fff-aaae-63803d257c25 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.274s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:11 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-14043515-dfec-4fff-aaae-63803d257c25 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Deleted allocations for instance 2eaecc2f-f6fe-4171-b445-55c3a2d33760
Nov 22 08:02:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-14043515-dfec-4fff-aaae-63803d257c25 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "2eaecc2f-f6fe-4171-b445-55c3a2d33760" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.463s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:11 user nova-compute[74348]: DEBUG nova.compute.manager [req-17db5dbf-9e69-4351-973e-1c77d857cde7 req-1ced8235-71a9-4b75-9594-5896e7dba43c service nova] [instance: 2eaecc2f-f6fe-4171-b445-55c3a2d33760] Received event network-vif-deleted-5a641519-9d0f-47c5-b1e3-e96f2a4411a2 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:02:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-44e25017-354a-466f-95a7-4e6f7b3bb855 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Acquiring lock "74cb3261-4f66-4d23-9e88-3c7bd53cfb01" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-44e25017-354a-466f-95a7-4e6f7b3bb855 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Lock "74cb3261-4f66-4d23-9e88-3c7bd53cfb01" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-44e25017-354a-466f-95a7-4e6f7b3bb855 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Acquiring lock "74cb3261-4f66-4d23-9e88-3c7bd53cfb01-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-44e25017-354a-466f-95a7-4e6f7b3bb855 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Lock "74cb3261-4f66-4d23-9e88-3c7bd53cfb01-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-44e25017-354a-466f-95a7-4e6f7b3bb855 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Lock "74cb3261-4f66-4d23-9e88-3c7bd53cfb01-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:15 user nova-compute[74348]: INFO nova.compute.manager [None req-44e25017-354a-466f-95a7-4e6f7b3bb855 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Terminating instance
Nov 22 08:02:15 user nova-compute[74348]: DEBUG nova.compute.manager [None req-44e25017-354a-466f-95a7-4e6f7b3bb855 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 08:02:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:16 user nova-compute[74348]: DEBUG nova.compute.manager [req-3eb73482-1b69-4c54-a5f6-9d469590160c req-fbd94b1d-7356-4d00-9c96-a51f3bfea42d service nova] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Received event network-vif-unplugged-a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:02:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3eb73482-1b69-4c54-a5f6-9d469590160c req-fbd94b1d-7356-4d00-9c96-a51f3bfea42d service nova] Acquiring lock "74cb3261-4f66-4d23-9e88-3c7bd53cfb01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3eb73482-1b69-4c54-a5f6-9d469590160c req-fbd94b1d-7356-4d00-9c96-a51f3bfea42d service nova] Lock "74cb3261-4f66-4d23-9e88-3c7bd53cfb01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3eb73482-1b69-4c54-a5f6-9d469590160c req-fbd94b1d-7356-4d00-9c96-a51f3bfea42d service nova] Lock "74cb3261-4f66-4d23-9e88-3c7bd53cfb01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:16 user nova-compute[74348]: DEBUG nova.compute.manager [req-3eb73482-1b69-4c54-a5f6-9d469590160c req-fbd94b1d-7356-4d00-9c96-a51f3bfea42d service nova] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] No waiting events found dispatching network-vif-unplugged-a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:02:16 user nova-compute[74348]: DEBUG nova.compute.manager [req-3eb73482-1b69-4c54-a5f6-9d469590160c req-fbd94b1d-7356-4d00-9c96-a51f3bfea42d service nova] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Received event network-vif-unplugged-a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 08:02:16 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Instance destroyed successfully.
Nov 22 08:02:16 user nova-compute[74348]: DEBUG nova.objects.instance [None req-44e25017-354a-466f-95a7-4e6f7b3bb855 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Lazy-loading 'resources' on Instance uuid 74cb3261-4f66-4d23-9e88-3c7bd53cfb01 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:02:16 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-44e25017-354a-466f-95a7-4e6f7b3bb855 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:00:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1458749919',display_name='tempest-VolumesActionsTest-instance-1458749919',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1458749919',id=23,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:00:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d9ac02b435a54124b9b8cfc3afeb9e57',ramdisk_id='',reservation_id='r-f3zqe1ht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1791306803',owner_user_name='tempest-VolumesActionsTest-1791306803-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T08:00:31Z,user_data=None,user_id='03aac0b5680c431592326486b1d030b9',uuid=74cb3261-4f66-4d23-9e88-3c7bd53cfb01,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d", "address": "fa:16:3e:74:b9:e6", "network": {"id": "58371390-13da-4593-a6f1-32b2c60f5e7d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2101379319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ac02b435a54124b9b8cfc3afeb9e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6dc4fff-0d", "ovs_interfaceid": "a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:02:16 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-44e25017-354a-466f-95a7-4e6f7b3bb855 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Converting VIF {"id": "a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d", "address": "fa:16:3e:74:b9:e6", "network": {"id": "58371390-13da-4593-a6f1-32b2c60f5e7d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2101379319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ac02b435a54124b9b8cfc3afeb9e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6dc4fff-0d", "ovs_interfaceid": "a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:02:16 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-44e25017-354a-466f-95a7-4e6f7b3bb855 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:b9:e6,bridge_name='br-int',has_traffic_filtering=True,id=a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d,network=Network(58371390-13da-4593-a6f1-32b2c60f5e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6dc4fff-0d') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:02:16 user nova-compute[74348]: DEBUG os_vif [None req-44e25017-354a-466f-95a7-4e6f7b3bb855 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:b9:e6,bridge_name='br-int',has_traffic_filtering=True,id=a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d,network=Network(58371390-13da-4593-a6f1-32b2c60f5e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6dc4fff-0d') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:02:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6dc4fff-0d, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:02:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=14f2d455-c141-464b-ad46-4da16152c296) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:02:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:16 user nova-compute[74348]: INFO os_vif [None req-44e25017-354a-466f-95a7-4e6f7b3bb855 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:b9:e6,bridge_name='br-int',has_traffic_filtering=True,id=a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d,network=Network(58371390-13da-4593-a6f1-32b2c60f5e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6dc4fff-0d')
Nov 22 08:02:16 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-44e25017-354a-466f-95a7-4e6f7b3bb855 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Deleting instance files /opt/stack/data/nova/instances/74cb3261-4f66-4d23-9e88-3c7bd53cfb01_del
Nov 22 08:02:16 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-44e25017-354a-466f-95a7-4e6f7b3bb855 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Deletion of /opt/stack/data/nova/instances/74cb3261-4f66-4d23-9e88-3c7bd53cfb01_del complete
Nov 22 08:02:16 user nova-compute[74348]: INFO nova.compute.manager [None req-44e25017-354a-466f-95a7-4e6f7b3bb855 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 22 08:02:16 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-44e25017-354a-466f-95a7-4e6f7b3bb855 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 08:02:16 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 08:02:16 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 08:02:17 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:02:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:17 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Took 0.44 seconds to deallocate network for instance.
Nov 22 08:02:17 user nova-compute[74348]: DEBUG nova.compute.manager [req-033936d0-2117-40e7-b5bc-e5b88489d49b req-32ca4001-4e4e-40fd-99c8-665fec416dda service nova] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Received event network-vif-deleted-a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:02:17 user nova-compute[74348]: INFO nova.compute.manager [req-033936d0-2117-40e7-b5bc-e5b88489d49b req-32ca4001-4e4e-40fd-99c8-665fec416dda service nova] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Neutron deleted interface a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d; detaching it from the instance and deleting it from the info cache
Nov 22 08:02:17 user nova-compute[74348]: DEBUG nova.network.neutron [req-033936d0-2117-40e7-b5bc-e5b88489d49b req-32ca4001-4e4e-40fd-99c8-665fec416dda service nova] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:02:17 user nova-compute[74348]: DEBUG nova.compute.manager [req-033936d0-2117-40e7-b5bc-e5b88489d49b req-32ca4001-4e4e-40fd-99c8-665fec416dda service nova] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Detach interface failed, port_id=a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d, reason: Instance 74cb3261-4f66-4d23-9e88-3c7bd53cfb01 could not be found. {{(pid=74348) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 08:02:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-44e25017-354a-466f-95a7-4e6f7b3bb855 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-44e25017-354a-466f-95a7-4e6f7b3bb855 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:17 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-44e25017-354a-466f-95a7-4e6f7b3bb855 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:02:17 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-44e25017-354a-466f-95a7-4e6f7b3bb855 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:02:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-44e25017-354a-466f-95a7-4e6f7b3bb855 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.284s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:17 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-44e25017-354a-466f-95a7-4e6f7b3bb855 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Deleted allocations for instance 74cb3261-4f66-4d23-9e88-3c7bd53cfb01
Nov 22 08:02:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-44e25017-354a-466f-95a7-4e6f7b3bb855 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Lock "74cb3261-4f66-4d23-9e88-3c7bd53cfb01" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.150s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:18 user nova-compute[74348]: DEBUG nova.compute.manager [req-9a1da807-6c8a-42e2-a198-3e371756e446 req-f225d3f6-857d-4a2d-83da-c7c19b6db985 service nova] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Received event network-vif-plugged-a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:02:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9a1da807-6c8a-42e2-a198-3e371756e446 req-f225d3f6-857d-4a2d-83da-c7c19b6db985 service nova] Acquiring lock "74cb3261-4f66-4d23-9e88-3c7bd53cfb01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9a1da807-6c8a-42e2-a198-3e371756e446 req-f225d3f6-857d-4a2d-83da-c7c19b6db985 service nova] Lock "74cb3261-4f66-4d23-9e88-3c7bd53cfb01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9a1da807-6c8a-42e2-a198-3e371756e446 req-f225d3f6-857d-4a2d-83da-c7c19b6db985 service nova] Lock "74cb3261-4f66-4d23-9e88-3c7bd53cfb01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:18 user nova-compute[74348]: DEBUG nova.compute.manager [req-9a1da807-6c8a-42e2-a198-3e371756e446 req-f225d3f6-857d-4a2d-83da-c7c19b6db985 service nova] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] No waiting events found dispatching network-vif-plugged-a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:02:18 user nova-compute[74348]: WARNING nova.compute.manager [req-9a1da807-6c8a-42e2-a198-3e371756e446 req-f225d3f6-857d-4a2d-83da-c7c19b6db985 service nova] [instance: 74cb3261-4f66-4d23-9e88-3c7bd53cfb01] Received unexpected event network-vif-plugged-a6dc4fff-0d8f-4ea6-9f6f-c9f8b497764d for instance with vm_state deleted and task_state None.
Nov 22 08:02:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:21 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:24 user nova-compute[74348]: INFO nova.compute.manager [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Rescuing
Nov 22 08:02:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "refresh_cache-b8f84c0b-fab5-4900-bf65-270c9c06baf8" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:02:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquired lock "refresh_cache-b8f84c0b-fab5-4900-bf65-270c9c06baf8" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:02:24 user nova-compute[74348]: DEBUG nova.network.neutron [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:02:25 user nova-compute[74348]: DEBUG nova.network.neutron [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Updating instance_info_cache with network_info: [{"id": "72e5b044-9d3b-412d-9a20-408387fb6fe6", "address": "fa:16:3e:5d:93:c7", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e5b044-9d", "ovs_interfaceid": "72e5b044-9d3b-412d-9a20-408387fb6fe6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:02:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Releasing lock "refresh_cache-b8f84c0b-fab5-4900-bf65-270c9c06baf8" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:02:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:25 user nova-compute[74348]: DEBUG nova.compute.manager [req-dd01581e-5600-4114-bf4c-4ebb606f73d7 req-4f0cf4ad-2a9a-43a2-b80b-63418dd85b93 service nova] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Received event network-vif-unplugged-72e5b044-9d3b-412d-9a20-408387fb6fe6 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:02:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-dd01581e-5600-4114-bf4c-4ebb606f73d7 req-4f0cf4ad-2a9a-43a2-b80b-63418dd85b93 service nova] Acquiring lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-dd01581e-5600-4114-bf4c-4ebb606f73d7 req-4f0cf4ad-2a9a-43a2-b80b-63418dd85b93 service nova] Lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-dd01581e-5600-4114-bf4c-4ebb606f73d7 req-4f0cf4ad-2a9a-43a2-b80b-63418dd85b93 service nova] Lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:25 user nova-compute[74348]: DEBUG nova.compute.manager [req-dd01581e-5600-4114-bf4c-4ebb606f73d7 req-4f0cf4ad-2a9a-43a2-b80b-63418dd85b93 service nova] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] No waiting events found dispatching network-vif-unplugged-72e5b044-9d3b-412d-9a20-408387fb6fe6 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:02:25 user nova-compute[74348]: WARNING nova.compute.manager [req-dd01581e-5600-4114-bf4c-4ebb606f73d7 req-4f0cf4ad-2a9a-43a2-b80b-63418dd85b93 service nova] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Received unexpected event network-vif-unplugged-72e5b044-9d3b-412d-9a20-408387fb6fe6 for instance with vm_state active and task_state rescuing.
Nov 22 08:02:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:26 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Instance destroyed successfully.
Nov 22 08:02:26 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Attempting a stable device rescue
Nov 22 08:02:26 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74348) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 22 08:02:26 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Instance directory exists: not creating {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 22 08:02:26 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Creating image(s)
Nov 22 08:02:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "/opt/stack/data/nova/instances/b8f84c0b-fab5-4900-bf65-270c9c06baf8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "/opt/stack/data/nova/instances/b8f84c0b-fab5-4900-bf65-270c9c06baf8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "/opt/stack/data/nova/instances/b8f84c0b-fab5-4900-bf65-270c9c06baf8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:26 user nova-compute[74348]: DEBUG nova.objects.instance [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lazy-loading 'trusted_certs' on Instance uuid b8f84c0b-fab5-4900-bf65-270c9c06baf8 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:02:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "7c8539d873e018dbefb214a5b90fc70a13691f17" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "7c8539d873e018dbefb214a5b90fc70a13691f17" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:27 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c8539d873e018dbefb214a5b90fc70a13691f17.part --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:02:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:27 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c8539d873e018dbefb214a5b90fc70a13691f17.part --force-share --output=json" returned: 0 in 0.171s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:02:27 user nova-compute[74348]: DEBUG nova.virt.images [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] 143d453d-406e-4e6c-8bcf-5a60becbf2b0 was qcow2, converting to raw {{(pid=74348) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 22 08:02:27 user nova-compute[74348]: DEBUG nova.privsep.utils [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74348) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 08:02:27 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7c8539d873e018dbefb214a5b90fc70a13691f17.part /opt/stack/data/nova/instances/_base/7c8539d873e018dbefb214a5b90fc70a13691f17.converted {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG nova.compute.manager [req-9a1038a4-e824-4653-b59c-1b2fca37e543 req-833637d9-8177-4e68-adb6-1e4266966a82 service nova] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Received event network-vif-plugged-72e5b044-9d3b-412d-9a20-408387fb6fe6 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9a1038a4-e824-4653-b59c-1b2fca37e543 req-833637d9-8177-4e68-adb6-1e4266966a82 service nova] Acquiring lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9a1038a4-e824-4653-b59c-1b2fca37e543 req-833637d9-8177-4e68-adb6-1e4266966a82 service nova] Lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9a1038a4-e824-4653-b59c-1b2fca37e543 req-833637d9-8177-4e68-adb6-1e4266966a82 service nova] Lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG nova.compute.manager [req-9a1038a4-e824-4653-b59c-1b2fca37e543 req-833637d9-8177-4e68-adb6-1e4266966a82 service nova] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] No waiting events found dispatching network-vif-plugged-72e5b044-9d3b-412d-9a20-408387fb6fe6 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:02:28 user nova-compute[74348]: WARNING nova.compute.manager [req-9a1038a4-e824-4653-b59c-1b2fca37e543 req-833637d9-8177-4e68-adb6-1e4266966a82 service nova] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Received unexpected event network-vif-plugged-72e5b044-9d3b-412d-9a20-408387fb6fe6 for instance with vm_state active and task_state rescuing.
Nov 22 08:02:28 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7c8539d873e018dbefb214a5b90fc70a13691f17.part /opt/stack/data/nova/instances/_base/7c8539d873e018dbefb214a5b90fc70a13691f17.converted" returned: 0 in 0.517s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c8539d873e018dbefb214a5b90fc70a13691f17.converted --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c8539d873e018dbefb214a5b90fc70a13691f17.converted --force-share --output=json" returned: 0 in 0.191s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "7c8539d873e018dbefb214a5b90fc70a13691f17" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.103s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "7c8539d873e018dbefb214a5b90fc70a13691f17" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "7c8539d873e018dbefb214a5b90fc70a13691f17" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c8539d873e018dbefb214a5b90fc70a13691f17 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c8539d873e018dbefb214a5b90fc70a13691f17 --force-share --output=json" returned: 0 in 0.181s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c8539d873e018dbefb214a5b90fc70a13691f17,backing_fmt=raw /opt/stack/data/nova/instances/b8f84c0b-fab5-4900-bf65-270c9c06baf8/disk.rescue {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c8539d873e018dbefb214a5b90fc70a13691f17,backing_fmt=raw /opt/stack/data/nova/instances/b8f84c0b-fab5-4900-bf65-270c9c06baf8/disk.rescue" returned: 0 in 0.044s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "7c8539d873e018dbefb214a5b90fc70a13691f17" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG nova.objects.instance [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lazy-loading 'migration_context' on Instance uuid b8f84c0b-fab5-4900-bf65-270c9c06baf8 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG nova.objects.base [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Object Instance<b8f84c0b-fab5-4900-bf65-270c9c06baf8> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Start _get_guest_xml network_info=[{"id": "72e5b044-9d3b-412d-9a20-408387fb6fe6", "address": "fa:16:3e:5d:93:c7", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "vif_mac": "fa:16:3e:5d:93:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e5b044-9d", "ovs_interfaceid": "72e5b044-9d3b-412d-9a20-408387fb6fe6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '143d453d-406e-4e6c-8bcf-5a60becbf2b0', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nVWumQGy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'b8f84c0b-fab5-4900-bf65-270c9c06baf8', 'attached_at': '', 'detached_at': '', 'volume_id': '75590810-f559-484b-947e-9e6f1397e7f8', 'serial': '75590810-f559-484b-947e-9e6f1397e7f8'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'bf76742b-ee21-43e4-b7c3-fbaafe60ea45', 'volume_type': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG nova.objects.instance [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lazy-loading 'resources' on Instance uuid b8f84c0b-fab5-4900-bf65-270c9c06baf8 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG nova.objects.base [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Object Instance<b8f84c0b-fab5-4900-bf65-270c9c06baf8> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG nova.objects.instance [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lazy-loading 'numa_topology' on Instance uuid b8f84c0b-fab5-4900-bf65-270c9c06baf8 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG nova.objects.base [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Object Instance<b8f84c0b-fab5-4900-bf65-270c9c06baf8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:02:28 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:02:28 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:02:28 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG nova.objects.instance [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lazy-loading 'vcpu_model' on Instance uuid b8f84c0b-fab5-4900-bf65-270c9c06baf8 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG nova.objects.base [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Object Instance<b8f84c0b-fab5-4900-bf65-270c9c06baf8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nVWumQGy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:02:28 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:02:28 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:02:28 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:02:28 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:02:28 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 08:02:28 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6697f89f-583f-42b2-abcc-5d9e64c2e1b0]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = nVWumQGy\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 22 08:02:28 user nova-compute[74348]: node.name = iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8
Nov 22 08:02:28 user nova-compute[74348]: node.tpgt = -1
Nov 22 08:02:28 user nova-compute[74348]: node.startup = automatic
Nov 22 08:02:28 user nova-compute[74348]: node.leading_login = No
Nov 22 08:02:28 user nova-compute[74348]: iface.iscsi_ifacename = default
Nov 22 08:02:28 user nova-compute[74348]: iface.net_ifacename = <empty>
Nov 22 08:02:28 user nova-compute[74348]: iface.ipaddress = <empty>
Nov 22 08:02:28 user nova-compute[74348]: iface.prefix_len = 0
Nov 22 08:02:28 user nova-compute[74348]: iface.hwaddress = <empty>
Nov 22 08:02:28 user nova-compute[74348]: iface.transport_name = tcp
Nov 22 08:02:28 user nova-compute[74348]: iface.initiatorname = <empty>
Nov 22 08:02:28 user nova-compute[74348]: iface.state = <empty>
Nov 22 08:02:28 user nova-compute[74348]: iface.vlan_id = 0
Nov 22 08:02:28 user nova-compute[74348]: iface.vlan_priority = 0
Nov 22 08:02:28 user nova-compute[74348]: iface.vlan_state = <empty>
Nov 22 08:02:28 user nova-compute[74348]: iface.iface_num = 0
Nov 22 08:02:28 user nova-compute[74348]: iface.mtu = 0
Nov 22 08:02:28 user nova-compute[74348]: iface.port = 0
Nov 22 08:02:28 user nova-compute[74348]: iface.bootproto = <empty>
Nov 22 08:02:28 user nova-compute[74348]: iface.subnet_mask = <empty>
Nov 22 08:02:28 user nova-compute[74348]: iface.gateway = <empty>
Nov 22 08:02:28 user nova-compute[74348]: iface.dhcp_alt_client_id_state = <empty>
Nov 22 08:02:28 user nova-compute[74348]: iface.dhcp_alt_client_id = <empty>
Nov 22 08:02:28 user nova-compute[74348]: iface.dhcp_dns = <empty>
Nov 22 08:02:28 user nova-compute[74348]: iface.dhcp_learn_iqn = <empty>
Nov 22 08:02:28 user nova-compute[74348]: iface.dhcp_req_vendor_id_state = <empty>
Nov 22 08:02:28 user nova-compute[74348]: iface.dhcp_vendor_id_state = <empty>
Nov 22 08:02:28 user nova-compute[74348]: iface.dhcp_vendor_id = <empty>
Nov 22 08:02:28 user nova-compute[74348]: iface.dhcp_slp_da = <empty>
Nov 22 08:02:28 user nova-compute[74348]: iface.fragmentation = <empty>
Nov 22 08:02:28 user nova-compute[74348]: iface.gratuitous_arp = <empty>
Nov 22 08:02:28 user nova-compute[74348]: iface.incoming_forwarding = <empty>
Nov 22 08:02:28 user nova-compute[74348]: iface.tos_state = <empty>
Nov 22 08:02:28 user nova-compute[74348]: iface.tos = 0
Nov 22 08:02:28 user nova-compute[74348]: iface.ttl = 0
Nov 22 08:02:28 user nova-compute[74348]: iface.delayed_ack = <empty>
Nov 22 08:02:28 user nova-compute[74348]: iface.tcp_nagle = <empty>
Nov 22 08:02:28 user nova-compute[74348]: iface.tcp_wsf_state = <empty>
Nov 22 08:02:28 user nova-compute[74348]: iface.tcp_wsf = 0
Nov 22 08:02:28 user nova-compute[74348]: iface.tcp_timer_scale = 0
Nov 22 08:02:28 user nova-compute[74348]: iface.tcp_timestamp = <empty>
Nov 22 08:02:28 user nova-compute[74348]: iface.redirect = <empty>
Nov 22 08:02:28 user nova-compute[74348]: iface.def_task_mgmt_timeout = 0
Nov 22 08:02:28 user nova-compute[74348]: iface.header_digest = <empty>
Nov 22 08:02:28 user nova-compute[74348]: iface.data_digest = <empty>
Nov 22 08:02:28 user nova-compute[74348]: iface.immediate_data = <empty>
Nov 22 08:02:28 user nova-compute[74348]: iface.initial_r2t = <empty>
Nov 22 08:02:28 user nova-compute[74348]: iface.data_seq_inorder = <empty>
Nov 22 08:02:28 user nova-compute[74348]: iface.data_pdu_inorder = <empty>
Nov 22 08:02:28 user nova-compute[74348]: iface.erl = 0
Nov 22 08:02:28 user nova-compute[74348]: iface.max_receive_data_len = 0
Nov 22 08:02:28 user nova-compute[74348]: iface.first_burst_len = 0
Nov 22 08:02:28 user nova-compute[74348]: iface.max_outstanding_r2t = 0
Nov 22 08:02:28 user nova-compute[74348]: iface.max_burst_len = 0
Nov 22 08:02:28 user nova-compute[74348]: iface.chap_auth = <empty>
Nov 22 08:02:28 user nova-compute[74348]: iface.bidi_chap = <empty>
Nov 22 08:02:28 user nova-compute[74348]: iface.strict_login_compliance = <empty>
Nov 22 08:02:28 user nova-compute[74348]: iface.discovery_auth = <empty>
Nov 22 08:02:28 user nova-compute[74348]: iface.discovery_logout = <empty>
Nov 22 08:02:28 user nova-compute[74348]: node.discovery_address = <empty>
Nov 22 08:02:28 user nova-compute[74348]: node.discovery_port = 0
Nov 22 08:02:28 user nova-compute[74348]: node.discovery_type = static
Nov 22 08:02:28 user nova-compute[74348]: node.session.initial_cmdsn = 0
Nov 22 08:02:28 user nova-compute[74348]: node.session.initial_login_retry_max = 8
Nov 22 08:02:28 user nova-compute[74348]: node.session.xmit_thread_priority = -20
Nov 22 08:02:28 user nova-compute[74348]: node.session.cmds_max = 128
Nov 22 08:02:28 user nova-compute[74348]: node.session.queue_depth = 32
Nov 22 08:02:28 user nova-compute[74348]: node.session.nr_sessions = 1
Nov 22 08:02:28 user nova-compute[74348]: node.session.auth.authmethod = CHAP
Nov 22 08:02:28 user nova-compute[74348]: node.session.auth.username = nVWumQGy
Nov 22 08:02:28 user nova-compute[74348]: node.session.auth.password = ***
Nov 22 08:02:28 user nova-compute[74348]: node.session.auth.username_in = <empty>
Nov 22 08:02:28 user nova-compute[74348]: node.session.auth.password_in = <empty>
Nov 22 08:02:28 user nova-compute[74348]: node.session.auth.chap_algs = MD5
Nov 22 08:02:28 user nova-compute[74348]: node.session.timeo.replacement_timeout = 120
Nov 22 08:02:28 user nova-compute[74348]: node.session.err_timeo.abort_timeout = 15
Nov 22 08:02:28 user nova-compute[74348]: node.session.err_timeo.lu_reset_timeout = 30
Nov 22 08:02:28 user nova-compute[74348]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 22 08:02:28 user nova-compute[74348]: node.session.err_timeo.host_reset_timeout = 60
Nov 22 08:02:28 user nova-compute[74348]: node.session.iscsi.FastAbort = Yes
Nov 22 08:02:28 user nova-compute[74348]: node.session.iscsi.InitialR2T = No
Nov 22 08:02:28 user nova-compute[74348]: node.session.iscsi.ImmediateData = Yes
Nov 22 08:02:28 user nova-compute[74348]: node.session.iscsi.FirstBurstLength = 262144
Nov 22 08:02:28 user nova-compute[74348]: node.session.iscsi.MaxBurstLength = 16776192
Nov 22 08:02:28 user nova-compute[74348]: node.session.iscsi.DefaultTime2Retain = 0
Nov 22 08:02:28 user nova-compute[74348]: node.session.iscsi.DefaultTime2Wait = 2
Nov 22 08:02:28 user nova-compute[74348]: node.session.iscsi.MaxConnections = 1
Nov 22 08:02:28 user nova-compute[74348]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 22 08:02:28 user nova-compute[74348]: node.session.iscsi.ERL = 0
Nov 22 08:02:28 user nova-compute[74348]: node.session.scan = manual
Nov 22 08:02:28 user nova-compute[74348]: node.session.reopen_max = 0
Nov 22 08:02:28 user nova-compute[74348]: node.conn[0].address = 172.16.0.220
Nov 22 08:02:28 user nova-compute[74348]: node.conn[0].port = 3260
Nov 22 08:02:28 user nova-compute[74348]: node.conn[0].startup = manual
Nov 22 08:02:28 user nova-compute[74348]: node.conn[0].tcp.window_size = 524288
Nov 22 08:02:28 user nova-compute[74348]: node.conn[0].tcp.type_of_service = 0
Nov 22 08:02:28 user nova-compute[74348]: node.conn[0].timeo.logout_timeout = 15
Nov 22 08:02:28 user nova-compute[74348]: node.conn[0].timeo.login_timeout = 15
Nov 22 08:02:28 user nova-compute[74348]: node.conn[0].timeo.auth_timeout = 45
Nov 22 08:02:28 user nova-compute[74348]: node.conn[0].timeo.noop_out_interval = 5
Nov 22 08:02:28 user nova-compute[74348]: node.conn[0].timeo.noop_out_timeout = 5
Nov 22 08:02:28 user nova-compute[74348]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 22 08:02:28 user nova-compute[74348]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 22 08:02:28 user nova-compute[74348]: node.conn[0].iscsi.HeaderDigest = None
Nov 22 08:02:28 user nova-compute[74348]: node.conn[0].iscsi.DataDigest = None
Nov 22 08:02:28 user nova-compute[74348]: node.conn[0].iscsi.IFMarker = No
Nov 22 08:02:28 user nova-compute[74348]: node.conn[0].iscsi.OFMarker = No
Nov 22 08:02:28 user nova-compute[74348]: # END RECORD
Nov 22 08:02:28 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[159b258c-4e68-427b-98bb-1f2033bc92e0]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:02:28 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:02:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:02:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[046feea9-a64a-4dfc-bfc2-f0d90ac6ceba]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:02:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:02:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nVWumQGy {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:02:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nVWumQGy" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:02:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[364833bc-351e-4e4d-a4d1-760061a118a7]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:02:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nVWumQGy'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:02:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:02:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:02:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[564cbbe3-0ffc-43fe-8be8-bbcb1ed46a41]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:02:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:02:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:02:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:02:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65262bd-b6de-412b-af51-08465bbcd908]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:02:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:02:29 user nova-compute[74348]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa (non-flash)
Nov 22 08:02:29 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:02:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:02:29 user nova-compute[74348]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa (non-flash)
Nov 22 08:02:29 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:02:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.157s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:02:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 08:02:29 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] HCTL ('33', '0', '0', 0) found on session 27 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 08:02:29 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 08:02:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:02:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.012s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:02:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[536f6b7a-954b-4175-bcac-d120d586fe36]: (4, ('0 0 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:02:29 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Searching for a device in session 27 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:02:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nVWumQGy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 08:02:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.180s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:02:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] <== connect_volume: return (182ms) {'type': 'block', 'scsi_wwn': '23662633762623831', 'path': '/dev/sdb'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:02:29 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662633762623831', 'path': '/dev/sdb'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 08:02:29 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:00:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1945716787',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1945716787',id=24,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:00:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a31d898cdc69494a8825e8d93a0d04bc',ramdisk_id='',reservation_id='r-9nke1bun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-502521972',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:00:52Z,user_data=None,user_id='1d5c8274eca14965b6cbfe22110f904d',uuid=b8f84c0b-fab5-4900-bf65-270c9c06baf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72e5b044-9d3b-412d-9a20-408387fb6fe6", "address": "fa:16:3e:5d:93:c7", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "vif_mac": "fa:16:3e:5d:93:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e5b044-9d", "ovs_interfaceid": "72e5b044-9d3b-412d-9a20-408387fb6fe6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 08:02:29 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Converting VIF {"id": "72e5b044-9d3b-412d-9a20-408387fb6fe6", "address": "fa:16:3e:5d:93:c7", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "vif_mac": "fa:16:3e:5d:93:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e5b044-9d", "ovs_interfaceid": "72e5b044-9d3b-412d-9a20-408387fb6fe6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:02:29 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:93:c7,bridge_name='br-int',has_traffic_filtering=True,id=72e5b044-9d3b-412d-9a20-408387fb6fe6,network=Network(6fe60468-191c-4d84-8dce-55c056f88936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72e5b044-9d') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:02:29 user nova-compute[74348]: DEBUG nova.objects.instance [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lazy-loading 'pci_devices' on Instance uuid b8f84c0b-fab5-4900-bf65-270c9c06baf8 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:02:29 user nova-compute[74348]: DEBUG nova.objects.base [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Object Instance<b8f84c0b-fab5-4900-bf65-270c9c06baf8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:02:29 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] End _get_guest_xml xml=<domain type="kvm">
Nov 22 08:02:29 user nova-compute[74348]:   <uuid>b8f84c0b-fab5-4900-bf65-270c9c06baf8</uuid>
Nov 22 08:02:29 user nova-compute[74348]:   <name>instance-00000018</name>
Nov 22 08:02:29 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 08:02:29 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 08:02:29 user nova-compute[74348]:   <metadata>
Nov 22 08:02:29 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 08:02:29 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 08:02:29 user nova-compute[74348]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1945716787</nova:name>
Nov 22 08:02:29 user nova-compute[74348]:       <nova:creationTime>2023-11-22 08:02:28</nova:creationTime>
Nov 22 08:02:29 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 08:02:29 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 08:02:29 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 08:02:29 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 08:02:29 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 08:02:29 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 08:02:29 user nova-compute[74348]:       </nova:flavor>
Nov 22 08:02:29 user nova-compute[74348]:       <nova:owner>
Nov 22 08:02:29 user nova-compute[74348]:         <nova:user uuid="1d5c8274eca14965b6cbfe22110f904d">tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member</nova:user>
Nov 22 08:02:29 user nova-compute[74348]:         <nova:project uuid="a31d898cdc69494a8825e8d93a0d04bc">tempest-ServerBootFromVolumeStableRescueTest-502521972</nova:project>
Nov 22 08:02:29 user nova-compute[74348]:       </nova:owner>
Nov 22 08:02:29 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 08:02:29 user nova-compute[74348]:       <nova:ports>
Nov 22 08:02:29 user nova-compute[74348]:         <nova:port uuid="72e5b044-9d3b-412d-9a20-408387fb6fe6">
Nov 22 08:02:29 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 22 08:02:29 user nova-compute[74348]:         </nova:port>
Nov 22 08:02:29 user nova-compute[74348]:       </nova:ports>
Nov 22 08:02:29 user nova-compute[74348]:     </nova:instance>
Nov 22 08:02:29 user nova-compute[74348]:   </metadata>
Nov 22 08:02:29 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 08:02:29 user nova-compute[74348]:     <system>
Nov 22 08:02:29 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 08:02:29 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 08:02:29 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 08:02:29 user nova-compute[74348]:       <entry name="serial">b8f84c0b-fab5-4900-bf65-270c9c06baf8</entry>
Nov 22 08:02:29 user nova-compute[74348]:       <entry name="uuid">b8f84c0b-fab5-4900-bf65-270c9c06baf8</entry>
Nov 22 08:02:29 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 08:02:29 user nova-compute[74348]:     </system>
Nov 22 08:02:29 user nova-compute[74348]:   </sysinfo>
Nov 22 08:02:29 user nova-compute[74348]:   <os>
Nov 22 08:02:29 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 08:02:29 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 08:02:29 user nova-compute[74348]:   </os>
Nov 22 08:02:29 user nova-compute[74348]:   <features>
Nov 22 08:02:29 user nova-compute[74348]:     <acpi/>
Nov 22 08:02:29 user nova-compute[74348]:     <apic/>
Nov 22 08:02:29 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 08:02:29 user nova-compute[74348]:   </features>
Nov 22 08:02:29 user nova-compute[74348]:   <clock offset="utc">
Nov 22 08:02:29 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 08:02:29 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 08:02:29 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 08:02:29 user nova-compute[74348]:   </clock>
Nov 22 08:02:29 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 08:02:29 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 08:02:29 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 08:02:29 user nova-compute[74348]:   </cpu>
Nov 22 08:02:29 user nova-compute[74348]:   <devices>
Nov 22 08:02:29 user nova-compute[74348]:     <disk type="block" device="disk">
Nov 22 08:02:29 user nova-compute[74348]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:02:29 user nova-compute[74348]:       <source dev="/dev/sdb"/>
Nov 22 08:02:29 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 08:02:29 user nova-compute[74348]:       <serial>75590810-f559-484b-947e-9e6f1397e7f8</serial>
Nov 22 08:02:29 user nova-compute[74348]:     </disk>
Nov 22 08:02:29 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 08:02:29 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 08:02:29 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/b8f84c0b-fab5-4900-bf65-270c9c06baf8/disk.rescue"/>
Nov 22 08:02:29 user nova-compute[74348]:       <target dev="vdb" bus="virtio"/>
Nov 22 08:02:29 user nova-compute[74348]:       <boot order="1"/>
Nov 22 08:02:29 user nova-compute[74348]:     </disk>
Nov 22 08:02:29 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 08:02:29 user nova-compute[74348]:       <mac address="fa:16:3e:5d:93:c7"/>
Nov 22 08:02:29 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:02:29 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 08:02:29 user nova-compute[74348]:       <target dev="tap72e5b044-9d"/>
Nov 22 08:02:29 user nova-compute[74348]:     </interface>
Nov 22 08:02:29 user nova-compute[74348]:     <serial type="pty">
Nov 22 08:02:29 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/b8f84c0b-fab5-4900-bf65-270c9c06baf8/console.log" append="off"/>
Nov 22 08:02:29 user nova-compute[74348]:     </serial>
Nov 22 08:02:29 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 08:02:29 user nova-compute[74348]:     <video>
Nov 22 08:02:29 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:02:29 user nova-compute[74348]:     </video>
Nov 22 08:02:29 user nova-compute[74348]:     <rng model="virtio">
Nov 22 08:02:29 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 08:02:29 user nova-compute[74348]:     </rng>
Nov 22 08:02:29 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 08:02:29 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 08:02:29 user nova-compute[74348]:       <stats period="10"/>
Nov 22 08:02:29 user nova-compute[74348]:     </memballoon>
Nov 22 08:02:29 user nova-compute[74348]:   </devices>
Nov 22 08:02:29 user nova-compute[74348]: </domain>
Nov 22 08:02:29 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 08:02:29 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Instance destroyed successfully.
Nov 22 08:02:29 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:02:29 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:02:29 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] No VIF found with MAC fa:16:3e:5d:93:c7, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:02:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:30 user nova-compute[74348]: DEBUG nova.compute.manager [req-f0b0b7b4-9edb-4395-9bf4-57a2b9ac83cf req-8be2f21f-ae3a-47d7-80e9-6efe7668950c service nova] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Received event network-vif-plugged-72e5b044-9d3b-412d-9a20-408387fb6fe6 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:02:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f0b0b7b4-9edb-4395-9bf4-57a2b9ac83cf req-8be2f21f-ae3a-47d7-80e9-6efe7668950c service nova] Acquiring lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f0b0b7b4-9edb-4395-9bf4-57a2b9ac83cf req-8be2f21f-ae3a-47d7-80e9-6efe7668950c service nova] Lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f0b0b7b4-9edb-4395-9bf4-57a2b9ac83cf req-8be2f21f-ae3a-47d7-80e9-6efe7668950c service nova] Lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:30 user nova-compute[74348]: DEBUG nova.compute.manager [req-f0b0b7b4-9edb-4395-9bf4-57a2b9ac83cf req-8be2f21f-ae3a-47d7-80e9-6efe7668950c service nova] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] No waiting events found dispatching network-vif-plugged-72e5b044-9d3b-412d-9a20-408387fb6fe6 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:02:30 user nova-compute[74348]: WARNING nova.compute.manager [req-f0b0b7b4-9edb-4395-9bf4-57a2b9ac83cf req-8be2f21f-ae3a-47d7-80e9-6efe7668950c service nova] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Received unexpected event network-vif-plugged-72e5b044-9d3b-412d-9a20-408387fb6fe6 for instance with vm_state active and task_state rescuing.
Nov 22 08:02:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:32 user nova-compute[74348]: DEBUG nova.compute.manager [None req-9ed86504-0708-478c-92b7-633b2e6b3edc tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:02:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:32 user nova-compute[74348]: DEBUG nova.compute.manager [req-1d7db649-6a46-49bf-bbb8-b8c047d177c3 req-d53ba365-97f4-45bc-8f89-12afa8c5521e service nova] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Received event network-vif-plugged-72e5b044-9d3b-412d-9a20-408387fb6fe6 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:02:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-1d7db649-6a46-49bf-bbb8-b8c047d177c3 req-d53ba365-97f4-45bc-8f89-12afa8c5521e service nova] Acquiring lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-1d7db649-6a46-49bf-bbb8-b8c047d177c3 req-d53ba365-97f4-45bc-8f89-12afa8c5521e service nova] Lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-1d7db649-6a46-49bf-bbb8-b8c047d177c3 req-d53ba365-97f4-45bc-8f89-12afa8c5521e service nova] Lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:32 user nova-compute[74348]: DEBUG nova.compute.manager [req-1d7db649-6a46-49bf-bbb8-b8c047d177c3 req-d53ba365-97f4-45bc-8f89-12afa8c5521e service nova] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] No waiting events found dispatching network-vif-plugged-72e5b044-9d3b-412d-9a20-408387fb6fe6 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:02:32 user nova-compute[74348]: WARNING nova.compute.manager [req-1d7db649-6a46-49bf-bbb8-b8c047d177c3 req-d53ba365-97f4-45bc-8f89-12afa8c5521e service nova] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Received unexpected event network-vif-plugged-72e5b044-9d3b-412d-9a20-408387fb6fe6 for instance with vm_state active and task_state rescuing.
Nov 22 08:02:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:37 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:39 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:02:39 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:02:39 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:02:39 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:02:39 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-765f8c47-c042-4430-8d35-07926ad693fe" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:02:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-765f8c47-c042-4430-8d35-07926ad693fe" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:02:39 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 08:02:40 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Updating instance_info_cache with network_info: [{"id": "3ee3f6b1-b929-404a-b3bb-6ece1c2d1052", "address": "fa:16:3e:60:74:68", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee3f6b1-b9", "ovs_interfaceid": "3ee3f6b1-b929-404a-b3bb-6ece1c2d1052", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:02:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-765f8c47-c042-4430-8d35-07926ad693fe" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:02:40 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 08:02:40 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:02:40 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:02:40 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:02:40 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:02:40 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:02:40 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:02:40 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:02:40 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:02:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:40 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:02:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:02:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:02:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:02:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:02:41 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:02:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8f84c0b-fab5-4900-bf65-270c9c06baf8/disk.rescue --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:02:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8f84c0b-fab5-4900-bf65-270c9c06baf8/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:02:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8f84c0b-fab5-4900-bf65-270c9c06baf8/disk.rescue --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:02:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8f84c0b-fab5-4900-bf65-270c9c06baf8/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:02:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c36455f-5fd6-4813-9c44-499e3742ed39/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:02:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c36455f-5fd6-4813-9c44-499e3742ed39/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:02:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c36455f-5fd6-4813-9c44-499e3742ed39/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:02:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c36455f-5fd6-4813-9c44-499e3742ed39/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:02:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:02:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:02:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:02:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:02:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:02:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:02:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:02:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:02:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a635cbbc-6b87-4877-80a8-bd4001c407c6/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:02:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a635cbbc-6b87-4877-80a8-bd4001c407c6/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:02:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a635cbbc-6b87-4877-80a8-bd4001c407c6/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:02:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a635cbbc-6b87-4877-80a8-bd4001c407c6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:02:43 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:02:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266eb2ee-43a5-4fd2-86aa-9e915cbc7562/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:02:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266eb2ee-43a5-4fd2-86aa-9e915cbc7562/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:02:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266eb2ee-43a5-4fd2-86aa-9e915cbc7562/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:02:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquiring lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:43 user nova-compute[74348]: DEBUG nova.compute.manager [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 08:02:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266eb2ee-43a5-4fd2-86aa-9e915cbc7562/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:02:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:43 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 08:02:43 user nova-compute[74348]: INFO nova.compute.claims [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Claim successful on node user
Nov 22 08:02:43 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:02:43 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:02:43 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=7769MB free_disk=24.935558319091797GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:02:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquiring lock "ba74ca7d-2875-426c-a485-d908af865bae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "ba74ca7d-2875-426c-a485-d908af865bae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:44 user nova-compute[74348]: DEBUG nova.compute.manager [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 08:02:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:44 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:02:44 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:02:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.578s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:44 user nova-compute[74348]: DEBUG nova.compute.manager [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 08:02:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.563s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:44 user nova-compute[74348]: DEBUG nova.compute.manager [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 08:02:44 user nova-compute[74348]: DEBUG nova.network.neutron [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 08:02:44 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 08:02:44 user nova-compute[74348]: DEBUG nova.compute.manager [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 08:02:44 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 9c36455f-5fd6-4813-9c44-499e3742ed39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:02:44 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 765f8c47-c042-4430-8d35-07926ad693fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:02:44 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance a635cbbc-6b87-4877-80a8-bd4001c407c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:02:44 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance b8f84c0b-fab5-4900-bf65-270c9c06baf8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:02:44 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 37c93c2a-1397-4b04-aef1-5068218ad9fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:02:44 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 5006cff5-4b67-405d-b6b1-4c355f82d920 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:02:44 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 266eb2ee-43a5-4fd2-86aa-9e915cbc7562 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:02:44 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 555f4246-d4b2-4f2f-b91c-dda8fe47264c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:02:44 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance ba74ca7d-2875-426c-a485-d908af865bae has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 22 08:02:44 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:02:44 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:02:44 user nova-compute[74348]: DEBUG nova.policy [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0b3c6587d0764b9fae5782792aec5d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d975b772fea4ed98b1b3ad284e51a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 08:02:44 user nova-compute[74348]: DEBUG nova.compute.manager [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 08:02:44 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 08:02:44 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Creating image(s)
Nov 22 08:02:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquiring lock "/opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "/opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "/opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:02:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.191s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:02:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquiring lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:02:44 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:02:44 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:02:45 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:02:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.558s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.630s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:45 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 08:02:45 user nova-compute[74348]: INFO nova.compute.claims [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Claim successful on node user
Nov 22 08:02:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.174s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:02:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:02:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk 1073741824" returned: 0 in 0.050s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:02:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:02:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.177s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:02:45 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Checking if we can resize image /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk. size=1073741824 {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 08:02:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:02:45 user nova-compute[74348]: DEBUG nova.network.neutron [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Successfully created port: 8e4fc0fe-f03b-4816-8a6a-c20a8eba5296 {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 08:02:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:02:45 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Cannot resize image /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk to a smaller size. {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 08:02:45 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 08:02:45 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Ensure instance console log exists: /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 08:02:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:45 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:02:45 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:02:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.582s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:45 user nova-compute[74348]: DEBUG nova.compute.manager [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 08:02:45 user nova-compute[74348]: DEBUG nova.compute.manager [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 08:02:45 user nova-compute[74348]: DEBUG nova.network.neutron [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 08:02:45 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 08:02:45 user nova-compute[74348]: DEBUG nova.compute.manager [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 08:02:45 user nova-compute[74348]: DEBUG nova.compute.manager [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 08:02:45 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 08:02:45 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Creating image(s)
Nov 22 08:02:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquiring lock "/opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "/opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "/opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.016s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:02:45 user nova-compute[74348]: DEBUG nova.policy [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0b3c6587d0764b9fae5782792aec5d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d975b772fea4ed98b1b3ad284e51a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 08:02:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.183s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:02:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquiring lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:02:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.186s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:02:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:02:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk 1073741824" returned: 0 in 0.046s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:02:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:02:46 user nova-compute[74348]: DEBUG nova.network.neutron [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Successfully updated port: 8e4fc0fe-f03b-4816-8a6a-c20a8eba5296 {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 08:02:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquiring lock "refresh_cache-555f4246-d4b2-4f2f-b91c-dda8fe47264c" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:02:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquired lock "refresh_cache-555f4246-d4b2-4f2f-b91c-dda8fe47264c" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:02:46 user nova-compute[74348]: DEBUG nova.network.neutron [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:02:46 user nova-compute[74348]: DEBUG nova.compute.manager [req-6da08f9e-19dd-4bae-91ab-812f96dd2f4f req-9ef55cdc-abca-41bc-adcf-5e27ccfcdb18 service nova] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Received event network-changed-8e4fc0fe-f03b-4816-8a6a-c20a8eba5296 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:02:46 user nova-compute[74348]: DEBUG nova.compute.manager [req-6da08f9e-19dd-4bae-91ab-812f96dd2f4f req-9ef55cdc-abca-41bc-adcf-5e27ccfcdb18 service nova] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Refreshing instance network info cache due to event network-changed-8e4fc0fe-f03b-4816-8a6a-c20a8eba5296. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:02:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-6da08f9e-19dd-4bae-91ab-812f96dd2f4f req-9ef55cdc-abca-41bc-adcf-5e27ccfcdb18 service nova] Acquiring lock "refresh_cache-555f4246-d4b2-4f2f-b91c-dda8fe47264c" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:02:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.172s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:02:46 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk. size=1073741824 {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 08:02:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:02:46 user nova-compute[74348]: DEBUG nova.network.neutron [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 08:02:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:02:46 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Cannot resize image /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk to a smaller size. {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 08:02:46 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 08:02:46 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Ensure instance console log exists: /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 08:02:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:46 user nova-compute[74348]: DEBUG nova.network.neutron [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Successfully created port: 674629a8-f3d5-41f1-a3d8-fbd957b97ad9 {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 08:02:46 user nova-compute[74348]: DEBUG nova.network.neutron [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Updating instance_info_cache with network_info: [{"id": "8e4fc0fe-f03b-4816-8a6a-c20a8eba5296", "address": "fa:16:3e:01:d5:cd", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4fc0fe-f0", "ovs_interfaceid": "8e4fc0fe-f03b-4816-8a6a-c20a8eba5296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:02:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Releasing lock "refresh_cache-555f4246-d4b2-4f2f-b91c-dda8fe47264c" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:02:46 user nova-compute[74348]: DEBUG nova.compute.manager [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Instance network_info: |[{"id": "8e4fc0fe-f03b-4816-8a6a-c20a8eba5296", "address": "fa:16:3e:01:d5:cd", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4fc0fe-f0", "ovs_interfaceid": "8e4fc0fe-f03b-4816-8a6a-c20a8eba5296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 08:02:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-6da08f9e-19dd-4bae-91ab-812f96dd2f4f req-9ef55cdc-abca-41bc-adcf-5e27ccfcdb18 service nova] Acquired lock "refresh_cache-555f4246-d4b2-4f2f-b91c-dda8fe47264c" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:02:46 user nova-compute[74348]: DEBUG nova.network.neutron [req-6da08f9e-19dd-4bae-91ab-812f96dd2f4f req-9ef55cdc-abca-41bc-adcf-5e27ccfcdb18 service nova] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Refreshing network info cache for port 8e4fc0fe-f03b-4816-8a6a-c20a8eba5296 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Start _get_guest_xml network_info=[{"id": "8e4fc0fe-f03b-4816-8a6a-c20a8eba5296", "address": "fa:16:3e:01:d5:cd", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4fc0fe-f0", "ovs_interfaceid": "8e4fc0fe-f03b-4816-8a6a-c20a8eba5296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 08:02:47 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:02:47 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:02:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:02:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-305514770',display_name='tempest-ServerRescueNegativeTestJSON-server-305514770',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-305514770',id=28,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d975b772fea4ed98b1b3ad284e51a65',ramdisk_id='',reservation_id='r-rd38z59i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1773499839',owner_user_name='tempest-ServerRescueNegativeTestJSON-1773499839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:02:45Z,user_data=None,user_id='0b3c6587d0764b9fae5782792aec5d92',uuid=555f4246-d4b2-4f2f-b91c-dda8fe47264c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e4fc0fe-f03b-4816-8a6a-c20a8eba5296", "address": "fa:16:3e:01:d5:cd", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4fc0fe-f0", "ovs_interfaceid": "8e4fc0fe-f03b-4816-8a6a-c20a8eba5296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Converting VIF {"id": "8e4fc0fe-f03b-4816-8a6a-c20a8eba5296", "address": "fa:16:3e:01:d5:cd", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4fc0fe-f0", "ovs_interfaceid": "8e4fc0fe-f03b-4816-8a6a-c20a8eba5296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:d5:cd,bridge_name='br-int',has_traffic_filtering=True,id=8e4fc0fe-f03b-4816-8a6a-c20a8eba5296,network=Network(246d8f55-a1eb-4883-906c-69f15289caef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e4fc0fe-f0') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG nova.objects.instance [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lazy-loading 'pci_devices' on Instance uuid 555f4246-d4b2-4f2f-b91c-dda8fe47264c {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] End _get_guest_xml xml=<domain type="kvm">
Nov 22 08:02:47 user nova-compute[74348]:   <uuid>555f4246-d4b2-4f2f-b91c-dda8fe47264c</uuid>
Nov 22 08:02:47 user nova-compute[74348]:   <name>instance-0000001c</name>
Nov 22 08:02:47 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 08:02:47 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 08:02:47 user nova-compute[74348]:   <metadata>
Nov 22 08:02:47 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 08:02:47 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 08:02:47 user nova-compute[74348]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-305514770</nova:name>
Nov 22 08:02:47 user nova-compute[74348]:       <nova:creationTime>2023-11-22 08:02:47</nova:creationTime>
Nov 22 08:02:47 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 08:02:47 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 08:02:47 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 08:02:47 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 08:02:47 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 08:02:47 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 08:02:47 user nova-compute[74348]:       </nova:flavor>
Nov 22 08:02:47 user nova-compute[74348]:       <nova:owner>
Nov 22 08:02:47 user nova-compute[74348]:         <nova:user uuid="0b3c6587d0764b9fae5782792aec5d92">tempest-ServerRescueNegativeTestJSON-1773499839-project-member</nova:user>
Nov 22 08:02:47 user nova-compute[74348]:         <nova:project uuid="5d975b772fea4ed98b1b3ad284e51a65">tempest-ServerRescueNegativeTestJSON-1773499839</nova:project>
Nov 22 08:02:47 user nova-compute[74348]:       </nova:owner>
Nov 22 08:02:47 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 08:02:47 user nova-compute[74348]:       <nova:ports>
Nov 22 08:02:47 user nova-compute[74348]:         <nova:port uuid="8e4fc0fe-f03b-4816-8a6a-c20a8eba5296">
Nov 22 08:02:47 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 22 08:02:47 user nova-compute[74348]:         </nova:port>
Nov 22 08:02:47 user nova-compute[74348]:       </nova:ports>
Nov 22 08:02:47 user nova-compute[74348]:     </nova:instance>
Nov 22 08:02:47 user nova-compute[74348]:   </metadata>
Nov 22 08:02:47 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 08:02:47 user nova-compute[74348]:     <system>
Nov 22 08:02:47 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 08:02:47 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 08:02:47 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 08:02:47 user nova-compute[74348]:       <entry name="serial">555f4246-d4b2-4f2f-b91c-dda8fe47264c</entry>
Nov 22 08:02:47 user nova-compute[74348]:       <entry name="uuid">555f4246-d4b2-4f2f-b91c-dda8fe47264c</entry>
Nov 22 08:02:47 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 08:02:47 user nova-compute[74348]:     </system>
Nov 22 08:02:47 user nova-compute[74348]:   </sysinfo>
Nov 22 08:02:47 user nova-compute[74348]:   <os>
Nov 22 08:02:47 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 08:02:47 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 08:02:47 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 08:02:47 user nova-compute[74348]:   </os>
Nov 22 08:02:47 user nova-compute[74348]:   <features>
Nov 22 08:02:47 user nova-compute[74348]:     <acpi/>
Nov 22 08:02:47 user nova-compute[74348]:     <apic/>
Nov 22 08:02:47 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 08:02:47 user nova-compute[74348]:   </features>
Nov 22 08:02:47 user nova-compute[74348]:   <clock offset="utc">
Nov 22 08:02:47 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 08:02:47 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 08:02:47 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 08:02:47 user nova-compute[74348]:   </clock>
Nov 22 08:02:47 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 08:02:47 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 08:02:47 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 08:02:47 user nova-compute[74348]:   </cpu>
Nov 22 08:02:47 user nova-compute[74348]:   <devices>
Nov 22 08:02:47 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 08:02:47 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 08:02:47 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk"/>
Nov 22 08:02:47 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 08:02:47 user nova-compute[74348]:     </disk>
Nov 22 08:02:47 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 08:02:47 user nova-compute[74348]:       <mac address="fa:16:3e:01:d5:cd"/>
Nov 22 08:02:47 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:02:47 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 08:02:47 user nova-compute[74348]:       <target dev="tap8e4fc0fe-f0"/>
Nov 22 08:02:47 user nova-compute[74348]:     </interface>
Nov 22 08:02:47 user nova-compute[74348]:     <serial type="pty">
Nov 22 08:02:47 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/console.log" append="off"/>
Nov 22 08:02:47 user nova-compute[74348]:     </serial>
Nov 22 08:02:47 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 08:02:47 user nova-compute[74348]:     <video>
Nov 22 08:02:47 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:02:47 user nova-compute[74348]:     </video>
Nov 22 08:02:47 user nova-compute[74348]:     <rng model="virtio">
Nov 22 08:02:47 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 08:02:47 user nova-compute[74348]:     </rng>
Nov 22 08:02:47 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 08:02:47 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 08:02:47 user nova-compute[74348]:       <stats period="10"/>
Nov 22 08:02:47 user nova-compute[74348]:     </memballoon>
Nov 22 08:02:47 user nova-compute[74348]:   </devices>
Nov 22 08:02:47 user nova-compute[74348]: </domain>
Nov 22 08:02:47 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:02:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-305514770',display_name='tempest-ServerRescueNegativeTestJSON-server-305514770',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-305514770',id=28,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d975b772fea4ed98b1b3ad284e51a65',ramdisk_id='',reservation_id='r-rd38z59i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1773499839',owner_user_name='tempest-ServerRescueNegativeTestJSON-1773499839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:02:45Z,user_data=None,user_id='0b3c6587d0764b9fae5782792aec5d92',uuid=555f4246-d4b2-4f2f-b91c-dda8fe47264c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e4fc0fe-f03b-4816-8a6a-c20a8eba5296", "address": "fa:16:3e:01:d5:cd", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4fc0fe-f0", "ovs_interfaceid": "8e4fc0fe-f03b-4816-8a6a-c20a8eba5296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Converting VIF {"id": "8e4fc0fe-f03b-4816-8a6a-c20a8eba5296", "address": "fa:16:3e:01:d5:cd", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4fc0fe-f0", "ovs_interfaceid": "8e4fc0fe-f03b-4816-8a6a-c20a8eba5296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:d5:cd,bridge_name='br-int',has_traffic_filtering=True,id=8e4fc0fe-f03b-4816-8a6a-c20a8eba5296,network=Network(246d8f55-a1eb-4883-906c-69f15289caef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e4fc0fe-f0') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG os_vif [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:d5:cd,bridge_name='br-int',has_traffic_filtering=True,id=8e4fc0fe-f03b-4816-8a6a-c20a8eba5296,network=Network(246d8f55-a1eb-4883-906c-69f15289caef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e4fc0fe-f0') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '85dd2cea-7111-52b5-ac84-5e2adfaa3e1b', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e4fc0fe-f0, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8e4fc0fe-f0, col_values=(('qos', UUID('ce4cb421-1ef3-4280-8ace-23eac44f6e97')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8e4fc0fe-f0, col_values=(('external_ids', {'iface-id': '8e4fc0fe-f03b-4816-8a6a-c20a8eba5296', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:d5:cd', 'vm-uuid': '555f4246-d4b2-4f2f-b91c-dda8fe47264c'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:47 user nova-compute[74348]: INFO os_vif [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:d5:cd,bridge_name='br-int',has_traffic_filtering=True,id=8e4fc0fe-f03b-4816-8a6a-c20a8eba5296,network=Network(246d8f55-a1eb-4883-906c-69f15289caef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e4fc0fe-f0')
Nov 22 08:02:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] No VIF found with MAC fa:16:3e:01:d5:cd, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG nova.network.neutron [req-6da08f9e-19dd-4bae-91ab-812f96dd2f4f req-9ef55cdc-abca-41bc-adcf-5e27ccfcdb18 service nova] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Updated VIF entry in instance network info cache for port 8e4fc0fe-f03b-4816-8a6a-c20a8eba5296. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG nova.network.neutron [req-6da08f9e-19dd-4bae-91ab-812f96dd2f4f req-9ef55cdc-abca-41bc-adcf-5e27ccfcdb18 service nova] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Updating instance_info_cache with network_info: [{"id": "8e4fc0fe-f03b-4816-8a6a-c20a8eba5296", "address": "fa:16:3e:01:d5:cd", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4fc0fe-f0", "ovs_interfaceid": "8e4fc0fe-f03b-4816-8a6a-c20a8eba5296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-6da08f9e-19dd-4bae-91ab-812f96dd2f4f req-9ef55cdc-abca-41bc-adcf-5e27ccfcdb18 service nova] Releasing lock "refresh_cache-555f4246-d4b2-4f2f-b91c-dda8fe47264c" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG nova.network.neutron [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Successfully updated port: 674629a8-f3d5-41f1-a3d8-fbd957b97ad9 {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquiring lock "refresh_cache-ba74ca7d-2875-426c-a485-d908af865bae" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquired lock "refresh_cache-ba74ca7d-2875-426c-a485-d908af865bae" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG nova.network.neutron [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:02:47 user nova-compute[74348]: DEBUG nova.network.neutron [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG nova.network.neutron [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Updating instance_info_cache with network_info: [{"id": "674629a8-f3d5-41f1-a3d8-fbd957b97ad9", "address": "fa:16:3e:46:7e:d8", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap674629a8-f3", "ovs_interfaceid": "674629a8-f3d5-41f1-a3d8-fbd957b97ad9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Releasing lock "refresh_cache-ba74ca7d-2875-426c-a485-d908af865bae" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG nova.compute.manager [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Instance network_info: |[{"id": "674629a8-f3d5-41f1-a3d8-fbd957b97ad9", "address": "fa:16:3e:46:7e:d8", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap674629a8-f3", "ovs_interfaceid": "674629a8-f3d5-41f1-a3d8-fbd957b97ad9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Start _get_guest_xml network_info=[{"id": "674629a8-f3d5-41f1-a3d8-fbd957b97ad9", "address": "fa:16:3e:46:7e:d8", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap674629a8-f3", "ovs_interfaceid": "674629a8-f3d5-41f1-a3d8-fbd957b97ad9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 08:02:48 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:02:48 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:02:48 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:02:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1470868857',display_name='tempest-ServerRescueNegativeTestJSON-server-1470868857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1470868857',id=29,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d975b772fea4ed98b1b3ad284e51a65',ramdisk_id='',reservation_id='r-wa0y0kht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1773499839',owner_user_name='tempest-ServerRescueNegativeTestJSON-1773499839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:02:46Z,user_data=None,user_id='0b3c6587d0764b9fae5782792aec5d92',uuid=ba74ca7d-2875-426c-a485-d908af865bae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "674629a8-f3d5-41f1-a3d8-fbd957b97ad9", "address": "fa:16:3e:46:7e:d8", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap674629a8-f3", "ovs_interfaceid": "674629a8-f3d5-41f1-a3d8-fbd957b97ad9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Converting VIF {"id": "674629a8-f3d5-41f1-a3d8-fbd957b97ad9", "address": "fa:16:3e:46:7e:d8", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap674629a8-f3", "ovs_interfaceid": "674629a8-f3d5-41f1-a3d8-fbd957b97ad9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:7e:d8,bridge_name='br-int',has_traffic_filtering=True,id=674629a8-f3d5-41f1-a3d8-fbd957b97ad9,network=Network(246d8f55-a1eb-4883-906c-69f15289caef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap674629a8-f3') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG nova.objects.instance [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lazy-loading 'pci_devices' on Instance uuid ba74ca7d-2875-426c-a485-d908af865bae {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] End _get_guest_xml xml=<domain type="kvm">
Nov 22 08:02:48 user nova-compute[74348]:   <uuid>ba74ca7d-2875-426c-a485-d908af865bae</uuid>
Nov 22 08:02:48 user nova-compute[74348]:   <name>instance-0000001d</name>
Nov 22 08:02:48 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 08:02:48 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 08:02:48 user nova-compute[74348]:   <metadata>
Nov 22 08:02:48 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 08:02:48 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 08:02:48 user nova-compute[74348]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1470868857</nova:name>
Nov 22 08:02:48 user nova-compute[74348]:       <nova:creationTime>2023-11-22 08:02:48</nova:creationTime>
Nov 22 08:02:48 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 08:02:48 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 08:02:48 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 08:02:48 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 08:02:48 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 08:02:48 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 08:02:48 user nova-compute[74348]:       </nova:flavor>
Nov 22 08:02:48 user nova-compute[74348]:       <nova:owner>
Nov 22 08:02:48 user nova-compute[74348]:         <nova:user uuid="0b3c6587d0764b9fae5782792aec5d92">tempest-ServerRescueNegativeTestJSON-1773499839-project-member</nova:user>
Nov 22 08:02:48 user nova-compute[74348]:         <nova:project uuid="5d975b772fea4ed98b1b3ad284e51a65">tempest-ServerRescueNegativeTestJSON-1773499839</nova:project>
Nov 22 08:02:48 user nova-compute[74348]:       </nova:owner>
Nov 22 08:02:48 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 08:02:48 user nova-compute[74348]:       <nova:ports>
Nov 22 08:02:48 user nova-compute[74348]:         <nova:port uuid="674629a8-f3d5-41f1-a3d8-fbd957b97ad9">
Nov 22 08:02:48 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 22 08:02:48 user nova-compute[74348]:         </nova:port>
Nov 22 08:02:48 user nova-compute[74348]:       </nova:ports>
Nov 22 08:02:48 user nova-compute[74348]:     </nova:instance>
Nov 22 08:02:48 user nova-compute[74348]:   </metadata>
Nov 22 08:02:48 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 08:02:48 user nova-compute[74348]:     <system>
Nov 22 08:02:48 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 08:02:48 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 08:02:48 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 08:02:48 user nova-compute[74348]:       <entry name="serial">ba74ca7d-2875-426c-a485-d908af865bae</entry>
Nov 22 08:02:48 user nova-compute[74348]:       <entry name="uuid">ba74ca7d-2875-426c-a485-d908af865bae</entry>
Nov 22 08:02:48 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 08:02:48 user nova-compute[74348]:     </system>
Nov 22 08:02:48 user nova-compute[74348]:   </sysinfo>
Nov 22 08:02:48 user nova-compute[74348]:   <os>
Nov 22 08:02:48 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 08:02:48 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 08:02:48 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 08:02:48 user nova-compute[74348]:   </os>
Nov 22 08:02:48 user nova-compute[74348]:   <features>
Nov 22 08:02:48 user nova-compute[74348]:     <acpi/>
Nov 22 08:02:48 user nova-compute[74348]:     <apic/>
Nov 22 08:02:48 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 08:02:48 user nova-compute[74348]:   </features>
Nov 22 08:02:48 user nova-compute[74348]:   <clock offset="utc">
Nov 22 08:02:48 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 08:02:48 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 08:02:48 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 08:02:48 user nova-compute[74348]:   </clock>
Nov 22 08:02:48 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 08:02:48 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 08:02:48 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 08:02:48 user nova-compute[74348]:   </cpu>
Nov 22 08:02:48 user nova-compute[74348]:   <devices>
Nov 22 08:02:48 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 08:02:48 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 08:02:48 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk"/>
Nov 22 08:02:48 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 08:02:48 user nova-compute[74348]:     </disk>
Nov 22 08:02:48 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 08:02:48 user nova-compute[74348]:       <mac address="fa:16:3e:46:7e:d8"/>
Nov 22 08:02:48 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:02:48 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 08:02:48 user nova-compute[74348]:       <target dev="tap674629a8-f3"/>
Nov 22 08:02:48 user nova-compute[74348]:     </interface>
Nov 22 08:02:48 user nova-compute[74348]:     <serial type="pty">
Nov 22 08:02:48 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/console.log" append="off"/>
Nov 22 08:02:48 user nova-compute[74348]:     </serial>
Nov 22 08:02:48 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 08:02:48 user nova-compute[74348]:     <video>
Nov 22 08:02:48 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:02:48 user nova-compute[74348]:     </video>
Nov 22 08:02:48 user nova-compute[74348]:     <rng model="virtio">
Nov 22 08:02:48 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 08:02:48 user nova-compute[74348]:     </rng>
Nov 22 08:02:48 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 08:02:48 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 08:02:48 user nova-compute[74348]:       <stats period="10"/>
Nov 22 08:02:48 user nova-compute[74348]:     </memballoon>
Nov 22 08:02:48 user nova-compute[74348]:   </devices>
Nov 22 08:02:48 user nova-compute[74348]: </domain>
Nov 22 08:02:48 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:02:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1470868857',display_name='tempest-ServerRescueNegativeTestJSON-server-1470868857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1470868857',id=29,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d975b772fea4ed98b1b3ad284e51a65',ramdisk_id='',reservation_id='r-wa0y0kht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1773499839',owner_user_name='tempest-ServerRescueNegativeTestJSON-1773499839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:02:46Z,user_data=None,user_id='0b3c6587d0764b9fae5782792aec5d92',uuid=ba74ca7d-2875-426c-a485-d908af865bae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "674629a8-f3d5-41f1-a3d8-fbd957b97ad9", "address": "fa:16:3e:46:7e:d8", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap674629a8-f3", "ovs_interfaceid": "674629a8-f3d5-41f1-a3d8-fbd957b97ad9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Converting VIF {"id": "674629a8-f3d5-41f1-a3d8-fbd957b97ad9", "address": "fa:16:3e:46:7e:d8", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap674629a8-f3", "ovs_interfaceid": "674629a8-f3d5-41f1-a3d8-fbd957b97ad9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:7e:d8,bridge_name='br-int',has_traffic_filtering=True,id=674629a8-f3d5-41f1-a3d8-fbd957b97ad9,network=Network(246d8f55-a1eb-4883-906c-69f15289caef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap674629a8-f3') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG os_vif [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:7e:d8,bridge_name='br-int',has_traffic_filtering=True,id=674629a8-f3d5-41f1-a3d8-fbd957b97ad9,network=Network(246d8f55-a1eb-4883-906c-69f15289caef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap674629a8-f3') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '596a665e-b695-5f3f-b4fa-0db49af7c352', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap674629a8-f3, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap674629a8-f3, col_values=(('qos', UUID('aa292653-a249-44ee-8377-3b6b07247f66')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap674629a8-f3, col_values=(('external_ids', {'iface-id': '674629a8-f3d5-41f1-a3d8-fbd957b97ad9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:7e:d8', 'vm-uuid': 'ba74ca7d-2875-426c-a485-d908af865bae'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:48 user nova-compute[74348]: INFO os_vif [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:7e:d8,bridge_name='br-int',has_traffic_filtering=True,id=674629a8-f3d5-41f1-a3d8-fbd957b97ad9,network=Network(246d8f55-a1eb-4883-906c-69f15289caef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap674629a8-f3')
Nov 22 08:02:48 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] No VIF found with MAC fa:16:3e:46:7e:d8, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG nova.compute.manager [req-a5807fbe-1548-42dd-9a6c-69d5bee8f8ad req-9ff10046-85f1-4e86-8f22-a3a98f987ba2 service nova] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Received event network-changed-674629a8-f3d5-41f1-a3d8-fbd957b97ad9 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG nova.compute.manager [req-a5807fbe-1548-42dd-9a6c-69d5bee8f8ad req-9ff10046-85f1-4e86-8f22-a3a98f987ba2 service nova] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Refreshing instance network info cache due to event network-changed-674629a8-f3d5-41f1-a3d8-fbd957b97ad9. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a5807fbe-1548-42dd-9a6c-69d5bee8f8ad req-9ff10046-85f1-4e86-8f22-a3a98f987ba2 service nova] Acquiring lock "refresh_cache-ba74ca7d-2875-426c-a485-d908af865bae" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a5807fbe-1548-42dd-9a6c-69d5bee8f8ad req-9ff10046-85f1-4e86-8f22-a3a98f987ba2 service nova] Acquired lock "refresh_cache-ba74ca7d-2875-426c-a485-d908af865bae" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG nova.network.neutron [req-a5807fbe-1548-42dd-9a6c-69d5bee8f8ad req-9ff10046-85f1-4e86-8f22-a3a98f987ba2 service nova] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Refreshing network info cache for port 674629a8-f3d5-41f1-a3d8-fbd957b97ad9 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG nova.compute.manager [req-2660cfd3-139d-4d1b-9d4d-2bcfc1572ab0 req-4a48204e-e467-4de4-a466-8459fe6b22b7 service nova] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Received event network-vif-plugged-8e4fc0fe-f03b-4816-8a6a-c20a8eba5296 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2660cfd3-139d-4d1b-9d4d-2bcfc1572ab0 req-4a48204e-e467-4de4-a466-8459fe6b22b7 service nova] Acquiring lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2660cfd3-139d-4d1b-9d4d-2bcfc1572ab0 req-4a48204e-e467-4de4-a466-8459fe6b22b7 service nova] Lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2660cfd3-139d-4d1b-9d4d-2bcfc1572ab0 req-4a48204e-e467-4de4-a466-8459fe6b22b7 service nova] Lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG nova.compute.manager [req-2660cfd3-139d-4d1b-9d4d-2bcfc1572ab0 req-4a48204e-e467-4de4-a466-8459fe6b22b7 service nova] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] No waiting events found dispatching network-vif-plugged-8e4fc0fe-f03b-4816-8a6a-c20a8eba5296 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:02:48 user nova-compute[74348]: WARNING nova.compute.manager [req-2660cfd3-139d-4d1b-9d4d-2bcfc1572ab0 req-4a48204e-e467-4de4-a466-8459fe6b22b7 service nova] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Received unexpected event network-vif-plugged-8e4fc0fe-f03b-4816-8a6a-c20a8eba5296 for instance with vm_state building and task_state spawning.
Nov 22 08:02:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG nova.network.neutron [req-a5807fbe-1548-42dd-9a6c-69d5bee8f8ad req-9ff10046-85f1-4e86-8f22-a3a98f987ba2 service nova] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Updated VIF entry in instance network info cache for port 674629a8-f3d5-41f1-a3d8-fbd957b97ad9. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG nova.network.neutron [req-a5807fbe-1548-42dd-9a6c-69d5bee8f8ad req-9ff10046-85f1-4e86-8f22-a3a98f987ba2 service nova] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Updating instance_info_cache with network_info: [{"id": "674629a8-f3d5-41f1-a3d8-fbd957b97ad9", "address": "fa:16:3e:46:7e:d8", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap674629a8-f3", "ovs_interfaceid": "674629a8-f3d5-41f1-a3d8-fbd957b97ad9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:02:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a5807fbe-1548-42dd-9a6c-69d5bee8f8ad req-9ff10046-85f1-4e86-8f22-a3a98f987ba2 service nova] Releasing lock "refresh_cache-ba74ca7d-2875-426c-a485-d908af865bae" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:02:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:50 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:50 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:50 user nova-compute[74348]: DEBUG nova.compute.manager [req-9ad10f5b-93aa-4f21-aa86-1923ff3a18b3 req-0073708b-bc8e-4ee9-8375-2dcf9b2334f7 service nova] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Received event network-vif-plugged-674629a8-f3d5-41f1-a3d8-fbd957b97ad9 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:02:50 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9ad10f5b-93aa-4f21-aa86-1923ff3a18b3 req-0073708b-bc8e-4ee9-8375-2dcf9b2334f7 service nova] Acquiring lock "ba74ca7d-2875-426c-a485-d908af865bae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:50 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9ad10f5b-93aa-4f21-aa86-1923ff3a18b3 req-0073708b-bc8e-4ee9-8375-2dcf9b2334f7 service nova] Lock "ba74ca7d-2875-426c-a485-d908af865bae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:50 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9ad10f5b-93aa-4f21-aa86-1923ff3a18b3 req-0073708b-bc8e-4ee9-8375-2dcf9b2334f7 service nova] Lock "ba74ca7d-2875-426c-a485-d908af865bae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:50 user nova-compute[74348]: DEBUG nova.compute.manager [req-9ad10f5b-93aa-4f21-aa86-1923ff3a18b3 req-0073708b-bc8e-4ee9-8375-2dcf9b2334f7 service nova] [instance: ba74ca7d-2875-426c-a485-d908af865bae] No waiting events found dispatching network-vif-plugged-674629a8-f3d5-41f1-a3d8-fbd957b97ad9 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:02:50 user nova-compute[74348]: WARNING nova.compute.manager [req-9ad10f5b-93aa-4f21-aa86-1923ff3a18b3 req-0073708b-bc8e-4ee9-8375-2dcf9b2334f7 service nova] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Received unexpected event network-vif-plugged-674629a8-f3d5-41f1-a3d8-fbd957b97ad9 for instance with vm_state building and task_state spawning.
Nov 22 08:02:50 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:50 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:50 user nova-compute[74348]: DEBUG nova.compute.manager [req-fe4f65a5-f745-44ea-8e12-004db011acc4 req-9d5f90bc-1b51-41ea-83c8-769f0bc3d39b service nova] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Received event network-vif-plugged-8e4fc0fe-f03b-4816-8a6a-c20a8eba5296 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:02:50 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-fe4f65a5-f745-44ea-8e12-004db011acc4 req-9d5f90bc-1b51-41ea-83c8-769f0bc3d39b service nova] Acquiring lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:50 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-fe4f65a5-f745-44ea-8e12-004db011acc4 req-9d5f90bc-1b51-41ea-83c8-769f0bc3d39b service nova] Lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:50 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-fe4f65a5-f745-44ea-8e12-004db011acc4 req-9d5f90bc-1b51-41ea-83c8-769f0bc3d39b service nova] Lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:50 user nova-compute[74348]: DEBUG nova.compute.manager [req-fe4f65a5-f745-44ea-8e12-004db011acc4 req-9d5f90bc-1b51-41ea-83c8-769f0bc3d39b service nova] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] No waiting events found dispatching network-vif-plugged-8e4fc0fe-f03b-4816-8a6a-c20a8eba5296 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:02:50 user nova-compute[74348]: WARNING nova.compute.manager [req-fe4f65a5-f745-44ea-8e12-004db011acc4 req-9d5f90bc-1b51-41ea-83c8-769f0bc3d39b service nova] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Received unexpected event network-vif-plugged-8e4fc0fe-f03b-4816-8a6a-c20a8eba5296 for instance with vm_state building and task_state spawning.
Nov 22 08:02:51 user nova-compute[74348]: DEBUG nova.compute.manager [req-52600123-5e2e-4c47-b1bd-b955b589ca20 req-bba0f472-633a-40a4-a0a2-488e675a7003 service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Received event network-changed-acc2d56f-6884-403d-b2e5-2eb64c40047f {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:02:51 user nova-compute[74348]: DEBUG nova.compute.manager [req-52600123-5e2e-4c47-b1bd-b955b589ca20 req-bba0f472-633a-40a4-a0a2-488e675a7003 service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Refreshing instance network info cache due to event network-changed-acc2d56f-6884-403d-b2e5-2eb64c40047f. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:02:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-52600123-5e2e-4c47-b1bd-b955b589ca20 req-bba0f472-633a-40a4-a0a2-488e675a7003 service nova] Acquiring lock "refresh_cache-37c93c2a-1397-4b04-aef1-5068218ad9fd" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:02:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-52600123-5e2e-4c47-b1bd-b955b589ca20 req-bba0f472-633a-40a4-a0a2-488e675a7003 service nova] Acquired lock "refresh_cache-37c93c2a-1397-4b04-aef1-5068218ad9fd" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:02:51 user nova-compute[74348]: DEBUG nova.network.neutron [req-52600123-5e2e-4c47-b1bd-b955b589ca20 req-bba0f472-633a-40a4-a0a2-488e675a7003 service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Refreshing network info cache for port acc2d56f-6884-403d-b2e5-2eb64c40047f {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:02:51 user nova-compute[74348]: DEBUG nova.network.neutron [req-52600123-5e2e-4c47-b1bd-b955b589ca20 req-bba0f472-633a-40a4-a0a2-488e675a7003 service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Updated VIF entry in instance network info cache for port acc2d56f-6884-403d-b2e5-2eb64c40047f. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:02:51 user nova-compute[74348]: DEBUG nova.network.neutron [req-52600123-5e2e-4c47-b1bd-b955b589ca20 req-bba0f472-633a-40a4-a0a2-488e675a7003 service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Updating instance_info_cache with network_info: [{"id": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "address": "fa:16:3e:62:f2:83", "network": {"id": "606a7c22-1285-47e8-bfa0-f09dbd7cb9ac", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-63336037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d1a2eb68ef4c0aa5ef081fe10877a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc2d56f-68", "ovs_interfaceid": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:02:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-52600123-5e2e-4c47-b1bd-b955b589ca20 req-bba0f472-633a-40a4-a0a2-488e675a7003 service nova] Releasing lock "refresh_cache-37c93c2a-1397-4b04-aef1-5068218ad9fd" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:02:51 user nova-compute[74348]: DEBUG nova.compute.manager [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 08:02:51 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 08:02:51 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Instance spawned successfully.
Nov 22 08:02:51 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 08:02:51 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:02:51 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:02:51 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:02:51 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:02:51 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:02:51 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:02:51 user nova-compute[74348]: INFO nova.compute.manager [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Took 7.18 seconds to spawn the instance on the hypervisor.
Nov 22 08:02:51 user nova-compute[74348]: DEBUG nova.compute.manager [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:02:52 user nova-compute[74348]: INFO nova.compute.manager [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Took 8.51 seconds to build instance.
Nov 22 08:02:52 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-76f164c5-0b74-491f-af18-50a06321c00a tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.706s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:52 user nova-compute[74348]: DEBUG nova.compute.manager [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 08:02:52 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 08:02:52 user nova-compute[74348]: DEBUG nova.compute.manager [req-fe308d62-2449-42e6-8341-f12a3c877cd5 req-ac60807e-b378-40dd-98f5-df7d6bb60907 service nova] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Received event network-vif-plugged-674629a8-f3d5-41f1-a3d8-fbd957b97ad9 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:02:52 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-fe308d62-2449-42e6-8341-f12a3c877cd5 req-ac60807e-b378-40dd-98f5-df7d6bb60907 service nova] Acquiring lock "ba74ca7d-2875-426c-a485-d908af865bae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:52 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-fe308d62-2449-42e6-8341-f12a3c877cd5 req-ac60807e-b378-40dd-98f5-df7d6bb60907 service nova] Lock "ba74ca7d-2875-426c-a485-d908af865bae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:52 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-fe308d62-2449-42e6-8341-f12a3c877cd5 req-ac60807e-b378-40dd-98f5-df7d6bb60907 service nova] Lock "ba74ca7d-2875-426c-a485-d908af865bae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:52 user nova-compute[74348]: DEBUG nova.compute.manager [req-fe308d62-2449-42e6-8341-f12a3c877cd5 req-ac60807e-b378-40dd-98f5-df7d6bb60907 service nova] [instance: ba74ca7d-2875-426c-a485-d908af865bae] No waiting events found dispatching network-vif-plugged-674629a8-f3d5-41f1-a3d8-fbd957b97ad9 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:02:52 user nova-compute[74348]: WARNING nova.compute.manager [req-fe308d62-2449-42e6-8341-f12a3c877cd5 req-ac60807e-b378-40dd-98f5-df7d6bb60907 service nova] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Received unexpected event network-vif-plugged-674629a8-f3d5-41f1-a3d8-fbd957b97ad9 for instance with vm_state building and task_state spawning.
Nov 22 08:02:52 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Instance spawned successfully.
Nov 22 08:02:52 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 08:02:52 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:02:52 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:02:52 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:02:52 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:02:52 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:02:52 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:02:52 user nova-compute[74348]: INFO nova.compute.manager [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Took 6.52 seconds to spawn the instance on the hypervisor.
Nov 22 08:02:52 user nova-compute[74348]: DEBUG nova.compute.manager [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:02:52 user nova-compute[74348]: INFO nova.compute.manager [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Took 8.14 seconds to build instance.
Nov 22 08:02:52 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4b8497f8-2bdb-49f1-bf39-3b33d12b6ea2 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "ba74ca7d-2875-426c-a485-d908af865bae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.310s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquiring lock "37c93c2a-1397-4b04-aef1-5068218ad9fd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "37c93c2a-1397-4b04-aef1-5068218ad9fd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:54 user nova-compute[74348]: DEBUG nova.objects.instance [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lazy-loading 'flavor' on Instance uuid 37c93c2a-1397-4b04-aef1-5068218ad9fd {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:02:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "37c93c2a-1397-4b04-aef1-5068218ad9fd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquiring lock "37c93c2a-1397-4b04-aef1-5068218ad9fd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "37c93c2a-1397-4b04-aef1-5068218ad9fd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:54 user nova-compute[74348]: INFO nova.compute.manager [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Attaching volume 5d3034db-c569-4cd9-ad54-142be23d7dea to /dev/vdb
Nov 22 08:02:54 user nova-compute[74348]: DEBUG os_brick.utils [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:02:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:02:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:02:54 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4904b9-f884-4ef0-bb80-506671ada820]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:02:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:02:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:02:54 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b73bac0-fbe9-4638-9371-bd1ab5b56366]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:02:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:02:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:02:54 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bce4f1-f4b8-47ba-aa90-d1d91ad8234c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:02:54 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[822b778f-64fa-4c7e-9e0b-edccb4882eee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:02:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:02:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:02:54 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 08:02:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:02:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:02:54 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 08:02:54 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6f80e0-5c1e-4080-a28b-6b56a80cec7c]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:02:54 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 08:02:54 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 08:02:54 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 08:02:54 user nova-compute[74348]: DEBUG os_brick.utils [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:02:54 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Updating existing volume attachment record: 022a0e53-7f71-414d-931b-5ec5c774b275 {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 08:02:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d8373680-2489-4cc0-9828-af9fbab6df70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Acquiring lock "9c36455f-5fd6-4813-9c44-499e3742ed39" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d8373680-2489-4cc0-9828-af9fbab6df70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lock "9c36455f-5fd6-4813-9c44-499e3742ed39" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d8373680-2489-4cc0-9828-af9fbab6df70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Acquiring lock "9c36455f-5fd6-4813-9c44-499e3742ed39-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d8373680-2489-4cc0-9828-af9fbab6df70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lock "9c36455f-5fd6-4813-9c44-499e3742ed39-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d8373680-2489-4cc0-9828-af9fbab6df70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lock "9c36455f-5fd6-4813-9c44-499e3742ed39-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:55 user nova-compute[74348]: INFO nova.compute.manager [None req-d8373680-2489-4cc0-9828-af9fbab6df70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Terminating instance
Nov 22 08:02:55 user nova-compute[74348]: DEBUG nova.compute.manager [None req-d8373680-2489-4cc0-9828-af9fbab6df70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 08:02:55 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:56 user nova-compute[74348]: DEBUG nova.compute.manager [req-e61d580b-eb68-4820-8e06-3b20fdfbd7dc req-5fa30330-0414-44b6-bcd9-0a938daf8d68 service nova] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Received event network-vif-unplugged-e8c429ee-f5b4-4cf5-935c-5d4631b369e3 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:02:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e61d580b-eb68-4820-8e06-3b20fdfbd7dc req-5fa30330-0414-44b6-bcd9-0a938daf8d68 service nova] Acquiring lock "9c36455f-5fd6-4813-9c44-499e3742ed39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e61d580b-eb68-4820-8e06-3b20fdfbd7dc req-5fa30330-0414-44b6-bcd9-0a938daf8d68 service nova] Lock "9c36455f-5fd6-4813-9c44-499e3742ed39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e61d580b-eb68-4820-8e06-3b20fdfbd7dc req-5fa30330-0414-44b6-bcd9-0a938daf8d68 service nova] Lock "9c36455f-5fd6-4813-9c44-499e3742ed39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:56 user nova-compute[74348]: DEBUG nova.compute.manager [req-e61d580b-eb68-4820-8e06-3b20fdfbd7dc req-5fa30330-0414-44b6-bcd9-0a938daf8d68 service nova] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] No waiting events found dispatching network-vif-unplugged-e8c429ee-f5b4-4cf5-935c-5d4631b369e3 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:02:56 user nova-compute[74348]: DEBUG nova.compute.manager [req-e61d580b-eb68-4820-8e06-3b20fdfbd7dc req-5fa30330-0414-44b6-bcd9-0a938daf8d68 service nova] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Received event network-vif-unplugged-e8c429ee-f5b4-4cf5-935c-5d4631b369e3 for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 08:02:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:56 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Instance destroyed successfully.
Nov 22 08:02:56 user nova-compute[74348]: DEBUG nova.objects.instance [None req-d8373680-2489-4cc0-9828-af9fbab6df70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lazy-loading 'resources' on Instance uuid 9c36455f-5fd6-4813-9c44-499e3742ed39 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:02:56 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-d8373680-2489-4cc0-9828-af9fbab6df70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:57:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-478948806',display_name='tempest-VolumesAdminNegativeTest-server-478948806',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-478948806',id=15,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeOXC7u3TOzHgB3Shtn6SnT6dcLnIROZ8883sTf+uKoKMeNKw3Wm5qNGZfCoXIooRQgnQ0hVgU6dUiQ0QL7jRKjKp9YjAJRU03WiiaXwZCTsoNH7pKBOFry4O0ra+81cQ==',key_name='tempest-keypair-24853503',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:57:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8780c23b60e4abe85276f2d71c591b0',ramdisk_id='',reservation_id='r-mxdyaa26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1341066445',owner_user_name='tempest-VolumesAdminNegativeTest-1341066445-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T07:57:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d4446ab7daa45fa8c843c2d991de43f',uuid=9c36455f-5fd6-4813-9c44-499e3742ed39,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8c429ee-f5b4-4cf5-935c-5d4631b369e3", "address": "fa:16:3e:87:e1:4c", "network": {"id": "c405fff5-285f-47eb-8bae-867c6393edf2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-368785799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8780c23b60e4abe85276f2d71c591b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c429ee-f5", "ovs_interfaceid": "e8c429ee-f5b4-4cf5-935c-5d4631b369e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:02:56 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-d8373680-2489-4cc0-9828-af9fbab6df70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Converting VIF {"id": "e8c429ee-f5b4-4cf5-935c-5d4631b369e3", "address": "fa:16:3e:87:e1:4c", "network": {"id": "c405fff5-285f-47eb-8bae-867c6393edf2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-368785799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8780c23b60e4abe85276f2d71c591b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c429ee-f5", "ovs_interfaceid": "e8c429ee-f5b4-4cf5-935c-5d4631b369e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:02:56 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-d8373680-2489-4cc0-9828-af9fbab6df70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:e1:4c,bridge_name='br-int',has_traffic_filtering=True,id=e8c429ee-f5b4-4cf5-935c-5d4631b369e3,network=Network(c405fff5-285f-47eb-8bae-867c6393edf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c429ee-f5') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:02:56 user nova-compute[74348]: DEBUG os_vif [None req-d8373680-2489-4cc0-9828-af9fbab6df70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:e1:4c,bridge_name='br-int',has_traffic_filtering=True,id=e8c429ee-f5b4-4cf5-935c-5d4631b369e3,network=Network(c405fff5-285f-47eb-8bae-867c6393edf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c429ee-f5') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:02:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8c429ee-f5, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:02:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=191d3a80-45b3-4bc8-8b92-836ba616ce15) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:02:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:02:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:02:56 user nova-compute[74348]: INFO os_vif [None req-d8373680-2489-4cc0-9828-af9fbab6df70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:e1:4c,bridge_name='br-int',has_traffic_filtering=True,id=e8c429ee-f5b4-4cf5-935c-5d4631b369e3,network=Network(c405fff5-285f-47eb-8bae-867c6393edf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c429ee-f5')
Nov 22 08:02:56 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-d8373680-2489-4cc0-9828-af9fbab6df70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Deleting instance files /opt/stack/data/nova/instances/9c36455f-5fd6-4813-9c44-499e3742ed39_del
Nov 22 08:02:56 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-d8373680-2489-4cc0-9828-af9fbab6df70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Deletion of /opt/stack/data/nova/instances/9c36455f-5fd6-4813-9c44-499e3742ed39_del complete
Nov 22 08:02:56 user nova-compute[74348]: INFO nova.compute.manager [None req-d8373680-2489-4cc0-9828-af9fbab6df70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Took 1.10 seconds to destroy the instance on the hypervisor.
Nov 22 08:02:56 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-d8373680-2489-4cc0-9828-af9fbab6df70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 08:02:56 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 08:02:56 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 08:02:57 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:02:57 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Took 0.70 seconds to deallocate network for instance.
Nov 22 08:02:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d8373680-2489-4cc0-9828-af9fbab6df70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d8373680-2489-4cc0-9828-af9fbab6df70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:58 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-d8373680-2489-4cc0-9828-af9fbab6df70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:02:58 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-d8373680-2489-4cc0-9828-af9fbab6df70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:02:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d8373680-2489-4cc0-9828-af9fbab6df70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:58 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-d8373680-2489-4cc0-9828-af9fbab6df70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Deleted allocations for instance 9c36455f-5fd6-4813-9c44-499e3742ed39
Nov 22 08:02:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d8373680-2489-4cc0-9828-af9fbab6df70 tempest-VolumesAdminNegativeTest-1341066445 tempest-VolumesAdminNegativeTest-1341066445-project-member] Lock "9c36455f-5fd6-4813-9c44-499e3742ed39" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.402s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:58 user nova-compute[74348]: DEBUG nova.compute.manager [req-b8e41fd0-12a5-4a43-996f-016a80e74d0a req-42c2b625-0cf8-48cd-b68b-30e0f6682ad4 service nova] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Received event network-vif-plugged-e8c429ee-f5b4-4cf5-935c-5d4631b369e3 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:02:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b8e41fd0-12a5-4a43-996f-016a80e74d0a req-42c2b625-0cf8-48cd-b68b-30e0f6682ad4 service nova] Acquiring lock "9c36455f-5fd6-4813-9c44-499e3742ed39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:02:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b8e41fd0-12a5-4a43-996f-016a80e74d0a req-42c2b625-0cf8-48cd-b68b-30e0f6682ad4 service nova] Lock "9c36455f-5fd6-4813-9c44-499e3742ed39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:02:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b8e41fd0-12a5-4a43-996f-016a80e74d0a req-42c2b625-0cf8-48cd-b68b-30e0f6682ad4 service nova] Lock "9c36455f-5fd6-4813-9c44-499e3742ed39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:02:58 user nova-compute[74348]: DEBUG nova.compute.manager [req-b8e41fd0-12a5-4a43-996f-016a80e74d0a req-42c2b625-0cf8-48cd-b68b-30e0f6682ad4 service nova] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] No waiting events found dispatching network-vif-plugged-e8c429ee-f5b4-4cf5-935c-5d4631b369e3 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:02:58 user nova-compute[74348]: WARNING nova.compute.manager [req-b8e41fd0-12a5-4a43-996f-016a80e74d0a req-42c2b625-0cf8-48cd-b68b-30e0f6682ad4 service nova] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Received unexpected event network-vif-plugged-e8c429ee-f5b4-4cf5-935c-5d4631b369e3 for instance with vm_state deleted and task_state None.
Nov 22 08:02:58 user nova-compute[74348]: DEBUG nova.compute.manager [req-b8e41fd0-12a5-4a43-996f-016a80e74d0a req-42c2b625-0cf8-48cd-b68b-30e0f6682ad4 service nova] [instance: 9c36455f-5fd6-4813-9c44-499e3742ed39] Received event network-vif-deleted-e8c429ee-f5b4-4cf5-935c-5d4631b369e3 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:02:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mfrDalSe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:03:02 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:03:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:03:02 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:03:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:03:02 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 08:03:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea -p 172.16.0.220:3260" returned: 21 in 0.034s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e6ce1e-5d91-474c-a253-b35bad00fae3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 08:03:02 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.052s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[213d1110-2a04-4dcb-92f7-46e0e18bbde1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea] added
Nov 22 08:03:02 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[488e3a2a-ec86-4a88-95c4-a1a4d63e0aca]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.040s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[702d416b-1f13-47e6-bf16-6b4101ee15a2]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mfrDalSe {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mfrDalSe" returned: 0 in 0.026s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e2ee96-a25e-4b38-96dd-93c6b97c615f]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mfrDalSe'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed13cdfa-3d37-4b70-b542-686aac1423f0]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fdc0a14-f7b5-4760-acf2-1bc5424f2c8c]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:03:02 user nova-compute[74348]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa (non-flash)
Nov 22 08:03:02 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:03:02 user nova-compute[74348]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa (non-flash)
Nov 22 08:03:02 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bcd9a4-5b22-4503-a968-278f92bb794b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea, portal: 172.16.0.220,3260]
Nov 22 08:03:02 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea, portal: 172.16.0.220,3260] successful.
Nov 22 08:03:02 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf6b424-8842-4eec-9730-ba27a92c03eb]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dfccc21-3321-4132-a84b-b201be0630fc]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:03:02 user nova-compute[74348]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa (non-flash)
Nov 22 08:03:02 user nova-compute[74348]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)
Nov 22 08:03:02 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:03:02 user nova-compute[74348]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa (non-flash)
Nov 22 08:03:02 user nova-compute[74348]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)
Nov 22 08:03:02 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.450s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] HCTL ('34', '-', '-', 0) found on session 31 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.030s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b28ab0f-d39d-452b-aa79-a191d8afe9e3]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mfrDalSe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG nova.compute.manager [req-f5afdb27-e803-4570-8ec2-9714c0bb8ac2 req-5f76a73a-c68c-4cfc-9d56-d78a08ddfdfb service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Received event network-changed-25edb763-90ad-43e6-98c1-6baf85e723d5 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG nova.compute.manager [req-f5afdb27-e803-4570-8ec2-9714c0bb8ac2 req-5f76a73a-c68c-4cfc-9d56-d78a08ddfdfb service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Refreshing instance network info cache due to event network-changed-25edb763-90ad-43e6-98c1-6baf85e723d5. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f5afdb27-e803-4570-8ec2-9714c0bb8ac2 req-5f76a73a-c68c-4cfc-9d56-d78a08ddfdfb service nova] Acquiring lock "refresh_cache-a635cbbc-6b87-4877-80a8-bd4001c407c6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f5afdb27-e803-4570-8ec2-9714c0bb8ac2 req-5f76a73a-c68c-4cfc-9d56-d78a08ddfdfb service nova] Acquired lock "refresh_cache-a635cbbc-6b87-4877-80a8-bd4001c407c6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:03:02 user nova-compute[74348]: DEBUG nova.network.neutron [req-f5afdb27-e803-4570-8ec2-9714c0bb8ac2 req-5f76a73a-c68c-4cfc-9d56-d78a08ddfdfb service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Refreshing network info cache for port 25edb763-90ad-43e6-98c1-6baf85e723d5 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:03:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "a31128a9-fc24-4a42-acdb-a50dfd64446e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:03:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "a31128a9-fc24-4a42-acdb-a50dfd64446e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:03:03 user nova-compute[74348]: DEBUG nova.compute.manager [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 08:03:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.518s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:03:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] <== connect_volume: return (1520ms) {'type': 'block', 'scsi_wwn': '23937386232393063', 'path': '/dev/sdc'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:03:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937386232393063', 'path': '/dev/sdc'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 08:03:03 user nova-compute[74348]: DEBUG nova.network.neutron [req-f5afdb27-e803-4570-8ec2-9714c0bb8ac2 req-5f76a73a-c68c-4cfc-9d56-d78a08ddfdfb service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Updated VIF entry in instance network info cache for port 25edb763-90ad-43e6-98c1-6baf85e723d5. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:03:03 user nova-compute[74348]: DEBUG nova.network.neutron [req-f5afdb27-e803-4570-8ec2-9714c0bb8ac2 req-5f76a73a-c68c-4cfc-9d56-d78a08ddfdfb service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Updating instance_info_cache with network_info: [{"id": "25edb763-90ad-43e6-98c1-6baf85e723d5", "address": "fa:16:3e:a5:2d:c8", "network": {"id": "442abc57-45e5-4cd7-878e-979afa78c421", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1395369508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d76d03d17cc4e5bb52a32a2f8fbd629", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25edb763-90", "ovs_interfaceid": "25edb763-90ad-43e6-98c1-6baf85e723d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:03:03 user nova-compute[74348]: DEBUG nova.objects.instance [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lazy-loading 'flavor' on Instance uuid 37c93c2a-1397-4b04-aef1-5068218ad9fd {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:03:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f5afdb27-e803-4570-8ec2-9714c0bb8ac2 req-5f76a73a-c68c-4cfc-9d56-d78a08ddfdfb service nova] Releasing lock "refresh_cache-a635cbbc-6b87-4877-80a8-bd4001c407c6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:03:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:03:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:03:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 08:03:03 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:03:03 user nova-compute[74348]:   <source dev="/dev/sdc"/>
Nov 22 08:03:03 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:03:03 user nova-compute[74348]:   <serial>5d3034db-c569-4cd9-ad54-142be23d7dea</serial>
Nov 22 08:03:03 user nova-compute[74348]: </disk>
Nov 22 08:03:03 user nova-compute[74348]:  {{(pid=74348) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 08:03:03 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 08:03:03 user nova-compute[74348]: INFO nova.compute.claims [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Claim successful on node user
Nov 22 08:03:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:04 user nova-compute[74348]: DEBUG nova.compute.manager [req-15e20f1e-5fdb-4b07-a3cf-afe5895266d9 req-2ad2e62f-43c9-47d4-ac57-cd9d63c36227 service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Received event network-changed-25edb763-90ad-43e6-98c1-6baf85e723d5 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:03:04 user nova-compute[74348]: DEBUG nova.compute.manager [req-15e20f1e-5fdb-4b07-a3cf-afe5895266d9 req-2ad2e62f-43c9-47d4-ac57-cd9d63c36227 service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Refreshing instance network info cache due to event network-changed-25edb763-90ad-43e6-98c1-6baf85e723d5. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:03:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-15e20f1e-5fdb-4b07-a3cf-afe5895266d9 req-2ad2e62f-43c9-47d4-ac57-cd9d63c36227 service nova] Acquiring lock "refresh_cache-a635cbbc-6b87-4877-80a8-bd4001c407c6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:03:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-15e20f1e-5fdb-4b07-a3cf-afe5895266d9 req-2ad2e62f-43c9-47d4-ac57-cd9d63c36227 service nova] Acquired lock "refresh_cache-a635cbbc-6b87-4877-80a8-bd4001c407c6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:03:04 user nova-compute[74348]: DEBUG nova.network.neutron [req-15e20f1e-5fdb-4b07-a3cf-afe5895266d9 req-2ad2e62f-43c9-47d4-ac57-cd9d63c36227 service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Refreshing network info cache for port 25edb763-90ad-43e6-98c1-6baf85e723d5 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:03:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:03:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:03:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] No VIF found with MAC fa:16:3e:62:f2:83, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:03:04 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:03:04 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:03:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.789s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:03:04 user nova-compute[74348]: DEBUG nova.compute.manager [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 08:03:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4bb3170d-0585-44ef-a50d-ba5f47693ee1 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "37c93c2a-1397-4b04-aef1-5068218ad9fd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.823s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:03:04 user nova-compute[74348]: DEBUG nova.compute.manager [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 08:03:04 user nova-compute[74348]: DEBUG nova.network.neutron [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 08:03:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-6733ee5c-326b-48d2-a33e-8758f77e08c9 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Acquiring lock "a635cbbc-6b87-4877-80a8-bd4001c407c6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:03:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-6733ee5c-326b-48d2-a33e-8758f77e08c9 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "a635cbbc-6b87-4877-80a8-bd4001c407c6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:03:04 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 08:03:04 user nova-compute[74348]: DEBUG nova.compute.manager [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 08:03:04 user nova-compute[74348]: INFO nova.compute.manager [None req-6733ee5c-326b-48d2-a33e-8758f77e08c9 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Detaching volume 12828237-e920-4f6e-bcaf-2b0443407daa
Nov 22 08:03:04 user nova-compute[74348]: INFO nova.virt.block_device [None req-6733ee5c-326b-48d2-a33e-8758f77e08c9 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Attempting to driver detach volume 12828237-e920-4f6e-bcaf-2b0443407daa from mountpoint /dev/vdb
Nov 22 08:03:04 user nova-compute[74348]: DEBUG nova.policy [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f8eca17e3a564220b3b07af4eddadaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569146bb9b04838ad8044260da6ad58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 08:03:04 user nova-compute[74348]: DEBUG nova.network.neutron [req-15e20f1e-5fdb-4b07-a3cf-afe5895266d9 req-2ad2e62f-43c9-47d4-ac57-cd9d63c36227 service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Updated VIF entry in instance network info cache for port 25edb763-90ad-43e6-98c1-6baf85e723d5. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:03:04 user nova-compute[74348]: DEBUG nova.network.neutron [req-15e20f1e-5fdb-4b07-a3cf-afe5895266d9 req-2ad2e62f-43c9-47d4-ac57-cd9d63c36227 service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Updating instance_info_cache with network_info: [{"id": "25edb763-90ad-43e6-98c1-6baf85e723d5", "address": "fa:16:3e:a5:2d:c8", "network": {"id": "442abc57-45e5-4cd7-878e-979afa78c421", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1395369508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d76d03d17cc4e5bb52a32a2f8fbd629", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25edb763-90", "ovs_interfaceid": "25edb763-90ad-43e6-98c1-6baf85e723d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:03:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-6733ee5c-326b-48d2-a33e-8758f77e08c9 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Attempting to detach device vdb from instance a635cbbc-6b87-4877-80a8-bd4001c407c6 from the persistent domain config. {{(pid=74348) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 08:03:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-6733ee5c-326b-48d2-a33e-8758f77e08c9 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:03:04 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:03:04 user nova-compute[74348]:   <source dev="/dev/sdd"/>
Nov 22 08:03:04 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:03:04 user nova-compute[74348]:   <serial>12828237-e920-4f6e-bcaf-2b0443407daa</serial>
Nov 22 08:03:04 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 22 08:03:04 user nova-compute[74348]: </disk>
Nov 22 08:03:04 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:03:04 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-6733ee5c-326b-48d2-a33e-8758f77e08c9 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Successfully detached device vdb from instance a635cbbc-6b87-4877-80a8-bd4001c407c6 from the persistent domain config.
Nov 22 08:03:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-6733ee5c-326b-48d2-a33e-8758f77e08c9 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a635cbbc-6b87-4877-80a8-bd4001c407c6 from the live domain config. {{(pid=74348) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 08:03:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-6733ee5c-326b-48d2-a33e-8758f77e08c9 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:03:04 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:03:04 user nova-compute[74348]:   <source dev="/dev/sdd"/>
Nov 22 08:03:04 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:03:04 user nova-compute[74348]:   <serial>12828237-e920-4f6e-bcaf-2b0443407daa</serial>
Nov 22 08:03:04 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 22 08:03:04 user nova-compute[74348]: </disk>
Nov 22 08:03:04 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:03:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-15e20f1e-5fdb-4b07-a3cf-afe5895266d9 req-2ad2e62f-43c9-47d4-ac57-cd9d63c36227 service nova] Releasing lock "refresh_cache-a635cbbc-6b87-4877-80a8-bd4001c407c6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:03:04 user nova-compute[74348]: DEBUG nova.compute.manager [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 08:03:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 08:03:04 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Creating image(s)
Nov 22 08:03:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "/opt/stack/data/nova/instances/a31128a9-fc24-4a42-acdb-a50dfd64446e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:03:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "/opt/stack/data/nova/instances/a31128a9-fc24-4a42-acdb-a50dfd64446e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:03:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "/opt/stack/data/nova/instances/a31128a9-fc24-4a42-acdb-a50dfd64446e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:03:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:05 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.211s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:03:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:03:05 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:05 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-6733ee5c-326b-48d2-a33e-8758f77e08c9 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a635cbbc-6b87-4877-80a8-bd4001c407c6 {{(pid=74348) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 08:03:05 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.221s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:05 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/a31128a9-fc24-4a42-acdb-a50dfd64446e/disk 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:05 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/a31128a9-fc24-4a42-acdb-a50dfd64446e/disk 1073741824" returned: 0 in 0.063s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:03:05 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:05 user nova-compute[74348]: DEBUG nova.network.neutron [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Successfully created port: 5e33f324-c04a-4be4-b29f-61b75abcd8ba {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 08:03:05 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.184s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:05 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a31128a9-fc24-4a42-acdb-a50dfd64446e/disk. size=1073741824 {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 08:03:05 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a31128a9-fc24-4a42-acdb-a50dfd64446e/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:05 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a31128a9-fc24-4a42-acdb-a50dfd64446e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:05 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Cannot resize image /opt/stack/data/nova/instances/a31128a9-fc24-4a42-acdb-a50dfd64446e/disk to a smaller size. {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 08:03:05 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 08:03:05 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Ensure instance console log exists: /opt/stack/data/nova/instances/a31128a9-fc24-4a42-acdb-a50dfd64446e/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 08:03:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:03:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:03:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:03:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-a99f8e11-ae5b-4b87-9e08-2d0328eb26ec tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquiring lock "37c93c2a-1397-4b04-aef1-5068218ad9fd" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:03:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-a99f8e11-ae5b-4b87-9e08-2d0328eb26ec tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "37c93c2a-1397-4b04-aef1-5068218ad9fd" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:03:05 user nova-compute[74348]: DEBUG nova.compute.manager [None req-a99f8e11-ae5b-4b87-9e08-2d0328eb26ec tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:03:05 user nova-compute[74348]: DEBUG nova.compute.manager [None req-a99f8e11-ae5b-4b87-9e08-2d0328eb26ec tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74348) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 22 08:03:05 user nova-compute[74348]: DEBUG nova.objects.instance [None req-a99f8e11-ae5b-4b87-9e08-2d0328eb26ec tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lazy-loading 'flavor' on Instance uuid 37c93c2a-1397-4b04-aef1-5068218ad9fd {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:03:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:06 user nova-compute[74348]: DEBUG nova.network.neutron [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Successfully updated port: 5e33f324-c04a-4be4-b29f-61b75abcd8ba {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 08:03:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "refresh_cache-a31128a9-fc24-4a42-acdb-a50dfd64446e" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:03:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquired lock "refresh_cache-a31128a9-fc24-4a42-acdb-a50dfd64446e" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:03:06 user nova-compute[74348]: DEBUG nova.network.neutron [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:03:06 user nova-compute[74348]: DEBUG nova.compute.manager [req-83e4faa5-0202-4ebf-bea4-68b755e3ee1e req-77a9fe07-8bfa-4342-8159-5f6823ece835 service nova] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Received event network-changed-5e33f324-c04a-4be4-b29f-61b75abcd8ba {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:03:06 user nova-compute[74348]: DEBUG nova.compute.manager [req-83e4faa5-0202-4ebf-bea4-68b755e3ee1e req-77a9fe07-8bfa-4342-8159-5f6823ece835 service nova] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Refreshing instance network info cache due to event network-changed-5e33f324-c04a-4be4-b29f-61b75abcd8ba. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:03:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-83e4faa5-0202-4ebf-bea4-68b755e3ee1e req-77a9fe07-8bfa-4342-8159-5f6823ece835 service nova] Acquiring lock "refresh_cache-a31128a9-fc24-4a42-acdb-a50dfd64446e" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:03:06 user nova-compute[74348]: DEBUG nova.compute.manager [req-d5c21fd1-6080-491f-8f11-b1cf3e47fa00 req-fe1bd957-c059-48b7-9b55-947e82a53153 service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Received event network-vif-unplugged-acc2d56f-6884-403d-b2e5-2eb64c40047f {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:03:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d5c21fd1-6080-491f-8f11-b1cf3e47fa00 req-fe1bd957-c059-48b7-9b55-947e82a53153 service nova] Acquiring lock "37c93c2a-1397-4b04-aef1-5068218ad9fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:03:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d5c21fd1-6080-491f-8f11-b1cf3e47fa00 req-fe1bd957-c059-48b7-9b55-947e82a53153 service nova] Lock "37c93c2a-1397-4b04-aef1-5068218ad9fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:03:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d5c21fd1-6080-491f-8f11-b1cf3e47fa00 req-fe1bd957-c059-48b7-9b55-947e82a53153 service nova] Lock "37c93c2a-1397-4b04-aef1-5068218ad9fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:03:06 user nova-compute[74348]: DEBUG nova.compute.manager [req-d5c21fd1-6080-491f-8f11-b1cf3e47fa00 req-fe1bd957-c059-48b7-9b55-947e82a53153 service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] No waiting events found dispatching network-vif-unplugged-acc2d56f-6884-403d-b2e5-2eb64c40047f {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:03:06 user nova-compute[74348]: WARNING nova.compute.manager [req-d5c21fd1-6080-491f-8f11-b1cf3e47fa00 req-fe1bd957-c059-48b7-9b55-947e82a53153 service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Received unexpected event network-vif-unplugged-acc2d56f-6884-403d-b2e5-2eb64c40047f for instance with vm_state active and task_state powering-off.
Nov 22 08:03:06 user nova-compute[74348]: DEBUG nova.network.neutron [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 08:03:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:07 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Instance destroyed successfully.
Nov 22 08:03:07 user nova-compute[74348]: DEBUG nova.compute.manager [None req-a99f8e11-ae5b-4b87-9e08-2d0328eb26ec tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-a99f8e11-ae5b-4b87-9e08-2d0328eb26ec tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "37c93c2a-1397-4b04-aef1-5068218ad9fd" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.538s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG nova.network.neutron [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Updating instance_info_cache with network_info: [{"id": "5e33f324-c04a-4be4-b29f-61b75abcd8ba", "address": "fa:16:3e:f8:ab:0b", "network": {"id": "5c50496a-0882-415b-8115-ddf7b65516a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-531638472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f569146bb9b04838ad8044260da6ad58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e33f324-c0", "ovs_interfaceid": "5e33f324-c04a-4be4-b29f-61b75abcd8ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Releasing lock "refresh_cache-a31128a9-fc24-4a42-acdb-a50dfd64446e" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG nova.compute.manager [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Instance network_info: |[{"id": "5e33f324-c04a-4be4-b29f-61b75abcd8ba", "address": "fa:16:3e:f8:ab:0b", "network": {"id": "5c50496a-0882-415b-8115-ddf7b65516a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-531638472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f569146bb9b04838ad8044260da6ad58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e33f324-c0", "ovs_interfaceid": "5e33f324-c04a-4be4-b29f-61b75abcd8ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-83e4faa5-0202-4ebf-bea4-68b755e3ee1e req-77a9fe07-8bfa-4342-8159-5f6823ece835 service nova] Acquired lock "refresh_cache-a31128a9-fc24-4a42-acdb-a50dfd64446e" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG nova.network.neutron [req-83e4faa5-0202-4ebf-bea4-68b755e3ee1e req-77a9fe07-8bfa-4342-8159-5f6823ece835 service nova] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Refreshing network info cache for port 5e33f324-c04a-4be4-b29f-61b75abcd8ba {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Start _get_guest_xml network_info=[{"id": "5e33f324-c04a-4be4-b29f-61b75abcd8ba", "address": "fa:16:3e:f8:ab:0b", "network": {"id": "5c50496a-0882-415b-8115-ddf7b65516a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-531638472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f569146bb9b04838ad8044260da6ad58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e33f324-c0", "ovs_interfaceid": "5e33f324-c04a-4be4-b29f-61b75abcd8ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 08:03:07 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:03:07 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:03:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:03:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1931830972',display_name='tempest-AttachVolumeNegativeTest-server-1931830972',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1931830972',id=30,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUVOKVXwpWxSaYILQ9WsYHWpLciTkEgvZX5tqPCq1lSRopPXuBqumcHko57p+dykJp45Ienvrk5Mz0bcqzvb/hHDHTuRMutgpHL0YcsLuGnAndXc+jpyRSFqyn/hkW59g==',key_name='tempest-keypair-1336374186',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f569146bb9b04838ad8044260da6ad58',ramdisk_id='',reservation_id='r-fxz5vcf5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1606364171',owner_user_name='tempest-AttachVolumeNegativeTest-1606364171-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:03:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8eca17e3a564220b3b07af4eddadaca',uuid=a31128a9-fc24-4a42-acdb-a50dfd64446e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e33f324-c04a-4be4-b29f-61b75abcd8ba", "address": "fa:16:3e:f8:ab:0b", "network": {"id": "5c50496a-0882-415b-8115-ddf7b65516a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-531638472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f569146bb9b04838ad8044260da6ad58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e33f324-c0", "ovs_interfaceid": "5e33f324-c04a-4be4-b29f-61b75abcd8ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Converting VIF {"id": "5e33f324-c04a-4be4-b29f-61b75abcd8ba", "address": "fa:16:3e:f8:ab:0b", "network": {"id": "5c50496a-0882-415b-8115-ddf7b65516a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-531638472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f569146bb9b04838ad8044260da6ad58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e33f324-c0", "ovs_interfaceid": "5e33f324-c04a-4be4-b29f-61b75abcd8ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:ab:0b,bridge_name='br-int',has_traffic_filtering=True,id=5e33f324-c04a-4be4-b29f-61b75abcd8ba,network=Network(5c50496a-0882-415b-8115-ddf7b65516a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e33f324-c0') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG nova.objects.instance [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lazy-loading 'pci_devices' on Instance uuid a31128a9-fc24-4a42-acdb-a50dfd64446e {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] End _get_guest_xml xml=<domain type="kvm">
Nov 22 08:03:07 user nova-compute[74348]:   <uuid>a31128a9-fc24-4a42-acdb-a50dfd64446e</uuid>
Nov 22 08:03:07 user nova-compute[74348]:   <name>instance-0000001e</name>
Nov 22 08:03:07 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 08:03:07 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 08:03:07 user nova-compute[74348]:   <metadata>
Nov 22 08:03:07 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 08:03:07 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 08:03:07 user nova-compute[74348]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1931830972</nova:name>
Nov 22 08:03:07 user nova-compute[74348]:       <nova:creationTime>2023-11-22 08:03:07</nova:creationTime>
Nov 22 08:03:07 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 08:03:07 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 08:03:07 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 08:03:07 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 08:03:07 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 08:03:07 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 08:03:07 user nova-compute[74348]:       </nova:flavor>
Nov 22 08:03:07 user nova-compute[74348]:       <nova:owner>
Nov 22 08:03:07 user nova-compute[74348]:         <nova:user uuid="f8eca17e3a564220b3b07af4eddadaca">tempest-AttachVolumeNegativeTest-1606364171-project-member</nova:user>
Nov 22 08:03:07 user nova-compute[74348]:         <nova:project uuid="f569146bb9b04838ad8044260da6ad58">tempest-AttachVolumeNegativeTest-1606364171</nova:project>
Nov 22 08:03:07 user nova-compute[74348]:       </nova:owner>
Nov 22 08:03:07 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 08:03:07 user nova-compute[74348]:       <nova:ports>
Nov 22 08:03:07 user nova-compute[74348]:         <nova:port uuid="5e33f324-c04a-4be4-b29f-61b75abcd8ba">
Nov 22 08:03:07 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 22 08:03:07 user nova-compute[74348]:         </nova:port>
Nov 22 08:03:07 user nova-compute[74348]:       </nova:ports>
Nov 22 08:03:07 user nova-compute[74348]:     </nova:instance>
Nov 22 08:03:07 user nova-compute[74348]:   </metadata>
Nov 22 08:03:07 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 08:03:07 user nova-compute[74348]:     <system>
Nov 22 08:03:07 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 08:03:07 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 08:03:07 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 08:03:07 user nova-compute[74348]:       <entry name="serial">a31128a9-fc24-4a42-acdb-a50dfd64446e</entry>
Nov 22 08:03:07 user nova-compute[74348]:       <entry name="uuid">a31128a9-fc24-4a42-acdb-a50dfd64446e</entry>
Nov 22 08:03:07 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 08:03:07 user nova-compute[74348]:     </system>
Nov 22 08:03:07 user nova-compute[74348]:   </sysinfo>
Nov 22 08:03:07 user nova-compute[74348]:   <os>
Nov 22 08:03:07 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 08:03:07 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 08:03:07 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 08:03:07 user nova-compute[74348]:   </os>
Nov 22 08:03:07 user nova-compute[74348]:   <features>
Nov 22 08:03:07 user nova-compute[74348]:     <acpi/>
Nov 22 08:03:07 user nova-compute[74348]:     <apic/>
Nov 22 08:03:07 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 08:03:07 user nova-compute[74348]:   </features>
Nov 22 08:03:07 user nova-compute[74348]:   <clock offset="utc">
Nov 22 08:03:07 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 08:03:07 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 08:03:07 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 08:03:07 user nova-compute[74348]:   </clock>
Nov 22 08:03:07 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 08:03:07 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 08:03:07 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 08:03:07 user nova-compute[74348]:   </cpu>
Nov 22 08:03:07 user nova-compute[74348]:   <devices>
Nov 22 08:03:07 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 08:03:07 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 08:03:07 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/a31128a9-fc24-4a42-acdb-a50dfd64446e/disk"/>
Nov 22 08:03:07 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 08:03:07 user nova-compute[74348]:     </disk>
Nov 22 08:03:07 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 08:03:07 user nova-compute[74348]:       <mac address="fa:16:3e:f8:ab:0b"/>
Nov 22 08:03:07 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:03:07 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 08:03:07 user nova-compute[74348]:       <target dev="tap5e33f324-c0"/>
Nov 22 08:03:07 user nova-compute[74348]:     </interface>
Nov 22 08:03:07 user nova-compute[74348]:     <serial type="pty">
Nov 22 08:03:07 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/a31128a9-fc24-4a42-acdb-a50dfd64446e/console.log" append="off"/>
Nov 22 08:03:07 user nova-compute[74348]:     </serial>
Nov 22 08:03:07 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 08:03:07 user nova-compute[74348]:     <video>
Nov 22 08:03:07 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:03:07 user nova-compute[74348]:     </video>
Nov 22 08:03:07 user nova-compute[74348]:     <rng model="virtio">
Nov 22 08:03:07 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 08:03:07 user nova-compute[74348]:     </rng>
Nov 22 08:03:07 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 08:03:07 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 08:03:07 user nova-compute[74348]:       <stats period="10"/>
Nov 22 08:03:07 user nova-compute[74348]:     </memballoon>
Nov 22 08:03:07 user nova-compute[74348]:   </devices>
Nov 22 08:03:07 user nova-compute[74348]: </domain>
Nov 22 08:03:07 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:03:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1931830972',display_name='tempest-AttachVolumeNegativeTest-server-1931830972',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1931830972',id=30,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUVOKVXwpWxSaYILQ9WsYHWpLciTkEgvZX5tqPCq1lSRopPXuBqumcHko57p+dykJp45Ienvrk5Mz0bcqzvb/hHDHTuRMutgpHL0YcsLuGnAndXc+jpyRSFqyn/hkW59g==',key_name='tempest-keypair-1336374186',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f569146bb9b04838ad8044260da6ad58',ramdisk_id='',reservation_id='r-fxz5vcf5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1606364171',owner_user_name='tempest-AttachVolumeNegativeTest-1606364171-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:03:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8eca17e3a564220b3b07af4eddadaca',uuid=a31128a9-fc24-4a42-acdb-a50dfd64446e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e33f324-c04a-4be4-b29f-61b75abcd8ba", "address": "fa:16:3e:f8:ab:0b", "network": {"id": "5c50496a-0882-415b-8115-ddf7b65516a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-531638472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f569146bb9b04838ad8044260da6ad58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e33f324-c0", "ovs_interfaceid": "5e33f324-c04a-4be4-b29f-61b75abcd8ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Converting VIF {"id": "5e33f324-c04a-4be4-b29f-61b75abcd8ba", "address": "fa:16:3e:f8:ab:0b", "network": {"id": "5c50496a-0882-415b-8115-ddf7b65516a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-531638472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f569146bb9b04838ad8044260da6ad58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e33f324-c0", "ovs_interfaceid": "5e33f324-c04a-4be4-b29f-61b75abcd8ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:ab:0b,bridge_name='br-int',has_traffic_filtering=True,id=5e33f324-c04a-4be4-b29f-61b75abcd8ba,network=Network(5c50496a-0882-415b-8115-ddf7b65516a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e33f324-c0') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG os_vif [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:ab:0b,bridge_name='br-int',has_traffic_filtering=True,id=5e33f324-c04a-4be4-b29f-61b75abcd8ba,network=Network(5c50496a-0882-415b-8115-ddf7b65516a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e33f324-c0') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ea0fa249-3753-5dbd-b00c-648ec32eac6f', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e33f324-c0, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5e33f324-c0, col_values=(('qos', UUID('990157c7-f0f8-4574-9005-aef14be9f4ee')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5e33f324-c0, col_values=(('external_ids', {'iface-id': '5e33f324-c04a-4be4-b29f-61b75abcd8ba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:ab:0b', 'vm-uuid': 'a31128a9-fc24-4a42-acdb-a50dfd64446e'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:07 user nova-compute[74348]: INFO os_vif [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:ab:0b,bridge_name='br-int',has_traffic_filtering=True,id=5e33f324-c04a-4be4-b29f-61b75abcd8ba,network=Network(5c50496a-0882-415b-8115-ddf7b65516a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e33f324-c0')
Nov 22 08:03:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] No VIF found with MAC fa:16:3e:f8:ab:0b, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG nova.network.neutron [req-83e4faa5-0202-4ebf-bea4-68b755e3ee1e req-77a9fe07-8bfa-4342-8159-5f6823ece835 service nova] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Updated VIF entry in instance network info cache for port 5e33f324-c04a-4be4-b29f-61b75abcd8ba. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG nova.network.neutron [req-83e4faa5-0202-4ebf-bea4-68b755e3ee1e req-77a9fe07-8bfa-4342-8159-5f6823ece835 service nova] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Updating instance_info_cache with network_info: [{"id": "5e33f324-c04a-4be4-b29f-61b75abcd8ba", "address": "fa:16:3e:f8:ab:0b", "network": {"id": "5c50496a-0882-415b-8115-ddf7b65516a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-531638472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f569146bb9b04838ad8044260da6ad58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e33f324-c0", "ovs_interfaceid": "5e33f324-c04a-4be4-b29f-61b75abcd8ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:03:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-83e4faa5-0202-4ebf-bea4-68b755e3ee1e req-77a9fe07-8bfa-4342-8159-5f6823ece835 service nova] Releasing lock "refresh_cache-a31128a9-fc24-4a42-acdb-a50dfd64446e" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:03:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Acquiring lock "a00543c8-2d8f-4f63-aa4d-01582a90775d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:03:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Lock "a00543c8-2d8f-4f63-aa4d-01582a90775d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:03:08 user nova-compute[74348]: DEBUG nova.compute.manager [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 08:03:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:03:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:03:08 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 08:03:08 user nova-compute[74348]: INFO nova.compute.claims [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Claim successful on node user
Nov 22 08:03:08 user nova-compute[74348]: DEBUG nova.compute.manager [req-806dae53-934f-449c-b984-f9b217782665 req-b0a9959f-017b-4945-a75c-dc7d1bac810d service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Received event network-vif-plugged-acc2d56f-6884-403d-b2e5-2eb64c40047f {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:03:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-806dae53-934f-449c-b984-f9b217782665 req-b0a9959f-017b-4945-a75c-dc7d1bac810d service nova] Acquiring lock "37c93c2a-1397-4b04-aef1-5068218ad9fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:03:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-806dae53-934f-449c-b984-f9b217782665 req-b0a9959f-017b-4945-a75c-dc7d1bac810d service nova] Lock "37c93c2a-1397-4b04-aef1-5068218ad9fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:03:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-806dae53-934f-449c-b984-f9b217782665 req-b0a9959f-017b-4945-a75c-dc7d1bac810d service nova] Lock "37c93c2a-1397-4b04-aef1-5068218ad9fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:03:08 user nova-compute[74348]: DEBUG nova.compute.manager [req-806dae53-934f-449c-b984-f9b217782665 req-b0a9959f-017b-4945-a75c-dc7d1bac810d service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] No waiting events found dispatching network-vif-plugged-acc2d56f-6884-403d-b2e5-2eb64c40047f {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:03:08 user nova-compute[74348]: WARNING nova.compute.manager [req-806dae53-934f-449c-b984-f9b217782665 req-b0a9959f-017b-4945-a75c-dc7d1bac810d service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Received unexpected event network-vif-plugged-acc2d56f-6884-403d-b2e5-2eb64c40047f for instance with vm_state stopped and task_state None.
Nov 22 08:03:08 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:03:08 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:03:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.397s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:03:08 user nova-compute[74348]: DEBUG nova.compute.manager [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 08:03:08 user nova-compute[74348]: DEBUG nova.compute.manager [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 08:03:08 user nova-compute[74348]: DEBUG nova.network.neutron [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 08:03:08 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 08:03:08 user nova-compute[74348]: DEBUG nova.compute.manager [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 08:03:08 user nova-compute[74348]: DEBUG nova.policy [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '03aac0b5680c431592326486b1d030b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ac02b435a54124b9b8cfc3afeb9e57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 08:03:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:08 user nova-compute[74348]: DEBUG nova.compute.manager [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 08:03:08 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 08:03:08 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Creating image(s)
Nov 22 08:03:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Acquiring lock "/opt/stack/data/nova/instances/a00543c8-2d8f-4f63-aa4d-01582a90775d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:03:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Lock "/opt/stack/data/nova/instances/a00543c8-2d8f-4f63-aa4d-01582a90775d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:03:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Lock "/opt/stack/data/nova/instances/a00543c8-2d8f-4f63-aa4d-01582a90775d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:03:08 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.196s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Acquiring lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:03:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:03:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.181s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/a00543c8-2d8f-4f63-aa4d-01582a90775d/disk 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/a00543c8-2d8f-4f63-aa4d-01582a90775d/disk 1073741824" returned: 0 in 0.062s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:03:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.176s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:09 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a00543c8-2d8f-4f63-aa4d-01582a90775d/disk. size=1073741824 {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 08:03:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a00543c8-2d8f-4f63-aa4d-01582a90775d/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:09 user nova-compute[74348]: DEBUG nova.compute.manager [req-22731fbf-c4b7-4ca8-8cfe-5bafd896f990 req-932e01d6-8b34-45f4-8f34-b016b0dd6013 service nova] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Received event network-vif-plugged-5e33f324-c04a-4be4-b29f-61b75abcd8ba {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:03:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-22731fbf-c4b7-4ca8-8cfe-5bafd896f990 req-932e01d6-8b34-45f4-8f34-b016b0dd6013 service nova] Acquiring lock "a31128a9-fc24-4a42-acdb-a50dfd64446e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:03:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-22731fbf-c4b7-4ca8-8cfe-5bafd896f990 req-932e01d6-8b34-45f4-8f34-b016b0dd6013 service nova] Lock "a31128a9-fc24-4a42-acdb-a50dfd64446e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:03:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-22731fbf-c4b7-4ca8-8cfe-5bafd896f990 req-932e01d6-8b34-45f4-8f34-b016b0dd6013 service nova] Lock "a31128a9-fc24-4a42-acdb-a50dfd64446e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:03:09 user nova-compute[74348]: DEBUG nova.compute.manager [req-22731fbf-c4b7-4ca8-8cfe-5bafd896f990 req-932e01d6-8b34-45f4-8f34-b016b0dd6013 service nova] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] No waiting events found dispatching network-vif-plugged-5e33f324-c04a-4be4-b29f-61b75abcd8ba {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:03:09 user nova-compute[74348]: WARNING nova.compute.manager [req-22731fbf-c4b7-4ca8-8cfe-5bafd896f990 req-932e01d6-8b34-45f4-8f34-b016b0dd6013 service nova] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Received unexpected event network-vif-plugged-5e33f324-c04a-4be4-b29f-61b75abcd8ba for instance with vm_state building and task_state spawning.
Nov 22 08:03:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a00543c8-2d8f-4f63-aa4d-01582a90775d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:09 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Cannot resize image /opt/stack/data/nova/instances/a00543c8-2d8f-4f63-aa4d-01582a90775d/disk to a smaller size. {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 08:03:09 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 08:03:09 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Ensure instance console log exists: /opt/stack/data/nova/instances/a00543c8-2d8f-4f63-aa4d-01582a90775d/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 08:03:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:03:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:03:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:03:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:10 user nova-compute[74348]: DEBUG nova.network.neutron [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Successfully created port: 3218c3ca-293c-41e8-96c5-1550439e96d0 {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 08:03:10 user nova-compute[74348]: DEBUG nova.network.neutron [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Successfully updated port: 3218c3ca-293c-41e8-96c5-1550439e96d0 {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 08:03:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Acquiring lock "refresh_cache-a00543c8-2d8f-4f63-aa4d-01582a90775d" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:03:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Acquired lock "refresh_cache-a00543c8-2d8f-4f63-aa4d-01582a90775d" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:03:10 user nova-compute[74348]: DEBUG nova.network.neutron [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:03:10 user nova-compute[74348]: DEBUG nova.network.neutron [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG nova.network.neutron [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Updating instance_info_cache with network_info: [{"id": "3218c3ca-293c-41e8-96c5-1550439e96d0", "address": "fa:16:3e:99:13:fb", "network": {"id": "58371390-13da-4593-a6f1-32b2c60f5e7d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2101379319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ac02b435a54124b9b8cfc3afeb9e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3218c3ca-29", "ovs_interfaceid": "3218c3ca-293c-41e8-96c5-1550439e96d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Releasing lock "refresh_cache-a00543c8-2d8f-4f63-aa4d-01582a90775d" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG nova.compute.manager [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Instance network_info: |[{"id": "3218c3ca-293c-41e8-96c5-1550439e96d0", "address": "fa:16:3e:99:13:fb", "network": {"id": "58371390-13da-4593-a6f1-32b2c60f5e7d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2101379319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ac02b435a54124b9b8cfc3afeb9e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3218c3ca-29", "ovs_interfaceid": "3218c3ca-293c-41e8-96c5-1550439e96d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Start _get_guest_xml network_info=[{"id": "3218c3ca-293c-41e8-96c5-1550439e96d0", "address": "fa:16:3e:99:13:fb", "network": {"id": "58371390-13da-4593-a6f1-32b2c60f5e7d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2101379319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ac02b435a54124b9b8cfc3afeb9e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3218c3ca-29", "ovs_interfaceid": "3218c3ca-293c-41e8-96c5-1550439e96d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 08:03:11 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:03:11 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:03:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:03:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-300150518',display_name='tempest-VolumesActionsTest-instance-300150518',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-300150518',id=31,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9ac02b435a54124b9b8cfc3afeb9e57',ramdisk_id='',reservation_id='r-4cuscpwr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1791306803',owner_user_name='tempest-VolumesActionsTest-1791306803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:03:09Z,user_data=None,user_id='03aac0b5680c431592326486b1d030b9',uuid=a00543c8-2d8f-4f63-aa4d-01582a90775d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3218c3ca-293c-41e8-96c5-1550439e96d0", "address": "fa:16:3e:99:13:fb", "network": {"id": "58371390-13da-4593-a6f1-32b2c60f5e7d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2101379319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ac02b435a54124b9b8cfc3afeb9e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3218c3ca-29", "ovs_interfaceid": "3218c3ca-293c-41e8-96c5-1550439e96d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Converting VIF {"id": "3218c3ca-293c-41e8-96c5-1550439e96d0", "address": "fa:16:3e:99:13:fb", "network": {"id": "58371390-13da-4593-a6f1-32b2c60f5e7d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2101379319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ac02b435a54124b9b8cfc3afeb9e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3218c3ca-29", "ovs_interfaceid": "3218c3ca-293c-41e8-96c5-1550439e96d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:13:fb,bridge_name='br-int',has_traffic_filtering=True,id=3218c3ca-293c-41e8-96c5-1550439e96d0,network=Network(58371390-13da-4593-a6f1-32b2c60f5e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3218c3ca-29') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG nova.objects.instance [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Lazy-loading 'pci_devices' on Instance uuid a00543c8-2d8f-4f63-aa4d-01582a90775d {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] End _get_guest_xml xml=<domain type="kvm">
Nov 22 08:03:11 user nova-compute[74348]:   <uuid>a00543c8-2d8f-4f63-aa4d-01582a90775d</uuid>
Nov 22 08:03:11 user nova-compute[74348]:   <name>instance-0000001f</name>
Nov 22 08:03:11 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 08:03:11 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 08:03:11 user nova-compute[74348]:   <metadata>
Nov 22 08:03:11 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 08:03:11 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 08:03:11 user nova-compute[74348]:       <nova:name>tempest-VolumesActionsTest-instance-300150518</nova:name>
Nov 22 08:03:11 user nova-compute[74348]:       <nova:creationTime>2023-11-22 08:03:11</nova:creationTime>
Nov 22 08:03:11 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 08:03:11 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 08:03:11 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 08:03:11 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 08:03:11 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 08:03:11 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 08:03:11 user nova-compute[74348]:       </nova:flavor>
Nov 22 08:03:11 user nova-compute[74348]:       <nova:owner>
Nov 22 08:03:11 user nova-compute[74348]:         <nova:user uuid="03aac0b5680c431592326486b1d030b9">tempest-VolumesActionsTest-1791306803-project-member</nova:user>
Nov 22 08:03:11 user nova-compute[74348]:         <nova:project uuid="d9ac02b435a54124b9b8cfc3afeb9e57">tempest-VolumesActionsTest-1791306803</nova:project>
Nov 22 08:03:11 user nova-compute[74348]:       </nova:owner>
Nov 22 08:03:11 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 08:03:11 user nova-compute[74348]:       <nova:ports>
Nov 22 08:03:11 user nova-compute[74348]:         <nova:port uuid="3218c3ca-293c-41e8-96c5-1550439e96d0">
Nov 22 08:03:11 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 22 08:03:11 user nova-compute[74348]:         </nova:port>
Nov 22 08:03:11 user nova-compute[74348]:       </nova:ports>
Nov 22 08:03:11 user nova-compute[74348]:     </nova:instance>
Nov 22 08:03:11 user nova-compute[74348]:   </metadata>
Nov 22 08:03:11 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 08:03:11 user nova-compute[74348]:     <system>
Nov 22 08:03:11 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 08:03:11 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 08:03:11 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 08:03:11 user nova-compute[74348]:       <entry name="serial">a00543c8-2d8f-4f63-aa4d-01582a90775d</entry>
Nov 22 08:03:11 user nova-compute[74348]:       <entry name="uuid">a00543c8-2d8f-4f63-aa4d-01582a90775d</entry>
Nov 22 08:03:11 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 08:03:11 user nova-compute[74348]:     </system>
Nov 22 08:03:11 user nova-compute[74348]:   </sysinfo>
Nov 22 08:03:11 user nova-compute[74348]:   <os>
Nov 22 08:03:11 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 08:03:11 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 08:03:11 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 08:03:11 user nova-compute[74348]:   </os>
Nov 22 08:03:11 user nova-compute[74348]:   <features>
Nov 22 08:03:11 user nova-compute[74348]:     <acpi/>
Nov 22 08:03:11 user nova-compute[74348]:     <apic/>
Nov 22 08:03:11 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 08:03:11 user nova-compute[74348]:   </features>
Nov 22 08:03:11 user nova-compute[74348]:   <clock offset="utc">
Nov 22 08:03:11 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 08:03:11 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 08:03:11 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 08:03:11 user nova-compute[74348]:   </clock>
Nov 22 08:03:11 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 08:03:11 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 08:03:11 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 08:03:11 user nova-compute[74348]:   </cpu>
Nov 22 08:03:11 user nova-compute[74348]:   <devices>
Nov 22 08:03:11 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 08:03:11 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 08:03:11 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/a00543c8-2d8f-4f63-aa4d-01582a90775d/disk"/>
Nov 22 08:03:11 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 08:03:11 user nova-compute[74348]:     </disk>
Nov 22 08:03:11 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 08:03:11 user nova-compute[74348]:       <mac address="fa:16:3e:99:13:fb"/>
Nov 22 08:03:11 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:03:11 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 08:03:11 user nova-compute[74348]:       <target dev="tap3218c3ca-29"/>
Nov 22 08:03:11 user nova-compute[74348]:     </interface>
Nov 22 08:03:11 user nova-compute[74348]:     <serial type="pty">
Nov 22 08:03:11 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/a00543c8-2d8f-4f63-aa4d-01582a90775d/console.log" append="off"/>
Nov 22 08:03:11 user nova-compute[74348]:     </serial>
Nov 22 08:03:11 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 08:03:11 user nova-compute[74348]:     <video>
Nov 22 08:03:11 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:03:11 user nova-compute[74348]:     </video>
Nov 22 08:03:11 user nova-compute[74348]:     <rng model="virtio">
Nov 22 08:03:11 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 08:03:11 user nova-compute[74348]:     </rng>
Nov 22 08:03:11 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 08:03:11 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 08:03:11 user nova-compute[74348]:       <stats period="10"/>
Nov 22 08:03:11 user nova-compute[74348]:     </memballoon>
Nov 22 08:03:11 user nova-compute[74348]:   </devices>
Nov 22 08:03:11 user nova-compute[74348]: </domain>
Nov 22 08:03:11 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:03:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-300150518',display_name='tempest-VolumesActionsTest-instance-300150518',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-300150518',id=31,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9ac02b435a54124b9b8cfc3afeb9e57',ramdisk_id='',reservation_id='r-4cuscpwr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1791306803',owner_user_name='tempest-VolumesActionsTest-1791306803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:03:09Z,user_data=None,user_id='03aac0b5680c431592326486b1d030b9',uuid=a00543c8-2d8f-4f63-aa4d-01582a90775d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3218c3ca-293c-41e8-96c5-1550439e96d0", "address": "fa:16:3e:99:13:fb", "network": {"id": "58371390-13da-4593-a6f1-32b2c60f5e7d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2101379319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ac02b435a54124b9b8cfc3afeb9e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3218c3ca-29", "ovs_interfaceid": "3218c3ca-293c-41e8-96c5-1550439e96d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Converting VIF {"id": "3218c3ca-293c-41e8-96c5-1550439e96d0", "address": "fa:16:3e:99:13:fb", "network": {"id": "58371390-13da-4593-a6f1-32b2c60f5e7d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2101379319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ac02b435a54124b9b8cfc3afeb9e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3218c3ca-29", "ovs_interfaceid": "3218c3ca-293c-41e8-96c5-1550439e96d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:13:fb,bridge_name='br-int',has_traffic_filtering=True,id=3218c3ca-293c-41e8-96c5-1550439e96d0,network=Network(58371390-13da-4593-a6f1-32b2c60f5e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3218c3ca-29') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG os_vif [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:13:fb,bridge_name='br-int',has_traffic_filtering=True,id=3218c3ca-293c-41e8-96c5-1550439e96d0,network=Network(58371390-13da-4593-a6f1-32b2c60f5e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3218c3ca-29') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a48681a5-9ac0-592a-a18a-8e81c3d3f6a7', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3218c3ca-29, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3218c3ca-29, col_values=(('qos', UUID('ce3e9e7e-ca3a-4ca4-9035-c83adecb232a')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3218c3ca-29, col_values=(('external_ids', {'iface-id': '3218c3ca-293c-41e8-96c5-1550439e96d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:13:fb', 'vm-uuid': 'a00543c8-2d8f-4f63-aa4d-01582a90775d'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:11 user nova-compute[74348]: INFO os_vif [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:13:fb,bridge_name='br-int',has_traffic_filtering=True,id=3218c3ca-293c-41e8-96c5-1550439e96d0,network=Network(58371390-13da-4593-a6f1-32b2c60f5e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3218c3ca-29')
Nov 22 08:03:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] No VIF found with MAC fa:16:3e:99:13:fb, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG nova.compute.manager [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 08:03:11 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Instance spawned successfully.
Nov 22 08:03:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:03:11 user nova-compute[74348]: INFO nova.compute.manager [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Took 6.57 seconds to spawn the instance on the hypervisor.
Nov 22 08:03:11 user nova-compute[74348]: DEBUG nova.compute.manager [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:03:11 user nova-compute[74348]: INFO nova.compute.manager [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Took 7.85 seconds to build instance.
Nov 22 08:03:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b360f8d3-c45b-4475-b7d3-72ccec286963 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "a31128a9-fc24-4a42-acdb-a50dfd64446e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.986s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG nova.compute.manager [req-31daf511-7d1e-4eca-9b2f-aa4d64dc7689 req-fc03853d-c2f6-4839-a886-1045ca071b8f service nova] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Received event network-vif-plugged-5e33f324-c04a-4be4-b29f-61b75abcd8ba {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-31daf511-7d1e-4eca-9b2f-aa4d64dc7689 req-fc03853d-c2f6-4839-a886-1045ca071b8f service nova] Acquiring lock "a31128a9-fc24-4a42-acdb-a50dfd64446e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-31daf511-7d1e-4eca-9b2f-aa4d64dc7689 req-fc03853d-c2f6-4839-a886-1045ca071b8f service nova] Lock "a31128a9-fc24-4a42-acdb-a50dfd64446e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-31daf511-7d1e-4eca-9b2f-aa4d64dc7689 req-fc03853d-c2f6-4839-a886-1045ca071b8f service nova] Lock "a31128a9-fc24-4a42-acdb-a50dfd64446e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG nova.compute.manager [req-31daf511-7d1e-4eca-9b2f-aa4d64dc7689 req-fc03853d-c2f6-4839-a886-1045ca071b8f service nova] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] No waiting events found dispatching network-vif-plugged-5e33f324-c04a-4be4-b29f-61b75abcd8ba {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:03:11 user nova-compute[74348]: WARNING nova.compute.manager [req-31daf511-7d1e-4eca-9b2f-aa4d64dc7689 req-fc03853d-c2f6-4839-a886-1045ca071b8f service nova] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Received unexpected event network-vif-plugged-5e33f324-c04a-4be4-b29f-61b75abcd8ba for instance with vm_state active and task_state None.
Nov 22 08:03:11 user nova-compute[74348]: DEBUG nova.compute.manager [req-31daf511-7d1e-4eca-9b2f-aa4d64dc7689 req-fc03853d-c2f6-4839-a886-1045ca071b8f service nova] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Received event network-changed-3218c3ca-293c-41e8-96c5-1550439e96d0 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG nova.compute.manager [req-31daf511-7d1e-4eca-9b2f-aa4d64dc7689 req-fc03853d-c2f6-4839-a886-1045ca071b8f service nova] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Refreshing instance network info cache due to event network-changed-3218c3ca-293c-41e8-96c5-1550439e96d0. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-31daf511-7d1e-4eca-9b2f-aa4d64dc7689 req-fc03853d-c2f6-4839-a886-1045ca071b8f service nova] Acquiring lock "refresh_cache-a00543c8-2d8f-4f63-aa4d-01582a90775d" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-31daf511-7d1e-4eca-9b2f-aa4d64dc7689 req-fc03853d-c2f6-4839-a886-1045ca071b8f service nova] Acquired lock "refresh_cache-a00543c8-2d8f-4f63-aa4d-01582a90775d" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:03:11 user nova-compute[74348]: DEBUG nova.network.neutron [req-31daf511-7d1e-4eca-9b2f-aa4d64dc7689 req-fc03853d-c2f6-4839-a886-1045ca071b8f service nova] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Refreshing network info cache for port 3218c3ca-293c-41e8-96c5-1550439e96d0 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:03:12 user nova-compute[74348]: DEBUG nova.network.neutron [req-31daf511-7d1e-4eca-9b2f-aa4d64dc7689 req-fc03853d-c2f6-4839-a886-1045ca071b8f service nova] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Updated VIF entry in instance network info cache for port 3218c3ca-293c-41e8-96c5-1550439e96d0. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:03:12 user nova-compute[74348]: DEBUG nova.network.neutron [req-31daf511-7d1e-4eca-9b2f-aa4d64dc7689 req-fc03853d-c2f6-4839-a886-1045ca071b8f service nova] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Updating instance_info_cache with network_info: [{"id": "3218c3ca-293c-41e8-96c5-1550439e96d0", "address": "fa:16:3e:99:13:fb", "network": {"id": "58371390-13da-4593-a6f1-32b2c60f5e7d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2101379319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ac02b435a54124b9b8cfc3afeb9e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3218c3ca-29", "ovs_interfaceid": "3218c3ca-293c-41e8-96c5-1550439e96d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:03:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-31daf511-7d1e-4eca-9b2f-aa4d64dc7689 req-fc03853d-c2f6-4839-a886-1045ca071b8f service nova] Releasing lock "refresh_cache-a00543c8-2d8f-4f63-aa4d-01582a90775d" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:03:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:13 user nova-compute[74348]: DEBUG nova.compute.manager [req-49aa8934-7428-4571-989e-630902a944da req-864b41f8-f493-43de-bbb3-55f68690f9ec service nova] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Received event network-vif-plugged-3218c3ca-293c-41e8-96c5-1550439e96d0 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:03:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-49aa8934-7428-4571-989e-630902a944da req-864b41f8-f493-43de-bbb3-55f68690f9ec service nova] Acquiring lock "a00543c8-2d8f-4f63-aa4d-01582a90775d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:03:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-49aa8934-7428-4571-989e-630902a944da req-864b41f8-f493-43de-bbb3-55f68690f9ec service nova] Lock "a00543c8-2d8f-4f63-aa4d-01582a90775d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:03:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-49aa8934-7428-4571-989e-630902a944da req-864b41f8-f493-43de-bbb3-55f68690f9ec service nova] Lock "a00543c8-2d8f-4f63-aa4d-01582a90775d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:03:13 user nova-compute[74348]: DEBUG nova.compute.manager [req-49aa8934-7428-4571-989e-630902a944da req-864b41f8-f493-43de-bbb3-55f68690f9ec service nova] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] No waiting events found dispatching network-vif-plugged-3218c3ca-293c-41e8-96c5-1550439e96d0 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:03:13 user nova-compute[74348]: WARNING nova.compute.manager [req-49aa8934-7428-4571-989e-630902a944da req-864b41f8-f493-43de-bbb3-55f68690f9ec service nova] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Received unexpected event network-vif-plugged-3218c3ca-293c-41e8-96c5-1550439e96d0 for instance with vm_state building and task_state spawning.
Nov 22 08:03:13 user nova-compute[74348]: DEBUG nova.compute.manager [req-49aa8934-7428-4571-989e-630902a944da req-864b41f8-f493-43de-bbb3-55f68690f9ec service nova] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Received event network-vif-plugged-3218c3ca-293c-41e8-96c5-1550439e96d0 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:03:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-49aa8934-7428-4571-989e-630902a944da req-864b41f8-f493-43de-bbb3-55f68690f9ec service nova] Acquiring lock "a00543c8-2d8f-4f63-aa4d-01582a90775d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:03:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-49aa8934-7428-4571-989e-630902a944da req-864b41f8-f493-43de-bbb3-55f68690f9ec service nova] Lock "a00543c8-2d8f-4f63-aa4d-01582a90775d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:03:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-49aa8934-7428-4571-989e-630902a944da req-864b41f8-f493-43de-bbb3-55f68690f9ec service nova] Lock "a00543c8-2d8f-4f63-aa4d-01582a90775d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:03:13 user nova-compute[74348]: DEBUG nova.compute.manager [req-49aa8934-7428-4571-989e-630902a944da req-864b41f8-f493-43de-bbb3-55f68690f9ec service nova] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] No waiting events found dispatching network-vif-plugged-3218c3ca-293c-41e8-96c5-1550439e96d0 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:03:13 user nova-compute[74348]: WARNING nova.compute.manager [req-49aa8934-7428-4571-989e-630902a944da req-864b41f8-f493-43de-bbb3-55f68690f9ec service nova] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Received unexpected event network-vif-plugged-3218c3ca-293c-41e8-96c5-1550439e96d0 for instance with vm_state building and task_state spawning.
Nov 22 08:03:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:15 user nova-compute[74348]: DEBUG nova.compute.manager [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 08:03:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 08:03:15 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Instance spawned successfully.
Nov 22 08:03:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 08:03:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:03:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:03:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:03:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:03:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:03:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:03:15 user nova-compute[74348]: INFO nova.compute.manager [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Took 6.26 seconds to spawn the instance on the hypervisor.
Nov 22 08:03:15 user nova-compute[74348]: DEBUG nova.compute.manager [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:03:15 user nova-compute[74348]: INFO nova.compute.manager [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Took 7.01 seconds to build instance.
Nov 22 08:03:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-83f19357-f554-4f2d-9c3e-7bcdd62ad4dd tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Lock "a00543c8-2d8f-4f63-aa4d-01582a90775d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.127s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:03:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:19 user nova-compute[74348]: DEBUG nova.compute.manager [req-4539d65c-b2d7-4cdf-9be5-945c857f7dd1 req-7965a37c-5c1f-4fb3-a2bc-d02bd54e8662 service nova] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Received event network-changed-db42bd08-8f0c-4e24-82c6-579bed0476bf {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:03:19 user nova-compute[74348]: DEBUG nova.compute.manager [req-4539d65c-b2d7-4cdf-9be5-945c857f7dd1 req-7965a37c-5c1f-4fb3-a2bc-d02bd54e8662 service nova] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Refreshing instance network info cache due to event network-changed-db42bd08-8f0c-4e24-82c6-579bed0476bf. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:03:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4539d65c-b2d7-4cdf-9be5-945c857f7dd1 req-7965a37c-5c1f-4fb3-a2bc-d02bd54e8662 service nova] Acquiring lock "refresh_cache-5006cff5-4b67-405d-b6b1-4c355f82d920" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:03:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4539d65c-b2d7-4cdf-9be5-945c857f7dd1 req-7965a37c-5c1f-4fb3-a2bc-d02bd54e8662 service nova] Acquired lock "refresh_cache-5006cff5-4b67-405d-b6b1-4c355f82d920" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:03:19 user nova-compute[74348]: DEBUG nova.network.neutron [req-4539d65c-b2d7-4cdf-9be5-945c857f7dd1 req-7965a37c-5c1f-4fb3-a2bc-d02bd54e8662 service nova] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Refreshing network info cache for port db42bd08-8f0c-4e24-82c6-579bed0476bf {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:03:20 user nova-compute[74348]: DEBUG nova.network.neutron [req-4539d65c-b2d7-4cdf-9be5-945c857f7dd1 req-7965a37c-5c1f-4fb3-a2bc-d02bd54e8662 service nova] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Updated VIF entry in instance network info cache for port db42bd08-8f0c-4e24-82c6-579bed0476bf. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:03:20 user nova-compute[74348]: DEBUG nova.network.neutron [req-4539d65c-b2d7-4cdf-9be5-945c857f7dd1 req-7965a37c-5c1f-4fb3-a2bc-d02bd54e8662 service nova] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Updating instance_info_cache with network_info: [{"id": "db42bd08-8f0c-4e24-82c6-579bed0476bf", "address": "fa:16:3e:4e:f8:01", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb42bd08-8f", "ovs_interfaceid": "db42bd08-8f0c-4e24-82c6-579bed0476bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:03:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4539d65c-b2d7-4cdf-9be5-945c857f7dd1 req-7965a37c-5c1f-4fb3-a2bc-d02bd54e8662 service nova] Releasing lock "refresh_cache-5006cff5-4b67-405d-b6b1-4c355f82d920" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:03:21 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:25 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-6733ee5c-326b-48d2-a33e-8758f77e08c9 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a635cbbc-6b87-4877-80a8-bd4001c407c6 is timed out.
Nov 22 08:03:25 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-6733ee5c-326b-48d2-a33e-8758f77e08c9 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Successfully detached device vdb from instance a635cbbc-6b87-4877-80a8-bd4001c407c6 from the live domain config.
Nov 22 08:03:25 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6733ee5c-326b-48d2-a33e-8758f77e08c9 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-6733ee5c-326b-48d2-a33e-8758f77e08c9 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cgaEthyr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:03:25 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-6733ee5c-326b-48d2-a33e-8758f77e08c9 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:03:25 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-6733ee5c-326b-48d2-a33e-8758f77e08c9 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-6733ee5c-326b-48d2-a33e-8758f77e08c9 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd872863-3362-440a-8ff9-0fa6d2b1fd2a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-6733ee5c-326b-48d2-a33e-8758f77e08c9 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 08:03:25 user nova-compute[74348]: No targets found.
Nov 22 08:03:25 user nova-compute[74348]: iSNS:
Nov 22 08:03:25 user nova-compute[74348]: No targets found.
Nov 22 08:03:25 user nova-compute[74348]: STATIC:
Nov 22 08:03:25 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8
Nov 22 08:03:25 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:03:25 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:03:25 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea
Nov 22 08:03:25 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:03:25 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:03:25 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa
Nov 22 08:03:25 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:03:25 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:03:25 user nova-compute[74348]: FIRMWARE:
Nov 22 08:03:25 user nova-compute[74348]: No targets found.
Nov 22 08:03:25 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-6733ee5c-326b-48d2-a33e-8758f77e08c9 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 08:03:25 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 08:03:25 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-6733ee5c-326b-48d2-a33e-8758f77e08c9 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d2b72c-2af8-4041-9f3a-48d754c6e3e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbebf600-e006-4038-bbd5-6269cceff84d]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-6733ee5c-326b-48d2-a33e-8758f77e08c9 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:03:25 user nova-compute[74348]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa (non-flash)
Nov 22 08:03:25 user nova-compute[74348]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)
Nov 22 08:03:25 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-6733ee5c-326b-48d2-a33e-8758f77e08c9 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:03:25 user nova-compute[74348]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa (non-flash)
Nov 22 08:03:25 user nova-compute[74348]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)
Nov 22 08:03:25 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-6733ee5c-326b-48d2-a33e-8758f77e08c9 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f224c5be560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa'): ({'sdd'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-6733ee5c-326b-48d2-a33e-8758f77e08c9 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Removing single pathed devices sdd {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e1941a-8d38-4878-91cd-2fd07e84b5fa]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[578d8389-8a58-4125-94f9-2672a7c80861]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-6733ee5c-326b-48d2-a33e-8758f77e08c9 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Flushing IO for device /dev/sdd {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7109ed-7724-4042-9395-0f31ca0f0b4b]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-6733ee5c-326b-48d2-a33e-8758f77e08c9 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9487b684-aab5-470a-806e-f9f4f3c0dbbe]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-6733ee5c-326b-48d2-a33e-8758f77e08c9 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-6733ee5c-326b-48d2-a33e-8758f77e08c9 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] SCSI volumes sdd have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-6733ee5c-326b-48d2-a33e-8758f77e08c9 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3adf2377-51fd-432b-b918-1fed93710c02]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-6733ee5c-326b-48d2-a33e-8758f77e08c9 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6599e63a-2d39-4d0d-a63a-21852fd3cc77]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-6733ee5c-326b-48d2-a33e-8758f77e08c9 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa, portal: 172.16.0.220,3260]
Nov 22 08:03:25 user nova-compute[74348]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa, portal: 172.16.0.220,3260] successful.
Nov 22 08:03:25 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12828237-e920-4f6e-bcaf-2b0443407daa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a43dac-e116-4313-86cb-4f007807068d]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-6733ee5c-326b-48d2-a33e-8758f77e08c9 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-6733ee5c-326b-48d2-a33e-8758f77e08c9 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-6733ee5c-326b-48d2-a33e-8758f77e08c9 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] <== disconnect_volume: return (333ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:03:25 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6733ee5c-326b-48d2-a33e-8758f77e08c9 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 08:03:26 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:26 user nova-compute[74348]: DEBUG nova.objects.instance [None req-6733ee5c-326b-48d2-a33e-8758f77e08c9 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lazy-loading 'flavor' on Instance uuid a635cbbc-6b87-4877-80a8-bd4001c407c6 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:03:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-6733ee5c-326b-48d2-a33e-8758f77e08c9 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "a635cbbc-6b87-4877-80a8-bd4001c407c6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.803s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:03:28 user nova-compute[74348]: DEBUG nova.compute.manager [req-3bd3dd5c-c90f-472c-8222-03dd89be4263 req-33289750-26f8-43fd-b02f-0efcf40301cc service nova] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Received event network-changed-d73167a0-1952-4e39-8cc0-0a422a6927b3 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:03:28 user nova-compute[74348]: DEBUG nova.compute.manager [req-3bd3dd5c-c90f-472c-8222-03dd89be4263 req-33289750-26f8-43fd-b02f-0efcf40301cc service nova] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Refreshing instance network info cache due to event network-changed-d73167a0-1952-4e39-8cc0-0a422a6927b3. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:03:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3bd3dd5c-c90f-472c-8222-03dd89be4263 req-33289750-26f8-43fd-b02f-0efcf40301cc service nova] Acquiring lock "refresh_cache-266eb2ee-43a5-4fd2-86aa-9e915cbc7562" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:03:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3bd3dd5c-c90f-472c-8222-03dd89be4263 req-33289750-26f8-43fd-b02f-0efcf40301cc service nova] Acquired lock "refresh_cache-266eb2ee-43a5-4fd2-86aa-9e915cbc7562" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:03:28 user nova-compute[74348]: DEBUG nova.network.neutron [req-3bd3dd5c-c90f-472c-8222-03dd89be4263 req-33289750-26f8-43fd-b02f-0efcf40301cc service nova] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Refreshing network info cache for port d73167a0-1952-4e39-8cc0-0a422a6927b3 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:03:28 user nova-compute[74348]: DEBUG nova.network.neutron [req-3bd3dd5c-c90f-472c-8222-03dd89be4263 req-33289750-26f8-43fd-b02f-0efcf40301cc service nova] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Updated VIF entry in instance network info cache for port d73167a0-1952-4e39-8cc0-0a422a6927b3. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:03:28 user nova-compute[74348]: DEBUG nova.network.neutron [req-3bd3dd5c-c90f-472c-8222-03dd89be4263 req-33289750-26f8-43fd-b02f-0efcf40301cc service nova] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Updating instance_info_cache with network_info: [{"id": "d73167a0-1952-4e39-8cc0-0a422a6927b3", "address": "fa:16:3e:f8:90:9f", "network": {"id": "59f6f7a7-7076-40e9-8db7-944f89ecb7e5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1331190296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c0496e87c6a468fab4258553c68b8d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd73167a0-19", "ovs_interfaceid": "d73167a0-1952-4e39-8cc0-0a422a6927b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:03:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3bd3dd5c-c90f-472c-8222-03dd89be4263 req-33289750-26f8-43fd-b02f-0efcf40301cc service nova] Releasing lock "refresh_cache-266eb2ee-43a5-4fd2-86aa-9e915cbc7562" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:03:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Acquiring lock "266eb2ee-43a5-4fd2-86aa-9e915cbc7562" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:03:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "266eb2ee-43a5-4fd2-86aa-9e915cbc7562" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:03:29 user nova-compute[74348]: DEBUG nova.objects.instance [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lazy-loading 'flavor' on Instance uuid 266eb2ee-43a5-4fd2-86aa-9e915cbc7562 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:03:29 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Ignoring supplied device name: /dev/vdb
Nov 22 08:03:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "266eb2ee-43a5-4fd2-86aa-9e915cbc7562" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:03:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Acquiring lock "266eb2ee-43a5-4fd2-86aa-9e915cbc7562" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:03:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "266eb2ee-43a5-4fd2-86aa-9e915cbc7562" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:03:29 user nova-compute[74348]: INFO nova.compute.manager [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Attaching volume 1a7b165e-fc69-432b-afea-d2aa8e1104b0 to /dev/vdb
Nov 22 08:03:29 user nova-compute[74348]: DEBUG os_brick.utils [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:03:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1fb6f8-da59-4b43-8721-f2957bdf8fd7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:03:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c28d9d-c7f7-4d55-bf65-c5eea83f0e02]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:03:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebdb453-c575-4913-8548-b95db2061b4f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:03:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9070dbea-b7a7-4b5a-99f2-060b078cb272]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:03:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:03:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 08:03:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:03:29 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 08:03:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d0ac74-64b6-4375-9c48-3b19fa94d84b]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:03:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 08:03:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 08:03:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 08:03:29 user nova-compute[74348]: DEBUG os_brick.utils [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:03:29 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Updating existing volume attachment record: 4bc599fa-6966-421c-9606-ac885a19fd25 {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 08:03:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:35 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:03:35 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:03:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-a635cbbc-6b87-4877-80a8-bd4001c407c6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:03:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-a635cbbc-6b87-4877-80a8-bd4001c407c6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:03:35 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Updating instance_info_cache with network_info: [{"id": "25edb763-90ad-43e6-98c1-6baf85e723d5", "address": "fa:16:3e:a5:2d:c8", "network": {"id": "442abc57-45e5-4cd7-878e-979afa78c421", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1395369508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d76d03d17cc4e5bb52a32a2f8fbd629", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25edb763-90", "ovs_interfaceid": "25edb763-90ad-43e6-98c1-6baf85e723d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-a635cbbc-6b87-4877-80a8-bd4001c407c6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yYSeAORf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:03:36 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:03:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:03:36 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:03:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:03:36 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 08:03:36 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0 -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07e7f91-9348-45d2-a908-6024a942fea1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 08:03:36 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2d2568-538a-407b-be72-9cca8ba805f1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0] added
Nov 22 08:03:36 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dba6762-16b2-4e5f-ab04-cc2adb315b40]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea961561-8092-443c-90cf-b99006374189]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yYSeAORf {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yYSeAORf" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb35079a-f1be-40c7-9ded-110631523c98]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yYSeAORf'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d32a07d-17f8-4732-b631-1424dc7b7809]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[661be1ed-8566-42dd-aa7b-2bf1221b3367]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:03:36 user nova-compute[74348]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)
Nov 22 08:03:36 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:03:36 user nova-compute[74348]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)
Nov 22 08:03:36 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0 -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1855d6b-b9c3-4369-a071-404d9eecc935]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0, portal: 172.16.0.220,3260]
Nov 22 08:03:36 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0, portal: 172.16.0.220,3260] successful.
Nov 22 08:03:36 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d15c58a-fe0f-4d26-884c-5e1d0f096799]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8a81dd-665c-42dd-9848-1ae180101a62]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:03:36 user nova-compute[74348]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)
Nov 22 08:03:36 user nova-compute[74348]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0 (non-flash)
Nov 22 08:03:36 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:03:36 user nova-compute[74348]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)
Nov 22 08:03:36 user nova-compute[74348]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0 (non-flash)
Nov 22 08:03:36 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[198dbb14-09a1-4c44-9c23-59cd770cb0a2]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yYSeAORf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 08:03:36 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:03:37 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:03:37 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '26536333966303866', 'path': '/dev/sdd'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:03:37 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536333966303866', 'path': '/dev/sdd'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 08:03:37 user nova-compute[74348]: DEBUG nova.objects.instance [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lazy-loading 'flavor' on Instance uuid 266eb2ee-43a5-4fd2-86aa-9e915cbc7562 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:03:37 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 08:03:37 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:03:37 user nova-compute[74348]:   <source dev="/dev/sdd"/>
Nov 22 08:03:37 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:03:37 user nova-compute[74348]:   <serial>1a7b165e-fc69-432b-afea-d2aa8e1104b0</serial>
Nov 22 08:03:37 user nova-compute[74348]: </disk>
Nov 22 08:03:37 user nova-compute[74348]:  {{(pid=74348) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 08:03:37 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:03:37 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:03:37 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:03:37 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:03:37 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:03:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:03:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:03:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:03:37 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:03:37 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:03:37 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:03:37 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] No VIF found with MAC fa:16:3e:f8:90:9f, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:03:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-2ee779c8-ef9d-40f7-8c1e-ecc10c2d4a18 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "266eb2ee-43a5-4fd2-86aa-9e915cbc7562" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.442s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:03:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:38 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:03:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8f84c0b-fab5-4900-bf65-270c9c06baf8/disk.rescue --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8f84c0b-fab5-4900-bf65-270c9c06baf8/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8f84c0b-fab5-4900-bf65-270c9c06baf8/disk.rescue --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8f84c0b-fab5-4900-bf65-270c9c06baf8/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:39 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:03:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:39 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a00543c8-2d8f-4f63-aa4d-01582a90775d/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a00543c8-2d8f-4f63-aa4d-01582a90775d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a00543c8-2d8f-4f63-aa4d-01582a90775d/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a00543c8-2d8f-4f63-aa4d-01582a90775d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a635cbbc-6b87-4877-80a8-bd4001c407c6/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a635cbbc-6b87-4877-80a8-bd4001c407c6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a635cbbc-6b87-4877-80a8-bd4001c407c6/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a635cbbc-6b87-4877-80a8-bd4001c407c6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266eb2ee-43a5-4fd2-86aa-9e915cbc7562/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266eb2ee-43a5-4fd2-86aa-9e915cbc7562/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266eb2ee-43a5-4fd2-86aa-9e915cbc7562/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266eb2ee-43a5-4fd2-86aa-9e915cbc7562/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:41 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:03:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a31128a9-fc24-4a42-acdb-a50dfd64446e/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a31128a9-fc24-4a42-acdb-a50dfd64446e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a31128a9-fc24-4a42-acdb-a50dfd64446e/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:03:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a31128a9-fc24-4a42-acdb-a50dfd64446e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:03:42 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:03:42 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:03:42 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=7330MB free_disk=24.84435272216797GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:03:42 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:03:42 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:03:42 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 765f8c47-c042-4430-8d35-07926ad693fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:03:42 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance a635cbbc-6b87-4877-80a8-bd4001c407c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:03:42 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance b8f84c0b-fab5-4900-bf65-270c9c06baf8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:03:42 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 37c93c2a-1397-4b04-aef1-5068218ad9fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:03:42 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 5006cff5-4b67-405d-b6b1-4c355f82d920 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:03:42 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 266eb2ee-43a5-4fd2-86aa-9e915cbc7562 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:03:42 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 555f4246-d4b2-4f2f-b91c-dda8fe47264c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:03:42 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance ba74ca7d-2875-426c-a485-d908af865bae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:03:42 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance a31128a9-fc24-4a42-acdb-a50dfd64446e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:03:42 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance a00543c8-2d8f-4f63-aa4d-01582a90775d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:03:42 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:03:42 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:03:42 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Refreshing inventories for resource provider 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 22 08:03:42 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Updating ProviderTree inventory for provider 52690f6a-773f-4e8d-be85-d278b6522975 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 22 08:03:42 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Updating inventory in ProviderTree for provider 52690f6a-773f-4e8d-be85-d278b6522975 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 22 08:03:42 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Refreshing aggregate associations for resource provider 52690f6a-773f-4e8d-be85-d278b6522975, aggregates: None {{(pid=74348) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 22 08:03:42 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Refreshing trait associations for resource provider 52690f6a-773f-4e8d-be85-d278b6522975, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=74348) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 22 08:03:42 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:03:42 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:03:42 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:03:42 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.755s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:03:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:44 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:03:46 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:46 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:03:46 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Cleaning up deleted instances {{(pid=74348) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 22 08:03:46 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] There are 0 instances to clean {{(pid=74348) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 22 08:03:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:47 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:03:47 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74348) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 22 08:03:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:51 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:03:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquiring lock "3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:03:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:03:56 user nova-compute[74348]: INFO nova.compute.manager [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Unshelving
Nov 22 08:03:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:03:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:03:57 user nova-compute[74348]: DEBUG nova.objects.instance [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lazy-loading 'pci_requests' on Instance uuid 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:03:57 user nova-compute[74348]: DEBUG nova.objects.instance [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lazy-loading 'numa_topology' on Instance uuid 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:03:57 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 08:03:57 user nova-compute[74348]: INFO nova.compute.claims [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Claim successful on node user
Nov 22 08:03:57 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:03:57 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:03:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.478s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:03:57 user nova-compute[74348]: INFO nova.network.neutron [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Updating port 6c9d4040-2941-469b-b602-69cc8b6e879b with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 22 08:03:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-0997a3c9-cb38-4bf4-8167-ef27f4ce4fa3 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Acquiring lock "266eb2ee-43a5-4fd2-86aa-9e915cbc7562" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:03:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-0997a3c9-cb38-4bf4-8167-ef27f4ce4fa3 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "266eb2ee-43a5-4fd2-86aa-9e915cbc7562" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:03:58 user nova-compute[74348]: INFO nova.compute.manager [None req-0997a3c9-cb38-4bf4-8167-ef27f4ce4fa3 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Detaching volume 1a7b165e-fc69-432b-afea-d2aa8e1104b0
Nov 22 08:03:58 user nova-compute[74348]: INFO nova.virt.block_device [None req-0997a3c9-cb38-4bf4-8167-ef27f4ce4fa3 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Attempting to driver detach volume 1a7b165e-fc69-432b-afea-d2aa8e1104b0 from mountpoint /dev/vdb
Nov 22 08:03:58 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-0997a3c9-cb38-4bf4-8167-ef27f4ce4fa3 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Attempting to detach device vdb from instance 266eb2ee-43a5-4fd2-86aa-9e915cbc7562 from the persistent domain config. {{(pid=74348) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 08:03:58 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-0997a3c9-cb38-4bf4-8167-ef27f4ce4fa3 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:03:58 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:03:58 user nova-compute[74348]:   <source dev="/dev/sdd"/>
Nov 22 08:03:58 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:03:58 user nova-compute[74348]:   <serial>1a7b165e-fc69-432b-afea-d2aa8e1104b0</serial>
Nov 22 08:03:58 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 08:03:58 user nova-compute[74348]: </disk>
Nov 22 08:03:58 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:03:58 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-0997a3c9-cb38-4bf4-8167-ef27f4ce4fa3 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Successfully detached device vdb from instance 266eb2ee-43a5-4fd2-86aa-9e915cbc7562 from the persistent domain config.
Nov 22 08:03:58 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-0997a3c9-cb38-4bf4-8167-ef27f4ce4fa3 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 266eb2ee-43a5-4fd2-86aa-9e915cbc7562 from the live domain config. {{(pid=74348) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 08:03:58 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-0997a3c9-cb38-4bf4-8167-ef27f4ce4fa3 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:03:58 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:03:58 user nova-compute[74348]:   <source dev="/dev/sdd"/>
Nov 22 08:03:58 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:03:58 user nova-compute[74348]:   <serial>1a7b165e-fc69-432b-afea-d2aa8e1104b0</serial>
Nov 22 08:03:58 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 08:03:58 user nova-compute[74348]: </disk>
Nov 22 08:03:58 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:03:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c295cc1b-d003-473c-8d51-a4f891c5e98e tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Acquiring lock "266eb2ee-43a5-4fd2-86aa-9e915cbc7562" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:03:58 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-0997a3c9-cb38-4bf4-8167-ef27f4ce4fa3 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 266eb2ee-43a5-4fd2-86aa-9e915cbc7562 {{(pid=74348) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 08:03:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquiring lock "refresh_cache-3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:03:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquired lock "refresh_cache-3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:03:58 user nova-compute[74348]: DEBUG nova.network.neutron [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:03:59 user nova-compute[74348]: DEBUG nova.compute.manager [req-7aee5954-d59e-440a-929c-6b3526556f3d req-fbad92eb-ac5a-4b0f-962a-bb53315b4aa4 service nova] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Received event network-changed-6c9d4040-2941-469b-b602-69cc8b6e879b {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:03:59 user nova-compute[74348]: DEBUG nova.compute.manager [req-7aee5954-d59e-440a-929c-6b3526556f3d req-fbad92eb-ac5a-4b0f-962a-bb53315b4aa4 service nova] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Refreshing instance network info cache due to event network-changed-6c9d4040-2941-469b-b602-69cc8b6e879b. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:03:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-7aee5954-d59e-440a-929c-6b3526556f3d req-fbad92eb-ac5a-4b0f-962a-bb53315b4aa4 service nova] Acquiring lock "refresh_cache-3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:03:59 user nova-compute[74348]: DEBUG nova.network.neutron [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Updating instance_info_cache with network_info: [{"id": "6c9d4040-2941-469b-b602-69cc8b6e879b", "address": "fa:16:3e:b0:44:f3", "network": {"id": "4ef640bb-4a2f-4f98-8b01-b5df87fcb35a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1216437312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444367658c0241d0b5b377a73fedb52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9d4040-29", "ovs_interfaceid": "6c9d4040-2941-469b-b602-69cc8b6e879b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:03:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Releasing lock "refresh_cache-3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:03:59 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 08:03:59 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Creating image(s)
Nov 22 08:03:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquiring lock "/opt/stack/data/nova/instances/3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:03:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "/opt/stack/data/nova/instances/3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:03:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "/opt/stack/data/nova/instances/3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:03:59 user nova-compute[74348]: DEBUG nova.objects.instance [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:03:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-7aee5954-d59e-440a-929c-6b3526556f3d req-fbad92eb-ac5a-4b0f-962a-bb53315b4aa4 service nova] Acquired lock "refresh_cache-3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:03:59 user nova-compute[74348]: DEBUG nova.network.neutron [req-7aee5954-d59e-440a-929c-6b3526556f3d req-fbad92eb-ac5a-4b0f-962a-bb53315b4aa4 service nova] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Refreshing network info cache for port 6c9d4040-2941-469b-b602-69cc8b6e879b {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:03:59 user nova-compute[74348]: DEBUG nova.objects.base [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Object Instance<3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:03:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquiring lock "7e6b8e7450cb8e786a5bb42a4d499f23fc2cbed0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:03:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "7e6b8e7450cb8e786a5bb42a4d499f23fc2cbed0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e6b8e7450cb8e786a5bb42a4d499f23fc2cbed0.part --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9165e771-7fc2-486a-80ce-9e75c97995eb tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Acquiring lock "a635cbbc-6b87-4877-80a8-bd4001c407c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9165e771-7fc2-486a-80ce-9e75c97995eb tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "a635cbbc-6b87-4877-80a8-bd4001c407c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9165e771-7fc2-486a-80ce-9e75c97995eb tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Acquiring lock "a635cbbc-6b87-4877-80a8-bd4001c407c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9165e771-7fc2-486a-80ce-9e75c97995eb tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "a635cbbc-6b87-4877-80a8-bd4001c407c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9165e771-7fc2-486a-80ce-9e75c97995eb tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "a635cbbc-6b87-4877-80a8-bd4001c407c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:00 user nova-compute[74348]: INFO nova.compute.manager [None req-9165e771-7fc2-486a-80ce-9e75c97995eb tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Terminating instance
Nov 22 08:04:00 user nova-compute[74348]: DEBUG nova.compute.manager [None req-9165e771-7fc2-486a-80ce-9e75c97995eb tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 08:04:00 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e6b8e7450cb8e786a5bb42a4d499f23fc2cbed0.part --force-share --output=json" returned: 0 in 0.218s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:00 user nova-compute[74348]: DEBUG nova.virt.images [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] 9c823066-c0c6-4571-af4c-0788bb06b9ce was qcow2, converting to raw {{(pid=74348) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 22 08:04:00 user nova-compute[74348]: DEBUG nova.privsep.utils [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74348) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 08:04:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7e6b8e7450cb8e786a5bb42a4d499f23fc2cbed0.part /opt/stack/data/nova/instances/_base/7e6b8e7450cb8e786a5bb42a4d499f23fc2cbed0.converted {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:00 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:00 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:00 user nova-compute[74348]: DEBUG nova.network.neutron [req-7aee5954-d59e-440a-929c-6b3526556f3d req-fbad92eb-ac5a-4b0f-962a-bb53315b4aa4 service nova] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Updated VIF entry in instance network info cache for port 6c9d4040-2941-469b-b602-69cc8b6e879b. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:04:00 user nova-compute[74348]: DEBUG nova.network.neutron [req-7aee5954-d59e-440a-929c-6b3526556f3d req-fbad92eb-ac5a-4b0f-962a-bb53315b4aa4 service nova] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Updating instance_info_cache with network_info: [{"id": "6c9d4040-2941-469b-b602-69cc8b6e879b", "address": "fa:16:3e:b0:44:f3", "network": {"id": "4ef640bb-4a2f-4f98-8b01-b5df87fcb35a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1216437312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444367658c0241d0b5b377a73fedb52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9d4040-29", "ovs_interfaceid": "6c9d4040-2941-469b-b602-69cc8b6e879b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:04:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-7aee5954-d59e-440a-929c-6b3526556f3d req-fbad92eb-ac5a-4b0f-962a-bb53315b4aa4 service nova] Releasing lock "refresh_cache-3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:04:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7e6b8e7450cb8e786a5bb42a4d499f23fc2cbed0.part /opt/stack/data/nova/instances/_base/7e6b8e7450cb8e786a5bb42a4d499f23fc2cbed0.converted" returned: 0 in 0.458s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e6b8e7450cb8e786a5bb42a4d499f23fc2cbed0.converted --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:01 user nova-compute[74348]: DEBUG nova.compute.manager [req-f6988f92-dbda-4a39-bdab-edf1a2cddd57 req-086efb10-24f3-4d0d-9eee-a3d495a7dda7 service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Received event network-vif-unplugged-25edb763-90ad-43e6-98c1-6baf85e723d5 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:04:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f6988f92-dbda-4a39-bdab-edf1a2cddd57 req-086efb10-24f3-4d0d-9eee-a3d495a7dda7 service nova] Acquiring lock "a635cbbc-6b87-4877-80a8-bd4001c407c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f6988f92-dbda-4a39-bdab-edf1a2cddd57 req-086efb10-24f3-4d0d-9eee-a3d495a7dda7 service nova] Lock "a635cbbc-6b87-4877-80a8-bd4001c407c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f6988f92-dbda-4a39-bdab-edf1a2cddd57 req-086efb10-24f3-4d0d-9eee-a3d495a7dda7 service nova] Lock "a635cbbc-6b87-4877-80a8-bd4001c407c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:01 user nova-compute[74348]: DEBUG nova.compute.manager [req-f6988f92-dbda-4a39-bdab-edf1a2cddd57 req-086efb10-24f3-4d0d-9eee-a3d495a7dda7 service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] No waiting events found dispatching network-vif-unplugged-25edb763-90ad-43e6-98c1-6baf85e723d5 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:04:01 user nova-compute[74348]: DEBUG nova.compute.manager [req-f6988f92-dbda-4a39-bdab-edf1a2cddd57 req-086efb10-24f3-4d0d-9eee-a3d495a7dda7 service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Received event network-vif-unplugged-25edb763-90ad-43e6-98c1-6baf85e723d5 for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 08:04:01 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Instance destroyed successfully.
Nov 22 08:04:01 user nova-compute[74348]: DEBUG nova.objects.instance [None req-9165e771-7fc2-486a-80ce-9e75c97995eb tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lazy-loading 'resources' on Instance uuid a635cbbc-6b87-4877-80a8-bd4001c407c6 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:04:01 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-9165e771-7fc2-486a-80ce-9e75c97995eb tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:58:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1710778813',display_name='tempest-TestMinimumBasicScenario-server-1710778813',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1710778813',id=19,image_ref='4f886734-5ace-46df-b52c-e3caa804822c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPf9GX11OafuHoT9ofuhjFoeTzRRPmShTAJMsT9i8I5ORMZS0S45M55gXRkwQTzdVnPq3dOA8Rf2U6W4vgKlq0UG1bzKFpjnmYUsgpcIBDzhWNaz3dJyseDrhmQvEX4BQw==',key_name='tempest-TestMinimumBasicScenario-1841491850',keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:59:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d76d03d17cc4e5bb52a32a2f8fbd629',ramdisk_id='',reservation_id='r-9lpz0te2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f886734-5ace-46df-b52c-e3caa804822c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1824455706',owner_user_name='tempest-TestMinimumBasicScenario-1824455706-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T08:01:18Z,user_data=None,user_id='cbd1eed03be64a42b8ba9d0200b10692',uuid=a635cbbc-6b87-4877-80a8-bd4001c407c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25edb763-90ad-43e6-98c1-6baf85e723d5", "address": "fa:16:3e:a5:2d:c8", "network": {"id": "442abc57-45e5-4cd7-878e-979afa78c421", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1395369508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d76d03d17cc4e5bb52a32a2f8fbd629", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25edb763-90", "ovs_interfaceid": "25edb763-90ad-43e6-98c1-6baf85e723d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:04:01 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-9165e771-7fc2-486a-80ce-9e75c97995eb tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Converting VIF {"id": "25edb763-90ad-43e6-98c1-6baf85e723d5", "address": "fa:16:3e:a5:2d:c8", "network": {"id": "442abc57-45e5-4cd7-878e-979afa78c421", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1395369508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d76d03d17cc4e5bb52a32a2f8fbd629", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25edb763-90", "ovs_interfaceid": "25edb763-90ad-43e6-98c1-6baf85e723d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:04:01 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-9165e771-7fc2-486a-80ce-9e75c97995eb tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:2d:c8,bridge_name='br-int',has_traffic_filtering=True,id=25edb763-90ad-43e6-98c1-6baf85e723d5,network=Network(442abc57-45e5-4cd7-878e-979afa78c421),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25edb763-90') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:04:01 user nova-compute[74348]: DEBUG os_vif [None req-9165e771-7fc2-486a-80ce-9e75c97995eb tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:2d:c8,bridge_name='br-int',has_traffic_filtering=True,id=25edb763-90ad-43e6-98c1-6baf85e723d5,network=Network(442abc57-45e5-4cd7-878e-979afa78c421),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25edb763-90') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:04:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25edb763-90, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:04:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e6b8e7450cb8e786a5bb42a4d499f23fc2cbed0.converted --force-share --output=json" returned: 0 in 0.267s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "7e6b8e7450cb8e786a5bb42a4d499f23fc2cbed0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.963s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e6b8e7450cb8e786a5bb42a4d499f23fc2cbed0 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=29961fa7-7d87-4dfb-af3e-5ccbe5fce57e) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:04:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:04:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:01 user nova-compute[74348]: INFO os_vif [None req-9165e771-7fc2-486a-80ce-9e75c97995eb tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:2d:c8,bridge_name='br-int',has_traffic_filtering=True,id=25edb763-90ad-43e6-98c1-6baf85e723d5,network=Network(442abc57-45e5-4cd7-878e-979afa78c421),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25edb763-90')
Nov 22 08:04:01 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-9165e771-7fc2-486a-80ce-9e75c97995eb tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Deleting instance files /opt/stack/data/nova/instances/a635cbbc-6b87-4877-80a8-bd4001c407c6_del
Nov 22 08:04:01 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-9165e771-7fc2-486a-80ce-9e75c97995eb tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Deletion of /opt/stack/data/nova/instances/a635cbbc-6b87-4877-80a8-bd4001c407c6_del complete
Nov 22 08:04:01 user nova-compute[74348]: INFO nova.compute.manager [None req-9165e771-7fc2-486a-80ce-9e75c97995eb tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Took 1.07 seconds to destroy the instance on the hypervisor.
Nov 22 08:04:01 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-9165e771-7fc2-486a-80ce-9e75c97995eb tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 08:04:01 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 08:04:01 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 08:04:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e6b8e7450cb8e786a5bb42a4d499f23fc2cbed0 --force-share --output=json" returned: 0 in 0.198s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquiring lock "7e6b8e7450cb8e786a5bb42a4d499f23fc2cbed0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "7e6b8e7450cb8e786a5bb42a4d499f23fc2cbed0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e6b8e7450cb8e786a5bb42a4d499f23fc2cbed0 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e6b8e7450cb8e786a5bb42a4d499f23fc2cbed0 --force-share --output=json" returned: 0 in 0.206s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e6b8e7450cb8e786a5bb42a4d499f23fc2cbed0,backing_fmt=raw /opt/stack/data/nova/instances/3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0/disk 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e6b8e7450cb8e786a5bb42a4d499f23fc2cbed0,backing_fmt=raw /opt/stack/data/nova/instances/3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0/disk 1073741824" returned: 0 in 0.053s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "7e6b8e7450cb8e786a5bb42a4d499f23fc2cbed0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e6b8e7450cb8e786a5bb42a4d499f23fc2cbed0 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e6b8e7450cb8e786a5bb42a4d499f23fc2cbed0 --force-share --output=json" returned: 0 in 0.194s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:02 user nova-compute[74348]: DEBUG nova.objects.instance [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lazy-loading 'migration_context' on Instance uuid 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:04:02 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:04:02 user nova-compute[74348]: DEBUG nova.objects.base [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Object Instance<3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:04:02 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Rebasing disk image.
Nov 22 08:04:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:02 user nova-compute[74348]: DEBUG nova.compute.manager [req-3d3769ce-f11d-4c80-9d08-52340850aecf req-1efca0b7-e4c7-4610-b911-cc5b50f4eb78 service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Received event network-vif-deleted-25edb763-90ad-43e6-98c1-6baf85e723d5 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:04:02 user nova-compute[74348]: INFO nova.compute.manager [req-3d3769ce-f11d-4c80-9d08-52340850aecf req-1efca0b7-e4c7-4610-b911-cc5b50f4eb78 service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Neutron deleted interface 25edb763-90ad-43e6-98c1-6baf85e723d5; detaching it from the instance and deleting it from the info cache
Nov 22 08:04:02 user nova-compute[74348]: DEBUG nova.network.neutron [req-3d3769ce-f11d-4c80-9d08-52340850aecf req-1efca0b7-e4c7-4610-b911-cc5b50f4eb78 service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:04:02 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Took 0.61 seconds to deallocate network for instance.
Nov 22 08:04:02 user nova-compute[74348]: DEBUG nova.compute.manager [req-3d3769ce-f11d-4c80-9d08-52340850aecf req-1efca0b7-e4c7-4610-b911-cc5b50f4eb78 service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Detach interface failed, port_id=25edb763-90ad-43e6-98c1-6baf85e723d5, reason: Instance a635cbbc-6b87-4877-80a8-bd4001c407c6 could not be found. {{(pid=74348) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 08:04:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9165e771-7fc2-486a-80ce-9e75c97995eb tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9165e771-7fc2-486a-80ce-9e75c97995eb tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.182s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 -F raw /opt/stack/data/nova/instances/3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0/disk {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:02 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-9165e771-7fc2-486a-80ce-9e75c97995eb tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:04:02 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-9165e771-7fc2-486a-80ce-9e75c97995eb tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:04:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9165e771-7fc2-486a-80ce-9e75c97995eb tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:02 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-9165e771-7fc2-486a-80ce-9e75c97995eb tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Deleted allocations for instance a635cbbc-6b87-4877-80a8-bd4001c407c6
Nov 22 08:04:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9165e771-7fc2-486a-80ce-9e75c97995eb tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "a635cbbc-6b87-4877-80a8-bd4001c407c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.298s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:03 user nova-compute[74348]: DEBUG nova.compute.manager [req-3c5de326-e408-4736-a475-262b66f3fb33 req-f625be49-10d3-4add-9fb2-84281a4619cf service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Received event network-vif-plugged-25edb763-90ad-43e6-98c1-6baf85e723d5 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:04:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3c5de326-e408-4736-a475-262b66f3fb33 req-f625be49-10d3-4add-9fb2-84281a4619cf service nova] Acquiring lock "a635cbbc-6b87-4877-80a8-bd4001c407c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3c5de326-e408-4736-a475-262b66f3fb33 req-f625be49-10d3-4add-9fb2-84281a4619cf service nova] Lock "a635cbbc-6b87-4877-80a8-bd4001c407c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3c5de326-e408-4736-a475-262b66f3fb33 req-f625be49-10d3-4add-9fb2-84281a4619cf service nova] Lock "a635cbbc-6b87-4877-80a8-bd4001c407c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:03 user nova-compute[74348]: DEBUG nova.compute.manager [req-3c5de326-e408-4736-a475-262b66f3fb33 req-f625be49-10d3-4add-9fb2-84281a4619cf service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] No waiting events found dispatching network-vif-plugged-25edb763-90ad-43e6-98c1-6baf85e723d5 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:04:03 user nova-compute[74348]: WARNING nova.compute.manager [req-3c5de326-e408-4736-a475-262b66f3fb33 req-f625be49-10d3-4add-9fb2-84281a4619cf service nova] [instance: a635cbbc-6b87-4877-80a8-bd4001c407c6] Received unexpected event network-vif-plugged-25edb763-90ad-43e6-98c1-6baf85e723d5 for instance with vm_state deleted and task_state None.
Nov 22 08:04:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 -F raw /opt/stack/data/nova/instances/3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0/disk" returned: 0 in 2.517s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Ensure instance console log exists: /opt/stack/data/nova/instances/3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Start _get_guest_xml network_info=[{"id": "6c9d4040-2941-469b-b602-69cc8b6e879b", "address": "fa:16:3e:b0:44:f3", "network": {"id": "4ef640bb-4a2f-4f98-8b01-b5df87fcb35a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1216437312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444367658c0241d0b5b377a73fedb52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9d4040-29", "ovs_interfaceid": "6c9d4040-2941-469b-b602-69cc8b6e879b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='0aeae612ba006ea390205cbd3206d424',container_format='bare',created_at=2023-11-22T08:02:04Z,direct_url=<?>,disk_format='qcow2',id=9c823066-c0c6-4571-af4c-0788bb06b9ce,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-335042483-shelved',owner='444367658c0241d0b5b377a73fedb52b',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-22T08:02:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 08:04:04 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:04:04 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:04:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0aeae612ba006ea390205cbd3206d424',container_format='bare',created_at=2023-11-22T08:02:04Z,direct_url=<?>,disk_format='qcow2',id=9c823066-c0c6-4571-af4c-0788bb06b9ce,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-335042483-shelved',owner='444367658c0241d0b5b377a73fedb52b',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-22T08:02:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG nova.objects.instance [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG nova.objects.base [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Object Instance<3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-22T08:00:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-335042483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-335042483',id=22,image_ref='9c823066-c0c6-4571-af4c-0788bb06b9ce',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1302414391',keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:00:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='444367658c0241d0b5b377a73fedb52b',ramdisk_id='',reservation_id='r-ihwqqxt1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1610098589',owner_user_name='tempest-AttachVolumeShelveTestJSON-1610098589-project-member',shelved_at='2023-11-22T08:02:08.277750',shelved_host='user',shelved_image_id='9c823066-c0c6-4571-af4c-0788bb06b9ce'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:03:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e8ce0d767724228bfd6cf3a4afad00d',uuid=3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6c9d4040-2941-469b-b602-69cc8b6e879b", "address": "fa:16:3e:b0:44:f3", "network": {"id": "4ef640bb-4a2f-4f98-8b01-b5df87fcb35a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1216437312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444367658c0241d0b5b377a73fedb52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9d4040-29", "ovs_interfaceid": "6c9d4040-2941-469b-b602-69cc8b6e879b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Converting VIF {"id": "6c9d4040-2941-469b-b602-69cc8b6e879b", "address": "fa:16:3e:b0:44:f3", "network": {"id": "4ef640bb-4a2f-4f98-8b01-b5df87fcb35a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1216437312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444367658c0241d0b5b377a73fedb52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9d4040-29", "ovs_interfaceid": "6c9d4040-2941-469b-b602-69cc8b6e879b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:44:f3,bridge_name='br-int',has_traffic_filtering=True,id=6c9d4040-2941-469b-b602-69cc8b6e879b,network=Network(4ef640bb-4a2f-4f98-8b01-b5df87fcb35a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9d4040-29') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG nova.objects.instance [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG nova.objects.base [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Object Instance<3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] End _get_guest_xml xml=<domain type="kvm">
Nov 22 08:04:04 user nova-compute[74348]:   <uuid>3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0</uuid>
Nov 22 08:04:04 user nova-compute[74348]:   <name>instance-00000016</name>
Nov 22 08:04:04 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 08:04:04 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 08:04:04 user nova-compute[74348]:   <metadata>
Nov 22 08:04:04 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 08:04:04 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 08:04:04 user nova-compute[74348]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-335042483</nova:name>
Nov 22 08:04:04 user nova-compute[74348]:       <nova:creationTime>2023-11-22 08:04:04</nova:creationTime>
Nov 22 08:04:04 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 08:04:04 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 08:04:04 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 08:04:04 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 08:04:04 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 08:04:04 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 08:04:04 user nova-compute[74348]:       </nova:flavor>
Nov 22 08:04:04 user nova-compute[74348]:       <nova:owner>
Nov 22 08:04:04 user nova-compute[74348]:         <nova:user uuid="2e8ce0d767724228bfd6cf3a4afad00d">tempest-AttachVolumeShelveTestJSON-1610098589-project-member</nova:user>
Nov 22 08:04:04 user nova-compute[74348]:         <nova:project uuid="444367658c0241d0b5b377a73fedb52b">tempest-AttachVolumeShelveTestJSON-1610098589</nova:project>
Nov 22 08:04:04 user nova-compute[74348]:       </nova:owner>
Nov 22 08:04:04 user nova-compute[74348]:       <nova:root type="image" uuid="9c823066-c0c6-4571-af4c-0788bb06b9ce"/>
Nov 22 08:04:04 user nova-compute[74348]:       <nova:ports>
Nov 22 08:04:04 user nova-compute[74348]:         <nova:port uuid="6c9d4040-2941-469b-b602-69cc8b6e879b">
Nov 22 08:04:04 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 22 08:04:04 user nova-compute[74348]:         </nova:port>
Nov 22 08:04:04 user nova-compute[74348]:       </nova:ports>
Nov 22 08:04:04 user nova-compute[74348]:     </nova:instance>
Nov 22 08:04:04 user nova-compute[74348]:   </metadata>
Nov 22 08:04:04 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 08:04:04 user nova-compute[74348]:     <system>
Nov 22 08:04:04 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 08:04:04 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 08:04:04 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 08:04:04 user nova-compute[74348]:       <entry name="serial">3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0</entry>
Nov 22 08:04:04 user nova-compute[74348]:       <entry name="uuid">3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0</entry>
Nov 22 08:04:04 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 08:04:04 user nova-compute[74348]:     </system>
Nov 22 08:04:04 user nova-compute[74348]:   </sysinfo>
Nov 22 08:04:04 user nova-compute[74348]:   <os>
Nov 22 08:04:04 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 08:04:04 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 08:04:04 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 08:04:04 user nova-compute[74348]:   </os>
Nov 22 08:04:04 user nova-compute[74348]:   <features>
Nov 22 08:04:04 user nova-compute[74348]:     <acpi/>
Nov 22 08:04:04 user nova-compute[74348]:     <apic/>
Nov 22 08:04:04 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 08:04:04 user nova-compute[74348]:   </features>
Nov 22 08:04:04 user nova-compute[74348]:   <clock offset="utc">
Nov 22 08:04:04 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 08:04:04 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 08:04:04 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 08:04:04 user nova-compute[74348]:   </clock>
Nov 22 08:04:04 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 08:04:04 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 08:04:04 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 08:04:04 user nova-compute[74348]:   </cpu>
Nov 22 08:04:04 user nova-compute[74348]:   <devices>
Nov 22 08:04:04 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 08:04:04 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 08:04:04 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0/disk"/>
Nov 22 08:04:04 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 08:04:04 user nova-compute[74348]:     </disk>
Nov 22 08:04:04 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 08:04:04 user nova-compute[74348]:       <mac address="fa:16:3e:b0:44:f3"/>
Nov 22 08:04:04 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:04:04 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 08:04:04 user nova-compute[74348]:       <target dev="tap6c9d4040-29"/>
Nov 22 08:04:04 user nova-compute[74348]:     </interface>
Nov 22 08:04:04 user nova-compute[74348]:     <serial type="pty">
Nov 22 08:04:04 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0/console.log" append="off"/>
Nov 22 08:04:04 user nova-compute[74348]:     </serial>
Nov 22 08:04:04 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 08:04:04 user nova-compute[74348]:     <video>
Nov 22 08:04:04 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:04:04 user nova-compute[74348]:     </video>
Nov 22 08:04:04 user nova-compute[74348]:     <rng model="virtio">
Nov 22 08:04:04 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 08:04:04 user nova-compute[74348]:     </rng>
Nov 22 08:04:04 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 08:04:04 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 08:04:04 user nova-compute[74348]:       <stats period="10"/>
Nov 22 08:04:04 user nova-compute[74348]:     </memballoon>
Nov 22 08:04:04 user nova-compute[74348]:   </devices>
Nov 22 08:04:04 user nova-compute[74348]: </domain>
Nov 22 08:04:04 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-22T08:00:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-335042483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-335042483',id=22,image_ref='9c823066-c0c6-4571-af4c-0788bb06b9ce',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1302414391',keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:00:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='444367658c0241d0b5b377a73fedb52b',ramdisk_id='',reservation_id='r-ihwqqxt1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1610098589',owner_user_name='tempest-AttachVolumeShelveTestJSON-1610098589-project-member',shelved_at='2023-11-22T08:02:08.277750',shelved_host='user',shelved_image_id='9c823066-c0c6-4571-af4c-0788bb06b9ce'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:03:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e8ce0d767724228bfd6cf3a4afad00d',uuid=3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6c9d4040-2941-469b-b602-69cc8b6e879b", "address": "fa:16:3e:b0:44:f3", "network": {"id": "4ef640bb-4a2f-4f98-8b01-b5df87fcb35a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1216437312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444367658c0241d0b5b377a73fedb52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9d4040-29", "ovs_interfaceid": "6c9d4040-2941-469b-b602-69cc8b6e879b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Converting VIF {"id": "6c9d4040-2941-469b-b602-69cc8b6e879b", "address": "fa:16:3e:b0:44:f3", "network": {"id": "4ef640bb-4a2f-4f98-8b01-b5df87fcb35a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1216437312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444367658c0241d0b5b377a73fedb52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9d4040-29", "ovs_interfaceid": "6c9d4040-2941-469b-b602-69cc8b6e879b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:44:f3,bridge_name='br-int',has_traffic_filtering=True,id=6c9d4040-2941-469b-b602-69cc8b6e879b,network=Network(4ef640bb-4a2f-4f98-8b01-b5df87fcb35a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9d4040-29') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG os_vif [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:44:f3,bridge_name='br-int',has_traffic_filtering=True,id=6c9d4040-2941-469b-b602-69cc8b6e879b,network=Network(4ef640bb-4a2f-4f98-8b01-b5df87fcb35a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9d4040-29') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd6dde906-d518-5e9b-8156-c21321983f80', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c9d4040-29, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6c9d4040-29, col_values=(('qos', UUID('f51452ff-2e5b-45b1-866c-894279ec9c30')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6c9d4040-29, col_values=(('external_ids', {'iface-id': '6c9d4040-2941-469b-b602-69cc8b6e879b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:44:f3', 'vm-uuid': '3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:04:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:04 user nova-compute[74348]: INFO os_vif [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:44:f3,bridge_name='br-int',has_traffic_filtering=True,id=6c9d4040-2941-469b-b602-69cc8b6e879b,network=Network(4ef640bb-4a2f-4f98-8b01-b5df87fcb35a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9d4040-29')
Nov 22 08:04:05 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:04:05 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] No VIF found with MAC fa:16:3e:b0:44:f3, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:04:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:08 user nova-compute[74348]: DEBUG nova.compute.manager [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 08:04:08 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 08:04:08 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Instance spawned successfully.
Nov 22 08:04:08 user nova-compute[74348]: DEBUG nova.compute.manager [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:04:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-71b103ea-78fb-44d1-bccd-00b975b09e80 tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.964s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:10 user nova-compute[74348]: DEBUG nova.compute.manager [req-a5395506-2d18-48a8-bb66-ca233c48ef69 req-e2be7ce5-2e2e-4aaa-b417-dac68c886d02 service nova] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Received event network-vif-plugged-6c9d4040-2941-469b-b602-69cc8b6e879b {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:04:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a5395506-2d18-48a8-bb66-ca233c48ef69 req-e2be7ce5-2e2e-4aaa-b417-dac68c886d02 service nova] Acquiring lock "3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a5395506-2d18-48a8-bb66-ca233c48ef69 req-e2be7ce5-2e2e-4aaa-b417-dac68c886d02 service nova] Lock "3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a5395506-2d18-48a8-bb66-ca233c48ef69 req-e2be7ce5-2e2e-4aaa-b417-dac68c886d02 service nova] Lock "3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:10 user nova-compute[74348]: DEBUG nova.compute.manager [req-a5395506-2d18-48a8-bb66-ca233c48ef69 req-e2be7ce5-2e2e-4aaa-b417-dac68c886d02 service nova] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] No waiting events found dispatching network-vif-plugged-6c9d4040-2941-469b-b602-69cc8b6e879b {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:04:10 user nova-compute[74348]: WARNING nova.compute.manager [req-a5395506-2d18-48a8-bb66-ca233c48ef69 req-e2be7ce5-2e2e-4aaa-b417-dac68c886d02 service nova] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Received unexpected event network-vif-plugged-6c9d4040-2941-469b-b602-69cc8b6e879b for instance with vm_state active and task_state None.
Nov 22 08:04:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:12 user nova-compute[74348]: DEBUG nova.compute.manager [req-9a5452d0-4f75-45c1-ba51-c8ba36838fa7 req-8f656eb9-474c-4c59-80d9-9f2e956787dd service nova] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Received event network-vif-plugged-6c9d4040-2941-469b-b602-69cc8b6e879b {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:04:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9a5452d0-4f75-45c1-ba51-c8ba36838fa7 req-8f656eb9-474c-4c59-80d9-9f2e956787dd service nova] Acquiring lock "3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9a5452d0-4f75-45c1-ba51-c8ba36838fa7 req-8f656eb9-474c-4c59-80d9-9f2e956787dd service nova] Lock "3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9a5452d0-4f75-45c1-ba51-c8ba36838fa7 req-8f656eb9-474c-4c59-80d9-9f2e956787dd service nova] Lock "3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:12 user nova-compute[74348]: DEBUG nova.compute.manager [req-9a5452d0-4f75-45c1-ba51-c8ba36838fa7 req-8f656eb9-474c-4c59-80d9-9f2e956787dd service nova] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] No waiting events found dispatching network-vif-plugged-6c9d4040-2941-469b-b602-69cc8b6e879b {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:04:12 user nova-compute[74348]: WARNING nova.compute.manager [req-9a5452d0-4f75-45c1-ba51-c8ba36838fa7 req-8f656eb9-474c-4c59-80d9-9f2e956787dd service nova] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Received unexpected event network-vif-plugged-6c9d4040-2941-469b-b602-69cc8b6e879b for instance with vm_state active and task_state None.
Nov 22 08:04:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:16 user nova-compute[74348]: INFO nova.compute.manager [None req-173b62e2-e000-41a6-9d19-28245158c691 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Unrescuing
Nov 22 08:04:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-173b62e2-e000-41a6-9d19-28245158c691 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "refresh_cache-b8f84c0b-fab5-4900-bf65-270c9c06baf8" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:04:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-173b62e2-e000-41a6-9d19-28245158c691 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquired lock "refresh_cache-b8f84c0b-fab5-4900-bf65-270c9c06baf8" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:04:16 user nova-compute[74348]: DEBUG nova.network.neutron [None req-173b62e2-e000-41a6-9d19-28245158c691 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:04:16 user nova-compute[74348]: DEBUG nova.network.neutron [None req-173b62e2-e000-41a6-9d19-28245158c691 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Updating instance_info_cache with network_info: [{"id": "72e5b044-9d3b-412d-9a20-408387fb6fe6", "address": "fa:16:3e:5d:93:c7", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e5b044-9d", "ovs_interfaceid": "72e5b044-9d3b-412d-9a20-408387fb6fe6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:04:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-173b62e2-e000-41a6-9d19-28245158c691 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Releasing lock "refresh_cache-b8f84c0b-fab5-4900-bf65-270c9c06baf8" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:04:16 user nova-compute[74348]: DEBUG nova.objects.instance [None req-173b62e2-e000-41a6-9d19-28245158c691 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lazy-loading 'flavor' on Instance uuid b8f84c0b-fab5-4900-bf65-270c9c06baf8 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:04:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:17 user nova-compute[74348]: DEBUG nova.compute.manager [req-f76a2853-ac13-4ddf-aed7-176f160d63ce req-d1c27a16-1b87-423a-b113-efab0b782db4 service nova] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Received event network-vif-unplugged-72e5b044-9d3b-412d-9a20-408387fb6fe6 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:04:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f76a2853-ac13-4ddf-aed7-176f160d63ce req-d1c27a16-1b87-423a-b113-efab0b782db4 service nova] Acquiring lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f76a2853-ac13-4ddf-aed7-176f160d63ce req-d1c27a16-1b87-423a-b113-efab0b782db4 service nova] Lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f76a2853-ac13-4ddf-aed7-176f160d63ce req-d1c27a16-1b87-423a-b113-efab0b782db4 service nova] Lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:17 user nova-compute[74348]: DEBUG nova.compute.manager [req-f76a2853-ac13-4ddf-aed7-176f160d63ce req-d1c27a16-1b87-423a-b113-efab0b782db4 service nova] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] No waiting events found dispatching network-vif-unplugged-72e5b044-9d3b-412d-9a20-408387fb6fe6 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:04:17 user nova-compute[74348]: WARNING nova.compute.manager [req-f76a2853-ac13-4ddf-aed7-176f160d63ce req-d1c27a16-1b87-423a-b113-efab0b782db4 service nova] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Received unexpected event network-vif-unplugged-72e5b044-9d3b-412d-9a20-408387fb6fe6 for instance with vm_state rescued and task_state unrescuing.
Nov 22 08:04:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:17 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Instance destroyed successfully.
Nov 22 08:04:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Acquiring lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:17 user nova-compute[74348]: DEBUG nova.compute.manager [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 08:04:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:17 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 08:04:17 user nova-compute[74348]: INFO nova.compute.claims [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Claim successful on node user
Nov 22 08:04:18 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.572s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG nova.compute.manager [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 08:04:18 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-0997a3c9-cb38-4bf4-8167-ef27f4ce4fa3 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 266eb2ee-43a5-4fd2-86aa-9e915cbc7562 is timed out.
Nov 22 08:04:18 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-0997a3c9-cb38-4bf4-8167-ef27f4ce4fa3 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Successfully detached device vdb from instance 266eb2ee-43a5-4fd2-86aa-9e915cbc7562 from the live domain config.
Nov 22 08:04:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0997a3c9-cb38-4bf4-8167-ef27f4ce4fa3 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0997a3c9-cb38-4bf4-8167-ef27f4ce4fa3 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yYSeAORf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:04:18 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-0997a3c9-cb38-4bf4-8167-ef27f4ce4fa3 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:04:18 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-0997a3c9-cb38-4bf4-8167-ef27f4ce4fa3 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-0997a3c9-cb38-4bf4-8167-ef27f4ce4fa3 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG nova.compute.manager [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG nova.network.neutron [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 08:04:18 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 08:04:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a502afa-8696-4468-842a-ef12382917bd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0997a3c9-cb38-4bf4-8167-ef27f4ce4fa3 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 08:04:18 user nova-compute[74348]: No targets found.
Nov 22 08:04:18 user nova-compute[74348]: iSNS:
Nov 22 08:04:18 user nova-compute[74348]: No targets found.
Nov 22 08:04:18 user nova-compute[74348]: STATIC:
Nov 22 08:04:18 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8
Nov 22 08:04:18 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:04:18 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:04:18 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea
Nov 22 08:04:18 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:04:18 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:04:18 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0
Nov 22 08:04:18 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:04:18 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:04:18 user nova-compute[74348]: FIRMWARE:
Nov 22 08:04:18 user nova-compute[74348]: No targets found.
Nov 22 08:04:18 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0997a3c9-cb38-4bf4-8167-ef27f4ce4fa3 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 08:04:18 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 08:04:18 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0997a3c9-cb38-4bf4-8167-ef27f4ce4fa3 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da23825-96b8-4152-9763-cb0d2c08950c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG nova.compute.manager [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38e0b84-6278-4de0-853d-cc80ed4442a0]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0997a3c9-cb38-4bf4-8167-ef27f4ce4fa3 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:04:18 user nova-compute[74348]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)
Nov 22 08:04:18 user nova-compute[74348]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0 (non-flash)
Nov 22 08:04:18 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0997a3c9-cb38-4bf4-8167-ef27f4ce4fa3 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:04:18 user nova-compute[74348]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)
Nov 22 08:04:18 user nova-compute[74348]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0 (non-flash)
Nov 22 08:04:18 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0997a3c9-cb38-4bf4-8167-ef27f4ce4fa3 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f224c5bfc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0'): ({'sdd'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-0997a3c9-cb38-4bf4-8167-ef27f4ce4fa3 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Removing single pathed devices sdd {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[405cf083-ea5b-4e6b-9f92-24fda42b651f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG nova.policy [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '08d86660380d4099badacce7e6e0cff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba09a4f903c4c49909926e9114be418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be84408-354f-437d-9a34-abcca6bdae86]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-0997a3c9-cb38-4bf4-8167-ef27f4ce4fa3 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Flushing IO for device /dev/sdd {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4741d63b-327d-45db-b1af-17738c63e572]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-0997a3c9-cb38-4bf4-8167-ef27f4ce4fa3 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG nova.compute.manager [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 08:04:18 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Creating image(s)
Nov 22 08:04:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Acquiring lock "/opt/stack/data/nova/instances/b6698b0d-0d43-47ea-bcdc-d99201d9833c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "/opt/stack/data/nova/instances/b6698b0d-0d43-47ea-bcdc-d99201d9833c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "/opt/stack/data/nova/instances/b6698b0d-0d43-47ea-bcdc-d99201d9833c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.034s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd2de20-8d3f-4bc2-acbe-631d2e0f9e62]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-0997a3c9-cb38-4bf4-8167-ef27f4ce4fa3 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-0997a3c9-cb38-4bf4-8167-ef27f4ce4fa3 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] SCSI volumes sdd have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0997a3c9-cb38-4bf4-8167-ef27f4ce4fa3 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.064s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82a2090-75b7-40b0-a281-9338ff610518]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0997a3c9-cb38-4bf4-8167-ef27f4ce4fa3 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0 -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.109s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:19 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0267f72d-eeeb-47cb-a139-e4166d615675]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:04:19 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0997a3c9-cb38-4bf4-8167-ef27f4ce4fa3 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0, portal: 172.16.0.220,3260]
Nov 22 08:04:19 user nova-compute[74348]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0, portal: 172.16.0.220,3260] successful.
Nov 22 08:04:19 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:04:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.234s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Acquiring lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0 -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:19 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b90f21-c1c6-435c-94c1-1900c3dbd6e2]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:04:19 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0997a3c9-cb38-4bf4-8167-ef27f4ce4fa3 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:04:19 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-0997a3c9-cb38-4bf4-8167-ef27f4ce4fa3 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.467s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:04:19 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0997a3c9-cb38-4bf4-8167-ef27f4ce4fa3 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] <== disconnect_volume: return (469ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:04:19 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0997a3c9-cb38-4bf4-8167-ef27f4ce4fa3 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 08:04:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.217s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/b6698b0d-0d43-47ea-bcdc-d99201d9833c/disk 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:19 user nova-compute[74348]: DEBUG nova.compute.manager [req-57d91b65-5444-4add-9fe1-0427adcbfbf3 req-e32c1d44-744b-45d5-8401-6b60efb2eb93 service nova] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Received event network-vif-plugged-72e5b044-9d3b-412d-9a20-408387fb6fe6 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:04:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-57d91b65-5444-4add-9fe1-0427adcbfbf3 req-e32c1d44-744b-45d5-8401-6b60efb2eb93 service nova] Acquiring lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-57d91b65-5444-4add-9fe1-0427adcbfbf3 req-e32c1d44-744b-45d5-8401-6b60efb2eb93 service nova] Lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-57d91b65-5444-4add-9fe1-0427adcbfbf3 req-e32c1d44-744b-45d5-8401-6b60efb2eb93 service nova] Lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:19 user nova-compute[74348]: DEBUG nova.compute.manager [req-57d91b65-5444-4add-9fe1-0427adcbfbf3 req-e32c1d44-744b-45d5-8401-6b60efb2eb93 service nova] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] No waiting events found dispatching network-vif-plugged-72e5b044-9d3b-412d-9a20-408387fb6fe6 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:04:19 user nova-compute[74348]: WARNING nova.compute.manager [req-57d91b65-5444-4add-9fe1-0427adcbfbf3 req-e32c1d44-744b-45d5-8401-6b60efb2eb93 service nova] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Received unexpected event network-vif-plugged-72e5b044-9d3b-412d-9a20-408387fb6fe6 for instance with vm_state rescued and task_state unrescuing.
Nov 22 08:04:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/b6698b0d-0d43-47ea-bcdc-d99201d9833c/disk 1073741824" returned: 0 in 0.076s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.189s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:19 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b6698b0d-0d43-47ea-bcdc-d99201d9833c/disk. size=1073741824 {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 08:04:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6698b0d-0d43-47ea-bcdc-d99201d9833c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6698b0d-0d43-47ea-bcdc-d99201d9833c/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:19 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Cannot resize image /opt/stack/data/nova/instances/b6698b0d-0d43-47ea-bcdc-d99201d9833c/disk to a smaller size. {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 08:04:19 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 08:04:19 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Ensure instance console log exists: /opt/stack/data/nova/instances/b6698b0d-0d43-47ea-bcdc-d99201d9833c/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 08:04:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:19 user nova-compute[74348]: DEBUG nova.network.neutron [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Successfully created port: 011479b6-f8d6-48e2-b215-789b56c4a2ad {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 08:04:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:19 user nova-compute[74348]: DEBUG nova.objects.instance [None req-0997a3c9-cb38-4bf4-8167-ef27f4ce4fa3 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lazy-loading 'flavor' on Instance uuid 266eb2ee-43a5-4fd2-86aa-9e915cbc7562 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-0997a3c9-cb38-4bf4-8167-ef27f4ce4fa3 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "266eb2ee-43a5-4fd2-86aa-9e915cbc7562" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.989s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c295cc1b-d003-473c-8d51-a4f891c5e98e tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "266eb2ee-43a5-4fd2-86aa-9e915cbc7562" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.816s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c295cc1b-d003-473c-8d51-a4f891c5e98e tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Acquiring lock "266eb2ee-43a5-4fd2-86aa-9e915cbc7562-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c295cc1b-d003-473c-8d51-a4f891c5e98e tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "266eb2ee-43a5-4fd2-86aa-9e915cbc7562-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c295cc1b-d003-473c-8d51-a4f891c5e98e tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "266eb2ee-43a5-4fd2-86aa-9e915cbc7562-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:20 user nova-compute[74348]: INFO nova.compute.manager [None req-c295cc1b-d003-473c-8d51-a4f891c5e98e tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Terminating instance
Nov 22 08:04:20 user nova-compute[74348]: DEBUG nova.compute.manager [None req-c295cc1b-d003-473c-8d51-a4f891c5e98e tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG nova.compute.manager [req-c9344a89-6610-4b66-95a8-24046e20bed9 req-49eaca3a-001e-4a98-b5b6-d9f2aecf4803 service nova] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Received event network-vif-unplugged-d73167a0-1952-4e39-8cc0-0a422a6927b3 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c9344a89-6610-4b66-95a8-24046e20bed9 req-49eaca3a-001e-4a98-b5b6-d9f2aecf4803 service nova] Acquiring lock "266eb2ee-43a5-4fd2-86aa-9e915cbc7562-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c9344a89-6610-4b66-95a8-24046e20bed9 req-49eaca3a-001e-4a98-b5b6-d9f2aecf4803 service nova] Lock "266eb2ee-43a5-4fd2-86aa-9e915cbc7562-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c9344a89-6610-4b66-95a8-24046e20bed9 req-49eaca3a-001e-4a98-b5b6-d9f2aecf4803 service nova] Lock "266eb2ee-43a5-4fd2-86aa-9e915cbc7562-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG nova.compute.manager [req-c9344a89-6610-4b66-95a8-24046e20bed9 req-49eaca3a-001e-4a98-b5b6-d9f2aecf4803 service nova] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] No waiting events found dispatching network-vif-unplugged-d73167a0-1952-4e39-8cc0-0a422a6927b3 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG nova.compute.manager [req-c9344a89-6610-4b66-95a8-24046e20bed9 req-49eaca3a-001e-4a98-b5b6-d9f2aecf4803 service nova] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Received event network-vif-unplugged-d73167a0-1952-4e39-8cc0-0a422a6927b3 for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG nova.network.neutron [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Successfully updated port: 011479b6-f8d6-48e2-b215-789b56c4a2ad {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Acquiring lock "refresh_cache-b6698b0d-0d43-47ea-bcdc-d99201d9833c" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Acquired lock "refresh_cache-b6698b0d-0d43-47ea-bcdc-d99201d9833c" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG nova.network.neutron [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG nova.network.neutron [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 08:04:20 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Instance destroyed successfully.
Nov 22 08:04:20 user nova-compute[74348]: DEBUG nova.objects.instance [None req-c295cc1b-d003-473c-8d51-a4f891c5e98e tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lazy-loading 'resources' on Instance uuid 266eb2ee-43a5-4fd2-86aa-9e915cbc7562 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-c295cc1b-d003-473c-8d51-a4f891c5e98e tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:01:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1512907752',display_name='tempest-VolumesSnapshotTestJSON-instance-1512907752',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1512907752',id=27,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLnC9VP7hgP3rr5137x76kYdOVi2S8U5ns95C69FZPFrPLSf2TLXbArkqFGwwjn8zN4qAiCxB/zmBHainFM54naC00wqyORSYl4ozKzDnyCaGZCoKBkkQQFfHgLAqJ05w==',key_name='tempest-keypair-1693709242',keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:01:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6c0496e87c6a468fab4258553c68b8d3',ramdisk_id='',reservation_id='r-nigfkf0w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-451679750',owner_user_name='tempest-VolumesSnapshotTestJSON-451679750-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T08:01:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='932048022f98418b9ac1d99a356fa39d',uuid=266eb2ee-43a5-4fd2-86aa-9e915cbc7562,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d73167a0-1952-4e39-8cc0-0a422a6927b3", "address": "fa:16:3e:f8:90:9f", "network": {"id": "59f6f7a7-7076-40e9-8db7-944f89ecb7e5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1331190296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c0496e87c6a468fab4258553c68b8d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd73167a0-19", "ovs_interfaceid": "d73167a0-1952-4e39-8cc0-0a422a6927b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-c295cc1b-d003-473c-8d51-a4f891c5e98e tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Converting VIF {"id": "d73167a0-1952-4e39-8cc0-0a422a6927b3", "address": "fa:16:3e:f8:90:9f", "network": {"id": "59f6f7a7-7076-40e9-8db7-944f89ecb7e5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1331190296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c0496e87c6a468fab4258553c68b8d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd73167a0-19", "ovs_interfaceid": "d73167a0-1952-4e39-8cc0-0a422a6927b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-c295cc1b-d003-473c-8d51-a4f891c5e98e tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:90:9f,bridge_name='br-int',has_traffic_filtering=True,id=d73167a0-1952-4e39-8cc0-0a422a6927b3,network=Network(59f6f7a7-7076-40e9-8db7-944f89ecb7e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd73167a0-19') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG os_vif [None req-c295cc1b-d003-473c-8d51-a4f891c5e98e tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:90:9f,bridge_name='br-int',has_traffic_filtering=True,id=d73167a0-1952-4e39-8cc0-0a422a6927b3,network=Network(59f6f7a7-7076-40e9-8db7-944f89ecb7e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd73167a0-19') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd73167a0-19, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3a162c47-a50f-4998-a89f-402dfd27179e) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:20 user nova-compute[74348]: INFO os_vif [None req-c295cc1b-d003-473c-8d51-a4f891c5e98e tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:90:9f,bridge_name='br-int',has_traffic_filtering=True,id=d73167a0-1952-4e39-8cc0-0a422a6927b3,network=Network(59f6f7a7-7076-40e9-8db7-944f89ecb7e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd73167a0-19')
Nov 22 08:04:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c295cc1b-d003-473c-8d51-a4f891c5e98e tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c295cc1b-d003-473c-8d51-a4f891c5e98e tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yYSeAORf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:04:20 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-c295cc1b-d003-473c-8d51-a4f891c5e98e tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:04:20 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-c295cc1b-d003-473c-8d51-a4f891c5e98e tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-c295cc1b-d003-473c-8d51-a4f891c5e98e tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG nova.network.neutron [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Updating instance_info_cache with network_info: [{"id": "011479b6-f8d6-48e2-b215-789b56c4a2ad", "address": "fa:16:3e:d2:53:6d", "network": {"id": "19a6226e-acc6-4a08-8157-d6651b1f0362", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-53573870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba09a4f903c4c49909926e9114be418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap011479b6-f8", "ovs_interfaceid": "011479b6-f8d6-48e2-b215-789b56c4a2ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c930d74-9c79-47aa-8585-23d5958ec166]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c295cc1b-d003-473c-8d51-a4f891c5e98e tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 08:04:20 user nova-compute[74348]: No targets found.
Nov 22 08:04:20 user nova-compute[74348]: iSNS:
Nov 22 08:04:20 user nova-compute[74348]: No targets found.
Nov 22 08:04:20 user nova-compute[74348]: STATIC:
Nov 22 08:04:20 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8
Nov 22 08:04:20 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:04:20 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:04:20 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea
Nov 22 08:04:20 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:04:20 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:04:20 user nova-compute[74348]: FIRMWARE:
Nov 22 08:04:20 user nova-compute[74348]: No targets found.
Nov 22 08:04:20 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c295cc1b-d003-473c-8d51-a4f891c5e98e tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 08:04:20 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 08:04:20 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c295cc1b-d003-473c-8d51-a4f891c5e98e tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a7b165e-fc69-432b-afea-d2aa8e1104b0', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Releasing lock "refresh_cache-b6698b0d-0d43-47ea-bcdc-d99201d9833c" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG nova.compute.manager [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Instance network_info: |[{"id": "011479b6-f8d6-48e2-b215-789b56c4a2ad", "address": "fa:16:3e:d2:53:6d", "network": {"id": "19a6226e-acc6-4a08-8157-d6651b1f0362", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-53573870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba09a4f903c4c49909926e9114be418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap011479b6-f8", "ovs_interfaceid": "011479b6-f8d6-48e2-b215-789b56c4a2ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Start _get_guest_xml network_info=[{"id": "011479b6-f8d6-48e2-b215-789b56c4a2ad", "address": "fa:16:3e:d2:53:6d", "network": {"id": "19a6226e-acc6-4a08-8157-d6651b1f0362", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-53573870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba09a4f903c4c49909926e9114be418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap011479b6-f8", "ovs_interfaceid": "011479b6-f8d6-48e2-b215-789b56c4a2ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ab7901-b341-47ba-9210-a644b45b6dde]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:20 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:04:20 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:04:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 08:04:20 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:04:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-711501342',display_name='tempest-SnapshotDataIntegrityTests-server-711501342',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-711501342',id=32,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0UjRmrA11QF4OQL93dB+Swt9DFhVmUV4oNe6sLciKg1lbVfwOUMKh93Lnql5l725RnlXExRVHEhDTh4+G322cxaRnCRl4TzvIvjwqvrLgmQM8wSUyLDirVw6X7pdXwng==',key_name='tempest-keypair-1991121525',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ba09a4f903c4c49909926e9114be418',ramdisk_id='',reservation_id='r-htxlgo9q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-572539985',owner_user_name='tempest-SnapshotDataIntegrityTests-572539985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:04:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='08d86660380d4099badacce7e6e0cff7',uuid=b6698b0d-0d43-47ea-bcdc-d99201d9833c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "011479b6-f8d6-48e2-b215-789b56c4a2ad", "address": "fa:16:3e:d2:53:6d", "network": {"id": "19a6226e-acc6-4a08-8157-d6651b1f0362", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-53573870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba09a4f903c4c49909926e9114be418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap011479b6-f8", "ovs_interfaceid": "011479b6-f8d6-48e2-b215-789b56c4a2ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Converting VIF {"id": "011479b6-f8d6-48e2-b215-789b56c4a2ad", "address": "fa:16:3e:d2:53:6d", "network": {"id": "19a6226e-acc6-4a08-8157-d6651b1f0362", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-53573870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba09a4f903c4c49909926e9114be418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap011479b6-f8", "ovs_interfaceid": "011479b6-f8d6-48e2-b215-789b56c4a2ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:53:6d,bridge_name='br-int',has_traffic_filtering=True,id=011479b6-f8d6-48e2-b215-789b56c4a2ad,network=Network(19a6226e-acc6-4a08-8157-d6651b1f0362),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap011479b6-f8') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG nova.objects.instance [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lazy-loading 'pci_devices' on Instance uuid b6698b0d-0d43-47ea-bcdc-d99201d9833c {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa0bfa6-f581-4484-9024-440440ed3e52]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c295cc1b-d003-473c-8d51-a4f891c5e98e tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:04:21 user nova-compute[74348]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)
Nov 22 08:04:21 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c295cc1b-d003-473c-8d51-a4f891c5e98e tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:04:21 user nova-compute[74348]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)
Nov 22 08:04:21 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c295cc1b-d003-473c-8d51-a4f891c5e98e tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2228228550>, {}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c295cc1b-d003-473c-8d51-a4f891c5e98e tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Disconnecting from: [] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-c295cc1b-d003-473c-8d51-a4f891c5e98e tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.124s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c295cc1b-d003-473c-8d51-a4f891c5e98e tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] <== disconnect_volume: return (126ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c295cc1b-d003-473c-8d51-a4f891c5e98e tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 08:04:21 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-c295cc1b-d003-473c-8d51-a4f891c5e98e tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Deleting instance files /opt/stack/data/nova/instances/266eb2ee-43a5-4fd2-86aa-9e915cbc7562_del
Nov 22 08:04:21 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-c295cc1b-d003-473c-8d51-a4f891c5e98e tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Deletion of /opt/stack/data/nova/instances/266eb2ee-43a5-4fd2-86aa-9e915cbc7562_del complete
Nov 22 08:04:21 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] End _get_guest_xml xml=<domain type="kvm">
Nov 22 08:04:21 user nova-compute[74348]:   <uuid>b6698b0d-0d43-47ea-bcdc-d99201d9833c</uuid>
Nov 22 08:04:21 user nova-compute[74348]:   <name>instance-00000020</name>
Nov 22 08:04:21 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 08:04:21 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 08:04:21 user nova-compute[74348]:   <metadata>
Nov 22 08:04:21 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 08:04:21 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 08:04:21 user nova-compute[74348]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-711501342</nova:name>
Nov 22 08:04:21 user nova-compute[74348]:       <nova:creationTime>2023-11-22 08:04:20</nova:creationTime>
Nov 22 08:04:21 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 08:04:21 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 08:04:21 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 08:04:21 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 08:04:21 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 08:04:21 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 08:04:21 user nova-compute[74348]:       </nova:flavor>
Nov 22 08:04:21 user nova-compute[74348]:       <nova:owner>
Nov 22 08:04:21 user nova-compute[74348]:         <nova:user uuid="08d86660380d4099badacce7e6e0cff7">tempest-SnapshotDataIntegrityTests-572539985-project-member</nova:user>
Nov 22 08:04:21 user nova-compute[74348]:         <nova:project uuid="0ba09a4f903c4c49909926e9114be418">tempest-SnapshotDataIntegrityTests-572539985</nova:project>
Nov 22 08:04:21 user nova-compute[74348]:       </nova:owner>
Nov 22 08:04:21 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 08:04:21 user nova-compute[74348]:       <nova:ports>
Nov 22 08:04:21 user nova-compute[74348]:         <nova:port uuid="011479b6-f8d6-48e2-b215-789b56c4a2ad">
Nov 22 08:04:21 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 22 08:04:21 user nova-compute[74348]:         </nova:port>
Nov 22 08:04:21 user nova-compute[74348]:       </nova:ports>
Nov 22 08:04:21 user nova-compute[74348]:     </nova:instance>
Nov 22 08:04:21 user nova-compute[74348]:   </metadata>
Nov 22 08:04:21 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 08:04:21 user nova-compute[74348]:     <system>
Nov 22 08:04:21 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 08:04:21 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 08:04:21 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 08:04:21 user nova-compute[74348]:       <entry name="serial">b6698b0d-0d43-47ea-bcdc-d99201d9833c</entry>
Nov 22 08:04:21 user nova-compute[74348]:       <entry name="uuid">b6698b0d-0d43-47ea-bcdc-d99201d9833c</entry>
Nov 22 08:04:21 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 08:04:21 user nova-compute[74348]:     </system>
Nov 22 08:04:21 user nova-compute[74348]:   </sysinfo>
Nov 22 08:04:21 user nova-compute[74348]:   <os>
Nov 22 08:04:21 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 08:04:21 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 08:04:21 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 08:04:21 user nova-compute[74348]:   </os>
Nov 22 08:04:21 user nova-compute[74348]:   <features>
Nov 22 08:04:21 user nova-compute[74348]:     <acpi/>
Nov 22 08:04:21 user nova-compute[74348]:     <apic/>
Nov 22 08:04:21 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 08:04:21 user nova-compute[74348]:   </features>
Nov 22 08:04:21 user nova-compute[74348]:   <clock offset="utc">
Nov 22 08:04:21 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 08:04:21 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 08:04:21 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 08:04:21 user nova-compute[74348]:   </clock>
Nov 22 08:04:21 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 08:04:21 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 08:04:21 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 08:04:21 user nova-compute[74348]:   </cpu>
Nov 22 08:04:21 user nova-compute[74348]:   <devices>
Nov 22 08:04:21 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 08:04:21 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 08:04:21 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/b6698b0d-0d43-47ea-bcdc-d99201d9833c/disk"/>
Nov 22 08:04:21 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 08:04:21 user nova-compute[74348]:     </disk>
Nov 22 08:04:21 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 08:04:21 user nova-compute[74348]:       <mac address="fa:16:3e:d2:53:6d"/>
Nov 22 08:04:21 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:04:21 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 08:04:21 user nova-compute[74348]:       <target dev="tap011479b6-f8"/>
Nov 22 08:04:21 user nova-compute[74348]:     </interface>
Nov 22 08:04:21 user nova-compute[74348]:     <serial type="pty">
Nov 22 08:04:21 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/b6698b0d-0d43-47ea-bcdc-d99201d9833c/console.log" append="off"/>
Nov 22 08:04:21 user nova-compute[74348]:     </serial>
Nov 22 08:04:21 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 08:04:21 user nova-compute[74348]:     <video>
Nov 22 08:04:21 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:04:21 user nova-compute[74348]:     </video>
Nov 22 08:04:21 user nova-compute[74348]:     <rng model="virtio">
Nov 22 08:04:21 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 08:04:21 user nova-compute[74348]:     </rng>
Nov 22 08:04:21 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 08:04:21 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 08:04:21 user nova-compute[74348]:       <stats period="10"/>
Nov 22 08:04:21 user nova-compute[74348]:     </memballoon>
Nov 22 08:04:21 user nova-compute[74348]:   </devices>
Nov 22 08:04:21 user nova-compute[74348]: </domain>
Nov 22 08:04:21 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:04:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-711501342',display_name='tempest-SnapshotDataIntegrityTests-server-711501342',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-711501342',id=32,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0UjRmrA11QF4OQL93dB+Swt9DFhVmUV4oNe6sLciKg1lbVfwOUMKh93Lnql5l725RnlXExRVHEhDTh4+G322cxaRnCRl4TzvIvjwqvrLgmQM8wSUyLDirVw6X7pdXwng==',key_name='tempest-keypair-1991121525',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ba09a4f903c4c49909926e9114be418',ramdisk_id='',reservation_id='r-htxlgo9q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-572539985',owner_user_name='tempest-SnapshotDataIntegrityTests-572539985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:04:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='08d86660380d4099badacce7e6e0cff7',uuid=b6698b0d-0d43-47ea-bcdc-d99201d9833c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "011479b6-f8d6-48e2-b215-789b56c4a2ad", "address": "fa:16:3e:d2:53:6d", "network": {"id": "19a6226e-acc6-4a08-8157-d6651b1f0362", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-53573870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba09a4f903c4c49909926e9114be418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap011479b6-f8", "ovs_interfaceid": "011479b6-f8d6-48e2-b215-789b56c4a2ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Converting VIF {"id": "011479b6-f8d6-48e2-b215-789b56c4a2ad", "address": "fa:16:3e:d2:53:6d", "network": {"id": "19a6226e-acc6-4a08-8157-d6651b1f0362", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-53573870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba09a4f903c4c49909926e9114be418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap011479b6-f8", "ovs_interfaceid": "011479b6-f8d6-48e2-b215-789b56c4a2ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:53:6d,bridge_name='br-int',has_traffic_filtering=True,id=011479b6-f8d6-48e2-b215-789b56c4a2ad,network=Network(19a6226e-acc6-4a08-8157-d6651b1f0362),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap011479b6-f8') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG os_vif [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:53:6d,bridge_name='br-int',has_traffic_filtering=True,id=011479b6-f8d6-48e2-b215-789b56c4a2ad,network=Network(19a6226e-acc6-4a08-8157-d6651b1f0362),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap011479b6-f8') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5bda2c30-b722-5099-84a9-8d9defdc016d', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap011479b6-f8, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap011479b6-f8, col_values=(('qos', UUID('1a3f32f8-f4ae-4cef-92e6-35722cad7823')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap011479b6-f8, col_values=(('external_ids', {'iface-id': '011479b6-f8d6-48e2-b215-789b56c4a2ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:53:6d', 'vm-uuid': 'b6698b0d-0d43-47ea-bcdc-d99201d9833c'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:21 user nova-compute[74348]: INFO os_vif [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:53:6d,bridge_name='br-int',has_traffic_filtering=True,id=011479b6-f8d6-48e2-b215-789b56c4a2ad,network=Network(19a6226e-acc6-4a08-8157-d6651b1f0362),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap011479b6-f8')
Nov 22 08:04:21 user nova-compute[74348]: INFO nova.compute.manager [None req-c295cc1b-d003-473c-8d51-a4f891c5e98e tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Took 1.07 seconds to destroy the instance on the hypervisor.
Nov 22 08:04:21 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-c295cc1b-d003-473c-8d51-a4f891c5e98e tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] No VIF found with MAC fa:16:3e:d2:53:6d, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG nova.compute.manager [None req-173b62e2-e000-41a6-9d19-28245158c691 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG nova.compute.manager [req-91bc226d-fda0-4a34-9b94-1534aa75577f req-a61cbe5a-6697-4b42-b08e-7053e1a5a179 service nova] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Received event network-vif-plugged-72e5b044-9d3b-412d-9a20-408387fb6fe6 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-91bc226d-fda0-4a34-9b94-1534aa75577f req-a61cbe5a-6697-4b42-b08e-7053e1a5a179 service nova] Acquiring lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-91bc226d-fda0-4a34-9b94-1534aa75577f req-a61cbe5a-6697-4b42-b08e-7053e1a5a179 service nova] Lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-91bc226d-fda0-4a34-9b94-1534aa75577f req-a61cbe5a-6697-4b42-b08e-7053e1a5a179 service nova] Lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG nova.compute.manager [req-91bc226d-fda0-4a34-9b94-1534aa75577f req-a61cbe5a-6697-4b42-b08e-7053e1a5a179 service nova] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] No waiting events found dispatching network-vif-plugged-72e5b044-9d3b-412d-9a20-408387fb6fe6 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:04:21 user nova-compute[74348]: WARNING nova.compute.manager [req-91bc226d-fda0-4a34-9b94-1534aa75577f req-a61cbe5a-6697-4b42-b08e-7053e1a5a179 service nova] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Received unexpected event network-vif-plugged-72e5b044-9d3b-412d-9a20-408387fb6fe6 for instance with vm_state rescued and task_state unrescuing.
Nov 22 08:04:21 user nova-compute[74348]: DEBUG nova.compute.manager [req-91bc226d-fda0-4a34-9b94-1534aa75577f req-a61cbe5a-6697-4b42-b08e-7053e1a5a179 service nova] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Received event network-vif-plugged-72e5b044-9d3b-412d-9a20-408387fb6fe6 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-91bc226d-fda0-4a34-9b94-1534aa75577f req-a61cbe5a-6697-4b42-b08e-7053e1a5a179 service nova] Acquiring lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-91bc226d-fda0-4a34-9b94-1534aa75577f req-a61cbe5a-6697-4b42-b08e-7053e1a5a179 service nova] Lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-91bc226d-fda0-4a34-9b94-1534aa75577f req-a61cbe5a-6697-4b42-b08e-7053e1a5a179 service nova] Lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG nova.compute.manager [req-91bc226d-fda0-4a34-9b94-1534aa75577f req-a61cbe5a-6697-4b42-b08e-7053e1a5a179 service nova] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] No waiting events found dispatching network-vif-plugged-72e5b044-9d3b-412d-9a20-408387fb6fe6 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:04:21 user nova-compute[74348]: WARNING nova.compute.manager [req-91bc226d-fda0-4a34-9b94-1534aa75577f req-a61cbe5a-6697-4b42-b08e-7053e1a5a179 service nova] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Received unexpected event network-vif-plugged-72e5b044-9d3b-412d-9a20-408387fb6fe6 for instance with vm_state rescued and task_state unrescuing.
Nov 22 08:04:21 user nova-compute[74348]: DEBUG nova.compute.manager [req-91bc226d-fda0-4a34-9b94-1534aa75577f req-a61cbe5a-6697-4b42-b08e-7053e1a5a179 service nova] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Received event network-changed-011479b6-f8d6-48e2-b215-789b56c4a2ad {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG nova.compute.manager [req-91bc226d-fda0-4a34-9b94-1534aa75577f req-a61cbe5a-6697-4b42-b08e-7053e1a5a179 service nova] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Refreshing instance network info cache due to event network-changed-011479b6-f8d6-48e2-b215-789b56c4a2ad. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-91bc226d-fda0-4a34-9b94-1534aa75577f req-a61cbe5a-6697-4b42-b08e-7053e1a5a179 service nova] Acquiring lock "refresh_cache-b6698b0d-0d43-47ea-bcdc-d99201d9833c" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-91bc226d-fda0-4a34-9b94-1534aa75577f req-a61cbe5a-6697-4b42-b08e-7053e1a5a179 service nova] Acquired lock "refresh_cache-b6698b0d-0d43-47ea-bcdc-d99201d9833c" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:04:21 user nova-compute[74348]: DEBUG nova.network.neutron [req-91bc226d-fda0-4a34-9b94-1534aa75577f req-a61cbe5a-6697-4b42-b08e-7053e1a5a179 service nova] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Refreshing network info cache for port 011479b6-f8d6-48e2-b215-789b56c4a2ad {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:04:22 user nova-compute[74348]: DEBUG nova.network.neutron [req-91bc226d-fda0-4a34-9b94-1534aa75577f req-a61cbe5a-6697-4b42-b08e-7053e1a5a179 service nova] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Updated VIF entry in instance network info cache for port 011479b6-f8d6-48e2-b215-789b56c4a2ad. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:04:22 user nova-compute[74348]: DEBUG nova.network.neutron [req-91bc226d-fda0-4a34-9b94-1534aa75577f req-a61cbe5a-6697-4b42-b08e-7053e1a5a179 service nova] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Updating instance_info_cache with network_info: [{"id": "011479b6-f8d6-48e2-b215-789b56c4a2ad", "address": "fa:16:3e:d2:53:6d", "network": {"id": "19a6226e-acc6-4a08-8157-d6651b1f0362", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-53573870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba09a4f903c4c49909926e9114be418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap011479b6-f8", "ovs_interfaceid": "011479b6-f8d6-48e2-b215-789b56c4a2ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:04:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-91bc226d-fda0-4a34-9b94-1534aa75577f req-a61cbe5a-6697-4b42-b08e-7053e1a5a179 service nova] Releasing lock "refresh_cache-b6698b0d-0d43-47ea-bcdc-d99201d9833c" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:04:22 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:04:22 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Took 1.13 seconds to deallocate network for instance.
Nov 22 08:04:22 user nova-compute[74348]: WARNING nova.volume.cinder [None req-c295cc1b-d003-473c-8d51-a4f891c5e98e tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Attachment 4bc599fa-6966-421c-9606-ac885a19fd25 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 4bc599fa-6966-421c-9606-ac885a19fd25. (HTTP 404) (Request-ID: req-4cfdbfc7-a2b1-4f1e-8011-4f3522c5d414)
Nov 22 08:04:22 user nova-compute[74348]: INFO nova.compute.manager [None req-c295cc1b-d003-473c-8d51-a4f891c5e98e tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Took 0.04 seconds to detach 1 volumes for instance.
Nov 22 08:04:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c295cc1b-d003-473c-8d51-a4f891c5e98e tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c295cc1b-d003-473c-8d51-a4f891c5e98e tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:22 user nova-compute[74348]: DEBUG nova.compute.manager [req-3e2332c8-0174-417c-812f-fdc0fff17e66 req-e3e682bb-3752-4f6d-ae8d-ef3fccd58daa service nova] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Received event network-vif-plugged-d73167a0-1952-4e39-8cc0-0a422a6927b3 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:04:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3e2332c8-0174-417c-812f-fdc0fff17e66 req-e3e682bb-3752-4f6d-ae8d-ef3fccd58daa service nova] Acquiring lock "266eb2ee-43a5-4fd2-86aa-9e915cbc7562-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3e2332c8-0174-417c-812f-fdc0fff17e66 req-e3e682bb-3752-4f6d-ae8d-ef3fccd58daa service nova] Lock "266eb2ee-43a5-4fd2-86aa-9e915cbc7562-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3e2332c8-0174-417c-812f-fdc0fff17e66 req-e3e682bb-3752-4f6d-ae8d-ef3fccd58daa service nova] Lock "266eb2ee-43a5-4fd2-86aa-9e915cbc7562-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:22 user nova-compute[74348]: DEBUG nova.compute.manager [req-3e2332c8-0174-417c-812f-fdc0fff17e66 req-e3e682bb-3752-4f6d-ae8d-ef3fccd58daa service nova] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] No waiting events found dispatching network-vif-plugged-d73167a0-1952-4e39-8cc0-0a422a6927b3 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:04:22 user nova-compute[74348]: WARNING nova.compute.manager [req-3e2332c8-0174-417c-812f-fdc0fff17e66 req-e3e682bb-3752-4f6d-ae8d-ef3fccd58daa service nova] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Received unexpected event network-vif-plugged-d73167a0-1952-4e39-8cc0-0a422a6927b3 for instance with vm_state deleted and task_state None.
Nov 22 08:04:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:22 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-c295cc1b-d003-473c-8d51-a4f891c5e98e tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:04:22 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-c295cc1b-d003-473c-8d51-a4f891c5e98e tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:04:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c295cc1b-d003-473c-8d51-a4f891c5e98e tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.488s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:22 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-c295cc1b-d003-473c-8d51-a4f891c5e98e tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Deleted allocations for instance 266eb2ee-43a5-4fd2-86aa-9e915cbc7562
Nov 22 08:04:22 user nova-compute[74348]: DEBUG nova.compute.manager [req-13d1f281-8b18-47c8-a003-289d51c7e757 req-831cf719-c562-4882-aff9-ddd8498cc336 service nova] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Received event network-vif-plugged-011479b6-f8d6-48e2-b215-789b56c4a2ad {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:04:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-13d1f281-8b18-47c8-a003-289d51c7e757 req-831cf719-c562-4882-aff9-ddd8498cc336 service nova] Acquiring lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-13d1f281-8b18-47c8-a003-289d51c7e757 req-831cf719-c562-4882-aff9-ddd8498cc336 service nova] Lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-13d1f281-8b18-47c8-a003-289d51c7e757 req-831cf719-c562-4882-aff9-ddd8498cc336 service nova] Lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:22 user nova-compute[74348]: DEBUG nova.compute.manager [req-13d1f281-8b18-47c8-a003-289d51c7e757 req-831cf719-c562-4882-aff9-ddd8498cc336 service nova] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] No waiting events found dispatching network-vif-plugged-011479b6-f8d6-48e2-b215-789b56c4a2ad {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:04:22 user nova-compute[74348]: WARNING nova.compute.manager [req-13d1f281-8b18-47c8-a003-289d51c7e757 req-831cf719-c562-4882-aff9-ddd8498cc336 service nova] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Received unexpected event network-vif-plugged-011479b6-f8d6-48e2-b215-789b56c4a2ad for instance with vm_state building and task_state spawning.
Nov 22 08:04:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c295cc1b-d003-473c-8d51-a4f891c5e98e tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "266eb2ee-43a5-4fd2-86aa-9e915cbc7562" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.945s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:23 user nova-compute[74348]: DEBUG nova.compute.manager [req-9a215a0e-693a-4e9b-9dc1-335b50eecf35 req-86048778-f65f-4bc7-98a1-acec52eebcb9 service nova] [instance: 266eb2ee-43a5-4fd2-86aa-9e915cbc7562] Received event network-vif-deleted-d73167a0-1952-4e39-8cc0-0a422a6927b3 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:04:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:24 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "016c8f4b-a226-4226-ba56-8a2b28cea146" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "016c8f4b-a226-4226-ba56-8a2b28cea146" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:24 user nova-compute[74348]: DEBUG nova.compute.manager [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 08:04:24 user nova-compute[74348]: DEBUG nova.compute.manager [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 08:04:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 08:04:24 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Instance spawned successfully.
Nov 22 08:04:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 08:04:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:04:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:04:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:04:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:04:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:04:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:04:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:24 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 08:04:24 user nova-compute[74348]: INFO nova.compute.claims [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Claim successful on node user
Nov 22 08:04:24 user nova-compute[74348]: INFO nova.compute.manager [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Took 6.15 seconds to spawn the instance on the hypervisor.
Nov 22 08:04:24 user nova-compute[74348]: DEBUG nova.compute.manager [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:04:25 user nova-compute[74348]: DEBUG nova.compute.manager [req-a95c0832-0f81-441a-8d7d-ed4e1cf58099 req-a520e69b-fd29-4027-8af6-90b048517e82 service nova] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Received event network-vif-plugged-011479b6-f8d6-48e2-b215-789b56c4a2ad {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:04:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a95c0832-0f81-441a-8d7d-ed4e1cf58099 req-a520e69b-fd29-4027-8af6-90b048517e82 service nova] Acquiring lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a95c0832-0f81-441a-8d7d-ed4e1cf58099 req-a520e69b-fd29-4027-8af6-90b048517e82 service nova] Lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a95c0832-0f81-441a-8d7d-ed4e1cf58099 req-a520e69b-fd29-4027-8af6-90b048517e82 service nova] Lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:25 user nova-compute[74348]: DEBUG nova.compute.manager [req-a95c0832-0f81-441a-8d7d-ed4e1cf58099 req-a520e69b-fd29-4027-8af6-90b048517e82 service nova] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] No waiting events found dispatching network-vif-plugged-011479b6-f8d6-48e2-b215-789b56c4a2ad {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:04:25 user nova-compute[74348]: WARNING nova.compute.manager [req-a95c0832-0f81-441a-8d7d-ed4e1cf58099 req-a520e69b-fd29-4027-8af6-90b048517e82 service nova] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Received unexpected event network-vif-plugged-011479b6-f8d6-48e2-b215-789b56c4a2ad for instance with vm_state building and task_state spawning.
Nov 22 08:04:25 user nova-compute[74348]: INFO nova.compute.manager [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Took 7.10 seconds to build instance.
Nov 22 08:04:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-303b93b3-443f-4921-aac6-6cfa9bfff0fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.204s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:25 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:04:25 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:04:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.416s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:25 user nova-compute[74348]: DEBUG nova.compute.manager [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 08:04:25 user nova-compute[74348]: DEBUG nova.compute.manager [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 08:04:25 user nova-compute[74348]: DEBUG nova.network.neutron [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 08:04:25 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 08:04:25 user nova-compute[74348]: DEBUG nova.compute.manager [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 08:04:25 user nova-compute[74348]: DEBUG nova.policy [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '43550ccf30be49aba6ed6de2caf9ae1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62fda81543f461288e324458620d07c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 08:04:25 user nova-compute[74348]: DEBUG nova.compute.manager [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 08:04:25 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 08:04:25 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Creating image(s)
Nov 22 08:04:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "/opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "/opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "/opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.172s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.189s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/disk 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/disk 1073741824" returned: 0 in 0.057s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:26 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:26 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.183s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:26 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Checking if we can resize image /opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/disk. size=1073741824 {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 08:04:26 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:26 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:26 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Cannot resize image /opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/disk to a smaller size. {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 08:04:26 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 08:04:26 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Ensure instance console log exists: /opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 08:04:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:26 user nova-compute[74348]: DEBUG nova.network.neutron [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Successfully created port: 014854c1-b4d7-4c60-830f-8aaa3f65c04c {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 08:04:26 user nova-compute[74348]: DEBUG nova.network.neutron [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Successfully updated port: 014854c1-b4d7-4c60-830f-8aaa3f65c04c {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "refresh_cache-016c8f4b-a226-4226-ba56-8a2b28cea146" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquired lock "refresh_cache-016c8f4b-a226-4226-ba56-8a2b28cea146" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG nova.network.neutron [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG nova.compute.manager [req-6ee43a22-c5b3-43c3-a9e7-1ef8b856f81f req-3dedb982-cd3d-43fc-99c1-6468e10c5cd9 service nova] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Received event network-changed-014854c1-b4d7-4c60-830f-8aaa3f65c04c {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG nova.compute.manager [req-6ee43a22-c5b3-43c3-a9e7-1ef8b856f81f req-3dedb982-cd3d-43fc-99c1-6468e10c5cd9 service nova] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Refreshing instance network info cache due to event network-changed-014854c1-b4d7-4c60-830f-8aaa3f65c04c. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-6ee43a22-c5b3-43c3-a9e7-1ef8b856f81f req-3dedb982-cd3d-43fc-99c1-6468e10c5cd9 service nova] Acquiring lock "refresh_cache-016c8f4b-a226-4226-ba56-8a2b28cea146" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG nova.network.neutron [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG nova.network.neutron [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Updating instance_info_cache with network_info: [{"id": "014854c1-b4d7-4c60-830f-8aaa3f65c04c", "address": "fa:16:3e:b7:7f:68", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014854c1-b4", "ovs_interfaceid": "014854c1-b4d7-4c60-830f-8aaa3f65c04c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Releasing lock "refresh_cache-016c8f4b-a226-4226-ba56-8a2b28cea146" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG nova.compute.manager [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Instance network_info: |[{"id": "014854c1-b4d7-4c60-830f-8aaa3f65c04c", "address": "fa:16:3e:b7:7f:68", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014854c1-b4", "ovs_interfaceid": "014854c1-b4d7-4c60-830f-8aaa3f65c04c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-6ee43a22-c5b3-43c3-a9e7-1ef8b856f81f req-3dedb982-cd3d-43fc-99c1-6468e10c5cd9 service nova] Acquired lock "refresh_cache-016c8f4b-a226-4226-ba56-8a2b28cea146" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG nova.network.neutron [req-6ee43a22-c5b3-43c3-a9e7-1ef8b856f81f req-3dedb982-cd3d-43fc-99c1-6468e10c5cd9 service nova] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Refreshing network info cache for port 014854c1-b4d7-4c60-830f-8aaa3f65c04c {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Start _get_guest_xml network_info=[{"id": "014854c1-b4d7-4c60-830f-8aaa3f65c04c", "address": "fa:16:3e:b7:7f:68", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014854c1-b4", "ovs_interfaceid": "014854c1-b4d7-4c60-830f-8aaa3f65c04c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 08:04:27 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:04:27 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:04:27 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:04:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1819188158',display_name='tempest-tempest.common.compute-instance-1819188158',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1819188158',id=33,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNd3+zQ71IrK3H/CeT/5sXY1BokTseqCM2aIkmRs++g+CAAgDFEf4yV5acjjuqLPFktfJ9gL8iuTvbEWurIg6VoeZwI5FnuAIzcoEVdZSVWfuZAGh4IJYsK7izDsTE/MYw==',key_name='tempest-keypair-568155222',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d62fda81543f461288e324458620d07c',ramdisk_id='',reservation_id='r-0gzl4a3w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-90817446',owner_user_name='tempest-ServerActionsTestOtherA-90817446-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:04:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43550ccf30be49aba6ed6de2caf9ae1e',uuid=016c8f4b-a226-4226-ba56-8a2b28cea146,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "014854c1-b4d7-4c60-830f-8aaa3f65c04c", "address": "fa:16:3e:b7:7f:68", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014854c1-b4", "ovs_interfaceid": "014854c1-b4d7-4c60-830f-8aaa3f65c04c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Converting VIF {"id": "014854c1-b4d7-4c60-830f-8aaa3f65c04c", "address": "fa:16:3e:b7:7f:68", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014854c1-b4", "ovs_interfaceid": "014854c1-b4d7-4c60-830f-8aaa3f65c04c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:7f:68,bridge_name='br-int',has_traffic_filtering=True,id=014854c1-b4d7-4c60-830f-8aaa3f65c04c,network=Network(9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap014854c1-b4') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG nova.objects.instance [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lazy-loading 'pci_devices' on Instance uuid 016c8f4b-a226-4226-ba56-8a2b28cea146 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] End _get_guest_xml xml=<domain type="kvm">
Nov 22 08:04:27 user nova-compute[74348]:   <uuid>016c8f4b-a226-4226-ba56-8a2b28cea146</uuid>
Nov 22 08:04:27 user nova-compute[74348]:   <name>instance-00000021</name>
Nov 22 08:04:27 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 08:04:27 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 08:04:27 user nova-compute[74348]:   <metadata>
Nov 22 08:04:27 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 08:04:27 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 08:04:27 user nova-compute[74348]:       <nova:name>tempest-tempest.common.compute-instance-1819188158</nova:name>
Nov 22 08:04:27 user nova-compute[74348]:       <nova:creationTime>2023-11-22 08:04:27</nova:creationTime>
Nov 22 08:04:27 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 08:04:27 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 08:04:27 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 08:04:27 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 08:04:27 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 08:04:27 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 08:04:27 user nova-compute[74348]:       </nova:flavor>
Nov 22 08:04:27 user nova-compute[74348]:       <nova:owner>
Nov 22 08:04:27 user nova-compute[74348]:         <nova:user uuid="43550ccf30be49aba6ed6de2caf9ae1e">tempest-ServerActionsTestOtherA-90817446-project-member</nova:user>
Nov 22 08:04:27 user nova-compute[74348]:         <nova:project uuid="d62fda81543f461288e324458620d07c">tempest-ServerActionsTestOtherA-90817446</nova:project>
Nov 22 08:04:27 user nova-compute[74348]:       </nova:owner>
Nov 22 08:04:27 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 08:04:27 user nova-compute[74348]:       <nova:ports>
Nov 22 08:04:27 user nova-compute[74348]:         <nova:port uuid="014854c1-b4d7-4c60-830f-8aaa3f65c04c">
Nov 22 08:04:27 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 22 08:04:27 user nova-compute[74348]:         </nova:port>
Nov 22 08:04:27 user nova-compute[74348]:       </nova:ports>
Nov 22 08:04:27 user nova-compute[74348]:     </nova:instance>
Nov 22 08:04:27 user nova-compute[74348]:   </metadata>
Nov 22 08:04:27 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 08:04:27 user nova-compute[74348]:     <system>
Nov 22 08:04:27 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 08:04:27 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 08:04:27 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 08:04:27 user nova-compute[74348]:       <entry name="serial">016c8f4b-a226-4226-ba56-8a2b28cea146</entry>
Nov 22 08:04:27 user nova-compute[74348]:       <entry name="uuid">016c8f4b-a226-4226-ba56-8a2b28cea146</entry>
Nov 22 08:04:27 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 08:04:27 user nova-compute[74348]:     </system>
Nov 22 08:04:27 user nova-compute[74348]:   </sysinfo>
Nov 22 08:04:27 user nova-compute[74348]:   <os>
Nov 22 08:04:27 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 08:04:27 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 08:04:27 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 08:04:27 user nova-compute[74348]:   </os>
Nov 22 08:04:27 user nova-compute[74348]:   <features>
Nov 22 08:04:27 user nova-compute[74348]:     <acpi/>
Nov 22 08:04:27 user nova-compute[74348]:     <apic/>
Nov 22 08:04:27 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 08:04:27 user nova-compute[74348]:   </features>
Nov 22 08:04:27 user nova-compute[74348]:   <clock offset="utc">
Nov 22 08:04:27 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 08:04:27 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 08:04:27 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 08:04:27 user nova-compute[74348]:   </clock>
Nov 22 08:04:27 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 08:04:27 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 08:04:27 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 08:04:27 user nova-compute[74348]:   </cpu>
Nov 22 08:04:27 user nova-compute[74348]:   <devices>
Nov 22 08:04:27 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 08:04:27 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 08:04:27 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/disk"/>
Nov 22 08:04:27 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 08:04:27 user nova-compute[74348]:     </disk>
Nov 22 08:04:27 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 08:04:27 user nova-compute[74348]:       <mac address="fa:16:3e:b7:7f:68"/>
Nov 22 08:04:27 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:04:27 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 08:04:27 user nova-compute[74348]:       <target dev="tap014854c1-b4"/>
Nov 22 08:04:27 user nova-compute[74348]:     </interface>
Nov 22 08:04:27 user nova-compute[74348]:     <serial type="pty">
Nov 22 08:04:27 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/console.log" append="off"/>
Nov 22 08:04:27 user nova-compute[74348]:     </serial>
Nov 22 08:04:27 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 08:04:27 user nova-compute[74348]:     <video>
Nov 22 08:04:27 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:04:27 user nova-compute[74348]:     </video>
Nov 22 08:04:27 user nova-compute[74348]:     <rng model="virtio">
Nov 22 08:04:27 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 08:04:27 user nova-compute[74348]:     </rng>
Nov 22 08:04:27 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 08:04:27 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 08:04:27 user nova-compute[74348]:       <stats period="10"/>
Nov 22 08:04:27 user nova-compute[74348]:     </memballoon>
Nov 22 08:04:27 user nova-compute[74348]:   </devices>
Nov 22 08:04:27 user nova-compute[74348]: </domain>
Nov 22 08:04:27 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:04:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1819188158',display_name='tempest-tempest.common.compute-instance-1819188158',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1819188158',id=33,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNd3+zQ71IrK3H/CeT/5sXY1BokTseqCM2aIkmRs++g+CAAgDFEf4yV5acjjuqLPFktfJ9gL8iuTvbEWurIg6VoeZwI5FnuAIzcoEVdZSVWfuZAGh4IJYsK7izDsTE/MYw==',key_name='tempest-keypair-568155222',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d62fda81543f461288e324458620d07c',ramdisk_id='',reservation_id='r-0gzl4a3w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-90817446',owner_user_name='tempest-ServerActionsTestOtherA-90817446-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:04:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43550ccf30be49aba6ed6de2caf9ae1e',uuid=016c8f4b-a226-4226-ba56-8a2b28cea146,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "014854c1-b4d7-4c60-830f-8aaa3f65c04c", "address": "fa:16:3e:b7:7f:68", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014854c1-b4", "ovs_interfaceid": "014854c1-b4d7-4c60-830f-8aaa3f65c04c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Converting VIF {"id": "014854c1-b4d7-4c60-830f-8aaa3f65c04c", "address": "fa:16:3e:b7:7f:68", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014854c1-b4", "ovs_interfaceid": "014854c1-b4d7-4c60-830f-8aaa3f65c04c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:7f:68,bridge_name='br-int',has_traffic_filtering=True,id=014854c1-b4d7-4c60-830f-8aaa3f65c04c,network=Network(9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap014854c1-b4') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG os_vif [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:7f:68,bridge_name='br-int',has_traffic_filtering=True,id=014854c1-b4d7-4c60-830f-8aaa3f65c04c,network=Network(9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap014854c1-b4') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '67d3fd11-0738-5677-90b7-faf4c1169eab', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap014854c1-b4, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap014854c1-b4, col_values=(('qos', UUID('2e573bb5-a70a-4915-959a-cb4819383ed6')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap014854c1-b4, col_values=(('external_ids', {'iface-id': '014854c1-b4d7-4c60-830f-8aaa3f65c04c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:7f:68', 'vm-uuid': '016c8f4b-a226-4226-ba56-8a2b28cea146'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:27 user nova-compute[74348]: INFO os_vif [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:7f:68,bridge_name='br-int',has_traffic_filtering=True,id=014854c1-b4d7-4c60-830f-8aaa3f65c04c,network=Network(9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap014854c1-b4')
Nov 22 08:04:27 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] No VIF found with MAC fa:16:3e:b7:7f:68, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG nova.network.neutron [req-6ee43a22-c5b3-43c3-a9e7-1ef8b856f81f req-3dedb982-cd3d-43fc-99c1-6468e10c5cd9 service nova] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Updated VIF entry in instance network info cache for port 014854c1-b4d7-4c60-830f-8aaa3f65c04c. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG nova.network.neutron [req-6ee43a22-c5b3-43c3-a9e7-1ef8b856f81f req-3dedb982-cd3d-43fc-99c1-6468e10c5cd9 service nova] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Updating instance_info_cache with network_info: [{"id": "014854c1-b4d7-4c60-830f-8aaa3f65c04c", "address": "fa:16:3e:b7:7f:68", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014854c1-b4", "ovs_interfaceid": "014854c1-b4d7-4c60-830f-8aaa3f65c04c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:04:27 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-6ee43a22-c5b3-43c3-a9e7-1ef8b856f81f req-3dedb982-cd3d-43fc-99c1-6468e10c5cd9 service nova] Releasing lock "refresh_cache-016c8f4b-a226-4226-ba56-8a2b28cea146" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:04:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:29 user nova-compute[74348]: DEBUG nova.compute.manager [req-f47078cc-2fa2-4c45-8951-cdf10cb42937 req-f11c6c16-8d01-4ad8-af64-655621d23462 service nova] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Received event network-vif-plugged-014854c1-b4d7-4c60-830f-8aaa3f65c04c {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:04:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f47078cc-2fa2-4c45-8951-cdf10cb42937 req-f11c6c16-8d01-4ad8-af64-655621d23462 service nova] Acquiring lock "016c8f4b-a226-4226-ba56-8a2b28cea146-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f47078cc-2fa2-4c45-8951-cdf10cb42937 req-f11c6c16-8d01-4ad8-af64-655621d23462 service nova] Lock "016c8f4b-a226-4226-ba56-8a2b28cea146-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f47078cc-2fa2-4c45-8951-cdf10cb42937 req-f11c6c16-8d01-4ad8-af64-655621d23462 service nova] Lock "016c8f4b-a226-4226-ba56-8a2b28cea146-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:29 user nova-compute[74348]: DEBUG nova.compute.manager [req-f47078cc-2fa2-4c45-8951-cdf10cb42937 req-f11c6c16-8d01-4ad8-af64-655621d23462 service nova] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] No waiting events found dispatching network-vif-plugged-014854c1-b4d7-4c60-830f-8aaa3f65c04c {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:04:29 user nova-compute[74348]: WARNING nova.compute.manager [req-f47078cc-2fa2-4c45-8951-cdf10cb42937 req-f11c6c16-8d01-4ad8-af64-655621d23462 service nova] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Received unexpected event network-vif-plugged-014854c1-b4d7-4c60-830f-8aaa3f65c04c for instance with vm_state building and task_state spawning.
Nov 22 08:04:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:31 user nova-compute[74348]: DEBUG nova.compute.manager [req-12cd9b8b-6369-496d-b3ee-04e13f7fd06b req-cd6465b9-6519-494c-873c-dc6e79770a79 service nova] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Received event network-vif-plugged-014854c1-b4d7-4c60-830f-8aaa3f65c04c {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:04:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-12cd9b8b-6369-496d-b3ee-04e13f7fd06b req-cd6465b9-6519-494c-873c-dc6e79770a79 service nova] Acquiring lock "016c8f4b-a226-4226-ba56-8a2b28cea146-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-12cd9b8b-6369-496d-b3ee-04e13f7fd06b req-cd6465b9-6519-494c-873c-dc6e79770a79 service nova] Lock "016c8f4b-a226-4226-ba56-8a2b28cea146-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-12cd9b8b-6369-496d-b3ee-04e13f7fd06b req-cd6465b9-6519-494c-873c-dc6e79770a79 service nova] Lock "016c8f4b-a226-4226-ba56-8a2b28cea146-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:31 user nova-compute[74348]: DEBUG nova.compute.manager [req-12cd9b8b-6369-496d-b3ee-04e13f7fd06b req-cd6465b9-6519-494c-873c-dc6e79770a79 service nova] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] No waiting events found dispatching network-vif-plugged-014854c1-b4d7-4c60-830f-8aaa3f65c04c {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:04:31 user nova-compute[74348]: WARNING nova.compute.manager [req-12cd9b8b-6369-496d-b3ee-04e13f7fd06b req-cd6465b9-6519-494c-873c-dc6e79770a79 service nova] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Received unexpected event network-vif-plugged-014854c1-b4d7-4c60-830f-8aaa3f65c04c for instance with vm_state building and task_state spawning.
Nov 22 08:04:31 user nova-compute[74348]: DEBUG nova.compute.manager [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 08:04:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 08:04:31 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Instance spawned successfully.
Nov 22 08:04:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 08:04:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:04:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:04:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:04:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:04:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:04:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:04:31 user nova-compute[74348]: INFO nova.compute.manager [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Took 6.15 seconds to spawn the instance on the hypervisor.
Nov 22 08:04:31 user nova-compute[74348]: DEBUG nova.compute.manager [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:04:31 user nova-compute[74348]: INFO nova.compute.manager [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Took 6.93 seconds to build instance.
Nov 22 08:04:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9d7cbc05-4e04-457a-a41b-d10afb11bff8 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "016c8f4b-a226-4226-ba56-8a2b28cea146" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.022s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:34 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:04:34 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:04:34 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Didn't find any instances for network info cache update. {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 08:04:34 user nova-compute[74348]: INFO nova.compute.manager [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Rescuing
Nov 22 08:04:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquiring lock "refresh_cache-ba74ca7d-2875-426c-a485-d908af865bae" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:04:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquired lock "refresh_cache-ba74ca7d-2875-426c-a485-d908af865bae" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:04:34 user nova-compute[74348]: DEBUG nova.network.neutron [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:04:35 user nova-compute[74348]: DEBUG nova.network.neutron [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Updating instance_info_cache with network_info: [{"id": "674629a8-f3d5-41f1-a3d8-fbd957b97ad9", "address": "fa:16:3e:46:7e:d8", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap674629a8-f3", "ovs_interfaceid": "674629a8-f3d5-41f1-a3d8-fbd957b97ad9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:04:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Releasing lock "refresh_cache-ba74ca7d-2875-426c-a485-d908af865bae" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:04:35 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:35 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:35 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:35 user nova-compute[74348]: DEBUG nova.compute.manager [req-42afa469-9620-47b1-a78b-3240897c54c2 req-047d2781-11d2-4aed-bc1c-05e7d7fff3aa service nova] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Received event network-vif-unplugged-674629a8-f3d5-41f1-a3d8-fbd957b97ad9 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:04:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-42afa469-9620-47b1-a78b-3240897c54c2 req-047d2781-11d2-4aed-bc1c-05e7d7fff3aa service nova] Acquiring lock "ba74ca7d-2875-426c-a485-d908af865bae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-42afa469-9620-47b1-a78b-3240897c54c2 req-047d2781-11d2-4aed-bc1c-05e7d7fff3aa service nova] Lock "ba74ca7d-2875-426c-a485-d908af865bae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-42afa469-9620-47b1-a78b-3240897c54c2 req-047d2781-11d2-4aed-bc1c-05e7d7fff3aa service nova] Lock "ba74ca7d-2875-426c-a485-d908af865bae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:35 user nova-compute[74348]: DEBUG nova.compute.manager [req-42afa469-9620-47b1-a78b-3240897c54c2 req-047d2781-11d2-4aed-bc1c-05e7d7fff3aa service nova] [instance: ba74ca7d-2875-426c-a485-d908af865bae] No waiting events found dispatching network-vif-unplugged-674629a8-f3d5-41f1-a3d8-fbd957b97ad9 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:04:35 user nova-compute[74348]: WARNING nova.compute.manager [req-42afa469-9620-47b1-a78b-3240897c54c2 req-047d2781-11d2-4aed-bc1c-05e7d7fff3aa service nova] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Received unexpected event network-vif-unplugged-674629a8-f3d5-41f1-a3d8-fbd957b97ad9 for instance with vm_state active and task_state rescuing.
Nov 22 08:04:35 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:36 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Instance destroyed successfully.
Nov 22 08:04:36 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Attempting rescue
Nov 22 08:04:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74348) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 22 08:04:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Instance directory exists: not creating {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 22 08:04:36 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Creating image(s)
Nov 22 08:04:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquiring lock "/opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "/opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "/opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:36 user nova-compute[74348]: DEBUG nova.objects.instance [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lazy-loading 'trusted_certs' on Instance uuid ba74ca7d-2875-426c-a485-d908af865bae {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:04:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquiring lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.185s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue" returned: 0 in 0.063s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:36 user nova-compute[74348]: DEBUG nova.objects.instance [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lazy-loading 'migration_context' on Instance uuid ba74ca7d-2875-426c-a485-d908af865bae {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:04:36 user nova-compute[74348]: DEBUG nova.objects.base [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Object Instance<ba74ca7d-2875-426c-a485-d908af865bae> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:04:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 08:04:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Start _get_guest_xml network_info=[{"id": "674629a8-f3d5-41f1-a3d8-fbd957b97ad9", "address": "fa:16:3e:46:7e:d8", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "vif_mac": "fa:16:3e:46:7e:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap674629a8-f3", "ovs_interfaceid": "674629a8-f3d5-41f1-a3d8-fbd957b97ad9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 08:04:36 user nova-compute[74348]: DEBUG nova.objects.instance [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lazy-loading 'resources' on Instance uuid ba74ca7d-2875-426c-a485-d908af865bae {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:04:36 user nova-compute[74348]: DEBUG nova.objects.base [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Object Instance<ba74ca7d-2875-426c-a485-d908af865bae> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:04:36 user nova-compute[74348]: DEBUG nova.objects.instance [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lazy-loading 'numa_topology' on Instance uuid ba74ca7d-2875-426c-a485-d908af865bae {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:04:36 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:04:36 user nova-compute[74348]: DEBUG nova.objects.base [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Object Instance<ba74ca7d-2875-426c-a485-d908af865bae> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:04:36 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:04:36 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:04:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 08:04:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 08:04:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 08:04:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 08:04:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 08:04:36 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 08:04:36 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 08:04:36 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 08:04:36 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 08:04:36 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 08:04:36 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 08:04:36 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 08:04:36 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 08:04:36 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 08:04:36 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 08:04:36 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 08:04:36 user nova-compute[74348]: DEBUG nova.objects.instance [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lazy-loading 'vcpu_model' on Instance uuid ba74ca7d-2875-426c-a485-d908af865bae {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:04:36 user nova-compute[74348]: DEBUG nova.objects.base [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Object Instance<ba74ca7d-2875-426c-a485-d908af865bae> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:04:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:02:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1470868857',display_name='tempest-ServerRescueNegativeTestJSON-server-1470868857',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1470868857',id=29,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:02:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d975b772fea4ed98b1b3ad284e51a65',ramdisk_id='',reservation_id='r-wa0y0kht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1773499839',owner_user_name='tempest-ServerRescueNegativeTestJSON-1773499839-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:02:53Z,user_data=None,user_id='0b3c6587d0764b9fae5782792aec5d92',uuid=ba74ca7d-2875-426c-a485-d908af865bae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "674629a8-f3d5-41f1-a3d8-fbd957b97ad9", "address": "fa:16:3e:46:7e:d8", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "vif_mac": "fa:16:3e:46:7e:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap674629a8-f3", "ovs_interfaceid": "674629a8-f3d5-41f1-a3d8-fbd957b97ad9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 08:04:36 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Converting VIF {"id": "674629a8-f3d5-41f1-a3d8-fbd957b97ad9", "address": "fa:16:3e:46:7e:d8", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "vif_mac": "fa:16:3e:46:7e:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap674629a8-f3", "ovs_interfaceid": "674629a8-f3d5-41f1-a3d8-fbd957b97ad9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:04:36 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:7e:d8,bridge_name='br-int',has_traffic_filtering=True,id=674629a8-f3d5-41f1-a3d8-fbd957b97ad9,network=Network(246d8f55-a1eb-4883-906c-69f15289caef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap674629a8-f3') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:04:36 user nova-compute[74348]: DEBUG nova.objects.instance [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lazy-loading 'pci_devices' on Instance uuid ba74ca7d-2875-426c-a485-d908af865bae {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:04:36 user nova-compute[74348]: DEBUG nova.objects.base [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Object Instance<ba74ca7d-2875-426c-a485-d908af865bae> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:04:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] End _get_guest_xml xml=<domain type="kvm">
Nov 22 08:04:36 user nova-compute[74348]:   <uuid>ba74ca7d-2875-426c-a485-d908af865bae</uuid>
Nov 22 08:04:36 user nova-compute[74348]:   <name>instance-0000001d</name>
Nov 22 08:04:36 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 08:04:36 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 08:04:36 user nova-compute[74348]:   <metadata>
Nov 22 08:04:36 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 08:04:36 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 08:04:36 user nova-compute[74348]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1470868857</nova:name>
Nov 22 08:04:36 user nova-compute[74348]:       <nova:creationTime>2023-11-22 08:04:36</nova:creationTime>
Nov 22 08:04:36 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 08:04:36 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 08:04:36 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 08:04:36 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 08:04:36 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 08:04:36 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 08:04:36 user nova-compute[74348]:       </nova:flavor>
Nov 22 08:04:36 user nova-compute[74348]:       <nova:owner>
Nov 22 08:04:36 user nova-compute[74348]:         <nova:user uuid="0b3c6587d0764b9fae5782792aec5d92">tempest-ServerRescueNegativeTestJSON-1773499839-project-member</nova:user>
Nov 22 08:04:36 user nova-compute[74348]:         <nova:project uuid="5d975b772fea4ed98b1b3ad284e51a65">tempest-ServerRescueNegativeTestJSON-1773499839</nova:project>
Nov 22 08:04:36 user nova-compute[74348]:       </nova:owner>
Nov 22 08:04:36 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 08:04:36 user nova-compute[74348]:       <nova:ports>
Nov 22 08:04:36 user nova-compute[74348]:         <nova:port uuid="674629a8-f3d5-41f1-a3d8-fbd957b97ad9">
Nov 22 08:04:36 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 22 08:04:36 user nova-compute[74348]:         </nova:port>
Nov 22 08:04:36 user nova-compute[74348]:       </nova:ports>
Nov 22 08:04:36 user nova-compute[74348]:     </nova:instance>
Nov 22 08:04:36 user nova-compute[74348]:   </metadata>
Nov 22 08:04:36 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 08:04:36 user nova-compute[74348]:     <system>
Nov 22 08:04:36 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 08:04:36 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 08:04:36 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 08:04:36 user nova-compute[74348]:       <entry name="serial">ba74ca7d-2875-426c-a485-d908af865bae</entry>
Nov 22 08:04:36 user nova-compute[74348]:       <entry name="uuid">ba74ca7d-2875-426c-a485-d908af865bae</entry>
Nov 22 08:04:36 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 08:04:36 user nova-compute[74348]:     </system>
Nov 22 08:04:36 user nova-compute[74348]:   </sysinfo>
Nov 22 08:04:36 user nova-compute[74348]:   <os>
Nov 22 08:04:36 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 08:04:36 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 08:04:36 user nova-compute[74348]:   </os>
Nov 22 08:04:36 user nova-compute[74348]:   <features>
Nov 22 08:04:36 user nova-compute[74348]:     <acpi/>
Nov 22 08:04:36 user nova-compute[74348]:     <apic/>
Nov 22 08:04:36 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 08:04:36 user nova-compute[74348]:   </features>
Nov 22 08:04:36 user nova-compute[74348]:   <clock offset="utc">
Nov 22 08:04:36 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 08:04:36 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 08:04:36 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 08:04:36 user nova-compute[74348]:   </clock>
Nov 22 08:04:36 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 08:04:36 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 08:04:36 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 08:04:36 user nova-compute[74348]:   </cpu>
Nov 22 08:04:36 user nova-compute[74348]:   <devices>
Nov 22 08:04:36 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 08:04:36 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 08:04:36 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue"/>
Nov 22 08:04:36 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 08:04:36 user nova-compute[74348]:     </disk>
Nov 22 08:04:36 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 08:04:36 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 08:04:36 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk"/>
Nov 22 08:04:36 user nova-compute[74348]:       <target dev="vdb" bus="virtio"/>
Nov 22 08:04:36 user nova-compute[74348]:     </disk>
Nov 22 08:04:36 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 08:04:36 user nova-compute[74348]:       <mac address="fa:16:3e:46:7e:d8"/>
Nov 22 08:04:36 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:04:36 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 08:04:36 user nova-compute[74348]:       <target dev="tap674629a8-f3"/>
Nov 22 08:04:36 user nova-compute[74348]:     </interface>
Nov 22 08:04:36 user nova-compute[74348]:     <serial type="pty">
Nov 22 08:04:36 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/console.log" append="off"/>
Nov 22 08:04:36 user nova-compute[74348]:     </serial>
Nov 22 08:04:36 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 08:04:36 user nova-compute[74348]:     <video>
Nov 22 08:04:36 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:04:36 user nova-compute[74348]:     </video>
Nov 22 08:04:36 user nova-compute[74348]:     <rng model="virtio">
Nov 22 08:04:36 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 08:04:36 user nova-compute[74348]:     </rng>
Nov 22 08:04:36 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 08:04:36 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 08:04:36 user nova-compute[74348]:       <stats period="10"/>
Nov 22 08:04:36 user nova-compute[74348]:     </memballoon>
Nov 22 08:04:36 user nova-compute[74348]:   </devices>
Nov 22 08:04:36 user nova-compute[74348]: </domain>
Nov 22 08:04:36 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 08:04:36 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Instance destroyed successfully.
Nov 22 08:04:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:04:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:04:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] No VIF found with MAC fa:16:3e:46:7e:d8, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:04:37 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:37 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:04:37 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:04:37 user nova-compute[74348]: DEBUG nova.compute.manager [req-9d5069d4-5389-46fc-adc7-ea75f1d32d3e req-1f853ab6-2722-4d25-b244-9284c4b93014 service nova] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Received event network-vif-plugged-674629a8-f3d5-41f1-a3d8-fbd957b97ad9 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:04:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9d5069d4-5389-46fc-adc7-ea75f1d32d3e req-1f853ab6-2722-4d25-b244-9284c4b93014 service nova] Acquiring lock "ba74ca7d-2875-426c-a485-d908af865bae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9d5069d4-5389-46fc-adc7-ea75f1d32d3e req-1f853ab6-2722-4d25-b244-9284c4b93014 service nova] Lock "ba74ca7d-2875-426c-a485-d908af865bae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9d5069d4-5389-46fc-adc7-ea75f1d32d3e req-1f853ab6-2722-4d25-b244-9284c4b93014 service nova] Lock "ba74ca7d-2875-426c-a485-d908af865bae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:37 user nova-compute[74348]: DEBUG nova.compute.manager [req-9d5069d4-5389-46fc-adc7-ea75f1d32d3e req-1f853ab6-2722-4d25-b244-9284c4b93014 service nova] [instance: ba74ca7d-2875-426c-a485-d908af865bae] No waiting events found dispatching network-vif-plugged-674629a8-f3d5-41f1-a3d8-fbd957b97ad9 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:04:37 user nova-compute[74348]: WARNING nova.compute.manager [req-9d5069d4-5389-46fc-adc7-ea75f1d32d3e req-1f853ab6-2722-4d25-b244-9284c4b93014 service nova] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Received unexpected event network-vif-plugged-674629a8-f3d5-41f1-a3d8-fbd957b97ad9 for instance with vm_state active and task_state rescuing.
Nov 22 08:04:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:38 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:04:38 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:04:38 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:04:39 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:39 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:04:39 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:04:39 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:04:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:39 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:04:39 user nova-compute[74348]: DEBUG nova.compute.manager [req-87de744f-8062-46ea-9061-84b8cda21b9a req-c5f75ead-fe6d-4c9c-a024-b9367bd22372 service nova] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Received event network-vif-plugged-674629a8-f3d5-41f1-a3d8-fbd957b97ad9 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:04:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-87de744f-8062-46ea-9061-84b8cda21b9a req-c5f75ead-fe6d-4c9c-a024-b9367bd22372 service nova] Acquiring lock "ba74ca7d-2875-426c-a485-d908af865bae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-87de744f-8062-46ea-9061-84b8cda21b9a req-c5f75ead-fe6d-4c9c-a024-b9367bd22372 service nova] Lock "ba74ca7d-2875-426c-a485-d908af865bae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-87de744f-8062-46ea-9061-84b8cda21b9a req-c5f75ead-fe6d-4c9c-a024-b9367bd22372 service nova] Lock "ba74ca7d-2875-426c-a485-d908af865bae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:39 user nova-compute[74348]: DEBUG nova.compute.manager [req-87de744f-8062-46ea-9061-84b8cda21b9a req-c5f75ead-fe6d-4c9c-a024-b9367bd22372 service nova] [instance: ba74ca7d-2875-426c-a485-d908af865bae] No waiting events found dispatching network-vif-plugged-674629a8-f3d5-41f1-a3d8-fbd957b97ad9 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:04:39 user nova-compute[74348]: WARNING nova.compute.manager [req-87de744f-8062-46ea-9061-84b8cda21b9a req-c5f75ead-fe6d-4c9c-a024-b9367bd22372 service nova] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Received unexpected event network-vif-plugged-674629a8-f3d5-41f1-a3d8-fbd957b97ad9 for instance with vm_state active and task_state rescuing.
Nov 22 08:04:39 user nova-compute[74348]: DEBUG nova.compute.manager [req-87de744f-8062-46ea-9061-84b8cda21b9a req-c5f75ead-fe6d-4c9c-a024-b9367bd22372 service nova] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Received event network-vif-plugged-674629a8-f3d5-41f1-a3d8-fbd957b97ad9 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:04:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-87de744f-8062-46ea-9061-84b8cda21b9a req-c5f75ead-fe6d-4c9c-a024-b9367bd22372 service nova] Acquiring lock "ba74ca7d-2875-426c-a485-d908af865bae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-87de744f-8062-46ea-9061-84b8cda21b9a req-c5f75ead-fe6d-4c9c-a024-b9367bd22372 service nova] Lock "ba74ca7d-2875-426c-a485-d908af865bae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-87de744f-8062-46ea-9061-84b8cda21b9a req-c5f75ead-fe6d-4c9c-a024-b9367bd22372 service nova] Lock "ba74ca7d-2875-426c-a485-d908af865bae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:39 user nova-compute[74348]: DEBUG nova.compute.manager [req-87de744f-8062-46ea-9061-84b8cda21b9a req-c5f75ead-fe6d-4c9c-a024-b9367bd22372 service nova] [instance: ba74ca7d-2875-426c-a485-d908af865bae] No waiting events found dispatching network-vif-plugged-674629a8-f3d5-41f1-a3d8-fbd957b97ad9 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:04:39 user nova-compute[74348]: WARNING nova.compute.manager [req-87de744f-8062-46ea-9061-84b8cda21b9a req-c5f75ead-fe6d-4c9c-a024-b9367bd22372 service nova] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Received unexpected event network-vif-plugged-674629a8-f3d5-41f1-a3d8-fbd957b97ad9 for instance with vm_state active and task_state rescuing.
Nov 22 08:04:40 user nova-compute[74348]: DEBUG nova.compute.manager [None req-395d0ede-8e96-4276-a63d-41d730c1ab92 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:04:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:41 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:04:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6698b0d-0d43-47ea-bcdc-d99201d9833c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6698b0d-0d43-47ea-bcdc-d99201d9833c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6698b0d-0d43-47ea-bcdc-d99201d9833c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6698b0d-0d43-47ea-bcdc-d99201d9833c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:41 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:04:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:44 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a00543c8-2d8f-4f63-aa4d-01582a90775d/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a00543c8-2d8f-4f63-aa4d-01582a90775d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a00543c8-2d8f-4f63-aa4d-01582a90775d/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a00543c8-2d8f-4f63-aa4d-01582a90775d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a31128a9-fc24-4a42-acdb-a50dfd64446e/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a31128a9-fc24-4a42-acdb-a50dfd64446e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a31128a9-fc24-4a42-acdb-a50dfd64446e/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a31128a9-fc24-4a42-acdb-a50dfd64446e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:45 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:04:45 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:04:45 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=7516MB free_disk=24.832080841064453GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:04:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:45 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 765f8c47-c042-4430-8d35-07926ad693fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:04:45 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance b8f84c0b-fab5-4900-bf65-270c9c06baf8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:04:45 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 37c93c2a-1397-4b04-aef1-5068218ad9fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:04:45 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 5006cff5-4b67-405d-b6b1-4c355f82d920 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:04:45 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 555f4246-d4b2-4f2f-b91c-dda8fe47264c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:04:45 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance ba74ca7d-2875-426c-a485-d908af865bae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:04:45 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance a31128a9-fc24-4a42-acdb-a50dfd64446e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:04:45 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance a00543c8-2d8f-4f63-aa4d-01582a90775d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:04:45 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:04:45 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance b6698b0d-0d43-47ea-bcdc-d99201d9833c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:04:45 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 016c8f4b-a226-4226-ba56-8a2b28cea146 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:04:45 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:04:45 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:04:46 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:04:46 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:04:46 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:04:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.791s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:49 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:04:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Acquiring lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:53 user nova-compute[74348]: DEBUG nova.compute.manager [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 08:04:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:54 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 08:04:54 user nova-compute[74348]: INFO nova.compute.claims [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Claim successful on node user
Nov 22 08:04:54 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:04:54 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:04:54 user nova-compute[74348]: DEBUG nova.compute.manager [req-ddb3c33b-14fe-4ffe-901d-ae1c139d7f18 req-117b0e66-8631-4f92-b72f-fce633852b12 service nova] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Received event network-changed-5e33f324-c04a-4be4-b29f-61b75abcd8ba {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:04:54 user nova-compute[74348]: DEBUG nova.compute.manager [req-ddb3c33b-14fe-4ffe-901d-ae1c139d7f18 req-117b0e66-8631-4f92-b72f-fce633852b12 service nova] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Refreshing instance network info cache due to event network-changed-5e33f324-c04a-4be4-b29f-61b75abcd8ba. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:04:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-ddb3c33b-14fe-4ffe-901d-ae1c139d7f18 req-117b0e66-8631-4f92-b72f-fce633852b12 service nova] Acquiring lock "refresh_cache-a31128a9-fc24-4a42-acdb-a50dfd64446e" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:04:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-ddb3c33b-14fe-4ffe-901d-ae1c139d7f18 req-117b0e66-8631-4f92-b72f-fce633852b12 service nova] Acquired lock "refresh_cache-a31128a9-fc24-4a42-acdb-a50dfd64446e" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:04:54 user nova-compute[74348]: DEBUG nova.network.neutron [req-ddb3c33b-14fe-4ffe-901d-ae1c139d7f18 req-117b0e66-8631-4f92-b72f-fce633852b12 service nova] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Refreshing network info cache for port 5e33f324-c04a-4be4-b29f-61b75abcd8ba {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:04:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.538s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:54 user nova-compute[74348]: DEBUG nova.compute.manager [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 08:04:54 user nova-compute[74348]: DEBUG nova.compute.manager [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 08:04:54 user nova-compute[74348]: DEBUG nova.network.neutron [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 08:04:54 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 08:04:54 user nova-compute[74348]: DEBUG nova.compute.manager [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 08:04:54 user nova-compute[74348]: DEBUG nova.policy [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cbd1eed03be64a42b8ba9d0200b10692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d76d03d17cc4e5bb52a32a2f8fbd629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 08:04:55 user nova-compute[74348]: DEBUG nova.compute.manager [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 08:04:55 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 08:04:55 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Creating image(s)
Nov 22 08:04:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Acquiring lock "/opt/stack/data/nova/instances/4fcddbef-dfaf-48a5-8561-26b8857fdbd6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "/opt/stack/data/nova/instances/4fcddbef-dfaf-48a5-8561-26b8857fdbd6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "/opt/stack/data/nova/instances/4fcddbef-dfaf-48a5-8561-26b8857fdbd6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Acquiring lock "0f06c382829d3f4aaafb7d4b649f1ad2bf44f3dc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "0f06c382829d3f4aaafb7d4b649f1ad2bf44f3dc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f06c382829d3f4aaafb7d4b649f1ad2bf44f3dc.part --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f06c382829d3f4aaafb7d4b649f1ad2bf44f3dc.part --force-share --output=json" returned: 0 in 0.312s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:56 user nova-compute[74348]: DEBUG nova.virt.images [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] 3a9f4e5f-c016-4fc5-ae4f-5f934efeb6ce was qcow2, converting to raw {{(pid=74348) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 22 08:04:56 user nova-compute[74348]: DEBUG nova.privsep.utils [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74348) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 08:04:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0f06c382829d3f4aaafb7d4b649f1ad2bf44f3dc.part /opt/stack/data/nova/instances/_base/0f06c382829d3f4aaafb7d4b649f1ad2bf44f3dc.converted {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:56 user nova-compute[74348]: DEBUG nova.network.neutron [req-ddb3c33b-14fe-4ffe-901d-ae1c139d7f18 req-117b0e66-8631-4f92-b72f-fce633852b12 service nova] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Updated VIF entry in instance network info cache for port 5e33f324-c04a-4be4-b29f-61b75abcd8ba. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:04:56 user nova-compute[74348]: DEBUG nova.network.neutron [req-ddb3c33b-14fe-4ffe-901d-ae1c139d7f18 req-117b0e66-8631-4f92-b72f-fce633852b12 service nova] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Updating instance_info_cache with network_info: [{"id": "5e33f324-c04a-4be4-b29f-61b75abcd8ba", "address": "fa:16:3e:f8:ab:0b", "network": {"id": "5c50496a-0882-415b-8115-ddf7b65516a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-531638472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f569146bb9b04838ad8044260da6ad58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e33f324-c0", "ovs_interfaceid": "5e33f324-c04a-4be4-b29f-61b75abcd8ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:04:56 user nova-compute[74348]: DEBUG nova.network.neutron [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Successfully created port: 71e66d69-de38-4524-8517-ce8bba4a01e0 {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 08:04:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-ddb3c33b-14fe-4ffe-901d-ae1c139d7f18 req-117b0e66-8631-4f92-b72f-fce633852b12 service nova] Releasing lock "refresh_cache-a31128a9-fc24-4a42-acdb-a50dfd64446e" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:04:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0f06c382829d3f4aaafb7d4b649f1ad2bf44f3dc.part /opt/stack/data/nova/instances/_base/0f06c382829d3f4aaafb7d4b649f1ad2bf44f3dc.converted" returned: 0 in 0.616s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f06c382829d3f4aaafb7d4b649f1ad2bf44f3dc.converted --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:56 user nova-compute[74348]: DEBUG nova.objects.instance [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lazy-loading 'flavor' on Instance uuid 37c93c2a-1397-4b04-aef1-5068218ad9fd {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:04:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquiring lock "refresh_cache-37c93c2a-1397-4b04-aef1-5068218ad9fd" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:04:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquired lock "refresh_cache-37c93c2a-1397-4b04-aef1-5068218ad9fd" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:04:56 user nova-compute[74348]: DEBUG nova.network.neutron [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:04:56 user nova-compute[74348]: DEBUG nova.objects.instance [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lazy-loading 'info_cache' on Instance uuid 37c93c2a-1397-4b04-aef1-5068218ad9fd {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:04:56 user nova-compute[74348]: DEBUG nova.objects.base [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Object Instance<37c93c2a-1397-4b04-aef1-5068218ad9fd> lazy-loaded attributes: flavor,info_cache {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:04:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f06c382829d3f4aaafb7d4b649f1ad2bf44f3dc.converted --force-share --output=json" returned: 0 in 0.185s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "0f06c382829d3f4aaafb7d4b649f1ad2bf44f3dc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.988s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f06c382829d3f4aaafb7d4b649f1ad2bf44f3dc --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f06c382829d3f4aaafb7d4b649f1ad2bf44f3dc --force-share --output=json" returned: 0 in 0.177s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Acquiring lock "0f06c382829d3f4aaafb7d4b649f1ad2bf44f3dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "0f06c382829d3f4aaafb7d4b649f1ad2bf44f3dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f06c382829d3f4aaafb7d4b649f1ad2bf44f3dc --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f06c382829d3f4aaafb7d4b649f1ad2bf44f3dc --force-share --output=json" returned: 0 in 0.166s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f06c382829d3f4aaafb7d4b649f1ad2bf44f3dc,backing_fmt=raw /opt/stack/data/nova/instances/4fcddbef-dfaf-48a5-8561-26b8857fdbd6/disk 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f06c382829d3f4aaafb7d4b649f1ad2bf44f3dc,backing_fmt=raw /opt/stack/data/nova/instances/4fcddbef-dfaf-48a5-8561-26b8857fdbd6/disk 1073741824" returned: 0 in 0.055s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "0f06c382829d3f4aaafb7d4b649f1ad2bf44f3dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f06c382829d3f4aaafb7d4b649f1ad2bf44f3dc --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f06c382829d3f4aaafb7d4b649f1ad2bf44f3dc --force-share --output=json" returned: 0 in 0.202s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:57 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4fcddbef-dfaf-48a5-8561-26b8857fdbd6/disk. size=1073741824 {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 08:04:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fcddbef-dfaf-48a5-8561-26b8857fdbd6/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fcddbef-dfaf-48a5-8561-26b8857fdbd6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:57 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Cannot resize image /opt/stack/data/nova/instances/4fcddbef-dfaf-48a5-8561-26b8857fdbd6/disk to a smaller size. {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 08:04:57 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 08:04:57 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Ensure instance console log exists: /opt/stack/data/nova/instances/4fcddbef-dfaf-48a5-8561-26b8857fdbd6/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 08:04:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "a31128a9-fc24-4a42-acdb-a50dfd64446e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "a31128a9-fc24-4a42-acdb-a50dfd64446e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:57 user nova-compute[74348]: DEBUG nova.objects.instance [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lazy-loading 'flavor' on Instance uuid a31128a9-fc24-4a42-acdb-a50dfd64446e {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:04:57 user nova-compute[74348]: DEBUG nova.network.neutron [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Successfully updated port: 71e66d69-de38-4524-8517-ce8bba4a01e0 {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "a31128a9-fc24-4a42-acdb-a50dfd64446e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Acquiring lock "refresh_cache-4fcddbef-dfaf-48a5-8561-26b8857fdbd6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Acquired lock "refresh_cache-4fcddbef-dfaf-48a5-8561-26b8857fdbd6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.network.neutron [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.network.neutron [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Updating instance_info_cache with network_info: [{"id": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "address": "fa:16:3e:62:f2:83", "network": {"id": "606a7c22-1285-47e8-bfa0-f09dbd7cb9ac", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-63336037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d1a2eb68ef4c0aa5ef081fe10877a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc2d56f-68", "ovs_interfaceid": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.network.neutron [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.compute.manager [req-59c304ad-3027-4c17-9ef0-f75b201b0a93 req-82361840-7f27-4cae-9874-2b801f2fb4a3 service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Received event network-changed-71e66d69-de38-4524-8517-ce8bba4a01e0 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.compute.manager [req-59c304ad-3027-4c17-9ef0-f75b201b0a93 req-82361840-7f27-4cae-9874-2b801f2fb4a3 service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Refreshing instance network info cache due to event network-changed-71e66d69-de38-4524-8517-ce8bba4a01e0. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-59c304ad-3027-4c17-9ef0-f75b201b0a93 req-82361840-7f27-4cae-9874-2b801f2fb4a3 service nova] Acquiring lock "refresh_cache-4fcddbef-dfaf-48a5-8561-26b8857fdbd6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Releasing lock "refresh_cache-37c93c2a-1397-4b04-aef1-5068218ad9fd" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:04:58 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Instance destroyed successfully.
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.objects.instance [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lazy-loading 'resources' on Instance uuid 37c93c2a-1397-4b04-aef1-5068218ad9fd {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.objects.base [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Object Instance<37c93c2a-1397-4b04-aef1-5068218ad9fd> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:00:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1956019398',display_name='tempest-AttachVolumeTestJSON-server-1956019398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1956019398',id=25,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwMcyh7MC6umn3uaanqgBLVw0olRPhsYeJZiuWM01oPuW2lMJM3v/uqqmw2CyNdCKwv23YM7ilvhBeMmJnwDV2ZnrEjaT/V3wGmEnZHbCJZSu5Yo+sT9JeBTaahsZul6Q==',key_name='tempest-keypair-1490397787',keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:01:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e2d1a2eb68ef4c0aa5ef081fe10877a9',ramdisk_id='',reservation_id='r-37qth7ay',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-608656879',owner_user_name='tempest-AttachVolumeTestJSON-608656879-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T08:03:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae8c7082420f4b85a9009ff82296d8cb',uuid=37c93c2a-1397-4b04-aef1-5068218ad9fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "address": "fa:16:3e:62:f2:83", "network": {"id": "606a7c22-1285-47e8-bfa0-f09dbd7cb9ac", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-63336037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d1a2eb68ef4c0aa5ef081fe10877a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc2d56f-68", "ovs_interfaceid": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Converting VIF {"id": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "address": "fa:16:3e:62:f2:83", "network": {"id": "606a7c22-1285-47e8-bfa0-f09dbd7cb9ac", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-63336037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d1a2eb68ef4c0aa5ef081fe10877a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc2d56f-68", "ovs_interfaceid": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:f2:83,bridge_name='br-int',has_traffic_filtering=True,id=acc2d56f-6884-403d-b2e5-2eb64c40047f,network=Network(606a7c22-1285-47e8-bfa0-f09dbd7cb9ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc2d56f-68') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG os_vif [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:f2:83,bridge_name='br-int',has_traffic_filtering=True,id=acc2d56f-6884-403d-b2e5-2eb64c40047f,network=Network(606a7c22-1285-47e8-bfa0-f09dbd7cb9ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc2d56f-68') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapacc2d56f-68, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3edc90a9-436a-45ea-ae1d-3d715d5a8849) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:58 user nova-compute[74348]: INFO os_vif [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:f2:83,bridge_name='br-int',has_traffic_filtering=True,id=acc2d56f-6884-403d-b2e5-2eb64c40047f,network=Network(606a7c22-1285-47e8-bfa0-f09dbd7cb9ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc2d56f-68')
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mfrDalSe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:04:58 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:04:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e37af04-88ce-4b73-ad83-264bf069ba81]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 08:04:58 user nova-compute[74348]: No targets found.
Nov 22 08:04:58 user nova-compute[74348]: iSNS:
Nov 22 08:04:58 user nova-compute[74348]: No targets found.
Nov 22 08:04:58 user nova-compute[74348]: STATIC:
Nov 22 08:04:58 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8
Nov 22 08:04:58 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:04:58 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:04:58 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea
Nov 22 08:04:58 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:04:58 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:04:58 user nova-compute[74348]: FIRMWARE:
Nov 22 08:04:58 user nova-compute[74348]: No targets found.
Nov 22 08:04:58 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 08:04:58 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 08:04:58 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[839a6396-8eb4-49a5-b28b-fddeed030493]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "a31128a9-fc24-4a42-acdb-a50dfd64446e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "a31128a9-fc24-4a42-acdb-a50dfd64446e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:04:58 user nova-compute[74348]: INFO nova.compute.manager [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Attaching volume 641e9a32-8750-4527-a85e-40c9ffa70718 to /dev/vdb
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.network.neutron [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Updating instance_info_cache with network_info: [{"id": "71e66d69-de38-4524-8517-ce8bba4a01e0", "address": "fa:16:3e:b3:59:21", "network": {"id": "442abc57-45e5-4cd7-878e-979afa78c421", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1395369508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d76d03d17cc4e5bb52a32a2f8fbd629", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71e66d69-de", "ovs_interfaceid": "71e66d69-de38-4524-8517-ce8bba4a01e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3da108-32e1-462c-ac70-46b003be675b]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:04:58 user nova-compute[74348]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)
Nov 22 08:04:58 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:04:58 user nova-compute[74348]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)
Nov 22 08:04:58 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f224c2c9990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea'): ({'sdc'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Removing single pathed devices sdc {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Releasing lock "refresh_cache-4fcddbef-dfaf-48a5-8561-26b8857fdbd6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.compute.manager [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Instance network_info: |[{"id": "71e66d69-de38-4524-8517-ce8bba4a01e0", "address": "fa:16:3e:b3:59:21", "network": {"id": "442abc57-45e5-4cd7-878e-979afa78c421", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1395369508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d76d03d17cc4e5bb52a32a2f8fbd629", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71e66d69-de", "ovs_interfaceid": "71e66d69-de38-4524-8517-ce8bba4a01e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-59c304ad-3027-4c17-9ef0-f75b201b0a93 req-82361840-7f27-4cae-9874-2b801f2fb4a3 service nova] Acquired lock "refresh_cache-4fcddbef-dfaf-48a5-8561-26b8857fdbd6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.network.neutron [req-59c304ad-3027-4c17-9ef0-f75b201b0a93 req-82361840-7f27-4cae-9874-2b801f2fb4a3 service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Refreshing network info cache for port 71e66d69-de38-4524-8517-ce8bba4a01e0 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Start _get_guest_xml network_info=[{"id": "71e66d69-de38-4524-8517-ce8bba4a01e0", "address": "fa:16:3e:b3:59:21", "network": {"id": "442abc57-45e5-4cd7-878e-979afa78c421", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1395369508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d76d03d17cc4e5bb52a32a2f8fbd629", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71e66d69-de", "ovs_interfaceid": "71e66d69-de38-4524-8517-ce8bba4a01e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T08:04:51Z,direct_url=<?>,disk_format='qcow2',id=3a9f4e5f-c016-4fc5-ae4f-5f934efeb6ce,min_disk=0,min_ram=0,name='tempest-scenario-img--2097481978',owner='0d76d03d17cc4e5bb52a32a2f8fbd629',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T08:04:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '3a9f4e5f-c016-4fc5-ae4f-5f934efeb6ce'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 08:04:58 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:04:58 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T08:04:51Z,direct_url=<?>,disk_format='qcow2',id=3a9f4e5f-c016-4fc5-ae4f-5f934efeb6ce,min_disk=0,min_ram=0,name='tempest-scenario-img--2097481978',owner='0d76d03d17cc4e5bb52a32a2f8fbd629',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T08:04:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:04:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1735944942',display_name='tempest-TestMinimumBasicScenario-server-1735944942',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1735944942',id=34,image_ref='3a9f4e5f-c016-4fc5-ae4f-5f934efeb6ce',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTA5sa4ucGLk6R4bbbIS1Un+/U1MroRTEfh4B5VVfOPJgVXMPVHmu6UNRu1B4sNfygrP1h9ziVV8ro1ekYrcHpxDc5Z78t7um7MQh6+amXdg0qPuk+qNP8DoQe4H729tg==',key_name='tempest-TestMinimumBasicScenario-1985444712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d76d03d17cc4e5bb52a32a2f8fbd629',ramdisk_id='',reservation_id='r-bv7s35se',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3a9f4e5f-c016-4fc5-ae4f-5f934efeb6ce',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1824455706',owner_user_name='tempest-TestMinimumBasicScenario-1824455706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:04:55Z,user_data=None,user_id='cbd1eed03be64a42b8ba9d0200b10692',uuid=4fcddbef-dfaf-48a5-8561-26b8857fdbd6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71e66d69-de38-4524-8517-ce8bba4a01e0", "address": "fa:16:3e:b3:59:21", "network": {"id": "442abc57-45e5-4cd7-878e-979afa78c421", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1395369508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d76d03d17cc4e5bb52a32a2f8fbd629", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71e66d69-de", "ovs_interfaceid": "71e66d69-de38-4524-8517-ce8bba4a01e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Converting VIF {"id": "71e66d69-de38-4524-8517-ce8bba4a01e0", "address": "fa:16:3e:b3:59:21", "network": {"id": "442abc57-45e5-4cd7-878e-979afa78c421", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1395369508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d76d03d17cc4e5bb52a32a2f8fbd629", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71e66d69-de", "ovs_interfaceid": "71e66d69-de38-4524-8517-ce8bba4a01e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:59:21,bridge_name='br-int',has_traffic_filtering=True,id=71e66d69-de38-4524-8517-ce8bba4a01e0,network=Network(442abc57-45e5-4cd7-878e-979afa78c421),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71e66d69-de') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.objects.instance [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lazy-loading 'pci_devices' on Instance uuid 4fcddbef-dfaf-48a5-8561-26b8857fdbd6 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG os_brick.utils [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.034s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3e5fd9-ec04-44cd-8b25-ac4acc3d9366]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] End _get_guest_xml xml=<domain type="kvm">
Nov 22 08:04:58 user nova-compute[74348]:   <uuid>4fcddbef-dfaf-48a5-8561-26b8857fdbd6</uuid>
Nov 22 08:04:58 user nova-compute[74348]:   <name>instance-00000022</name>
Nov 22 08:04:58 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 08:04:58 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 08:04:58 user nova-compute[74348]:   <metadata>
Nov 22 08:04:58 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 08:04:58 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 08:04:58 user nova-compute[74348]:       <nova:name>tempest-TestMinimumBasicScenario-server-1735944942</nova:name>
Nov 22 08:04:58 user nova-compute[74348]:       <nova:creationTime>2023-11-22 08:04:58</nova:creationTime>
Nov 22 08:04:58 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 08:04:58 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 08:04:58 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 08:04:58 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 08:04:58 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 08:04:58 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 08:04:58 user nova-compute[74348]:       </nova:flavor>
Nov 22 08:04:58 user nova-compute[74348]:       <nova:owner>
Nov 22 08:04:58 user nova-compute[74348]:         <nova:user uuid="cbd1eed03be64a42b8ba9d0200b10692">tempest-TestMinimumBasicScenario-1824455706-project-member</nova:user>
Nov 22 08:04:58 user nova-compute[74348]:         <nova:project uuid="0d76d03d17cc4e5bb52a32a2f8fbd629">tempest-TestMinimumBasicScenario-1824455706</nova:project>
Nov 22 08:04:58 user nova-compute[74348]:       </nova:owner>
Nov 22 08:04:58 user nova-compute[74348]:       <nova:root type="image" uuid="3a9f4e5f-c016-4fc5-ae4f-5f934efeb6ce"/>
Nov 22 08:04:58 user nova-compute[74348]:       <nova:ports>
Nov 22 08:04:58 user nova-compute[74348]:         <nova:port uuid="71e66d69-de38-4524-8517-ce8bba4a01e0">
Nov 22 08:04:58 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 22 08:04:58 user nova-compute[74348]:         </nova:port>
Nov 22 08:04:58 user nova-compute[74348]:       </nova:ports>
Nov 22 08:04:58 user nova-compute[74348]:     </nova:instance>
Nov 22 08:04:58 user nova-compute[74348]:   </metadata>
Nov 22 08:04:58 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 08:04:58 user nova-compute[74348]:     <system>
Nov 22 08:04:58 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 08:04:58 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 08:04:58 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 08:04:58 user nova-compute[74348]:       <entry name="serial">4fcddbef-dfaf-48a5-8561-26b8857fdbd6</entry>
Nov 22 08:04:58 user nova-compute[74348]:       <entry name="uuid">4fcddbef-dfaf-48a5-8561-26b8857fdbd6</entry>
Nov 22 08:04:58 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 08:04:58 user nova-compute[74348]:     </system>
Nov 22 08:04:58 user nova-compute[74348]:   </sysinfo>
Nov 22 08:04:58 user nova-compute[74348]:   <os>
Nov 22 08:04:58 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 08:04:58 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 08:04:58 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 08:04:58 user nova-compute[74348]:   </os>
Nov 22 08:04:58 user nova-compute[74348]:   <features>
Nov 22 08:04:58 user nova-compute[74348]:     <acpi/>
Nov 22 08:04:58 user nova-compute[74348]:     <apic/>
Nov 22 08:04:58 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 08:04:58 user nova-compute[74348]:   </features>
Nov 22 08:04:58 user nova-compute[74348]:   <clock offset="utc">
Nov 22 08:04:58 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 08:04:58 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 08:04:58 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 08:04:58 user nova-compute[74348]:   </clock>
Nov 22 08:04:58 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 08:04:58 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 08:04:58 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 08:04:58 user nova-compute[74348]:   </cpu>
Nov 22 08:04:58 user nova-compute[74348]:   <devices>
Nov 22 08:04:58 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 08:04:58 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 08:04:58 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/4fcddbef-dfaf-48a5-8561-26b8857fdbd6/disk"/>
Nov 22 08:04:58 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 08:04:58 user nova-compute[74348]:     </disk>
Nov 22 08:04:58 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 08:04:58 user nova-compute[74348]:       <mac address="fa:16:3e:b3:59:21"/>
Nov 22 08:04:58 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:04:58 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 08:04:58 user nova-compute[74348]:       <target dev="tap71e66d69-de"/>
Nov 22 08:04:58 user nova-compute[74348]:     </interface>
Nov 22 08:04:58 user nova-compute[74348]:     <serial type="pty">
Nov 22 08:04:58 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/4fcddbef-dfaf-48a5-8561-26b8857fdbd6/console.log" append="off"/>
Nov 22 08:04:58 user nova-compute[74348]:     </serial>
Nov 22 08:04:58 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 08:04:58 user nova-compute[74348]:     <video>
Nov 22 08:04:58 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:04:58 user nova-compute[74348]:     </video>
Nov 22 08:04:58 user nova-compute[74348]:     <rng model="virtio">
Nov 22 08:04:58 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 08:04:58 user nova-compute[74348]:     </rng>
Nov 22 08:04:58 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 08:04:58 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 08:04:58 user nova-compute[74348]:       <stats period="10"/>
Nov 22 08:04:58 user nova-compute[74348]:     </memballoon>
Nov 22 08:04:58 user nova-compute[74348]:   </devices>
Nov 22 08:04:58 user nova-compute[74348]: </domain>
Nov 22 08:04:58 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:04:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1735944942',display_name='tempest-TestMinimumBasicScenario-server-1735944942',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1735944942',id=34,image_ref='3a9f4e5f-c016-4fc5-ae4f-5f934efeb6ce',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTA5sa4ucGLk6R4bbbIS1Un+/U1MroRTEfh4B5VVfOPJgVXMPVHmu6UNRu1B4sNfygrP1h9ziVV8ro1ekYrcHpxDc5Z78t7um7MQh6+amXdg0qPuk+qNP8DoQe4H729tg==',key_name='tempest-TestMinimumBasicScenario-1985444712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d76d03d17cc4e5bb52a32a2f8fbd629',ramdisk_id='',reservation_id='r-bv7s35se',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3a9f4e5f-c016-4fc5-ae4f-5f934efeb6ce',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1824455706',owner_user_name='tempest-TestMinimumBasicScenario-1824455706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:04:55Z,user_data=None,user_id='cbd1eed03be64a42b8ba9d0200b10692',uuid=4fcddbef-dfaf-48a5-8561-26b8857fdbd6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71e66d69-de38-4524-8517-ce8bba4a01e0", "address": "fa:16:3e:b3:59:21", "network": {"id": "442abc57-45e5-4cd7-878e-979afa78c421", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1395369508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d76d03d17cc4e5bb52a32a2f8fbd629", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71e66d69-de", "ovs_interfaceid": "71e66d69-de38-4524-8517-ce8bba4a01e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Converting VIF {"id": "71e66d69-de38-4524-8517-ce8bba4a01e0", "address": "fa:16:3e:b3:59:21", "network": {"id": "442abc57-45e5-4cd7-878e-979afa78c421", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1395369508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d76d03d17cc4e5bb52a32a2f8fbd629", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71e66d69-de", "ovs_interfaceid": "71e66d69-de38-4524-8517-ce8bba4a01e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:59:21,bridge_name='br-int',has_traffic_filtering=True,id=71e66d69-de38-4524-8517-ce8bba4a01e0,network=Network(442abc57-45e5-4cd7-878e-979afa78c421),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71e66d69-de') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG os_vif [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:59:21,bridge_name='br-int',has_traffic_filtering=True,id=71e66d69-de38-4524-8517-ce8bba4a01e0,network=Network(442abc57-45e5-4cd7-878e-979afa78c421),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71e66d69-de') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7df5baa7-478f-5175-b553-f2acedb114b7', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[782257e6-dc73-4420-9659-52081414ce2c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[58dc1900-afec-40b1-961e-9f100f5a1925]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Flushing IO for device /dev/sdc {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71e66d69-de, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap71e66d69-de, col_values=(('qos', UUID('86073795-d955-44dd-a18f-388488a8e631')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap71e66d69-de, col_values=(('external_ids', {'iface-id': '71e66d69-de38-4524-8517-ce8bba4a01e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:59:21', 'vm-uuid': '4fcddbef-dfaf-48a5-8561-26b8857fdbd6'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3e41a3-a696-42fa-97c5-81ecd28158e0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eebc825-eb0d-497e-b7a2-38c571dd8138]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:58 user nova-compute[74348]: INFO os_vif [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:59:21,bridge_name='br-int',has_traffic_filtering=True,id=71e66d69-de38-4524-8517-ce8bba4a01e0,network=Network(442abc57-45e5-4cd7-878e-979afa78c421),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71e66d69-de')
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc84f9e9-ff29-48fc-b3eb-61202b1ab173]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bef6ec8-c947-4385-ba53-22b2715e0299]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c61233-79ca-4a73-9f40-549e9897c07d]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] SCSI volumes sdc have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:04:58 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9efa22-6652-4ea9-b730-fbccbc1b06c6]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG os_brick.utils [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] <== get_connector_properties: return (184ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Updating existing volume attachment record: 8b5675ca-104c-40e7-9eef-e457fe30d9b2 {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4f8952-86ec-4e8a-b1ea-8b857a968610]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] No VIF found with MAC fa:16:3e:b3:59:21, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0ace6a-2444-497b-b235-3e5c395562ea]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea, portal: 172.16.0.220,3260]
Nov 22 08:04:58 user nova-compute[74348]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea, portal: 172.16.0.220,3260] successful.
Nov 22 08:04:58 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4808c564-ebe3-418b-874b-cc70f77d7669]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.451s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] <== disconnect_volume: return (453ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Start _get_guest_xml network_info=[{"id": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "address": "fa:16:3e:62:f2:83", "network": {"id": "606a7c22-1285-47e8-bfa0-f09dbd7cb9ac", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-63336037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d1a2eb68ef4c0aa5ef081fe10877a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc2d56f-68", "ovs_interfaceid": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mfrDalSe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '37c93c2a-1397-4b04-aef1-5068218ad9fd', 'attached_at': '', 'detached_at': '', 'volume_id': '5d3034db-c569-4cd9-ad54-142be23d7dea', 'serial': '5d3034db-c569-4cd9-ad54-142be23d7dea'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'attachment_id': '022a0e53-7f71-414d-931b-5ec5c774b275', 'volume_type': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.objects.instance [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lazy-loading 'numa_topology' on Instance uuid 37c93c2a-1397-4b04-aef1-5068218ad9fd {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.objects.base [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Object Instance<37c93c2a-1397-4b04-aef1-5068218ad9fd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:04:58 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:04:58 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.objects.instance [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lazy-loading 'vcpu_model' on Instance uuid 37c93c2a-1397-4b04-aef1-5068218ad9fd {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.objects.base [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Object Instance<37c93c2a-1397-4b04-aef1-5068218ad9fd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mfrDalSe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:04:58 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:04:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:04:58 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:04:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:04:58 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9c5399-4293-4f80-bec9-e6cfc2141b24]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 08:04:58 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b8014c-5ef6-4274-b886-17b3cac2d5f2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea] added
Nov 22 08:04:58 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:04:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:59 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e21b48-29b7-4c79-b3e5-19689c225a22]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:04:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:04:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:59 user nova-compute[74348]: DEBUG nova.network.neutron [req-59c304ad-3027-4c17-9ef0-f75b201b0a93 req-82361840-7f27-4cae-9874-2b801f2fb4a3 service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Updated VIF entry in instance network info cache for port 71e66d69-de38-4524-8517-ce8bba4a01e0. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:04:59 user nova-compute[74348]: DEBUG nova.network.neutron [req-59c304ad-3027-4c17-9ef0-f75b201b0a93 req-82361840-7f27-4cae-9874-2b801f2fb4a3 service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Updating instance_info_cache with network_info: [{"id": "71e66d69-de38-4524-8517-ce8bba4a01e0", "address": "fa:16:3e:b3:59:21", "network": {"id": "442abc57-45e5-4cd7-878e-979afa78c421", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1395369508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d76d03d17cc4e5bb52a32a2f8fbd629", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71e66d69-de", "ovs_interfaceid": "71e66d69-de38-4524-8517-ce8bba4a01e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:04:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:59 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e90e8c-124d-4877-ba7f-2de000b73cd1]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:04:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:04:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mfrDalSe {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:04:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-59c304ad-3027-4c17-9ef0-f75b201b0a93 req-82361840-7f27-4cae-9874-2b801f2fb4a3 service nova] Releasing lock "refresh_cache-4fcddbef-dfaf-48a5-8561-26b8857fdbd6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:04:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mfrDalSe" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:59 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fa5e2a-58ee-40c8-bcc8-21760c93493f]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:04:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mfrDalSe'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:04:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:59 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[265e8f6c-3514-4922-a85d-0ff3a2afbace]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:04:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:04:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:59 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b285b25-bc2a-4df5-bf28-6eb9703fe96d]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:04:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:04:59 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:04:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:04:59 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:04:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:59 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[28649d6f-af61-4bb9-b77b-b41e04348eef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:04:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea, portal: 172.16.0.220,3260]
Nov 22 08:04:59 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea, portal: 172.16.0.220,3260] successful.
Nov 22 08:04:59 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:04:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.064s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:59 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a479218b-5f5c-4212-8b26-e379e78fb12a]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:04:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:04:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:59 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6c161a-a467-4387-869f-0722c440e2ae]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:04:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:04:59 user nova-compute[74348]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)
Nov 22 08:04:59 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:04:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:04:59 user nova-compute[74348]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)
Nov 22 08:04:59 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:04:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.398s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:04:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 08:04:59 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 08:04:59 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 08:04:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:04:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:04:59 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[171ccfa5-879d-4a33-90ed-481f7e9a0a67]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:04:59 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:04:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mfrDalSe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 08:05:00 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:00 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:00 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:00 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.434s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:05:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] <== connect_volume: return (1435ms) {'type': 'block', 'scsi_wwn': '23937386232393063', 'path': '/dev/sdc'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:05:00 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937386232393063', 'path': '/dev/sdc'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 08:05:00 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:00:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1956019398',display_name='tempest-AttachVolumeTestJSON-server-1956019398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1956019398',id=25,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwMcyh7MC6umn3uaanqgBLVw0olRPhsYeJZiuWM01oPuW2lMJM3v/uqqmw2CyNdCKwv23YM7ilvhBeMmJnwDV2ZnrEjaT/V3wGmEnZHbCJZSu5Yo+sT9JeBTaahsZul6Q==',key_name='tempest-keypair-1490397787',keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:01:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e2d1a2eb68ef4c0aa5ef081fe10877a9',ramdisk_id='',reservation_id='r-37qth7ay',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-608656879',owner_user_name='tempest-AttachVolumeTestJSON-608656879-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T08:03:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae8c7082420f4b85a9009ff82296d8cb',uuid=37c93c2a-1397-4b04-aef1-5068218ad9fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "address": "fa:16:3e:62:f2:83", "network": {"id": "606a7c22-1285-47e8-bfa0-f09dbd7cb9ac", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-63336037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d1a2eb68ef4c0aa5ef081fe10877a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc2d56f-68", "ovs_interfaceid": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 08:05:00 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Converting VIF {"id": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "address": "fa:16:3e:62:f2:83", "network": {"id": "606a7c22-1285-47e8-bfa0-f09dbd7cb9ac", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-63336037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d1a2eb68ef4c0aa5ef081fe10877a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc2d56f-68", "ovs_interfaceid": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:05:00 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:f2:83,bridge_name='br-int',has_traffic_filtering=True,id=acc2d56f-6884-403d-b2e5-2eb64c40047f,network=Network(606a7c22-1285-47e8-bfa0-f09dbd7cb9ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc2d56f-68') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:05:00 user nova-compute[74348]: DEBUG nova.objects.instance [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lazy-loading 'pci_devices' on Instance uuid 37c93c2a-1397-4b04-aef1-5068218ad9fd {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:05:00 user nova-compute[74348]: DEBUG nova.objects.base [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Object Instance<37c93c2a-1397-4b04-aef1-5068218ad9fd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:05:00 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] End _get_guest_xml xml=<domain type="kvm">
Nov 22 08:05:00 user nova-compute[74348]:   <uuid>37c93c2a-1397-4b04-aef1-5068218ad9fd</uuid>
Nov 22 08:05:00 user nova-compute[74348]:   <name>instance-00000019</name>
Nov 22 08:05:00 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 08:05:00 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 08:05:00 user nova-compute[74348]:   <metadata>
Nov 22 08:05:00 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 08:05:00 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 08:05:00 user nova-compute[74348]:       <nova:name>tempest-AttachVolumeTestJSON-server-1956019398</nova:name>
Nov 22 08:05:00 user nova-compute[74348]:       <nova:creationTime>2023-11-22 08:04:58</nova:creationTime>
Nov 22 08:05:00 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 08:05:00 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 08:05:00 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 08:05:00 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 08:05:00 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 08:05:00 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 08:05:00 user nova-compute[74348]:       </nova:flavor>
Nov 22 08:05:00 user nova-compute[74348]:       <nova:owner>
Nov 22 08:05:00 user nova-compute[74348]:         <nova:user uuid="ae8c7082420f4b85a9009ff82296d8cb">tempest-AttachVolumeTestJSON-608656879-project-member</nova:user>
Nov 22 08:05:00 user nova-compute[74348]:         <nova:project uuid="e2d1a2eb68ef4c0aa5ef081fe10877a9">tempest-AttachVolumeTestJSON-608656879</nova:project>
Nov 22 08:05:00 user nova-compute[74348]:       </nova:owner>
Nov 22 08:05:00 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 08:05:00 user nova-compute[74348]:       <nova:ports>
Nov 22 08:05:00 user nova-compute[74348]:         <nova:port uuid="acc2d56f-6884-403d-b2e5-2eb64c40047f">
Nov 22 08:05:00 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 22 08:05:00 user nova-compute[74348]:         </nova:port>
Nov 22 08:05:00 user nova-compute[74348]:       </nova:ports>
Nov 22 08:05:00 user nova-compute[74348]:     </nova:instance>
Nov 22 08:05:00 user nova-compute[74348]:   </metadata>
Nov 22 08:05:00 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 08:05:00 user nova-compute[74348]:     <system>
Nov 22 08:05:00 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 08:05:00 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 08:05:00 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 08:05:00 user nova-compute[74348]:       <entry name="serial">37c93c2a-1397-4b04-aef1-5068218ad9fd</entry>
Nov 22 08:05:00 user nova-compute[74348]:       <entry name="uuid">37c93c2a-1397-4b04-aef1-5068218ad9fd</entry>
Nov 22 08:05:00 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 08:05:00 user nova-compute[74348]:     </system>
Nov 22 08:05:00 user nova-compute[74348]:   </sysinfo>
Nov 22 08:05:00 user nova-compute[74348]:   <os>
Nov 22 08:05:00 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 08:05:00 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 08:05:00 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 08:05:00 user nova-compute[74348]:   </os>
Nov 22 08:05:00 user nova-compute[74348]:   <features>
Nov 22 08:05:00 user nova-compute[74348]:     <acpi/>
Nov 22 08:05:00 user nova-compute[74348]:     <apic/>
Nov 22 08:05:00 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 08:05:00 user nova-compute[74348]:   </features>
Nov 22 08:05:00 user nova-compute[74348]:   <clock offset="utc">
Nov 22 08:05:00 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 08:05:00 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 08:05:00 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 08:05:00 user nova-compute[74348]:   </clock>
Nov 22 08:05:00 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 08:05:00 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 08:05:00 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 08:05:00 user nova-compute[74348]:   </cpu>
Nov 22 08:05:00 user nova-compute[74348]:   <devices>
Nov 22 08:05:00 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 08:05:00 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 08:05:00 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk"/>
Nov 22 08:05:00 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 08:05:00 user nova-compute[74348]:     </disk>
Nov 22 08:05:00 user nova-compute[74348]:     <disk type="block" device="disk">
Nov 22 08:05:00 user nova-compute[74348]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:05:00 user nova-compute[74348]:       <source dev="/dev/sdc"/>
Nov 22 08:05:00 user nova-compute[74348]:       <target dev="vdb" bus="virtio"/>
Nov 22 08:05:00 user nova-compute[74348]:       <serial>5d3034db-c569-4cd9-ad54-142be23d7dea</serial>
Nov 22 08:05:00 user nova-compute[74348]:     </disk>
Nov 22 08:05:00 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 08:05:00 user nova-compute[74348]:       <mac address="fa:16:3e:62:f2:83"/>
Nov 22 08:05:00 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:05:00 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 08:05:00 user nova-compute[74348]:       <target dev="tapacc2d56f-68"/>
Nov 22 08:05:00 user nova-compute[74348]:     </interface>
Nov 22 08:05:00 user nova-compute[74348]:     <serial type="pty">
Nov 22 08:05:00 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/console.log" append="off"/>
Nov 22 08:05:00 user nova-compute[74348]:     </serial>
Nov 22 08:05:00 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 08:05:00 user nova-compute[74348]:     <video>
Nov 22 08:05:00 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:05:00 user nova-compute[74348]:     </video>
Nov 22 08:05:00 user nova-compute[74348]:     <rng model="virtio">
Nov 22 08:05:00 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 08:05:00 user nova-compute[74348]:     </rng>
Nov 22 08:05:00 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 08:05:00 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 08:05:00 user nova-compute[74348]:       <stats period="10"/>
Nov 22 08:05:00 user nova-compute[74348]:     </memballoon>
Nov 22 08:05:00 user nova-compute[74348]:   </devices>
Nov 22 08:05:00 user nova-compute[74348]: </domain>
Nov 22 08:05:00 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 08:05:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:00 user nova-compute[74348]: DEBUG nova.compute.manager [req-037deaa8-a943-4076-8440-959c8bccec0e req-a661a0fa-0af0-47e4-a662-62a4125a467b service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Received event network-vif-plugged-71e66d69-de38-4524-8517-ce8bba4a01e0 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:05:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-037deaa8-a943-4076-8440-959c8bccec0e req-a661a0fa-0af0-47e4-a662-62a4125a467b service nova] Acquiring lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:05:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-037deaa8-a943-4076-8440-959c8bccec0e req-a661a0fa-0af0-47e4-a662-62a4125a467b service nova] Lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.014s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:05:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-037deaa8-a943-4076-8440-959c8bccec0e req-a661a0fa-0af0-47e4-a662-62a4125a467b service nova] Lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:05:00 user nova-compute[74348]: DEBUG nova.compute.manager [req-037deaa8-a943-4076-8440-959c8bccec0e req-a661a0fa-0af0-47e4-a662-62a4125a467b service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] No waiting events found dispatching network-vif-plugged-71e66d69-de38-4524-8517-ce8bba4a01e0 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:05:00 user nova-compute[74348]: WARNING nova.compute.manager [req-037deaa8-a943-4076-8440-959c8bccec0e req-a661a0fa-0af0-47e4-a662-62a4125a467b service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Received unexpected event network-vif-plugged-71e66d69-de38-4524-8517-ce8bba4a01e0 for instance with vm_state building and task_state spawning.
Nov 22 08:05:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:00 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:05:00 user nova-compute[74348]: DEBUG nova.objects.instance [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lazy-loading 'trusted_certs' on Instance uuid 37c93c2a-1397-4b04-aef1-5068218ad9fd {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:05:00 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:00 user nova-compute[74348]: DEBUG nova.objects.base [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Object Instance<37c93c2a-1397-4b04-aef1-5068218ad9fd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:05:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.201s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:01 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Checking if we can resize image /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk. size=1073741824 {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 08:05:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:01 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Cannot resize image /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk to a smaller size. {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 08:05:01 user nova-compute[74348]: DEBUG nova.objects.instance [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lazy-loading 'migration_context' on Instance uuid 37c93c2a-1397-4b04-aef1-5068218ad9fd {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:05:01 user nova-compute[74348]: DEBUG nova.objects.base [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Object Instance<37c93c2a-1397-4b04-aef1-5068218ad9fd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:05:01 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:00:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1956019398',display_name='tempest-AttachVolumeTestJSON-server-1956019398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1956019398',id=25,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwMcyh7MC6umn3uaanqgBLVw0olRPhsYeJZiuWM01oPuW2lMJM3v/uqqmw2CyNdCKwv23YM7ilvhBeMmJnwDV2ZnrEjaT/V3wGmEnZHbCJZSu5Yo+sT9JeBTaahsZul6Q==',key_name='tempest-keypair-1490397787',keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:01:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='e2d1a2eb68ef4c0aa5ef081fe10877a9',ramdisk_id='',reservation_id='r-37qth7ay',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-608656879',owner_user_name='tempest-AttachVolumeTestJSON-608656879-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:03:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae8c7082420f4b85a9009ff82296d8cb',uuid=37c93c2a-1397-4b04-aef1-5068218ad9fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "address": "fa:16:3e:62:f2:83", "network": {"id": "606a7c22-1285-47e8-bfa0-f09dbd7cb9ac", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-63336037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d1a2eb68ef4c0aa5ef081fe10877a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc2d56f-68", "ovs_interfaceid": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 08:05:01 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Converting VIF {"id": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "address": "fa:16:3e:62:f2:83", "network": {"id": "606a7c22-1285-47e8-bfa0-f09dbd7cb9ac", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-63336037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d1a2eb68ef4c0aa5ef081fe10877a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc2d56f-68", "ovs_interfaceid": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:05:01 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:f2:83,bridge_name='br-int',has_traffic_filtering=True,id=acc2d56f-6884-403d-b2e5-2eb64c40047f,network=Network(606a7c22-1285-47e8-bfa0-f09dbd7cb9ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc2d56f-68') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:05:01 user nova-compute[74348]: DEBUG os_vif [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:f2:83,bridge_name='br-int',has_traffic_filtering=True,id=acc2d56f-6884-403d-b2e5-2eb64c40047f,network=Network(606a7c22-1285-47e8-bfa0-f09dbd7cb9ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc2d56f-68') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 08:05:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:05:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 08:05:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4a180c9d-5588-5a6b-b08e-82b4a489dd60', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:05:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:05:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapacc2d56f-68, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:05:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapacc2d56f-68, col_values=(('qos', UUID('f31436ce-b3fa-4fe9-8560-bcd42ee42b9c')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:05:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapacc2d56f-68, col_values=(('external_ids', {'iface-id': 'acc2d56f-6884-403d-b2e5-2eb64c40047f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:f2:83', 'vm-uuid': '37c93c2a-1397-4b04-aef1-5068218ad9fd'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:05:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:05:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:01 user nova-compute[74348]: INFO os_vif [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:f2:83,bridge_name='br-int',has_traffic_filtering=True,id=acc2d56f-6884-403d-b2e5-2eb64c40047f,network=Network(606a7c22-1285-47e8-bfa0-f09dbd7cb9ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc2d56f-68')
Nov 22 08:05:02 user nova-compute[74348]: DEBUG nova.compute.manager [req-a01459b3-ea46-4732-809e-74fc16e4f2e4 req-2dedb645-ccc7-4aa8-8480-911893dd935f service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Received event network-vif-plugged-71e66d69-de38-4524-8517-ce8bba4a01e0 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:05:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a01459b3-ea46-4732-809e-74fc16e4f2e4 req-2dedb645-ccc7-4aa8-8480-911893dd935f service nova] Acquiring lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:05:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a01459b3-ea46-4732-809e-74fc16e4f2e4 req-2dedb645-ccc7-4aa8-8480-911893dd935f service nova] Lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:05:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a01459b3-ea46-4732-809e-74fc16e4f2e4 req-2dedb645-ccc7-4aa8-8480-911893dd935f service nova] Lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:05:02 user nova-compute[74348]: DEBUG nova.compute.manager [req-a01459b3-ea46-4732-809e-74fc16e4f2e4 req-2dedb645-ccc7-4aa8-8480-911893dd935f service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] No waiting events found dispatching network-vif-plugged-71e66d69-de38-4524-8517-ce8bba4a01e0 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:05:02 user nova-compute[74348]: WARNING nova.compute.manager [req-a01459b3-ea46-4732-809e-74fc16e4f2e4 req-2dedb645-ccc7-4aa8-8480-911893dd935f service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Received unexpected event network-vif-plugged-71e66d69-de38-4524-8517-ce8bba4a01e0 for instance with vm_state building and task_state spawning.
Nov 22 08:05:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ab9bae4d-e567-4e99-8108-c480282ebea4 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Acquiring lock "a00543c8-2d8f-4f63-aa4d-01582a90775d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:05:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ab9bae4d-e567-4e99-8108-c480282ebea4 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Lock "a00543c8-2d8f-4f63-aa4d-01582a90775d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:05:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ab9bae4d-e567-4e99-8108-c480282ebea4 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Acquiring lock "a00543c8-2d8f-4f63-aa4d-01582a90775d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:05:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ab9bae4d-e567-4e99-8108-c480282ebea4 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Lock "a00543c8-2d8f-4f63-aa4d-01582a90775d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:05:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ab9bae4d-e567-4e99-8108-c480282ebea4 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Lock "a00543c8-2d8f-4f63-aa4d-01582a90775d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:05:02 user nova-compute[74348]: INFO nova.compute.manager [None req-ab9bae4d-e567-4e99-8108-c480282ebea4 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Terminating instance
Nov 22 08:05:02 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ab9bae4d-e567-4e99-8108-c480282ebea4 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 08:05:02 user nova-compute[74348]: DEBUG nova.compute.manager [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 08:05:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 08:05:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:02 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Instance spawned successfully.
Nov 22 08:05:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 08:05:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:05:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:05:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:05:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:05:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:05:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:05:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:03 user nova-compute[74348]: INFO nova.compute.manager [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Took 8.10 seconds to spawn the instance on the hypervisor.
Nov 22 08:05:03 user nova-compute[74348]: DEBUG nova.compute.manager [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:05:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:03 user nova-compute[74348]: INFO nova.compute.manager [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Took 9.16 seconds to build instance.
Nov 22 08:05:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-05ecf601-b0e6-4a0f-b230-6baedf81ce78 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.391s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:05:03 user nova-compute[74348]: DEBUG nova.compute.manager [req-7e5e3857-08e1-463c-92e8-bb6e84d8d3b5 req-203aa427-44d5-4986-9622-074568937b42 service nova] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Received event network-vif-unplugged-3218c3ca-293c-41e8-96c5-1550439e96d0 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:05:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-7e5e3857-08e1-463c-92e8-bb6e84d8d3b5 req-203aa427-44d5-4986-9622-074568937b42 service nova] Acquiring lock "a00543c8-2d8f-4f63-aa4d-01582a90775d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:05:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-7e5e3857-08e1-463c-92e8-bb6e84d8d3b5 req-203aa427-44d5-4986-9622-074568937b42 service nova] Lock "a00543c8-2d8f-4f63-aa4d-01582a90775d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:05:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-7e5e3857-08e1-463c-92e8-bb6e84d8d3b5 req-203aa427-44d5-4986-9622-074568937b42 service nova] Lock "a00543c8-2d8f-4f63-aa4d-01582a90775d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:05:03 user nova-compute[74348]: DEBUG nova.compute.manager [req-7e5e3857-08e1-463c-92e8-bb6e84d8d3b5 req-203aa427-44d5-4986-9622-074568937b42 service nova] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] No waiting events found dispatching network-vif-unplugged-3218c3ca-293c-41e8-96c5-1550439e96d0 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:05:03 user nova-compute[74348]: DEBUG nova.compute.manager [req-7e5e3857-08e1-463c-92e8-bb6e84d8d3b5 req-203aa427-44d5-4986-9622-074568937b42 service nova] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Received event network-vif-unplugged-3218c3ca-293c-41e8-96c5-1550439e96d0 for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 08:05:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:03 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Instance destroyed successfully.
Nov 22 08:05:03 user nova-compute[74348]: DEBUG nova.objects.instance [None req-ab9bae4d-e567-4e99-8108-c480282ebea4 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Lazy-loading 'resources' on Instance uuid a00543c8-2d8f-4f63-aa4d-01582a90775d {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:05:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-ab9bae4d-e567-4e99-8108-c480282ebea4 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:03:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-300150518',display_name='tempest-VolumesActionsTest-instance-300150518',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-300150518',id=31,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:03:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d9ac02b435a54124b9b8cfc3afeb9e57',ramdisk_id='',reservation_id='r-4cuscpwr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1791306803',owner_user_name='tempest-VolumesActionsTest-1791306803-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T08:03:15Z,user_data=None,user_id='03aac0b5680c431592326486b1d030b9',uuid=a00543c8-2d8f-4f63-aa4d-01582a90775d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3218c3ca-293c-41e8-96c5-1550439e96d0", "address": "fa:16:3e:99:13:fb", "network": {"id": "58371390-13da-4593-a6f1-32b2c60f5e7d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2101379319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ac02b435a54124b9b8cfc3afeb9e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3218c3ca-29", "ovs_interfaceid": "3218c3ca-293c-41e8-96c5-1550439e96d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:05:03 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-ab9bae4d-e567-4e99-8108-c480282ebea4 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Converting VIF {"id": "3218c3ca-293c-41e8-96c5-1550439e96d0", "address": "fa:16:3e:99:13:fb", "network": {"id": "58371390-13da-4593-a6f1-32b2c60f5e7d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2101379319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ac02b435a54124b9b8cfc3afeb9e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3218c3ca-29", "ovs_interfaceid": "3218c3ca-293c-41e8-96c5-1550439e96d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:05:03 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-ab9bae4d-e567-4e99-8108-c480282ebea4 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:13:fb,bridge_name='br-int',has_traffic_filtering=True,id=3218c3ca-293c-41e8-96c5-1550439e96d0,network=Network(58371390-13da-4593-a6f1-32b2c60f5e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3218c3ca-29') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:05:03 user nova-compute[74348]: DEBUG os_vif [None req-ab9bae4d-e567-4e99-8108-c480282ebea4 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:13:fb,bridge_name='br-int',has_traffic_filtering=True,id=3218c3ca-293c-41e8-96c5-1550439e96d0,network=Network(58371390-13da-4593-a6f1-32b2c60f5e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3218c3ca-29') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:05:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3218c3ca-29, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:05:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:05:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ce3e9e7e-ca3a-4ca4-9035-c83adecb232a) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:05:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:03 user nova-compute[74348]: INFO os_vif [None req-ab9bae4d-e567-4e99-8108-c480282ebea4 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:13:fb,bridge_name='br-int',has_traffic_filtering=True,id=3218c3ca-293c-41e8-96c5-1550439e96d0,network=Network(58371390-13da-4593-a6f1-32b2c60f5e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3218c3ca-29')
Nov 22 08:05:03 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-ab9bae4d-e567-4e99-8108-c480282ebea4 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Deleting instance files /opt/stack/data/nova/instances/a00543c8-2d8f-4f63-aa4d-01582a90775d_del
Nov 22 08:05:03 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-ab9bae4d-e567-4e99-8108-c480282ebea4 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Deletion of /opt/stack/data/nova/instances/a00543c8-2d8f-4f63-aa4d-01582a90775d_del complete
Nov 22 08:05:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:04 user nova-compute[74348]: INFO nova.compute.manager [None req-ab9bae4d-e567-4e99-8108-c480282ebea4 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Took 1.29 seconds to destroy the instance on the hypervisor.
Nov 22 08:05:04 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-ab9bae4d-e567-4e99-8108-c480282ebea4 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 08:05:04 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 08:05:04 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 08:05:04 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:05:04 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Took 0.46 seconds to deallocate network for instance.
Nov 22 08:05:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ab9bae4d-e567-4e99-8108-c480282ebea4 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:05:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ab9bae4d-e567-4e99-8108-c480282ebea4 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:05:04 user nova-compute[74348]: DEBUG nova.compute.manager [req-c0bb48f1-884a-4562-91d1-28ee8e8548b3 req-192a1c46-f3bf-425e-bb5f-f37ffd9edacd service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Received event network-vif-plugged-acc2d56f-6884-403d-b2e5-2eb64c40047f {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:05:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c0bb48f1-884a-4562-91d1-28ee8e8548b3 req-192a1c46-f3bf-425e-bb5f-f37ffd9edacd service nova] Acquiring lock "37c93c2a-1397-4b04-aef1-5068218ad9fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:05:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c0bb48f1-884a-4562-91d1-28ee8e8548b3 req-192a1c46-f3bf-425e-bb5f-f37ffd9edacd service nova] Lock "37c93c2a-1397-4b04-aef1-5068218ad9fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:05:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c0bb48f1-884a-4562-91d1-28ee8e8548b3 req-192a1c46-f3bf-425e-bb5f-f37ffd9edacd service nova] Lock "37c93c2a-1397-4b04-aef1-5068218ad9fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:05:04 user nova-compute[74348]: DEBUG nova.compute.manager [req-c0bb48f1-884a-4562-91d1-28ee8e8548b3 req-192a1c46-f3bf-425e-bb5f-f37ffd9edacd service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] No waiting events found dispatching network-vif-plugged-acc2d56f-6884-403d-b2e5-2eb64c40047f {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:05:04 user nova-compute[74348]: WARNING nova.compute.manager [req-c0bb48f1-884a-4562-91d1-28ee8e8548b3 req-192a1c46-f3bf-425e-bb5f-f37ffd9edacd service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Received unexpected event network-vif-plugged-acc2d56f-6884-403d-b2e5-2eb64c40047f for instance with vm_state stopped and task_state powering-on.
Nov 22 08:05:04 user nova-compute[74348]: DEBUG nova.compute.manager [req-c0bb48f1-884a-4562-91d1-28ee8e8548b3 req-192a1c46-f3bf-425e-bb5f-f37ffd9edacd service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Received event network-vif-plugged-acc2d56f-6884-403d-b2e5-2eb64c40047f {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:05:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c0bb48f1-884a-4562-91d1-28ee8e8548b3 req-192a1c46-f3bf-425e-bb5f-f37ffd9edacd service nova] Acquiring lock "37c93c2a-1397-4b04-aef1-5068218ad9fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:05:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c0bb48f1-884a-4562-91d1-28ee8e8548b3 req-192a1c46-f3bf-425e-bb5f-f37ffd9edacd service nova] Lock "37c93c2a-1397-4b04-aef1-5068218ad9fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:05:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c0bb48f1-884a-4562-91d1-28ee8e8548b3 req-192a1c46-f3bf-425e-bb5f-f37ffd9edacd service nova] Lock "37c93c2a-1397-4b04-aef1-5068218ad9fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:05:04 user nova-compute[74348]: DEBUG nova.compute.manager [req-c0bb48f1-884a-4562-91d1-28ee8e8548b3 req-192a1c46-f3bf-425e-bb5f-f37ffd9edacd service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] No waiting events found dispatching network-vif-plugged-acc2d56f-6884-403d-b2e5-2eb64c40047f {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:05:04 user nova-compute[74348]: WARNING nova.compute.manager [req-c0bb48f1-884a-4562-91d1-28ee8e8548b3 req-192a1c46-f3bf-425e-bb5f-f37ffd9edacd service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Received unexpected event network-vif-plugged-acc2d56f-6884-403d-b2e5-2eb64c40047f for instance with vm_state stopped and task_state powering-on.
Nov 22 08:05:05 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ab9bae4d-e567-4e99-8108-c480282ebea4 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:05:05 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ab9bae4d-e567-4e99-8108-c480282ebea4 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:05:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ab9bae4d-e567-4e99-8108-c480282ebea4 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.550s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:05:05 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-ab9bae4d-e567-4e99-8108-c480282ebea4 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Deleted allocations for instance a00543c8-2d8f-4f63-aa4d-01582a90775d
Nov 22 08:05:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ab9bae4d-e567-4e99-8108-c480282ebea4 tempest-VolumesActionsTest-1791306803 tempest-VolumesActionsTest-1791306803-project-member] Lock "a00543c8-2d8f-4f63-aa4d-01582a90775d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.590s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:05:05 user nova-compute[74348]: DEBUG nova.compute.manager [req-2e9cf969-25a7-4dd5-83eb-a15fc897b77f req-3184a512-25ec-4c7a-8a7d-838bb6a0cc26 service nova] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Received event network-vif-plugged-3218c3ca-293c-41e8-96c5-1550439e96d0 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:05:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2e9cf969-25a7-4dd5-83eb-a15fc897b77f req-3184a512-25ec-4c7a-8a7d-838bb6a0cc26 service nova] Acquiring lock "a00543c8-2d8f-4f63-aa4d-01582a90775d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:05:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2e9cf969-25a7-4dd5-83eb-a15fc897b77f req-3184a512-25ec-4c7a-8a7d-838bb6a0cc26 service nova] Lock "a00543c8-2d8f-4f63-aa4d-01582a90775d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:05:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2e9cf969-25a7-4dd5-83eb-a15fc897b77f req-3184a512-25ec-4c7a-8a7d-838bb6a0cc26 service nova] Lock "a00543c8-2d8f-4f63-aa4d-01582a90775d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:05:05 user nova-compute[74348]: DEBUG nova.compute.manager [req-2e9cf969-25a7-4dd5-83eb-a15fc897b77f req-3184a512-25ec-4c7a-8a7d-838bb6a0cc26 service nova] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] No waiting events found dispatching network-vif-plugged-3218c3ca-293c-41e8-96c5-1550439e96d0 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:05:05 user nova-compute[74348]: WARNING nova.compute.manager [req-2e9cf969-25a7-4dd5-83eb-a15fc897b77f req-3184a512-25ec-4c7a-8a7d-838bb6a0cc26 service nova] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Received unexpected event network-vif-plugged-3218c3ca-293c-41e8-96c5-1550439e96d0 for instance with vm_state deleted and task_state None.
Nov 22 08:05:05 user nova-compute[74348]: DEBUG nova.compute.manager [req-2e9cf969-25a7-4dd5-83eb-a15fc897b77f req-3184a512-25ec-4c7a-8a7d-838bb6a0cc26 service nova] [instance: a00543c8-2d8f-4f63-aa4d-01582a90775d] Received event network-vif-deleted-3218c3ca-293c-41e8-96c5-1550439e96d0 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cVstNlSG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:05:06 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:05:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:05:06 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:05:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:05:06 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 08:05:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718 -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718 -p 172.16.0.220:3260" returned: 21 in 0.031s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f36f34c-ad24-411a-a1e3-cde53d421285]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 08:05:06 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718 -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a79db9-7ae2-433e-8c5f-7791095d0683]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718] added
Nov 22 08:05:06 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG nova.compute.manager [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 08:05:06 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Instance rebooted successfully.
Nov 22 08:05:06 user nova-compute[74348]: DEBUG nova.compute.manager [None req-7a748098-45c3-485e-ace0-d9677e7d93b4 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.044s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7e2c20-b88e-45a6-a355-3a23b3aff94b]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b311716b-0362-42d8-b7bc-0f124e74341e]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cVstNlSG {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cVstNlSG" returned: 0 in 0.040s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5557d7-40e3-4729-abc5-08e5d1217d2b]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cVstNlSG'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[759abadf-be4d-4763-851e-34bbbf424852]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c1ff06-8d37-4b7d-8945-93074efbdc4f]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:05:06 user nova-compute[74348]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)
Nov 22 08:05:06 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:05:06 user nova-compute[74348]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)
Nov 22 08:05:06 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718 -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdd134a-ad54-4643-99d7-655c295b5960]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718, portal: 172.16.0.220,3260]
Nov 22 08:05:06 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718, portal: 172.16.0.220,3260] successful.
Nov 22 08:05:06 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ac4f25-bbc4-4347-a0f6-98b11561ecb1]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f06bdb-4042-4d86-b723-48ea8eccb9a6]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:05:06 user nova-compute[74348]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)
Nov 22 08:05:06 user nova-compute[74348]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718 (non-flash)
Nov 22 08:05:06 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:05:06 user nova-compute[74348]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)
Nov 22 08:05:06 user nova-compute[74348]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718 (non-flash)
Nov 22 08:05:06 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.410s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6383fe-4179-41d4-90ef-eb1571f8dbd0]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:05:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cVstNlSG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 08:05:07 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.466s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:05:07 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] <== connect_volume: return (1468ms) {'type': 'block', 'scsi_wwn': '23931626131343563', 'path': '/dev/sdd'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:05:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931626131343563', 'path': '/dev/sdd'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 08:05:07 user nova-compute[74348]: DEBUG nova.objects.instance [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lazy-loading 'flavor' on Instance uuid a31128a9-fc24-4a42-acdb-a50dfd64446e {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:05:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 08:05:07 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:05:07 user nova-compute[74348]:   <source dev="/dev/sdd"/>
Nov 22 08:05:07 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:05:07 user nova-compute[74348]:   <serial>641e9a32-8750-4527-a85e-40c9ffa70718</serial>
Nov 22 08:05:07 user nova-compute[74348]: </disk>
Nov 22 08:05:07 user nova-compute[74348]:  {{(pid=74348) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 08:05:08 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:05:08 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:05:08 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] No VIF found with MAC fa:16:3e:f8:ab:0b, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:05:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Acquiring lock "a19d2696-fccb-4b94-8a42-a76b35b32582" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:05:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "a19d2696-fccb-4b94-8a42-a76b35b32582" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:05:08 user nova-compute[74348]: DEBUG nova.compute.manager [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 08:05:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b60d9ba4-25d7-4328-a04b-d825fd728e5a tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "a31128a9-fc24-4a42-acdb-a50dfd64446e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.864s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:05:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:05:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:05:08 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 08:05:08 user nova-compute[74348]: INFO nova.compute.claims [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Claim successful on node user
Nov 22 08:05:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f82f38ab-27c7-4888-9733-5986b458cec4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "a31128a9-fc24-4a42-acdb-a50dfd64446e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:05:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f82f38ab-27c7-4888-9733-5986b458cec4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "a31128a9-fc24-4a42-acdb-a50dfd64446e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:05:08 user nova-compute[74348]: INFO nova.compute.manager [None req-f82f38ab-27c7-4888-9733-5986b458cec4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Detaching volume 641e9a32-8750-4527-a85e-40c9ffa70718
Nov 22 08:05:08 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:05:08 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:05:08 user nova-compute[74348]: INFO nova.virt.block_device [None req-f82f38ab-27c7-4888-9733-5986b458cec4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Attempting to driver detach volume 641e9a32-8750-4527-a85e-40c9ffa70718 from mountpoint /dev/vdb
Nov 22 08:05:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.595s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:05:08 user nova-compute[74348]: DEBUG nova.compute.manager [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 08:05:08 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-f82f38ab-27c7-4888-9733-5986b458cec4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Attempting to detach device vdb from instance a31128a9-fc24-4a42-acdb-a50dfd64446e from the persistent domain config. {{(pid=74348) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 08:05:08 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-f82f38ab-27c7-4888-9733-5986b458cec4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:05:08 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:05:08 user nova-compute[74348]:   <source dev="/dev/sdd"/>
Nov 22 08:05:08 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:05:08 user nova-compute[74348]:   <serial>641e9a32-8750-4527-a85e-40c9ffa70718</serial>
Nov 22 08:05:08 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 08:05:08 user nova-compute[74348]: </disk>
Nov 22 08:05:08 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:05:08 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-f82f38ab-27c7-4888-9733-5986b458cec4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Successfully detached device vdb from instance a31128a9-fc24-4a42-acdb-a50dfd64446e from the persistent domain config.
Nov 22 08:05:08 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-f82f38ab-27c7-4888-9733-5986b458cec4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a31128a9-fc24-4a42-acdb-a50dfd64446e from the live domain config. {{(pid=74348) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 08:05:08 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-f82f38ab-27c7-4888-9733-5986b458cec4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:05:08 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:05:08 user nova-compute[74348]:   <source dev="/dev/sdd"/>
Nov 22 08:05:08 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:05:08 user nova-compute[74348]:   <serial>641e9a32-8750-4527-a85e-40c9ffa70718</serial>
Nov 22 08:05:08 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 08:05:08 user nova-compute[74348]: </disk>
Nov 22 08:05:08 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:05:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:08 user nova-compute[74348]: DEBUG nova.compute.manager [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 08:05:08 user nova-compute[74348]: DEBUG nova.network.neutron [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 08:05:08 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 08:05:09 user nova-compute[74348]: DEBUG nova.compute.manager [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 08:05:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:09 user nova-compute[74348]: DEBUG nova.policy [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '932048022f98418b9ac1d99a356fa39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0496e87c6a468fab4258553c68b8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 08:05:09 user nova-compute[74348]: DEBUG nova.compute.manager [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 08:05:09 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 08:05:09 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Creating image(s)
Nov 22 08:05:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Acquiring lock "/opt/stack/data/nova/instances/a19d2696-fccb-4b94-8a42-a76b35b32582/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:05:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "/opt/stack/data/nova/instances/a19d2696-fccb-4b94-8a42-a76b35b32582/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:05:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "/opt/stack/data/nova/instances/a19d2696-fccb-4b94-8a42-a76b35b32582/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:05:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.197s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Acquiring lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:05:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:05:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:09 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-f82f38ab-27c7-4888-9733-5986b458cec4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a31128a9-fc24-4a42-acdb-a50dfd64446e {{(pid=74348) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 08:05:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.202s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/a19d2696-fccb-4b94-8a42-a76b35b32582/disk 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/a19d2696-fccb-4b94-8a42-a76b35b32582/disk 1073741824" returned: 0 in 0.060s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:05:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:09 user nova-compute[74348]: DEBUG nova.network.neutron [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Successfully created port: 9122ca7d-1ee6-4cae-be01-8b846027d7d8 {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 08:05:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.213s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:09 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a19d2696-fccb-4b94-8a42-a76b35b32582/disk. size=1073741824 {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 08:05:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19d2696-fccb-4b94-8a42-a76b35b32582/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19d2696-fccb-4b94-8a42-a76b35b32582/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:10 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Cannot resize image /opt/stack/data/nova/instances/a19d2696-fccb-4b94-8a42-a76b35b32582/disk to a smaller size. {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 08:05:10 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 08:05:10 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Ensure instance console log exists: /opt/stack/data/nova/instances/a19d2696-fccb-4b94-8a42-a76b35b32582/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 08:05:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:05:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:05:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:05:10 user nova-compute[74348]: DEBUG nova.network.neutron [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Successfully updated port: 9122ca7d-1ee6-4cae-be01-8b846027d7d8 {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 08:05:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Acquiring lock "refresh_cache-a19d2696-fccb-4b94-8a42-a76b35b32582" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:05:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Acquired lock "refresh_cache-a19d2696-fccb-4b94-8a42-a76b35b32582" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:05:10 user nova-compute[74348]: DEBUG nova.network.neutron [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:05:10 user nova-compute[74348]: DEBUG nova.compute.manager [req-68d7dd53-493e-423f-828a-1e3e5de8fbc3 req-3f52f71a-a93a-4df1-8edc-5cd99b74b0d5 service nova] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Received event network-changed-9122ca7d-1ee6-4cae-be01-8b846027d7d8 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:05:10 user nova-compute[74348]: DEBUG nova.compute.manager [req-68d7dd53-493e-423f-828a-1e3e5de8fbc3 req-3f52f71a-a93a-4df1-8edc-5cd99b74b0d5 service nova] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Refreshing instance network info cache due to event network-changed-9122ca7d-1ee6-4cae-be01-8b846027d7d8. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:05:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-68d7dd53-493e-423f-828a-1e3e5de8fbc3 req-3f52f71a-a93a-4df1-8edc-5cd99b74b0d5 service nova] Acquiring lock "refresh_cache-a19d2696-fccb-4b94-8a42-a76b35b32582" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:05:10 user nova-compute[74348]: DEBUG nova.network.neutron [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 08:05:10 user nova-compute[74348]: DEBUG nova.network.neutron [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Updating instance_info_cache with network_info: [{"id": "9122ca7d-1ee6-4cae-be01-8b846027d7d8", "address": "fa:16:3e:f7:7e:99", "network": {"id": "59f6f7a7-7076-40e9-8db7-944f89ecb7e5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1331190296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c0496e87c6a468fab4258553c68b8d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9122ca7d-1e", "ovs_interfaceid": "9122ca7d-1ee6-4cae-be01-8b846027d7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:05:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Releasing lock "refresh_cache-a19d2696-fccb-4b94-8a42-a76b35b32582" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:05:10 user nova-compute[74348]: DEBUG nova.compute.manager [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Instance network_info: |[{"id": "9122ca7d-1ee6-4cae-be01-8b846027d7d8", "address": "fa:16:3e:f7:7e:99", "network": {"id": "59f6f7a7-7076-40e9-8db7-944f89ecb7e5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1331190296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c0496e87c6a468fab4258553c68b8d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9122ca7d-1e", "ovs_interfaceid": "9122ca7d-1ee6-4cae-be01-8b846027d7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 08:05:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-68d7dd53-493e-423f-828a-1e3e5de8fbc3 req-3f52f71a-a93a-4df1-8edc-5cd99b74b0d5 service nova] Acquired lock "refresh_cache-a19d2696-fccb-4b94-8a42-a76b35b32582" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:05:10 user nova-compute[74348]: DEBUG nova.network.neutron [req-68d7dd53-493e-423f-828a-1e3e5de8fbc3 req-3f52f71a-a93a-4df1-8edc-5cd99b74b0d5 service nova] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Refreshing network info cache for port 9122ca7d-1ee6-4cae-be01-8b846027d7d8 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:05:10 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Start _get_guest_xml network_info=[{"id": "9122ca7d-1ee6-4cae-be01-8b846027d7d8", "address": "fa:16:3e:f7:7e:99", "network": {"id": "59f6f7a7-7076-40e9-8db7-944f89ecb7e5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1331190296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c0496e87c6a468fab4258553c68b8d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9122ca7d-1e", "ovs_interfaceid": "9122ca7d-1ee6-4cae-be01-8b846027d7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 08:05:10 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:05:10 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:05:10 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 08:05:10 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 08:05:10 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 08:05:10 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 08:05:10 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 08:05:10 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 08:05:10 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 08:05:10 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 08:05:10 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 08:05:10 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 08:05:10 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 08:05:10 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 08:05:10 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 08:05:10 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 08:05:10 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 08:05:10 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 08:05:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:05:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1152938346',display_name='tempest-VolumesSnapshotTestJSON-instance-1152938346',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1152938346',id=35,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpj1Nj+5hiXkSZp4vwIXH7tCa5FsYWMg1RoOkU/A/Ai/p/gmdsXCnEFmB5uKidYPSbLvy9fNriNEwlPea7nvBZPRl/Ydc7pyuK1SiHyUpAdAtJgK7skFdjP+imkMe9kfg==',key_name='tempest-keypair-1653635626',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c0496e87c6a468fab4258553c68b8d3',ramdisk_id='',reservation_id='r-st5dd2jn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-451679750',owner_user_name='tempest-VolumesSnapshotTestJSON-451679750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:05:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='932048022f98418b9ac1d99a356fa39d',uuid=a19d2696-fccb-4b94-8a42-a76b35b32582,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9122ca7d-1ee6-4cae-be01-8b846027d7d8", "address": "fa:16:3e:f7:7e:99", "network": {"id": "59f6f7a7-7076-40e9-8db7-944f89ecb7e5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1331190296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c0496e87c6a468fab4258553c68b8d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9122ca7d-1e", "ovs_interfaceid": "9122ca7d-1ee6-4cae-be01-8b846027d7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 08:05:11 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Converting VIF {"id": "9122ca7d-1ee6-4cae-be01-8b846027d7d8", "address": "fa:16:3e:f7:7e:99", "network": {"id": "59f6f7a7-7076-40e9-8db7-944f89ecb7e5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1331190296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c0496e87c6a468fab4258553c68b8d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9122ca7d-1e", "ovs_interfaceid": "9122ca7d-1ee6-4cae-be01-8b846027d7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:05:11 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:7e:99,bridge_name='br-int',has_traffic_filtering=True,id=9122ca7d-1ee6-4cae-be01-8b846027d7d8,network=Network(59f6f7a7-7076-40e9-8db7-944f89ecb7e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9122ca7d-1e') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:05:11 user nova-compute[74348]: DEBUG nova.objects.instance [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lazy-loading 'pci_devices' on Instance uuid a19d2696-fccb-4b94-8a42-a76b35b32582 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:05:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] End _get_guest_xml xml=<domain type="kvm">
Nov 22 08:05:11 user nova-compute[74348]:   <uuid>a19d2696-fccb-4b94-8a42-a76b35b32582</uuid>
Nov 22 08:05:11 user nova-compute[74348]:   <name>instance-00000023</name>
Nov 22 08:05:11 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 08:05:11 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 08:05:11 user nova-compute[74348]:   <metadata>
Nov 22 08:05:11 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 08:05:11 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 08:05:11 user nova-compute[74348]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1152938346</nova:name>
Nov 22 08:05:11 user nova-compute[74348]:       <nova:creationTime>2023-11-22 08:05:10</nova:creationTime>
Nov 22 08:05:11 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 08:05:11 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 08:05:11 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 08:05:11 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 08:05:11 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 08:05:11 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 08:05:11 user nova-compute[74348]:       </nova:flavor>
Nov 22 08:05:11 user nova-compute[74348]:       <nova:owner>
Nov 22 08:05:11 user nova-compute[74348]:         <nova:user uuid="932048022f98418b9ac1d99a356fa39d">tempest-VolumesSnapshotTestJSON-451679750-project-member</nova:user>
Nov 22 08:05:11 user nova-compute[74348]:         <nova:project uuid="6c0496e87c6a468fab4258553c68b8d3">tempest-VolumesSnapshotTestJSON-451679750</nova:project>
Nov 22 08:05:11 user nova-compute[74348]:       </nova:owner>
Nov 22 08:05:11 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 08:05:11 user nova-compute[74348]:       <nova:ports>
Nov 22 08:05:11 user nova-compute[74348]:         <nova:port uuid="9122ca7d-1ee6-4cae-be01-8b846027d7d8">
Nov 22 08:05:11 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 22 08:05:11 user nova-compute[74348]:         </nova:port>
Nov 22 08:05:11 user nova-compute[74348]:       </nova:ports>
Nov 22 08:05:11 user nova-compute[74348]:     </nova:instance>
Nov 22 08:05:11 user nova-compute[74348]:   </metadata>
Nov 22 08:05:11 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 08:05:11 user nova-compute[74348]:     <system>
Nov 22 08:05:11 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 08:05:11 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 08:05:11 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 08:05:11 user nova-compute[74348]:       <entry name="serial">a19d2696-fccb-4b94-8a42-a76b35b32582</entry>
Nov 22 08:05:11 user nova-compute[74348]:       <entry name="uuid">a19d2696-fccb-4b94-8a42-a76b35b32582</entry>
Nov 22 08:05:11 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 08:05:11 user nova-compute[74348]:     </system>
Nov 22 08:05:11 user nova-compute[74348]:   </sysinfo>
Nov 22 08:05:11 user nova-compute[74348]:   <os>
Nov 22 08:05:11 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 08:05:11 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 08:05:11 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 08:05:11 user nova-compute[74348]:   </os>
Nov 22 08:05:11 user nova-compute[74348]:   <features>
Nov 22 08:05:11 user nova-compute[74348]:     <acpi/>
Nov 22 08:05:11 user nova-compute[74348]:     <apic/>
Nov 22 08:05:11 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 08:05:11 user nova-compute[74348]:   </features>
Nov 22 08:05:11 user nova-compute[74348]:   <clock offset="utc">
Nov 22 08:05:11 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 08:05:11 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 08:05:11 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 08:05:11 user nova-compute[74348]:   </clock>
Nov 22 08:05:11 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 08:05:11 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 08:05:11 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 08:05:11 user nova-compute[74348]:   </cpu>
Nov 22 08:05:11 user nova-compute[74348]:   <devices>
Nov 22 08:05:11 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 08:05:11 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 08:05:11 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/a19d2696-fccb-4b94-8a42-a76b35b32582/disk"/>
Nov 22 08:05:11 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 08:05:11 user nova-compute[74348]:     </disk>
Nov 22 08:05:11 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 08:05:11 user nova-compute[74348]:       <mac address="fa:16:3e:f7:7e:99"/>
Nov 22 08:05:11 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:05:11 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 08:05:11 user nova-compute[74348]:       <target dev="tap9122ca7d-1e"/>
Nov 22 08:05:11 user nova-compute[74348]:     </interface>
Nov 22 08:05:11 user nova-compute[74348]:     <serial type="pty">
Nov 22 08:05:11 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/a19d2696-fccb-4b94-8a42-a76b35b32582/console.log" append="off"/>
Nov 22 08:05:11 user nova-compute[74348]:     </serial>
Nov 22 08:05:11 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 08:05:11 user nova-compute[74348]:     <video>
Nov 22 08:05:11 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:05:11 user nova-compute[74348]:     </video>
Nov 22 08:05:11 user nova-compute[74348]:     <rng model="virtio">
Nov 22 08:05:11 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 08:05:11 user nova-compute[74348]:     </rng>
Nov 22 08:05:11 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 08:05:11 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 08:05:11 user nova-compute[74348]:       <stats period="10"/>
Nov 22 08:05:11 user nova-compute[74348]:     </memballoon>
Nov 22 08:05:11 user nova-compute[74348]:   </devices>
Nov 22 08:05:11 user nova-compute[74348]: </domain>
Nov 22 08:05:11 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 08:05:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:05:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1152938346',display_name='tempest-VolumesSnapshotTestJSON-instance-1152938346',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1152938346',id=35,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpj1Nj+5hiXkSZp4vwIXH7tCa5FsYWMg1RoOkU/A/Ai/p/gmdsXCnEFmB5uKidYPSbLvy9fNriNEwlPea7nvBZPRl/Ydc7pyuK1SiHyUpAdAtJgK7skFdjP+imkMe9kfg==',key_name='tempest-keypair-1653635626',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c0496e87c6a468fab4258553c68b8d3',ramdisk_id='',reservation_id='r-st5dd2jn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-451679750',owner_user_name='tempest-VolumesSnapshotTestJSON-451679750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:05:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='932048022f98418b9ac1d99a356fa39d',uuid=a19d2696-fccb-4b94-8a42-a76b35b32582,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9122ca7d-1ee6-4cae-be01-8b846027d7d8", "address": "fa:16:3e:f7:7e:99", "network": {"id": "59f6f7a7-7076-40e9-8db7-944f89ecb7e5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1331190296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c0496e87c6a468fab4258553c68b8d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9122ca7d-1e", "ovs_interfaceid": "9122ca7d-1ee6-4cae-be01-8b846027d7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 08:05:11 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Converting VIF {"id": "9122ca7d-1ee6-4cae-be01-8b846027d7d8", "address": "fa:16:3e:f7:7e:99", "network": {"id": "59f6f7a7-7076-40e9-8db7-944f89ecb7e5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1331190296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c0496e87c6a468fab4258553c68b8d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9122ca7d-1e", "ovs_interfaceid": "9122ca7d-1ee6-4cae-be01-8b846027d7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:05:11 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:7e:99,bridge_name='br-int',has_traffic_filtering=True,id=9122ca7d-1ee6-4cae-be01-8b846027d7d8,network=Network(59f6f7a7-7076-40e9-8db7-944f89ecb7e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9122ca7d-1e') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:05:11 user nova-compute[74348]: DEBUG os_vif [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:7e:99,bridge_name='br-int',has_traffic_filtering=True,id=9122ca7d-1ee6-4cae-be01-8b846027d7d8,network=Network(59f6f7a7-7076-40e9-8db7-944f89ecb7e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9122ca7d-1e') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 08:05:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:05:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 08:05:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2491df56-ceee-5a21-976a-d748e7961157', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:05:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9122ca7d-1e, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:05:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9122ca7d-1e, col_values=(('qos', UUID('4733eedd-f3b0-4fb6-ad58-2069f17657e2')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:05:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9122ca7d-1e, col_values=(('external_ids', {'iface-id': '9122ca7d-1ee6-4cae-be01-8b846027d7d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:7e:99', 'vm-uuid': 'a19d2696-fccb-4b94-8a42-a76b35b32582'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:05:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:05:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:11 user nova-compute[74348]: INFO os_vif [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:7e:99,bridge_name='br-int',has_traffic_filtering=True,id=9122ca7d-1ee6-4cae-be01-8b846027d7d8,network=Network(59f6f7a7-7076-40e9-8db7-944f89ecb7e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9122ca7d-1e')
Nov 22 08:05:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:05:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] No VIF found with MAC fa:16:3e:f7:7e:99, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:05:11 user nova-compute[74348]: DEBUG nova.network.neutron [req-68d7dd53-493e-423f-828a-1e3e5de8fbc3 req-3f52f71a-a93a-4df1-8edc-5cd99b74b0d5 service nova] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Updated VIF entry in instance network info cache for port 9122ca7d-1ee6-4cae-be01-8b846027d7d8. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:05:11 user nova-compute[74348]: DEBUG nova.network.neutron [req-68d7dd53-493e-423f-828a-1e3e5de8fbc3 req-3f52f71a-a93a-4df1-8edc-5cd99b74b0d5 service nova] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Updating instance_info_cache with network_info: [{"id": "9122ca7d-1ee6-4cae-be01-8b846027d7d8", "address": "fa:16:3e:f7:7e:99", "network": {"id": "59f6f7a7-7076-40e9-8db7-944f89ecb7e5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1331190296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c0496e87c6a468fab4258553c68b8d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9122ca7d-1e", "ovs_interfaceid": "9122ca7d-1ee6-4cae-be01-8b846027d7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:05:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-68d7dd53-493e-423f-828a-1e3e5de8fbc3 req-3f52f71a-a93a-4df1-8edc-5cd99b74b0d5 service nova] Releasing lock "refresh_cache-a19d2696-fccb-4b94-8a42-a76b35b32582" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:05:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:12 user nova-compute[74348]: DEBUG nova.compute.manager [req-c51c808e-3331-4343-b16a-d3bd9725ce8a req-1665ac29-9b5d-41f6-97d8-60834a2d67f9 service nova] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Received event network-vif-plugged-9122ca7d-1ee6-4cae-be01-8b846027d7d8 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:05:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c51c808e-3331-4343-b16a-d3bd9725ce8a req-1665ac29-9b5d-41f6-97d8-60834a2d67f9 service nova] Acquiring lock "a19d2696-fccb-4b94-8a42-a76b35b32582-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:05:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c51c808e-3331-4343-b16a-d3bd9725ce8a req-1665ac29-9b5d-41f6-97d8-60834a2d67f9 service nova] Lock "a19d2696-fccb-4b94-8a42-a76b35b32582-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:05:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c51c808e-3331-4343-b16a-d3bd9725ce8a req-1665ac29-9b5d-41f6-97d8-60834a2d67f9 service nova] Lock "a19d2696-fccb-4b94-8a42-a76b35b32582-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:05:12 user nova-compute[74348]: DEBUG nova.compute.manager [req-c51c808e-3331-4343-b16a-d3bd9725ce8a req-1665ac29-9b5d-41f6-97d8-60834a2d67f9 service nova] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] No waiting events found dispatching network-vif-plugged-9122ca7d-1ee6-4cae-be01-8b846027d7d8 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:05:12 user nova-compute[74348]: WARNING nova.compute.manager [req-c51c808e-3331-4343-b16a-d3bd9725ce8a req-1665ac29-9b5d-41f6-97d8-60834a2d67f9 service nova] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Received unexpected event network-vif-plugged-9122ca7d-1ee6-4cae-be01-8b846027d7d8 for instance with vm_state building and task_state spawning.
Nov 22 08:05:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:14 user nova-compute[74348]: DEBUG nova.compute.manager [req-b89ac145-2353-4827-ad25-3057df174f88 req-314b5c7c-69f7-41bc-a89b-f0e0bcf203ff service nova] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Received event network-vif-plugged-9122ca7d-1ee6-4cae-be01-8b846027d7d8 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:05:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b89ac145-2353-4827-ad25-3057df174f88 req-314b5c7c-69f7-41bc-a89b-f0e0bcf203ff service nova] Acquiring lock "a19d2696-fccb-4b94-8a42-a76b35b32582-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:05:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b89ac145-2353-4827-ad25-3057df174f88 req-314b5c7c-69f7-41bc-a89b-f0e0bcf203ff service nova] Lock "a19d2696-fccb-4b94-8a42-a76b35b32582-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:05:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b89ac145-2353-4827-ad25-3057df174f88 req-314b5c7c-69f7-41bc-a89b-f0e0bcf203ff service nova] Lock "a19d2696-fccb-4b94-8a42-a76b35b32582-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:05:14 user nova-compute[74348]: DEBUG nova.compute.manager [req-b89ac145-2353-4827-ad25-3057df174f88 req-314b5c7c-69f7-41bc-a89b-f0e0bcf203ff service nova] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] No waiting events found dispatching network-vif-plugged-9122ca7d-1ee6-4cae-be01-8b846027d7d8 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:05:14 user nova-compute[74348]: WARNING nova.compute.manager [req-b89ac145-2353-4827-ad25-3057df174f88 req-314b5c7c-69f7-41bc-a89b-f0e0bcf203ff service nova] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Received unexpected event network-vif-plugged-9122ca7d-1ee6-4cae-be01-8b846027d7d8 for instance with vm_state building and task_state spawning.
Nov 22 08:05:14 user nova-compute[74348]: DEBUG nova.compute.manager [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 08:05:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 08:05:14 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Instance spawned successfully.
Nov 22 08:05:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 08:05:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:05:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:05:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:05:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:05:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:05:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:05:15 user nova-compute[74348]: INFO nova.compute.manager [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Took 5.83 seconds to spawn the instance on the hypervisor.
Nov 22 08:05:15 user nova-compute[74348]: DEBUG nova.compute.manager [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:05:15 user nova-compute[74348]: INFO nova.compute.manager [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Took 6.92 seconds to build instance.
Nov 22 08:05:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e9c2712a-cfa6-4a69-b644-6b135275aeef tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "a19d2696-fccb-4b94-8a42-a76b35b32582" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.073s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:05:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:21 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:24 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:26 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:29 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-f82f38ab-27c7-4888-9733-5986b458cec4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a31128a9-fc24-4a42-acdb-a50dfd64446e is timed out.
Nov 22 08:05:29 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-f82f38ab-27c7-4888-9733-5986b458cec4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Successfully detached device vdb from instance a31128a9-fc24-4a42-acdb-a50dfd64446e from the live domain config.
Nov 22 08:05:29 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f82f38ab-27c7-4888-9733-5986b458cec4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82f38ab-27c7-4888-9733-5986b458cec4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cVstNlSG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:05:29 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-f82f38ab-27c7-4888-9733-5986b458cec4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:05:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-f82f38ab-27c7-4888-9733-5986b458cec4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-f82f38ab-27c7-4888-9733-5986b458cec4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d271ffcc-cbdb-4934-9fb8-9932a64eb616]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82f38ab-27c7-4888-9733-5986b458cec4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 08:05:29 user nova-compute[74348]: No targets found.
Nov 22 08:05:29 user nova-compute[74348]: iSNS:
Nov 22 08:05:29 user nova-compute[74348]: No targets found.
Nov 22 08:05:29 user nova-compute[74348]: STATIC:
Nov 22 08:05:29 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718
Nov 22 08:05:29 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:05:29 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:05:29 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8
Nov 22 08:05:29 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:05:29 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:05:29 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea
Nov 22 08:05:29 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:05:29 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:05:29 user nova-compute[74348]: FIRMWARE:
Nov 22 08:05:29 user nova-compute[74348]: No targets found.
Nov 22 08:05:29 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82f38ab-27c7-4888-9733-5986b458cec4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 08:05:29 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 08:05:29 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82f38ab-27c7-4888-9733-5986b458cec4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2a9d3e-7d49-4592-9563-666970d6a8ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b930393-8b01-44b6-8ee2-ea5df3f9104e]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82f38ab-27c7-4888-9733-5986b458cec4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:05:29 user nova-compute[74348]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)
Nov 22 08:05:29 user nova-compute[74348]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718 (non-flash)
Nov 22 08:05:29 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82f38ab-27c7-4888-9733-5986b458cec4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:05:29 user nova-compute[74348]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)
Nov 22 08:05:29 user nova-compute[74348]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718 (non-flash)
Nov 22 08:05:29 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82f38ab-27c7-4888-9733-5986b458cec4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f224c5be680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718'): ({'sdd'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-f82f38ab-27c7-4888-9733-5986b458cec4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Removing single pathed devices sdd {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0961008b-6f32-4ec8-b2c7-ecbe3c50da12]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.028s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[77681d76-e4c1-4e84-80a5-59480a89dad1]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-f82f38ab-27c7-4888-9733-5986b458cec4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Flushing IO for device /dev/sdd {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bcede71-52ae-4481-9b44-8362d53d9129]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-f82f38ab-27c7-4888-9733-5986b458cec4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.034s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08ee219-a9b4-4407-925b-77fc704c0c64]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-f82f38ab-27c7-4888-9733-5986b458cec4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-f82f38ab-27c7-4888-9733-5986b458cec4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] SCSI volumes sdd have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82f38ab-27c7-4888-9733-5986b458cec4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[130ebdbe-421c-47b4-a4f6-9139ecbc3e67]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82f38ab-27c7-4888-9733-5986b458cec4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718 -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab987ecf-0837-4c27-8acd-c2009dad78ae]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82f38ab-27c7-4888-9733-5986b458cec4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718, portal: 172.16.0.220,3260]
Nov 22 08:05:29 user nova-compute[74348]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718, portal: 172.16.0.220,3260] successful.
Nov 22 08:05:29 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718 -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:641e9a32-8750-4527-a85e-40c9ffa70718 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a005a3b2-30c4-4e94-86dc-9f0a0195be57]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82f38ab-27c7-4888-9733-5986b458cec4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-f82f38ab-27c7-4888-9733-5986b458cec4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82f38ab-27c7-4888-9733-5986b458cec4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] <== disconnect_volume: return (308ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:05:29 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f82f38ab-27c7-4888-9733-5986b458cec4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 08:05:30 user nova-compute[74348]: DEBUG nova.objects.instance [None req-f82f38ab-27c7-4888-9733-5986b458cec4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lazy-loading 'flavor' on Instance uuid a31128a9-fc24-4a42-acdb-a50dfd64446e {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:05:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f82f38ab-27c7-4888-9733-5986b458cec4 tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "a31128a9-fc24-4a42-acdb-a50dfd64446e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.992s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:05:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:35 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:05:35 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:05:35 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Rebuilding the list of instances to heal {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 08:05:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-765f8c47-c042-4430-8d35-07926ad693fe" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:05:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-765f8c47-c042-4430-8d35-07926ad693fe" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:05:35 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 08:05:35 user nova-compute[74348]: DEBUG nova.objects.instance [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lazy-loading 'info_cache' on Instance uuid 765f8c47-c042-4430-8d35-07926ad693fe {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:05:35 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Updating instance_info_cache with network_info: [{"id": "3ee3f6b1-b929-404a-b3bb-6ece1c2d1052", "address": "fa:16:3e:60:74:68", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee3f6b1-b9", "ovs_interfaceid": "3ee3f6b1-b929-404a-b3bb-6ece1c2d1052", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:05:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-765f8c47-c042-4430-8d35-07926ad693fe" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:05:36 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 08:05:36 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:37 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:05:37 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:05:38 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:05:38 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:05:38 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:05:39 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:39 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:05:40 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:05:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:05:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:05:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:05:40 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:05:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:41 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:05:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6698b0d-0d43-47ea-bcdc-d99201d9833c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6698b0d-0d43-47ea-bcdc-d99201d9833c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6698b0d-0d43-47ea-bcdc-d99201d9833c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6698b0d-0d43-47ea-bcdc-d99201d9833c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:41 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:05:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19d2696-fccb-4b94-8a42-a76b35b32582/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19d2696-fccb-4b94-8a42-a76b35b32582/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19d2696-fccb-4b94-8a42-a76b35b32582/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19d2696-fccb-4b94-8a42-a76b35b32582/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:44 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a31128a9-fc24-4a42-acdb-a50dfd64446e/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a31128a9-fc24-4a42-acdb-a50dfd64446e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a31128a9-fc24-4a42-acdb-a50dfd64446e/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a31128a9-fc24-4a42-acdb-a50dfd64446e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fcddbef-dfaf-48a5-8561-26b8857fdbd6/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fcddbef-dfaf-48a5-8561-26b8857fdbd6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fcddbef-dfaf-48a5-8561-26b8857fdbd6/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:05:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fcddbef-dfaf-48a5-8561-26b8857fdbd6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:05:45 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:05:45 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:05:45 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=7148MB free_disk=24.739856719970703GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:05:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:05:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:05:45 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 765f8c47-c042-4430-8d35-07926ad693fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:05:45 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance b8f84c0b-fab5-4900-bf65-270c9c06baf8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:05:45 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 37c93c2a-1397-4b04-aef1-5068218ad9fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:05:45 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 5006cff5-4b67-405d-b6b1-4c355f82d920 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:05:45 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 555f4246-d4b2-4f2f-b91c-dda8fe47264c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:05:45 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance ba74ca7d-2875-426c-a485-d908af865bae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:05:45 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance a31128a9-fc24-4a42-acdb-a50dfd64446e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:05:45 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:05:45 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance b6698b0d-0d43-47ea-bcdc-d99201d9833c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:05:45 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 016c8f4b-a226-4226-ba56-8a2b28cea146 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:05:45 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 4fcddbef-dfaf-48a5-8561-26b8857fdbd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:05:45 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance a19d2696-fccb-4b94-8a42-a76b35b32582 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:05:45 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:05:45 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:05:46 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:46 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:05:46 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:05:46 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:05:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.532s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:05:47 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:05:47 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:05:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b11fdda4-46a5-482c-aba5-d3d2b52b08ee tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquiring lock "3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:05:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b11fdda4-46a5-482c-aba5-d3d2b52b08ee tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:05:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b11fdda4-46a5-482c-aba5-d3d2b52b08ee tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquiring lock "3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:05:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b11fdda4-46a5-482c-aba5-d3d2b52b08ee tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:05:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b11fdda4-46a5-482c-aba5-d3d2b52b08ee tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:05:47 user nova-compute[74348]: INFO nova.compute.manager [None req-b11fdda4-46a5-482c-aba5-d3d2b52b08ee tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Terminating instance
Nov 22 08:05:47 user nova-compute[74348]: DEBUG nova.compute.manager [None req-b11fdda4-46a5-482c-aba5-d3d2b52b08ee tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 08:05:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:47 user nova-compute[74348]: DEBUG nova.compute.manager [req-735a03a8-4a60-495c-8e6e-c2cce890adb2 req-76674704-935b-4f4f-b0b2-17c11c166342 service nova] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Received event network-vif-unplugged-6c9d4040-2941-469b-b602-69cc8b6e879b {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:05:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-735a03a8-4a60-495c-8e6e-c2cce890adb2 req-76674704-935b-4f4f-b0b2-17c11c166342 service nova] Acquiring lock "3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:05:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-735a03a8-4a60-495c-8e6e-c2cce890adb2 req-76674704-935b-4f4f-b0b2-17c11c166342 service nova] Lock "3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:05:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-735a03a8-4a60-495c-8e6e-c2cce890adb2 req-76674704-935b-4f4f-b0b2-17c11c166342 service nova] Lock "3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:05:47 user nova-compute[74348]: DEBUG nova.compute.manager [req-735a03a8-4a60-495c-8e6e-c2cce890adb2 req-76674704-935b-4f4f-b0b2-17c11c166342 service nova] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] No waiting events found dispatching network-vif-unplugged-6c9d4040-2941-469b-b602-69cc8b6e879b {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:05:47 user nova-compute[74348]: DEBUG nova.compute.manager [req-735a03a8-4a60-495c-8e6e-c2cce890adb2 req-76674704-935b-4f4f-b0b2-17c11c166342 service nova] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Received event network-vif-unplugged-6c9d4040-2941-469b-b602-69cc8b6e879b for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 08:05:48 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Instance destroyed successfully.
Nov 22 08:05:48 user nova-compute[74348]: DEBUG nova.objects.instance [None req-b11fdda4-46a5-482c-aba5-d3d2b52b08ee tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lazy-loading 'resources' on Instance uuid 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:05:48 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-b11fdda4-46a5-482c-aba5-d3d2b52b08ee tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-22T08:00:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-335042483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-335042483',id=22,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHPUs6p+/jls1RPfIFV5xXa9y76RX5cEwthTUZNcmPfI6OBMJxFWtX95JSXaEnXQjIlzA5fswFbK+8eLhdSOUct5GBpwfuknlt+F7shfIItWr4KCKRAfovZkkd27ju+WQ==',key_name='tempest-keypair-1302414391',keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:04:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='444367658c0241d0b5b377a73fedb52b',ramdisk_id='',reservation_id='r-ihwqqxt1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1610098589',owner_user_name='tempest-AttachVolumeShelveTestJSON-1610098589-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T08:04:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e8ce0d767724228bfd6cf3a4afad00d',uuid=3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c9d4040-2941-469b-b602-69cc8b6e879b", "address": "fa:16:3e:b0:44:f3", "network": {"id": "4ef640bb-4a2f-4f98-8b01-b5df87fcb35a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1216437312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444367658c0241d0b5b377a73fedb52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9d4040-29", "ovs_interfaceid": "6c9d4040-2941-469b-b602-69cc8b6e879b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:05:48 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-b11fdda4-46a5-482c-aba5-d3d2b52b08ee tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Converting VIF {"id": "6c9d4040-2941-469b-b602-69cc8b6e879b", "address": "fa:16:3e:b0:44:f3", "network": {"id": "4ef640bb-4a2f-4f98-8b01-b5df87fcb35a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1216437312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444367658c0241d0b5b377a73fedb52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9d4040-29", "ovs_interfaceid": "6c9d4040-2941-469b-b602-69cc8b6e879b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:05:48 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-b11fdda4-46a5-482c-aba5-d3d2b52b08ee tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:44:f3,bridge_name='br-int',has_traffic_filtering=True,id=6c9d4040-2941-469b-b602-69cc8b6e879b,network=Network(4ef640bb-4a2f-4f98-8b01-b5df87fcb35a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9d4040-29') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:05:48 user nova-compute[74348]: DEBUG os_vif [None req-b11fdda4-46a5-482c-aba5-d3d2b52b08ee tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:44:f3,bridge_name='br-int',has_traffic_filtering=True,id=6c9d4040-2941-469b-b602-69cc8b6e879b,network=Network(4ef640bb-4a2f-4f98-8b01-b5df87fcb35a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9d4040-29') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:05:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c9d4040-29, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:05:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f51452ff-2e5b-45b1-866c-894279ec9c30) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:05:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:05:48 user nova-compute[74348]: INFO os_vif [None req-b11fdda4-46a5-482c-aba5-d3d2b52b08ee tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:44:f3,bridge_name='br-int',has_traffic_filtering=True,id=6c9d4040-2941-469b-b602-69cc8b6e879b,network=Network(4ef640bb-4a2f-4f98-8b01-b5df87fcb35a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9d4040-29')
Nov 22 08:05:48 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-b11fdda4-46a5-482c-aba5-d3d2b52b08ee tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Deleting instance files /opt/stack/data/nova/instances/3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0_del
Nov 22 08:05:48 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-b11fdda4-46a5-482c-aba5-d3d2b52b08ee tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Deletion of /opt/stack/data/nova/instances/3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0_del complete
Nov 22 08:05:48 user nova-compute[74348]: INFO nova.compute.manager [None req-b11fdda4-46a5-482c-aba5-d3d2b52b08ee tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 22 08:05:48 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-b11fdda4-46a5-482c-aba5-d3d2b52b08ee tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 08:05:48 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 08:05:48 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 08:05:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:49 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:05:49 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Took 0.92 seconds to deallocate network for instance.
Nov 22 08:05:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b11fdda4-46a5-482c-aba5-d3d2b52b08ee tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:05:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b11fdda4-46a5-482c-aba5-d3d2b52b08ee tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:05:49 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-b11fdda4-46a5-482c-aba5-d3d2b52b08ee tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:05:49 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-b11fdda4-46a5-482c-aba5-d3d2b52b08ee tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:05:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b11fdda4-46a5-482c-aba5-d3d2b52b08ee tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:05:49 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-b11fdda4-46a5-482c-aba5-d3d2b52b08ee tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Deleted allocations for instance 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0
Nov 22 08:05:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b11fdda4-46a5-482c-aba5-d3d2b52b08ee tempest-AttachVolumeShelveTestJSON-1610098589 tempest-AttachVolumeShelveTestJSON-1610098589-project-member] Lock "3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.431s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:05:49 user nova-compute[74348]: DEBUG nova.compute.manager [req-f46909a1-7068-4fab-a39b-a852ba9767b0 req-7bdf23e7-3e85-4159-9d02-2e0392023673 service nova] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Received event network-vif-plugged-6c9d4040-2941-469b-b602-69cc8b6e879b {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:05:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f46909a1-7068-4fab-a39b-a852ba9767b0 req-7bdf23e7-3e85-4159-9d02-2e0392023673 service nova] Acquiring lock "3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:05:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f46909a1-7068-4fab-a39b-a852ba9767b0 req-7bdf23e7-3e85-4159-9d02-2e0392023673 service nova] Lock "3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:05:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f46909a1-7068-4fab-a39b-a852ba9767b0 req-7bdf23e7-3e85-4159-9d02-2e0392023673 service nova] Lock "3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:05:49 user nova-compute[74348]: DEBUG nova.compute.manager [req-f46909a1-7068-4fab-a39b-a852ba9767b0 req-7bdf23e7-3e85-4159-9d02-2e0392023673 service nova] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] No waiting events found dispatching network-vif-plugged-6c9d4040-2941-469b-b602-69cc8b6e879b {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:05:49 user nova-compute[74348]: WARNING nova.compute.manager [req-f46909a1-7068-4fab-a39b-a852ba9767b0 req-7bdf23e7-3e85-4159-9d02-2e0392023673 service nova] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Received unexpected event network-vif-plugged-6c9d4040-2941-469b-b602-69cc8b6e879b for instance with vm_state deleted and task_state None.
Nov 22 08:05:49 user nova-compute[74348]: DEBUG nova.compute.manager [req-f46909a1-7068-4fab-a39b-a852ba9767b0 req-7bdf23e7-3e85-4159-9d02-2e0392023673 service nova] [instance: 3f34f2a3-b312-4b6f-ab6a-f652a4f8aaa0] Received event network-vif-deleted-6c9d4040-2941-469b-b602-69cc8b6e879b {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:05:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:05:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:05:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:05:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:05:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1b09f992-9482-43eb-8a1d-9a0d7356756e tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "a31128a9-fc24-4a42-acdb-a50dfd64446e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:05:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1b09f992-9482-43eb-8a1d-9a0d7356756e tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "a31128a9-fc24-4a42-acdb-a50dfd64446e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:05:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1b09f992-9482-43eb-8a1d-9a0d7356756e tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "a31128a9-fc24-4a42-acdb-a50dfd64446e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:05:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1b09f992-9482-43eb-8a1d-9a0d7356756e tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "a31128a9-fc24-4a42-acdb-a50dfd64446e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:05:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1b09f992-9482-43eb-8a1d-9a0d7356756e tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "a31128a9-fc24-4a42-acdb-a50dfd64446e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:05:59 user nova-compute[74348]: INFO nova.compute.manager [None req-1b09f992-9482-43eb-8a1d-9a0d7356756e tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Terminating instance
Nov 22 08:05:59 user nova-compute[74348]: DEBUG nova.compute.manager [None req-1b09f992-9482-43eb-8a1d-9a0d7356756e tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 08:05:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:59 user nova-compute[74348]: DEBUG nova.compute.manager [req-728754ee-464d-411e-b110-e4d99851a0fb req-7ddc7684-6f5c-42be-8425-ba0da2e22c9d service nova] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Received event network-vif-unplugged-5e33f324-c04a-4be4-b29f-61b75abcd8ba {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:05:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-728754ee-464d-411e-b110-e4d99851a0fb req-7ddc7684-6f5c-42be-8425-ba0da2e22c9d service nova] Acquiring lock "a31128a9-fc24-4a42-acdb-a50dfd64446e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:05:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-728754ee-464d-411e-b110-e4d99851a0fb req-7ddc7684-6f5c-42be-8425-ba0da2e22c9d service nova] Lock "a31128a9-fc24-4a42-acdb-a50dfd64446e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:05:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-728754ee-464d-411e-b110-e4d99851a0fb req-7ddc7684-6f5c-42be-8425-ba0da2e22c9d service nova] Lock "a31128a9-fc24-4a42-acdb-a50dfd64446e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:05:59 user nova-compute[74348]: DEBUG nova.compute.manager [req-728754ee-464d-411e-b110-e4d99851a0fb req-7ddc7684-6f5c-42be-8425-ba0da2e22c9d service nova] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] No waiting events found dispatching network-vif-unplugged-5e33f324-c04a-4be4-b29f-61b75abcd8ba {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:05:59 user nova-compute[74348]: DEBUG nova.compute.manager [req-728754ee-464d-411e-b110-e4d99851a0fb req-7ddc7684-6f5c-42be-8425-ba0da2e22c9d service nova] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Received event network-vif-unplugged-5e33f324-c04a-4be4-b29f-61b75abcd8ba for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 08:05:59 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Instance destroyed successfully.
Nov 22 08:05:59 user nova-compute[74348]: DEBUG nova.objects.instance [None req-1b09f992-9482-43eb-8a1d-9a0d7356756e tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lazy-loading 'resources' on Instance uuid a31128a9-fc24-4a42-acdb-a50dfd64446e {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:05:59 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-1b09f992-9482-43eb-8a1d-9a0d7356756e tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:03:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1931830972',display_name='tempest-AttachVolumeNegativeTest-server-1931830972',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1931830972',id=30,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUVOKVXwpWxSaYILQ9WsYHWpLciTkEgvZX5tqPCq1lSRopPXuBqumcHko57p+dykJp45Ienvrk5Mz0bcqzvb/hHDHTuRMutgpHL0YcsLuGnAndXc+jpyRSFqyn/hkW59g==',key_name='tempest-keypair-1336374186',keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:03:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f569146bb9b04838ad8044260da6ad58',ramdisk_id='',reservation_id='r-fxz5vcf5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1606364171',owner_user_name='tempest-AttachVolumeNegativeTest-1606364171-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T08:03:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8eca17e3a564220b3b07af4eddadaca',uuid=a31128a9-fc24-4a42-acdb-a50dfd64446e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e33f324-c04a-4be4-b29f-61b75abcd8ba", "address": "fa:16:3e:f8:ab:0b", "network": {"id": "5c50496a-0882-415b-8115-ddf7b65516a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-531638472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f569146bb9b04838ad8044260da6ad58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e33f324-c0", "ovs_interfaceid": "5e33f324-c04a-4be4-b29f-61b75abcd8ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:05:59 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-1b09f992-9482-43eb-8a1d-9a0d7356756e tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Converting VIF {"id": "5e33f324-c04a-4be4-b29f-61b75abcd8ba", "address": "fa:16:3e:f8:ab:0b", "network": {"id": "5c50496a-0882-415b-8115-ddf7b65516a7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-531638472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f569146bb9b04838ad8044260da6ad58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e33f324-c0", "ovs_interfaceid": "5e33f324-c04a-4be4-b29f-61b75abcd8ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:05:59 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-1b09f992-9482-43eb-8a1d-9a0d7356756e tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:ab:0b,bridge_name='br-int',has_traffic_filtering=True,id=5e33f324-c04a-4be4-b29f-61b75abcd8ba,network=Network(5c50496a-0882-415b-8115-ddf7b65516a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e33f324-c0') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:05:59 user nova-compute[74348]: DEBUG os_vif [None req-1b09f992-9482-43eb-8a1d-9a0d7356756e tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:ab:0b,bridge_name='br-int',has_traffic_filtering=True,id=5e33f324-c04a-4be4-b29f-61b75abcd8ba,network=Network(5c50496a-0882-415b-8115-ddf7b65516a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e33f324-c0') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:05:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e33f324-c0, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:05:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:05:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=990157c7-f0f8-4574-9005-aef14be9f4ee) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:05:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:05:59 user nova-compute[74348]: INFO os_vif [None req-1b09f992-9482-43eb-8a1d-9a0d7356756e tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:ab:0b,bridge_name='br-int',has_traffic_filtering=True,id=5e33f324-c04a-4be4-b29f-61b75abcd8ba,network=Network(5c50496a-0882-415b-8115-ddf7b65516a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e33f324-c0')
Nov 22 08:05:59 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-1b09f992-9482-43eb-8a1d-9a0d7356756e tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Deleting instance files /opt/stack/data/nova/instances/a31128a9-fc24-4a42-acdb-a50dfd64446e_del
Nov 22 08:05:59 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-1b09f992-9482-43eb-8a1d-9a0d7356756e tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Deletion of /opt/stack/data/nova/instances/a31128a9-fc24-4a42-acdb-a50dfd64446e_del complete
Nov 22 08:06:00 user nova-compute[74348]: INFO nova.compute.manager [None req-1b09f992-9482-43eb-8a1d-9a0d7356756e tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 22 08:06:00 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-1b09f992-9482-43eb-8a1d-9a0d7356756e tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 08:06:00 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 08:06:00 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 08:06:00 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:06:00 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Took 0.67 seconds to deallocate network for instance.
Nov 22 08:06:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1b09f992-9482-43eb-8a1d-9a0d7356756e tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:06:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1b09f992-9482-43eb-8a1d-9a0d7356756e tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:06:01 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-1b09f992-9482-43eb-8a1d-9a0d7356756e tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:06:01 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-1b09f992-9482-43eb-8a1d-9a0d7356756e tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:06:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1b09f992-9482-43eb-8a1d-9a0d7356756e tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.445s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:06:01 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-1b09f992-9482-43eb-8a1d-9a0d7356756e tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Deleted allocations for instance a31128a9-fc24-4a42-acdb-a50dfd64446e
Nov 22 08:06:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1b09f992-9482-43eb-8a1d-9a0d7356756e tempest-AttachVolumeNegativeTest-1606364171 tempest-AttachVolumeNegativeTest-1606364171-project-member] Lock "a31128a9-fc24-4a42-acdb-a50dfd64446e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.262s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:06:01 user nova-compute[74348]: DEBUG nova.compute.manager [req-82c81ced-8f8f-41a0-9f18-44b26703862c req-4bc421f0-8bec-4ff3-a668-fc63dda21874 service nova] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Received event network-vif-plugged-5e33f324-c04a-4be4-b29f-61b75abcd8ba {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:06:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-82c81ced-8f8f-41a0-9f18-44b26703862c req-4bc421f0-8bec-4ff3-a668-fc63dda21874 service nova] Acquiring lock "a31128a9-fc24-4a42-acdb-a50dfd64446e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:06:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-82c81ced-8f8f-41a0-9f18-44b26703862c req-4bc421f0-8bec-4ff3-a668-fc63dda21874 service nova] Lock "a31128a9-fc24-4a42-acdb-a50dfd64446e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:06:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-82c81ced-8f8f-41a0-9f18-44b26703862c req-4bc421f0-8bec-4ff3-a668-fc63dda21874 service nova] Lock "a31128a9-fc24-4a42-acdb-a50dfd64446e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:06:01 user nova-compute[74348]: DEBUG nova.compute.manager [req-82c81ced-8f8f-41a0-9f18-44b26703862c req-4bc421f0-8bec-4ff3-a668-fc63dda21874 service nova] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] No waiting events found dispatching network-vif-plugged-5e33f324-c04a-4be4-b29f-61b75abcd8ba {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:06:01 user nova-compute[74348]: WARNING nova.compute.manager [req-82c81ced-8f8f-41a0-9f18-44b26703862c req-4bc421f0-8bec-4ff3-a668-fc63dda21874 service nova] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Received unexpected event network-vif-plugged-5e33f324-c04a-4be4-b29f-61b75abcd8ba for instance with vm_state deleted and task_state None.
Nov 22 08:06:01 user nova-compute[74348]: DEBUG nova.compute.manager [req-82c81ced-8f8f-41a0-9f18-44b26703862c req-4bc421f0-8bec-4ff3-a668-fc63dda21874 service nova] [instance: a31128a9-fc24-4a42-acdb-a50dfd64446e] Received event network-vif-deleted-5e33f324-c04a-4be4-b29f-61b75abcd8ba {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:06:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "b95b6cae-1885-43e8-b589-ee89854100a3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:06:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "b95b6cae-1885-43e8-b589-ee89854100a3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:06:08 user nova-compute[74348]: DEBUG nova.compute.manager [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 08:06:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:06:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:06:08 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 08:06:08 user nova-compute[74348]: INFO nova.compute.claims [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Claim successful on node user
Nov 22 08:06:08 user nova-compute[74348]: DEBUG nova.compute.manager [req-2494eee2-8804-4a01-b3d8-5422f38cc15a req-7e2d3680-bfb5-416e-b32b-3514d1053be8 service nova] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Received event network-changed-011479b6-f8d6-48e2-b215-789b56c4a2ad {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:06:08 user nova-compute[74348]: DEBUG nova.compute.manager [req-2494eee2-8804-4a01-b3d8-5422f38cc15a req-7e2d3680-bfb5-416e-b32b-3514d1053be8 service nova] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Refreshing instance network info cache due to event network-changed-011479b6-f8d6-48e2-b215-789b56c4a2ad. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:06:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2494eee2-8804-4a01-b3d8-5422f38cc15a req-7e2d3680-bfb5-416e-b32b-3514d1053be8 service nova] Acquiring lock "refresh_cache-b6698b0d-0d43-47ea-bcdc-d99201d9833c" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:06:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2494eee2-8804-4a01-b3d8-5422f38cc15a req-7e2d3680-bfb5-416e-b32b-3514d1053be8 service nova] Acquired lock "refresh_cache-b6698b0d-0d43-47ea-bcdc-d99201d9833c" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:06:08 user nova-compute[74348]: DEBUG nova.network.neutron [req-2494eee2-8804-4a01-b3d8-5422f38cc15a req-7e2d3680-bfb5-416e-b32b-3514d1053be8 service nova] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Refreshing network info cache for port 011479b6-f8d6-48e2-b215-789b56c4a2ad {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:06:08 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:06:08 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:06:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.545s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:06:09 user nova-compute[74348]: DEBUG nova.compute.manager [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 08:06:09 user nova-compute[74348]: DEBUG nova.compute.manager [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 08:06:09 user nova-compute[74348]: DEBUG nova.network.neutron [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 08:06:09 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 08:06:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:09 user nova-compute[74348]: DEBUG nova.compute.manager [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 08:06:09 user nova-compute[74348]: DEBUG nova.policy [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1d5c8274eca14965b6cbfe22110f904d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31d898cdc69494a8825e8d93a0d04bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 08:06:09 user nova-compute[74348]: DEBUG nova.compute.manager [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 08:06:09 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 08:06:09 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Creating image(s)
Nov 22 08:06:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "/opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:06:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "/opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:06:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "/opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.121s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:06:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:09 user nova-compute[74348]: DEBUG nova.network.neutron [req-2494eee2-8804-4a01-b3d8-5422f38cc15a req-7e2d3680-bfb5-416e-b32b-3514d1053be8 service nova] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Updated VIF entry in instance network info cache for port 011479b6-f8d6-48e2-b215-789b56c4a2ad. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:06:09 user nova-compute[74348]: DEBUG nova.network.neutron [req-2494eee2-8804-4a01-b3d8-5422f38cc15a req-7e2d3680-bfb5-416e-b32b-3514d1053be8 service nova] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Updating instance_info_cache with network_info: [{"id": "011479b6-f8d6-48e2-b215-789b56c4a2ad", "address": "fa:16:3e:d2:53:6d", "network": {"id": "19a6226e-acc6-4a08-8157-d6651b1f0362", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-53573870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba09a4f903c4c49909926e9114be418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap011479b6-f8", "ovs_interfaceid": "011479b6-f8d6-48e2-b215-789b56c4a2ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:06:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2494eee2-8804-4a01-b3d8-5422f38cc15a req-7e2d3680-bfb5-416e-b32b-3514d1053be8 service nova] Releasing lock "refresh_cache-b6698b0d-0d43-47ea-bcdc-d99201d9833c" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:06:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.618s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:06:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:06:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.203s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk 1073741824" returned: 0 in 0.489s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.699s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:06:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.214s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:11 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk. size=1073741824 {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 08:06:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:11 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Cannot resize image /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk to a smaller size. {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 08:06:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 08:06:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Ensure instance console log exists: /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 08:06:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:06:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:06:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:06:11 user nova-compute[74348]: DEBUG nova.network.neutron [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Successfully created port: b6962c71-a062-4eac-a40d-7e3df83cc086 {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 08:06:13 user nova-compute[74348]: DEBUG nova.network.neutron [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Successfully updated port: b6962c71-a062-4eac-a40d-7e3df83cc086 {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 08:06:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "refresh_cache-b95b6cae-1885-43e8-b589-ee89854100a3" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:06:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquired lock "refresh_cache-b95b6cae-1885-43e8-b589-ee89854100a3" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:06:13 user nova-compute[74348]: DEBUG nova.network.neutron [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:06:13 user nova-compute[74348]: DEBUG nova.compute.manager [req-397e6721-aff1-4bc4-b5db-7536c1cbd122 req-74b82780-cfd4-40e4-b226-5b1cacc0ac81 service nova] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Received event network-changed-b6962c71-a062-4eac-a40d-7e3df83cc086 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:06:13 user nova-compute[74348]: DEBUG nova.compute.manager [req-397e6721-aff1-4bc4-b5db-7536c1cbd122 req-74b82780-cfd4-40e4-b226-5b1cacc0ac81 service nova] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Refreshing instance network info cache due to event network-changed-b6962c71-a062-4eac-a40d-7e3df83cc086. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:06:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-397e6721-aff1-4bc4-b5db-7536c1cbd122 req-74b82780-cfd4-40e4-b226-5b1cacc0ac81 service nova] Acquiring lock "refresh_cache-b95b6cae-1885-43e8-b589-ee89854100a3" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:06:13 user nova-compute[74348]: DEBUG nova.network.neutron [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 08:06:13 user nova-compute[74348]: DEBUG nova.network.neutron [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Updating instance_info_cache with network_info: [{"id": "b6962c71-a062-4eac-a40d-7e3df83cc086", "address": "fa:16:3e:e1:4b:c3", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6962c71-a0", "ovs_interfaceid": "b6962c71-a062-4eac-a40d-7e3df83cc086", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Releasing lock "refresh_cache-b95b6cae-1885-43e8-b589-ee89854100a3" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG nova.compute.manager [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Instance network_info: |[{"id": "b6962c71-a062-4eac-a40d-7e3df83cc086", "address": "fa:16:3e:e1:4b:c3", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6962c71-a0", "ovs_interfaceid": "b6962c71-a062-4eac-a40d-7e3df83cc086", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-397e6721-aff1-4bc4-b5db-7536c1cbd122 req-74b82780-cfd4-40e4-b226-5b1cacc0ac81 service nova] Acquired lock "refresh_cache-b95b6cae-1885-43e8-b589-ee89854100a3" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG nova.network.neutron [req-397e6721-aff1-4bc4-b5db-7536c1cbd122 req-74b82780-cfd4-40e4-b226-5b1cacc0ac81 service nova] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Refreshing network info cache for port b6962c71-a062-4eac-a40d-7e3df83cc086 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Start _get_guest_xml network_info=[{"id": "b6962c71-a062-4eac-a40d-7e3df83cc086", "address": "fa:16:3e:e1:4b:c3", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6962c71-a0", "ovs_interfaceid": "b6962c71-a062-4eac-a40d-7e3df83cc086", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 08:06:14 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:06:14 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:06:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:06:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1672365080',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1672365080',id=36,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a31d898cdc69494a8825e8d93a0d04bc',ramdisk_id='',reservation_id='r-ja4dvge7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-502521972',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:06:09Z,user_data=None,user_id='1d5c8274eca14965b6cbfe22110f904d',uuid=b95b6cae-1885-43e8-b589-ee89854100a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6962c71-a062-4eac-a40d-7e3df83cc086", "address": "fa:16:3e:e1:4b:c3", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6962c71-a0", "ovs_interfaceid": "b6962c71-a062-4eac-a40d-7e3df83cc086", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Converting VIF {"id": "b6962c71-a062-4eac-a40d-7e3df83cc086", "address": "fa:16:3e:e1:4b:c3", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6962c71-a0", "ovs_interfaceid": "b6962c71-a062-4eac-a40d-7e3df83cc086", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:4b:c3,bridge_name='br-int',has_traffic_filtering=True,id=b6962c71-a062-4eac-a40d-7e3df83cc086,network=Network(6fe60468-191c-4d84-8dce-55c056f88936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6962c71-a0') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG nova.objects.instance [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lazy-loading 'pci_devices' on Instance uuid b95b6cae-1885-43e8-b589-ee89854100a3 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] End _get_guest_xml xml=<domain type="kvm">
Nov 22 08:06:14 user nova-compute[74348]:   <uuid>b95b6cae-1885-43e8-b589-ee89854100a3</uuid>
Nov 22 08:06:14 user nova-compute[74348]:   <name>instance-00000024</name>
Nov 22 08:06:14 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 08:06:14 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 08:06:14 user nova-compute[74348]:   <metadata>
Nov 22 08:06:14 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 08:06:14 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 08:06:14 user nova-compute[74348]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1672365080</nova:name>
Nov 22 08:06:14 user nova-compute[74348]:       <nova:creationTime>2023-11-22 08:06:14</nova:creationTime>
Nov 22 08:06:14 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 08:06:14 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 08:06:14 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 08:06:14 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 08:06:14 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 08:06:14 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 08:06:14 user nova-compute[74348]:       </nova:flavor>
Nov 22 08:06:14 user nova-compute[74348]:       <nova:owner>
Nov 22 08:06:14 user nova-compute[74348]:         <nova:user uuid="1d5c8274eca14965b6cbfe22110f904d">tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member</nova:user>
Nov 22 08:06:14 user nova-compute[74348]:         <nova:project uuid="a31d898cdc69494a8825e8d93a0d04bc">tempest-ServerBootFromVolumeStableRescueTest-502521972</nova:project>
Nov 22 08:06:14 user nova-compute[74348]:       </nova:owner>
Nov 22 08:06:14 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 08:06:14 user nova-compute[74348]:       <nova:ports>
Nov 22 08:06:14 user nova-compute[74348]:         <nova:port uuid="b6962c71-a062-4eac-a40d-7e3df83cc086">
Nov 22 08:06:14 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 22 08:06:14 user nova-compute[74348]:         </nova:port>
Nov 22 08:06:14 user nova-compute[74348]:       </nova:ports>
Nov 22 08:06:14 user nova-compute[74348]:     </nova:instance>
Nov 22 08:06:14 user nova-compute[74348]:   </metadata>
Nov 22 08:06:14 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 08:06:14 user nova-compute[74348]:     <system>
Nov 22 08:06:14 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 08:06:14 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 08:06:14 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 08:06:14 user nova-compute[74348]:       <entry name="serial">b95b6cae-1885-43e8-b589-ee89854100a3</entry>
Nov 22 08:06:14 user nova-compute[74348]:       <entry name="uuid">b95b6cae-1885-43e8-b589-ee89854100a3</entry>
Nov 22 08:06:14 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 08:06:14 user nova-compute[74348]:     </system>
Nov 22 08:06:14 user nova-compute[74348]:   </sysinfo>
Nov 22 08:06:14 user nova-compute[74348]:   <os>
Nov 22 08:06:14 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 08:06:14 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 08:06:14 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 08:06:14 user nova-compute[74348]:   </os>
Nov 22 08:06:14 user nova-compute[74348]:   <features>
Nov 22 08:06:14 user nova-compute[74348]:     <acpi/>
Nov 22 08:06:14 user nova-compute[74348]:     <apic/>
Nov 22 08:06:14 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 08:06:14 user nova-compute[74348]:   </features>
Nov 22 08:06:14 user nova-compute[74348]:   <clock offset="utc">
Nov 22 08:06:14 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 08:06:14 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 08:06:14 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 08:06:14 user nova-compute[74348]:   </clock>
Nov 22 08:06:14 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 08:06:14 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 08:06:14 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 08:06:14 user nova-compute[74348]:   </cpu>
Nov 22 08:06:14 user nova-compute[74348]:   <devices>
Nov 22 08:06:14 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 08:06:14 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 08:06:14 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk"/>
Nov 22 08:06:14 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 08:06:14 user nova-compute[74348]:     </disk>
Nov 22 08:06:14 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 08:06:14 user nova-compute[74348]:       <mac address="fa:16:3e:e1:4b:c3"/>
Nov 22 08:06:14 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:06:14 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 08:06:14 user nova-compute[74348]:       <target dev="tapb6962c71-a0"/>
Nov 22 08:06:14 user nova-compute[74348]:     </interface>
Nov 22 08:06:14 user nova-compute[74348]:     <serial type="pty">
Nov 22 08:06:14 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/console.log" append="off"/>
Nov 22 08:06:14 user nova-compute[74348]:     </serial>
Nov 22 08:06:14 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 08:06:14 user nova-compute[74348]:     <video>
Nov 22 08:06:14 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:06:14 user nova-compute[74348]:     </video>
Nov 22 08:06:14 user nova-compute[74348]:     <rng model="virtio">
Nov 22 08:06:14 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 08:06:14 user nova-compute[74348]:     </rng>
Nov 22 08:06:14 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 08:06:14 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 08:06:14 user nova-compute[74348]:       <stats period="10"/>
Nov 22 08:06:14 user nova-compute[74348]:     </memballoon>
Nov 22 08:06:14 user nova-compute[74348]:   </devices>
Nov 22 08:06:14 user nova-compute[74348]: </domain>
Nov 22 08:06:14 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:06:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1672365080',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1672365080',id=36,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a31d898cdc69494a8825e8d93a0d04bc',ramdisk_id='',reservation_id='r-ja4dvge7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-502521972',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:06:09Z,user_data=None,user_id='1d5c8274eca14965b6cbfe22110f904d',uuid=b95b6cae-1885-43e8-b589-ee89854100a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6962c71-a062-4eac-a40d-7e3df83cc086", "address": "fa:16:3e:e1:4b:c3", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6962c71-a0", "ovs_interfaceid": "b6962c71-a062-4eac-a40d-7e3df83cc086", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Converting VIF {"id": "b6962c71-a062-4eac-a40d-7e3df83cc086", "address": "fa:16:3e:e1:4b:c3", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6962c71-a0", "ovs_interfaceid": "b6962c71-a062-4eac-a40d-7e3df83cc086", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:4b:c3,bridge_name='br-int',has_traffic_filtering=True,id=b6962c71-a062-4eac-a40d-7e3df83cc086,network=Network(6fe60468-191c-4d84-8dce-55c056f88936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6962c71-a0') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG os_vif [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:4b:c3,bridge_name='br-int',has_traffic_filtering=True,id=b6962c71-a062-4eac-a40d-7e3df83cc086,network=Network(6fe60468-191c-4d84-8dce-55c056f88936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6962c71-a0') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c006ac50-6140-53eb-8e3d-668e0396ad74', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb6962c71-a0, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb6962c71-a0, col_values=(('qos', UUID('277f9308-5fa1-4349-8061-27d9b1e8f3a1')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb6962c71-a0, col_values=(('external_ids', {'iface-id': 'b6962c71-a062-4eac-a40d-7e3df83cc086', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:4b:c3', 'vm-uuid': 'b95b6cae-1885-43e8-b589-ee89854100a3'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:14 user nova-compute[74348]: INFO os_vif [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:4b:c3,bridge_name='br-int',has_traffic_filtering=True,id=b6962c71-a062-4eac-a40d-7e3df83cc086,network=Network(6fe60468-191c-4d84-8dce-55c056f88936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6962c71-a0')
Nov 22 08:06:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] No VIF found with MAC fa:16:3e:e1:4b:c3, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG nova.network.neutron [req-397e6721-aff1-4bc4-b5db-7536c1cbd122 req-74b82780-cfd4-40e4-b226-5b1cacc0ac81 service nova] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Updated VIF entry in instance network info cache for port b6962c71-a062-4eac-a40d-7e3df83cc086. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG nova.network.neutron [req-397e6721-aff1-4bc4-b5db-7536c1cbd122 req-74b82780-cfd4-40e4-b226-5b1cacc0ac81 service nova] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Updating instance_info_cache with network_info: [{"id": "b6962c71-a062-4eac-a40d-7e3df83cc086", "address": "fa:16:3e:e1:4b:c3", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6962c71-a0", "ovs_interfaceid": "b6962c71-a062-4eac-a40d-7e3df83cc086", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:06:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-397e6721-aff1-4bc4-b5db-7536c1cbd122 req-74b82780-cfd4-40e4-b226-5b1cacc0ac81 service nova] Releasing lock "refresh_cache-b95b6cae-1885-43e8-b589-ee89854100a3" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:06:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Acquiring lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:06:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:06:15 user nova-compute[74348]: DEBUG nova.objects.instance [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lazy-loading 'flavor' on Instance uuid b6698b0d-0d43-47ea-bcdc-d99201d9833c {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:06:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:06:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Acquiring lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:06:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:06:15 user nova-compute[74348]: INFO nova.compute.manager [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Attaching volume f60c0c47-ef14-4229-8dae-a89bf78009d5 to /dev/vdb
Nov 22 08:06:15 user nova-compute[74348]: DEBUG os_brick.utils [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:06:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfacf544-1e1f-47bc-85a5-33eee1782ee8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc65ece-2967-4f10-8a50-4bf01fb3147f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.059s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c52932-4e17-45a9-89b8-817dcfef5efb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[77eb6a4b-07fe-4433-9740-e6ab876f59c9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:06:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 08:06:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:06:15 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 08:06:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[05305738-13e8-4aa4-9d9e-3cea6679c2e6]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 08:06:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 08:06:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 08:06:15 user nova-compute[74348]: DEBUG os_brick.utils [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] <== get_connector_properties: return (187ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:06:15 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Updating existing volume attachment record: f46dd870-7aca-4fe6-afe3-df4d88ffae05 {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 08:06:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:16 user nova-compute[74348]: DEBUG nova.compute.manager [req-e8ea0c4f-9bf4-4321-85e7-9f5d7bdf0a80 req-4d04d763-34f1-4f57-a1a8-72f84634f289 service nova] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Received event network-vif-plugged-b6962c71-a062-4eac-a40d-7e3df83cc086 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:06:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e8ea0c4f-9bf4-4321-85e7-9f5d7bdf0a80 req-4d04d763-34f1-4f57-a1a8-72f84634f289 service nova] Acquiring lock "b95b6cae-1885-43e8-b589-ee89854100a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:06:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e8ea0c4f-9bf4-4321-85e7-9f5d7bdf0a80 req-4d04d763-34f1-4f57-a1a8-72f84634f289 service nova] Lock "b95b6cae-1885-43e8-b589-ee89854100a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:06:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e8ea0c4f-9bf4-4321-85e7-9f5d7bdf0a80 req-4d04d763-34f1-4f57-a1a8-72f84634f289 service nova] Lock "b95b6cae-1885-43e8-b589-ee89854100a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:06:16 user nova-compute[74348]: DEBUG nova.compute.manager [req-e8ea0c4f-9bf4-4321-85e7-9f5d7bdf0a80 req-4d04d763-34f1-4f57-a1a8-72f84634f289 service nova] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] No waiting events found dispatching network-vif-plugged-b6962c71-a062-4eac-a40d-7e3df83cc086 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:06:16 user nova-compute[74348]: WARNING nova.compute.manager [req-e8ea0c4f-9bf4-4321-85e7-9f5d7bdf0a80 req-4d04d763-34f1-4f57-a1a8-72f84634f289 service nova] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Received unexpected event network-vif-plugged-b6962c71-a062-4eac-a40d-7e3df83cc086 for instance with vm_state building and task_state spawning.
Nov 22 08:06:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "016c8f4b-a226-4226-ba56-8a2b28cea146" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:06:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "016c8f4b-a226-4226-ba56-8a2b28cea146" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:06:17 user nova-compute[74348]: DEBUG nova.objects.instance [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lazy-loading 'flavor' on Instance uuid 016c8f4b-a226-4226-ba56-8a2b28cea146 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:06:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "016c8f4b-a226-4226-ba56-8a2b28cea146" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:06:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "016c8f4b-a226-4226-ba56-8a2b28cea146" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:06:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "016c8f4b-a226-4226-ba56-8a2b28cea146" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:06:17 user nova-compute[74348]: INFO nova.compute.manager [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Attaching volume e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a to /dev/vdb
Nov 22 08:06:17 user nova-compute[74348]: DEBUG os_brick.utils [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:06:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.045s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:17 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf045e5-63a7-4a51-aefd-bd601965befa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:17 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1d3f2d-1e62-4587-bfe6-6332fae49e3d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.133s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:17 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f626d33-6ca5-4e14-9a3a-75224e4482bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:17 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4512701-4689-4f06-b5dd-e207b7a454c8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:06:17 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 08:06:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:06:17 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 08:06:17 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[590494c5-fe3c-4567-800e-86edc9ddbd8e]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:17 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 08:06:17 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 08:06:17 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 08:06:17 user nova-compute[74348]: DEBUG os_brick.utils [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] <== get_connector_properties: return (339ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:06:17 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Updating existing volume attachment record: 00198062-d813-440d-883c-57d9f564bdcf {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 08:06:18 user nova-compute[74348]: DEBUG nova.compute.manager [req-2b62c33a-a0c2-43cd-bf9f-bcfb3de26c8b req-8b02a1f0-c656-4f8c-bf5d-499012c4a320 service nova] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Received event network-changed-014854c1-b4d7-4c60-830f-8aaa3f65c04c {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:06:18 user nova-compute[74348]: DEBUG nova.compute.manager [req-2b62c33a-a0c2-43cd-bf9f-bcfb3de26c8b req-8b02a1f0-c656-4f8c-bf5d-499012c4a320 service nova] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Refreshing instance network info cache due to event network-changed-014854c1-b4d7-4c60-830f-8aaa3f65c04c. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:06:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2b62c33a-a0c2-43cd-bf9f-bcfb3de26c8b req-8b02a1f0-c656-4f8c-bf5d-499012c4a320 service nova] Acquiring lock "refresh_cache-016c8f4b-a226-4226-ba56-8a2b28cea146" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:06:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2b62c33a-a0c2-43cd-bf9f-bcfb3de26c8b req-8b02a1f0-c656-4f8c-bf5d-499012c4a320 service nova] Acquired lock "refresh_cache-016c8f4b-a226-4226-ba56-8a2b28cea146" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:06:18 user nova-compute[74348]: DEBUG nova.network.neutron [req-2b62c33a-a0c2-43cd-bf9f-bcfb3de26c8b req-8b02a1f0-c656-4f8c-bf5d-499012c4a320 service nova] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Refreshing network info cache for port 014854c1-b4d7-4c60-830f-8aaa3f65c04c {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:06:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:19 user nova-compute[74348]: DEBUG nova.compute.manager [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 08:06:19 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 08:06:19 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Instance spawned successfully.
Nov 22 08:06:19 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 08:06:19 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:06:19 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:06:19 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:06:19 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:06:19 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:06:19 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:06:19 user nova-compute[74348]: DEBUG nova.network.neutron [req-2b62c33a-a0c2-43cd-bf9f-bcfb3de26c8b req-8b02a1f0-c656-4f8c-bf5d-499012c4a320 service nova] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Updated VIF entry in instance network info cache for port 014854c1-b4d7-4c60-830f-8aaa3f65c04c. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:06:19 user nova-compute[74348]: DEBUG nova.network.neutron [req-2b62c33a-a0c2-43cd-bf9f-bcfb3de26c8b req-8b02a1f0-c656-4f8c-bf5d-499012c4a320 service nova] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Updating instance_info_cache with network_info: [{"id": "014854c1-b4d7-4c60-830f-8aaa3f65c04c", "address": "fa:16:3e:b7:7f:68", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014854c1-b4", "ovs_interfaceid": "014854c1-b4d7-4c60-830f-8aaa3f65c04c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:06:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2b62c33a-a0c2-43cd-bf9f-bcfb3de26c8b req-8b02a1f0-c656-4f8c-bf5d-499012c4a320 service nova] Releasing lock "refresh_cache-016c8f4b-a226-4226-ba56-8a2b28cea146" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:06:19 user nova-compute[74348]: DEBUG nova.compute.manager [req-2b62c33a-a0c2-43cd-bf9f-bcfb3de26c8b req-8b02a1f0-c656-4f8c-bf5d-499012c4a320 service nova] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Received event network-vif-plugged-b6962c71-a062-4eac-a40d-7e3df83cc086 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:06:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2b62c33a-a0c2-43cd-bf9f-bcfb3de26c8b req-8b02a1f0-c656-4f8c-bf5d-499012c4a320 service nova] Acquiring lock "b95b6cae-1885-43e8-b589-ee89854100a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:06:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2b62c33a-a0c2-43cd-bf9f-bcfb3de26c8b req-8b02a1f0-c656-4f8c-bf5d-499012c4a320 service nova] Lock "b95b6cae-1885-43e8-b589-ee89854100a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:06:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2b62c33a-a0c2-43cd-bf9f-bcfb3de26c8b req-8b02a1f0-c656-4f8c-bf5d-499012c4a320 service nova] Lock "b95b6cae-1885-43e8-b589-ee89854100a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:06:19 user nova-compute[74348]: DEBUG nova.compute.manager [req-2b62c33a-a0c2-43cd-bf9f-bcfb3de26c8b req-8b02a1f0-c656-4f8c-bf5d-499012c4a320 service nova] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] No waiting events found dispatching network-vif-plugged-b6962c71-a062-4eac-a40d-7e3df83cc086 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:06:19 user nova-compute[74348]: WARNING nova.compute.manager [req-2b62c33a-a0c2-43cd-bf9f-bcfb3de26c8b req-8b02a1f0-c656-4f8c-bf5d-499012c4a320 service nova] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Received unexpected event network-vif-plugged-b6962c71-a062-4eac-a40d-7e3df83cc086 for instance with vm_state building and task_state spawning.
Nov 22 08:06:19 user nova-compute[74348]: INFO nova.compute.manager [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Took 10.38 seconds to spawn the instance on the hypervisor.
Nov 22 08:06:19 user nova-compute[74348]: DEBUG nova.compute.manager [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:06:19 user nova-compute[74348]: INFO nova.compute.manager [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Took 11.51 seconds to build instance.
Nov 22 08:06:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4753c8dd-3661-4d5c-9892-0c2defe481e5 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "b95b6cae-1885-43e8-b589-ee89854100a3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.654s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CTugBDcX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:06:22 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:06:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:06:22 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:06:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:06:22 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 08:06:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5 -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8eaaa5-829b-43d7-bb61-27c4cc002273]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 08:06:22 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[89251ae9-1ce4-433e-98e3-5887a0ee94b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5] added
Nov 22 08:06:22 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a382b66-450c-4dd1-a252-5ce23b86fa72]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d008dbef-de13-4d45-a3de-eb1a3108f0a6]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CTugBDcX {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CTugBDcX" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4b5dcb-e6c4-4af5-81c1-7b7289ec94c0]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CTugBDcX'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[590bd00c-78f3-401e-9a2c-9b520818ed99]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9573e8-c398-499e-818d-caf5d1cf102f]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:06:22 user nova-compute[74348]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)
Nov 22 08:06:22 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:06:22 user nova-compute[74348]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)
Nov 22 08:06:22 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5 -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1b60c8-53b0-40da-8642-2347ee527b5b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5, portal: 172.16.0.220,3260]
Nov 22 08:06:22 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5, portal: 172.16.0.220,3260] successful.
Nov 22 08:06:22 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[be82a45a-e4d7-4c2e-a1b4-f9d483c47775]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[002048e8-7b6e-4cd2-8670-605ca0a22053]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:06:22 user nova-compute[74348]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)
Nov 22 08:06:22 user nova-compute[74348]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5 (non-flash)
Nov 22 08:06:22 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:06:22 user nova-compute[74348]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)
Nov 22 08:06:22 user nova-compute[74348]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5 (non-flash)
Nov 22 08:06:22 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] HCTL ('35', '-', '-', 0) found on session 36 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[90914e00-8c19-4862-8187-46a52927d842]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:06:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CTugBDcX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 08:06:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:06:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23830343266376530', 'path': '/dev/sdd'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:06:23 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830343266376530', 'path': '/dev/sdd'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 08:06:23 user nova-compute[74348]: DEBUG nova.objects.instance [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lazy-loading 'flavor' on Instance uuid b6698b0d-0d43-47ea-bcdc-d99201d9833c {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:06:23 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 08:06:23 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:06:23 user nova-compute[74348]:   <source dev="/dev/sdd"/>
Nov 22 08:06:23 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:06:23 user nova-compute[74348]:   <serial>f60c0c47-ef14-4229-8dae-a89bf78009d5</serial>
Nov 22 08:06:23 user nova-compute[74348]: </disk>
Nov 22 08:06:23 user nova-compute[74348]:  {{(pid=74348) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] No VIF found with MAC fa:16:3e:d2:53:6d, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c458b88b-a75b-438f-9eca-9ec0189680fd tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.975s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bxSHZRyp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:06:24 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:06:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:06:24 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:06:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:06:24 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 08:06:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[72be3a6f-780b-4706-be43-58272ea7802b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 08:06:24 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5e8949-269b-47a7-9d64-699be7fa8599]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a] added
Nov 22 08:06:24 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a068d05-76c3-4715-a2c0-2d97cd6e01ae]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29d8f5c-8c55-4621-9c96-5f43970b7782]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bxSHZRyp {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bxSHZRyp" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6a6b36-24a5-4917-aa94-dc9a8baa48b6]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bxSHZRyp'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec24673-2a56-49b4-b5e9-78ce2b9ec200]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ffa253-3fa9-4ff5-9d29-42f3950eb72f]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:06:24 user nova-compute[74348]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)
Nov 22 08:06:24 user nova-compute[74348]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5 (non-flash)
Nov 22 08:06:24 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:06:24 user nova-compute[74348]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)
Nov 22 08:06:24 user nova-compute[74348]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5 (non-flash)
Nov 22 08:06:24 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1f93a7-74cd-4097-a090-ecb7e83b3220]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a, portal: 172.16.0.220,3260]
Nov 22 08:06:24 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a, portal: 172.16.0.220,3260] successful.
Nov 22 08:06:24 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f756e8a-58c4-4924-b488-c9e2cdf2f60f]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3f0be3-8d56-42cd-aab3-721bf57df74c]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:06:24 user nova-compute[74348]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)
Nov 22 08:06:24 user nova-compute[74348]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5 (non-flash)
Nov 22 08:06:24 user nova-compute[74348]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)
Nov 22 08:06:24 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:06:24 user nova-compute[74348]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)
Nov 22 08:06:24 user nova-compute[74348]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5 (non-flash)
Nov 22 08:06:24 user nova-compute[74348]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)
Nov 22 08:06:24 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] HCTL ('36', '-', '-', 0) found on session 37 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9fa582-d168-486c-ae8d-b42472719fa7]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:06:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bxSHZRyp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 08:06:25 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:06:25 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23333613133373163', 'path': '/dev/sde'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:06:25 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333613133373163', 'path': '/dev/sde'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 08:06:25 user nova-compute[74348]: DEBUG nova.objects.instance [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lazy-loading 'flavor' on Instance uuid 016c8f4b-a226-4226-ba56-8a2b28cea146 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:06:25 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 08:06:25 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:06:25 user nova-compute[74348]:   <source dev="/dev/sde"/>
Nov 22 08:06:25 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:06:25 user nova-compute[74348]:   <serial>e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a</serial>
Nov 22 08:06:25 user nova-compute[74348]: </disk>
Nov 22 08:06:25 user nova-compute[74348]:  {{(pid=74348) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 08:06:26 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:06:26 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:06:26 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] No VIF found with MAC fa:16:3e:b7:7f:68, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:06:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-0331f1bf-0499-490e-864a-004bd0a9ccea tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "016c8f4b-a226-4226-ba56-8a2b28cea146" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.093s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:06:27 user nova-compute[74348]: INFO nova.compute.manager [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Rebuilding instance
Nov 22 08:06:28 user nova-compute[74348]: DEBUG nova.compute.manager [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:06:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:28 user nova-compute[74348]: DEBUG nova.compute.manager [req-8eda4739-ff68-4d97-8989-e5f6ef5bd239 req-7d732cee-4ec3-47c2-b0bb-bec72888a8e5 service nova] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Received event network-vif-unplugged-014854c1-b4d7-4c60-830f-8aaa3f65c04c {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:06:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-8eda4739-ff68-4d97-8989-e5f6ef5bd239 req-7d732cee-4ec3-47c2-b0bb-bec72888a8e5 service nova] Acquiring lock "016c8f4b-a226-4226-ba56-8a2b28cea146-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:06:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-8eda4739-ff68-4d97-8989-e5f6ef5bd239 req-7d732cee-4ec3-47c2-b0bb-bec72888a8e5 service nova] Lock "016c8f4b-a226-4226-ba56-8a2b28cea146-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:06:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-8eda4739-ff68-4d97-8989-e5f6ef5bd239 req-7d732cee-4ec3-47c2-b0bb-bec72888a8e5 service nova] Lock "016c8f4b-a226-4226-ba56-8a2b28cea146-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:06:28 user nova-compute[74348]: DEBUG nova.compute.manager [req-8eda4739-ff68-4d97-8989-e5f6ef5bd239 req-7d732cee-4ec3-47c2-b0bb-bec72888a8e5 service nova] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] No waiting events found dispatching network-vif-unplugged-014854c1-b4d7-4c60-830f-8aaa3f65c04c {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:06:28 user nova-compute[74348]: WARNING nova.compute.manager [req-8eda4739-ff68-4d97-8989-e5f6ef5bd239 req-7d732cee-4ec3-47c2-b0bb-bec72888a8e5 service nova] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Received unexpected event network-vif-unplugged-014854c1-b4d7-4c60-830f-8aaa3f65c04c for instance with vm_state active and task_state rebuilding.
Nov 22 08:06:29 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Instance destroyed successfully.
Nov 22 08:06:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:29 user nova-compute[74348]: INFO nova.compute.manager [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Detaching volume e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a
Nov 22 08:06:29 user nova-compute[74348]: INFO nova.virt.block_device [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Attempting to driver detach volume e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a from mountpoint /dev/vdb
Nov 22 08:06:29 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Attempting to detach device vdb from instance 016c8f4b-a226-4226-ba56-8a2b28cea146 from the persistent domain config. {{(pid=74348) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:06:29 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:06:29 user nova-compute[74348]:   <source dev="/dev/sde"/>
Nov 22 08:06:29 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:06:29 user nova-compute[74348]:   <serial>e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a</serial>
Nov 22 08:06:29 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 08:06:29 user nova-compute[74348]: </disk>
Nov 22 08:06:29 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:06:29 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Successfully detached device vdb from instance 016c8f4b-a226-4226-ba56-8a2b28cea146 from the persistent domain config.
Nov 22 08:06:29 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bxSHZRyp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:06:29 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 22 08:06:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4c847b-c198-4f77-a13d-16aa11a90c35]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 08:06:29 user nova-compute[74348]: No targets found.
Nov 22 08:06:29 user nova-compute[74348]: iSNS:
Nov 22 08:06:29 user nova-compute[74348]: No targets found.
Nov 22 08:06:29 user nova-compute[74348]: STATIC:
Nov 22 08:06:29 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a
Nov 22 08:06:29 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:06:29 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:06:29 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8
Nov 22 08:06:29 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:06:29 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:06:29 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea
Nov 22 08:06:29 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:06:29 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:06:29 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5
Nov 22 08:06:29 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:06:29 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:06:29 user nova-compute[74348]: FIRMWARE:
Nov 22 08:06:29 user nova-compute[74348]: No targets found.
Nov 22 08:06:29 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 08:06:29 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 08:06:29 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eebfe84-0ce9-4b39-b825-d080fac1ed0b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b7782f-9ec7-432d-a4e8-1cbe26c1d010]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:06:29 user nova-compute[74348]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)
Nov 22 08:06:29 user nova-compute[74348]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5 (non-flash)
Nov 22 08:06:29 user nova-compute[74348]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)
Nov 22 08:06:29 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:06:29 user nova-compute[74348]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)
Nov 22 08:06:29 user nova-compute[74348]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5 (non-flash)
Nov 22 08:06:29 user nova-compute[74348]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)
Nov 22 08:06:29 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f22285adc60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a'): ({'sde'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Removing single pathed devices sde {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[396a1166-b5c2-47e8-b615-367ffd009e7b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e8d168-3f51-4eaf-b57c-f9c13a34699b]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Flushing IO for device /dev/sde {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[319206ae-fca7-41a3-8e37-e3482469f798]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.062s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8e197d-f085-4376-936b-7cad42b6e038]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] SCSI volumes sde have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b413357e-c8ae-4a48-b3ec-6c4eae7e32b3]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a35548-1abd-405b-8694-09b89ed9f921]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a, portal: 172.16.0.220,3260]
Nov 22 08:06:29 user nova-compute[74348]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a, portal: 172.16.0.220,3260] successful.
Nov 22 08:06:29 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a452cd5c-f2d1-4e52-bbf2-7f01062d950c]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] <== disconnect_volume: return (345ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:06:29 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 08:06:30 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Instance destroyed successfully.
Nov 22 08:06:30 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:04:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1819188158',display_name='tempest-ServerActionsTestOtherA-server-580891727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1819188158',id=33,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNd3+zQ71IrK3H/CeT/5sXY1BokTseqCM2aIkmRs++g+CAAgDFEf4yV5acjjuqLPFktfJ9gL8iuTvbEWurIg6VoeZwI5FnuAIzcoEVdZSVWfuZAGh4IJYsK7izDsTE/MYw==',key_name='tempest-keypair-568155222',keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:04:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d62fda81543f461288e324458620d07c',ramdisk_id='',reservation_id='r-0gzl4a3w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-90817446',owner_user_name='tempest-ServerActionsTestOtherA-90817446-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:06:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43550ccf30be49aba6ed6de2caf9ae1e',uuid=016c8f4b-a226-4226-ba56-8a2b28cea146,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "014854c1-b4d7-4c60-830f-8aaa3f65c04c", "address": "fa:16:3e:b7:7f:68", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014854c1-b4", "ovs_interfaceid": "014854c1-b4d7-4c60-830f-8aaa3f65c04c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Converting VIF {"id": "014854c1-b4d7-4c60-830f-8aaa3f65c04c", "address": "fa:16:3e:b7:7f:68", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014854c1-b4", "ovs_interfaceid": "014854c1-b4d7-4c60-830f-8aaa3f65c04c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:7f:68,bridge_name='br-int',has_traffic_filtering=True,id=014854c1-b4d7-4c60-830f-8aaa3f65c04c,network=Network(9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap014854c1-b4') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG os_vif [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:7f:68,bridge_name='br-int',has_traffic_filtering=True,id=014854c1-b4d7-4c60-830f-8aaa3f65c04c,network=Network(9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap014854c1-b4') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap014854c1-b4, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2e573bb5-a70a-4915-959a-cb4819383ed6) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:06:30 user nova-compute[74348]: INFO os_vif [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:7f:68,bridge_name='br-int',has_traffic_filtering=True,id=014854c1-b4d7-4c60-830f-8aaa3f65c04c,network=Network(9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap014854c1-b4')
Nov 22 08:06:30 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bxSHZRyp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:06:30 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 22 08:06:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[437e9dbc-e70d-4c7e-a99b-d1254da4b2b7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 08:06:30 user nova-compute[74348]: No targets found.
Nov 22 08:06:30 user nova-compute[74348]: iSNS:
Nov 22 08:06:30 user nova-compute[74348]: No targets found.
Nov 22 08:06:30 user nova-compute[74348]: STATIC:
Nov 22 08:06:30 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8
Nov 22 08:06:30 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:06:30 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:06:30 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea
Nov 22 08:06:30 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:06:30 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:06:30 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5
Nov 22 08:06:30 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:06:30 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:06:30 user nova-compute[74348]: FIRMWARE:
Nov 22 08:06:30 user nova-compute[74348]: No targets found.
Nov 22 08:06:30 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 08:06:30 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 08:06:30 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8320f6e4-f081-4f26-8a39-1dd13525793b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[67fa836f-aa3d-4184-bb69-199c5e6fd63d]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:06:30 user nova-compute[74348]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)
Nov 22 08:06:30 user nova-compute[74348]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5 (non-flash)
Nov 22 08:06:30 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:06:30 user nova-compute[74348]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)
Nov 22 08:06:30 user nova-compute[74348]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5 (non-flash)
Nov 22 08:06:30 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f22285bf010>, {}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Disconnecting from: [] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.076s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] <== disconnect_volume: return (77ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 08:06:30 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Deleting instance files /opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146_del
Nov 22 08:06:30 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Deletion of /opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146_del complete
Nov 22 08:06:30 user nova-compute[74348]: INFO nova.virt.block_device [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Booting with volume e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a at /dev/vdb
Nov 22 08:06:30 user nova-compute[74348]: DEBUG os_brick.utils [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51529fd-2fd4-4007-8917-032c2e75b100]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5543518-c5fc-4c62-8bbd-1f26d578982e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0a7963-655f-4461-be82-f42c39d33822]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f67ed30-ad7a-4f41-8ca0-3652d8f4370d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG nova.compute.manager [req-455e0df8-a212-4d12-85f2-93b1edf9a97b req-06d94359-1335-4143-b071-fd42e2d719a3 service nova] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Received event network-vif-plugged-014854c1-b4d7-4c60-830f-8aaa3f65c04c {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-455e0df8-a212-4d12-85f2-93b1edf9a97b req-06d94359-1335-4143-b071-fd42e2d719a3 service nova] Acquiring lock "016c8f4b-a226-4226-ba56-8a2b28cea146-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-455e0df8-a212-4d12-85f2-93b1edf9a97b req-06d94359-1335-4143-b071-fd42e2d719a3 service nova] Lock "016c8f4b-a226-4226-ba56-8a2b28cea146-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-455e0df8-a212-4d12-85f2-93b1edf9a97b req-06d94359-1335-4143-b071-fd42e2d719a3 service nova] Lock "016c8f4b-a226-4226-ba56-8a2b28cea146-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG nova.compute.manager [req-455e0df8-a212-4d12-85f2-93b1edf9a97b req-06d94359-1335-4143-b071-fd42e2d719a3 service nova] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] No waiting events found dispatching network-vif-plugged-014854c1-b4d7-4c60-830f-8aaa3f65c04c {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:06:30 user nova-compute[74348]: WARNING nova.compute.manager [req-455e0df8-a212-4d12-85f2-93b1edf9a97b req-06d94359-1335-4143-b071-fd42e2d719a3 service nova] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Received unexpected event network-vif-plugged-014854c1-b4d7-4c60-830f-8aaa3f65c04c for instance with vm_state active and task_state rebuild_block_device_mapping.
Nov 22 08:06:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:06:30 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 08:06:30 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[047eff69-47c7-4185-bb77-00993e859057]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG os_brick.utils [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:06:30 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Updating existing volume attachment record: cd1b9452-ff98-4374-bcd4-8126eed49dd2 {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 08:06:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:35 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:36 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:06:36 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:06:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-b8f84c0b-fab5-4900-bf65-270c9c06baf8" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:06:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-b8f84c0b-fab5-4900-bf65-270c9c06baf8" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:06:36 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 08:06:37 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Updating instance_info_cache with network_info: [{"id": "72e5b044-9d3b-412d-9a20-408387fb6fe6", "address": "fa:16:3e:5d:93:c7", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e5b044-9d", "ovs_interfaceid": "72e5b044-9d3b-412d-9a20-408387fb6fe6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:06:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-b8f84c0b-fab5-4900-bf65-270c9c06baf8" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:06:37 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 08:06:37 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 08:06:37 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Creating image(s)
Nov 22 08:06:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "/opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:06:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "/opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:06:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "/opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:06:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.186s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:06:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:06:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:37 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:06:37 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:06:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.191s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/disk 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/disk 1073741824" returned: 0 in 0.046s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:06:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.176s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:37 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Checking if we can resize image /opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/disk. size=1073741824 {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 08:06:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Cannot resize image /opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/disk to a smaller size. {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Ensure instance console log exists: /opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Start _get_guest_xml network_info=[{"id": "014854c1-b4d7-4c60-830f-8aaa3f65c04c", "address": "fa:16:3e:b7:7f:68", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014854c1-b4", "ovs_interfaceid": "014854c1-b4d7-4c60-830f-8aaa3f65c04c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bxSHZRyp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '016c8f4b-a226-4226-ba56-8a2b28cea146', 'attached_at': '', 'detached_at': '', 'volume_id': 'e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a', 'serial': 'e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'attachment_id': 'cd1b9452-ff98-4374-bcd4-8126eed49dd2', 'volume_type': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 08:06:38 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 22 08:06:38 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 22 08:06:38 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG nova.objects.instance [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lazy-loading 'vcpu_model' on Instance uuid 016c8f4b-a226-4226-ba56-8a2b28cea146 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bxSHZRyp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:06:38 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 22 08:06:38 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:06:38 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 22 08:06:38 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:06:38 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 08:06:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb7b00d-0873-4201-8390-a75278f28fff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 08:06:38 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae9fc1d-1878-40d0-a162-8cf4cbef1a9f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a] added
Nov 22 08:06:38 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf264141-9e22-441e-9707-57cfc2b3d37f]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f50dfcc-a502-4405-b03b-7be92c7cec83]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bxSHZRyp {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bxSHZRyp" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21b30ab-e606-4b56-ae7c-df670c4844d5]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bxSHZRyp'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[217e8946-ec14-439b-9780-8bcdb7081381]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3c4263-ea5a-4034-adb9-d600ac426b4c]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:06:38 user nova-compute[74348]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)
Nov 22 08:06:38 user nova-compute[74348]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5 (non-flash)
Nov 22 08:06:38 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:06:38 user nova-compute[74348]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)
Nov 22 08:06:38 user nova-compute[74348]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5 (non-flash)
Nov 22 08:06:38 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[af572549-188a-496c-a24b-98033821c1e7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a, portal: 172.16.0.220,3260]
Nov 22 08:06:38 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a, portal: 172.16.0.220,3260] successful.
Nov 22 08:06:38 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3f62af-cafc-44ed-ac6e-a90352582c72]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[58cb2b67-083f-4397-83a5-a745d9fc9afa]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:06:38 user nova-compute[74348]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)
Nov 22 08:06:38 user nova-compute[74348]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5 (non-flash)
Nov 22 08:06:38 user nova-compute[74348]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)
Nov 22 08:06:38 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:06:38 user nova-compute[74348]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)
Nov 22 08:06:38 user nova-compute[74348]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5 (non-flash)
Nov 22 08:06:38 user nova-compute[74348]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)
Nov 22 08:06:38 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] HCTL ('36', '-', '-', 0) found on session 38 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4196fc4b-6aff-412d-8968-e8955d3d7e18]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bxSHZRyp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-500c6a80-957c-434d-971e-dc7f7404bc78 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Acquiring lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-500c6a80-957c-434d-971e-dc7f7404bc78 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:06:38 user nova-compute[74348]: INFO nova.compute.manager [None req-500c6a80-957c-434d-971e-dc7f7404bc78 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Detaching volume f60c0c47-ef14-4229-8dae-a89bf78009d5
Nov 22 08:06:38 user nova-compute[74348]: INFO nova.virt.block_device [None req-500c6a80-957c-434d-971e-dc7f7404bc78 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Attempting to driver detach volume f60c0c47-ef14-4229-8dae-a89bf78009d5 from mountpoint /dev/vdb
Nov 22 08:06:38 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-500c6a80-957c-434d-971e-dc7f7404bc78 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Attempting to detach device vdb from instance b6698b0d-0d43-47ea-bcdc-d99201d9833c from the persistent domain config. {{(pid=74348) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-500c6a80-957c-434d-971e-dc7f7404bc78 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:06:38 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:06:38 user nova-compute[74348]:   <source dev="/dev/sdd"/>
Nov 22 08:06:38 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:06:38 user nova-compute[74348]:   <serial>f60c0c47-ef14-4229-8dae-a89bf78009d5</serial>
Nov 22 08:06:38 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 08:06:38 user nova-compute[74348]: </disk>
Nov 22 08:06:38 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:06:38 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-500c6a80-957c-434d-971e-dc7f7404bc78 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Successfully detached device vdb from instance b6698b0d-0d43-47ea-bcdc-d99201d9833c from the persistent domain config.
Nov 22 08:06:38 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-500c6a80-957c-434d-971e-dc7f7404bc78 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b6698b0d-0d43-47ea-bcdc-d99201d9833c from the live domain config. {{(pid=74348) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 08:06:38 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-500c6a80-957c-434d-971e-dc7f7404bc78 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:06:38 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:06:38 user nova-compute[74348]:   <source dev="/dev/sdd"/>
Nov 22 08:06:38 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:06:38 user nova-compute[74348]:   <serial>f60c0c47-ef14-4229-8dae-a89bf78009d5</serial>
Nov 22 08:06:38 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 08:06:38 user nova-compute[74348]: </disk>
Nov 22 08:06:38 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:06:39 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:39 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-500c6a80-957c-434d-971e-dc7f7404bc78 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b6698b0d-0d43-47ea-bcdc-d99201d9833c {{(pid=74348) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 08:06:39 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:06:39 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23333613133373163', 'path': '/dev/sde'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:06:39 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333613133373163', 'path': '/dev/sde'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 08:06:39 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-22T08:04:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1819188158',display_name='tempest-ServerActionsTestOtherA-server-580891727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1819188158',id=33,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNd3+zQ71IrK3H/CeT/5sXY1BokTseqCM2aIkmRs++g+CAAgDFEf4yV5acjjuqLPFktfJ9gL8iuTvbEWurIg6VoeZwI5FnuAIzcoEVdZSVWfuZAGh4IJYsK7izDsTE/MYw==',key_name='tempest-keypair-568155222',keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:04:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d62fda81543f461288e324458620d07c',ramdisk_id='',reservation_id='r-0gzl4a3w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-90817446',owner_user_name='tempest-ServerActionsTestOtherA-90817446-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:06:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43550ccf30be49aba6ed6de2caf9ae1e',uuid=016c8f4b-a226-4226-ba56-8a2b28cea146,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "014854c1-b4d7-4c60-830f-8aaa3f65c04c", "address": "fa:16:3e:b7:7f:68", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014854c1-b4", "ovs_interfaceid": "014854c1-b4d7-4c60-830f-8aaa3f65c04c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 08:06:39 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Converting VIF {"id": "014854c1-b4d7-4c60-830f-8aaa3f65c04c", "address": "fa:16:3e:b7:7f:68", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014854c1-b4", "ovs_interfaceid": "014854c1-b4d7-4c60-830f-8aaa3f65c04c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:06:39 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:7f:68,bridge_name='br-int',has_traffic_filtering=True,id=014854c1-b4d7-4c60-830f-8aaa3f65c04c,network=Network(9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap014854c1-b4') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:06:39 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] End _get_guest_xml xml=<domain type="kvm">
Nov 22 08:06:39 user nova-compute[74348]:   <uuid>016c8f4b-a226-4226-ba56-8a2b28cea146</uuid>
Nov 22 08:06:39 user nova-compute[74348]:   <name>instance-00000021</name>
Nov 22 08:06:39 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 08:06:39 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 08:06:39 user nova-compute[74348]:   <metadata>
Nov 22 08:06:39 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 08:06:39 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 08:06:39 user nova-compute[74348]:       <nova:name>tempest-ServerActionsTestOtherA-server-580891727</nova:name>
Nov 22 08:06:39 user nova-compute[74348]:       <nova:creationTime>2023-11-22 08:06:38</nova:creationTime>
Nov 22 08:06:39 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 08:06:39 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 08:06:39 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 08:06:39 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 08:06:39 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 08:06:39 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 08:06:39 user nova-compute[74348]:       </nova:flavor>
Nov 22 08:06:39 user nova-compute[74348]:       <nova:owner>
Nov 22 08:06:39 user nova-compute[74348]:         <nova:user uuid="43550ccf30be49aba6ed6de2caf9ae1e">tempest-ServerActionsTestOtherA-90817446-project-member</nova:user>
Nov 22 08:06:39 user nova-compute[74348]:         <nova:project uuid="d62fda81543f461288e324458620d07c">tempest-ServerActionsTestOtherA-90817446</nova:project>
Nov 22 08:06:39 user nova-compute[74348]:       </nova:owner>
Nov 22 08:06:39 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 08:06:39 user nova-compute[74348]:       <nova:ports>
Nov 22 08:06:39 user nova-compute[74348]:         <nova:port uuid="014854c1-b4d7-4c60-830f-8aaa3f65c04c">
Nov 22 08:06:39 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 22 08:06:39 user nova-compute[74348]:         </nova:port>
Nov 22 08:06:39 user nova-compute[74348]:       </nova:ports>
Nov 22 08:06:39 user nova-compute[74348]:     </nova:instance>
Nov 22 08:06:39 user nova-compute[74348]:   </metadata>
Nov 22 08:06:39 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 08:06:39 user nova-compute[74348]:     <system>
Nov 22 08:06:39 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 08:06:39 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 08:06:39 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 08:06:39 user nova-compute[74348]:       <entry name="serial">016c8f4b-a226-4226-ba56-8a2b28cea146</entry>
Nov 22 08:06:39 user nova-compute[74348]:       <entry name="uuid">016c8f4b-a226-4226-ba56-8a2b28cea146</entry>
Nov 22 08:06:39 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 08:06:39 user nova-compute[74348]:     </system>
Nov 22 08:06:39 user nova-compute[74348]:   </sysinfo>
Nov 22 08:06:39 user nova-compute[74348]:   <os>
Nov 22 08:06:39 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 08:06:39 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 08:06:39 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 08:06:39 user nova-compute[74348]:   </os>
Nov 22 08:06:39 user nova-compute[74348]:   <features>
Nov 22 08:06:39 user nova-compute[74348]:     <acpi/>
Nov 22 08:06:39 user nova-compute[74348]:     <apic/>
Nov 22 08:06:39 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 08:06:39 user nova-compute[74348]:   </features>
Nov 22 08:06:39 user nova-compute[74348]:   <clock offset="utc">
Nov 22 08:06:39 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 08:06:39 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 08:06:39 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 08:06:39 user nova-compute[74348]:   </clock>
Nov 22 08:06:39 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 08:06:39 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 08:06:39 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 08:06:39 user nova-compute[74348]:   </cpu>
Nov 22 08:06:39 user nova-compute[74348]:   <devices>
Nov 22 08:06:39 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 08:06:39 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 08:06:39 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/disk"/>
Nov 22 08:06:39 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 08:06:39 user nova-compute[74348]:     </disk>
Nov 22 08:06:39 user nova-compute[74348]:     <disk type="block" device="disk">
Nov 22 08:06:39 user nova-compute[74348]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:06:39 user nova-compute[74348]:       <source dev="/dev/sde"/>
Nov 22 08:06:39 user nova-compute[74348]:       <target dev="vdb" bus="virtio"/>
Nov 22 08:06:39 user nova-compute[74348]:       <serial>e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a</serial>
Nov 22 08:06:39 user nova-compute[74348]:     </disk>
Nov 22 08:06:39 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 08:06:39 user nova-compute[74348]:       <mac address="fa:16:3e:b7:7f:68"/>
Nov 22 08:06:39 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:06:39 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 08:06:39 user nova-compute[74348]:       <target dev="tap014854c1-b4"/>
Nov 22 08:06:39 user nova-compute[74348]:     </interface>
Nov 22 08:06:39 user nova-compute[74348]:     <serial type="pty">
Nov 22 08:06:39 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/console.log" append="off"/>
Nov 22 08:06:39 user nova-compute[74348]:     </serial>
Nov 22 08:06:39 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 08:06:39 user nova-compute[74348]:     <video>
Nov 22 08:06:39 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:06:39 user nova-compute[74348]:     </video>
Nov 22 08:06:39 user nova-compute[74348]:     <rng model="virtio">
Nov 22 08:06:39 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 08:06:39 user nova-compute[74348]:     </rng>
Nov 22 08:06:39 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 08:06:39 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 08:06:39 user nova-compute[74348]:       <stats period="10"/>
Nov 22 08:06:39 user nova-compute[74348]:     </memballoon>
Nov 22 08:06:39 user nova-compute[74348]:   </devices>
Nov 22 08:06:39 user nova-compute[74348]: </domain>
Nov 22 08:06:39 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 08:06:39 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-22T08:04:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1819188158',display_name='tempest-ServerActionsTestOtherA-server-580891727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1819188158',id=33,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNd3+zQ71IrK3H/CeT/5sXY1BokTseqCM2aIkmRs++g+CAAgDFEf4yV5acjjuqLPFktfJ9gL8iuTvbEWurIg6VoeZwI5FnuAIzcoEVdZSVWfuZAGh4IJYsK7izDsTE/MYw==',key_name='tempest-keypair-568155222',keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:04:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d62fda81543f461288e324458620d07c',ramdisk_id='',reservation_id='r-0gzl4a3w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-90817446',owner_user_name='tempest-ServerActionsTestOtherA-90817446-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:06:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43550ccf30be49aba6ed6de2caf9ae1e',uuid=016c8f4b-a226-4226-ba56-8a2b28cea146,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "014854c1-b4d7-4c60-830f-8aaa3f65c04c", "address": "fa:16:3e:b7:7f:68", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014854c1-b4", "ovs_interfaceid": "014854c1-b4d7-4c60-830f-8aaa3f65c04c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 08:06:39 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Converting VIF {"id": "014854c1-b4d7-4c60-830f-8aaa3f65c04c", "address": "fa:16:3e:b7:7f:68", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014854c1-b4", "ovs_interfaceid": "014854c1-b4d7-4c60-830f-8aaa3f65c04c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:06:39 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:7f:68,bridge_name='br-int',has_traffic_filtering=True,id=014854c1-b4d7-4c60-830f-8aaa3f65c04c,network=Network(9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap014854c1-b4') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:06:39 user nova-compute[74348]: DEBUG os_vif [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:7f:68,bridge_name='br-int',has_traffic_filtering=True,id=014854c1-b4d7-4c60-830f-8aaa3f65c04c,network=Network(9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap014854c1-b4') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 08:06:39 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:39 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:06:39 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 08:06:39 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:39 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '67d3fd11-0738-5677-90b7-faf4c1169eab', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:06:39 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:39 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:06:39 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:39 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap014854c1-b4, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:06:39 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap014854c1-b4, col_values=(('qos', UUID('dbbfac27-3cff-4b9d-9714-c559ac709ede')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:06:39 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap014854c1-b4, col_values=(('external_ids', {'iface-id': '014854c1-b4d7-4c60-830f-8aaa3f65c04c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:7f:68', 'vm-uuid': '016c8f4b-a226-4226-ba56-8a2b28cea146'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:06:39 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:39 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:06:39 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:39 user nova-compute[74348]: INFO os_vif [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:7f:68,bridge_name='br-int',has_traffic_filtering=True,id=014854c1-b4d7-4c60-830f-8aaa3f65c04c,network=Network(9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap014854c1-b4')
Nov 22 08:06:39 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:06:39 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:06:39 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] No VIF found with MAC fa:16:3e:b7:7f:68, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:06:40 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:06:40 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:06:40 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:06:40 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:06:40 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:40 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:40 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:40 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:41 user nova-compute[74348]: DEBUG nova.compute.manager [req-f593ce9c-c5f8-43bc-a1bb-cac02982e9d7 req-5dc5e300-bea9-4980-91ee-723f0744723f service nova] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Received event network-vif-plugged-014854c1-b4d7-4c60-830f-8aaa3f65c04c {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:06:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f593ce9c-c5f8-43bc-a1bb-cac02982e9d7 req-5dc5e300-bea9-4980-91ee-723f0744723f service nova] Acquiring lock "016c8f4b-a226-4226-ba56-8a2b28cea146-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:06:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f593ce9c-c5f8-43bc-a1bb-cac02982e9d7 req-5dc5e300-bea9-4980-91ee-723f0744723f service nova] Lock "016c8f4b-a226-4226-ba56-8a2b28cea146-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:06:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f593ce9c-c5f8-43bc-a1bb-cac02982e9d7 req-5dc5e300-bea9-4980-91ee-723f0744723f service nova] Lock "016c8f4b-a226-4226-ba56-8a2b28cea146-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:06:41 user nova-compute[74348]: DEBUG nova.compute.manager [req-f593ce9c-c5f8-43bc-a1bb-cac02982e9d7 req-5dc5e300-bea9-4980-91ee-723f0744723f service nova] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] No waiting events found dispatching network-vif-plugged-014854c1-b4d7-4c60-830f-8aaa3f65c04c {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:06:41 user nova-compute[74348]: WARNING nova.compute.manager [req-f593ce9c-c5f8-43bc-a1bb-cac02982e9d7 req-5dc5e300-bea9-4980-91ee-723f0744723f service nova] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Received unexpected event network-vif-plugged-014854c1-b4d7-4c60-830f-8aaa3f65c04c for instance with vm_state active and task_state rebuild_spawning.
Nov 22 08:06:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:41 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:06:41 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:06:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:06:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:06:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:06:41 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:06:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:41 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:42 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:06:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6698b0d-0d43-47ea-bcdc-d99201d9833c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6698b0d-0d43-47ea-bcdc-d99201d9833c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6698b0d-0d43-47ea-bcdc-d99201d9833c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6698b0d-0d43-47ea-bcdc-d99201d9833c/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:43 user nova-compute[74348]: DEBUG nova.compute.manager [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 08:06:43 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 08:06:43 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Instance spawned successfully.
Nov 22 08:06:43 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 08:06:43 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:06:43 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:06:43 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:06:43 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:06:43 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:06:43 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:06:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:43 user nova-compute[74348]: DEBUG nova.compute.manager [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:06:43 user nova-compute[74348]: DEBUG nova.compute.manager [req-393ec099-d100-4ca4-b573-7d9b4f8c5d8f req-55467a96-6e84-44aa-993b-fcdde520d364 service nova] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Received event network-vif-plugged-014854c1-b4d7-4c60-830f-8aaa3f65c04c {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:06:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-393ec099-d100-4ca4-b573-7d9b4f8c5d8f req-55467a96-6e84-44aa-993b-fcdde520d364 service nova] Acquiring lock "016c8f4b-a226-4226-ba56-8a2b28cea146-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:06:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-393ec099-d100-4ca4-b573-7d9b4f8c5d8f req-55467a96-6e84-44aa-993b-fcdde520d364 service nova] Lock "016c8f4b-a226-4226-ba56-8a2b28cea146-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:06:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-393ec099-d100-4ca4-b573-7d9b4f8c5d8f req-55467a96-6e84-44aa-993b-fcdde520d364 service nova] Lock "016c8f4b-a226-4226-ba56-8a2b28cea146-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:06:43 user nova-compute[74348]: DEBUG nova.compute.manager [req-393ec099-d100-4ca4-b573-7d9b4f8c5d8f req-55467a96-6e84-44aa-993b-fcdde520d364 service nova] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] No waiting events found dispatching network-vif-plugged-014854c1-b4d7-4c60-830f-8aaa3f65c04c {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:06:43 user nova-compute[74348]: WARNING nova.compute.manager [req-393ec099-d100-4ca4-b573-7d9b4f8c5d8f req-55467a96-6e84-44aa-993b-fcdde520d364 service nova] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Received unexpected event network-vif-plugged-014854c1-b4d7-4c60-830f-8aaa3f65c04c for instance with vm_state active and task_state rebuild_spawning.
Nov 22 08:06:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:06:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:06:43 user nova-compute[74348]: DEBUG nova.objects.instance [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74348) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 22 08:06:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:43 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:06:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-32354433-4737-4730-b89d-4466aab213f7 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.108s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:06:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:43 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:06:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:44 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:44 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19d2696-fccb-4b94-8a42-a76b35b32582/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19d2696-fccb-4b94-8a42-a76b35b32582/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19d2696-fccb-4b94-8a42-a76b35b32582/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19d2696-fccb-4b94-8a42-a76b35b32582/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fcddbef-dfaf-48a5-8561-26b8857fdbd6/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fcddbef-dfaf-48a5-8561-26b8857fdbd6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fcddbef-dfaf-48a5-8561-26b8857fdbd6/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fcddbef-dfaf-48a5-8561-26b8857fdbd6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:46 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:06:46 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:06:46 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=7584MB free_disk=24.783035278320312GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:06:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:06:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:06:46 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 765f8c47-c042-4430-8d35-07926ad693fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:06:46 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance b8f84c0b-fab5-4900-bf65-270c9c06baf8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:06:46 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 37c93c2a-1397-4b04-aef1-5068218ad9fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:06:46 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 5006cff5-4b67-405d-b6b1-4c355f82d920 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:06:46 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 555f4246-d4b2-4f2f-b91c-dda8fe47264c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:06:46 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance ba74ca7d-2875-426c-a485-d908af865bae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:06:46 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance b6698b0d-0d43-47ea-bcdc-d99201d9833c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:06:46 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 016c8f4b-a226-4226-ba56-8a2b28cea146 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:06:46 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 4fcddbef-dfaf-48a5-8561-26b8857fdbd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:06:46 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance a19d2696-fccb-4b94-8a42-a76b35b32582 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:06:46 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance b95b6cae-1885-43e8-b589-ee89854100a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:06:46 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:06:46 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:06:47 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:06:47 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:06:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Acquiring lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:06:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:06:47 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:06:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.563s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:06:47 user nova-compute[74348]: DEBUG nova.objects.instance [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lazy-loading 'flavor' on Instance uuid 4fcddbef-dfaf-48a5-8561-26b8857fdbd6 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:06:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:06:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Acquiring lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:06:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:06:47 user nova-compute[74348]: INFO nova.compute.manager [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Attaching volume 4fe21fec-f8eb-4806-a4b7-c1837032b030 to /dev/vdb
Nov 22 08:06:47 user nova-compute[74348]: DEBUG os_brick.utils [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:06:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:47 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[99385db0-4250-4bb8-aee1-48314f6eda66]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:47 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab654977-1515-41cc-9b82-16d63de7d36b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:47 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03aaeba-5b9e-4393-aa3d-87dad3c0f6de]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:47 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aec11fe-66ab-4044-9fcf-f62111b3f159]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:06:47 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 08:06:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:06:47 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 08:06:47 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01053d0-be72-40f0-9962-807786d946f0]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:47 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 08:06:47 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 08:06:47 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 08:06:47 user nova-compute[74348]: DEBUG os_brick.utils [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:06:47 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Updating existing volume attachment record: 9aca0e40-1981-4a80-8452-ef879be74bd5 {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 08:06:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:48 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:06:48 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:06:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b0d082bf-a952-4c37-850b-3ab003f66481 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquiring lock "37c93c2a-1397-4b04-aef1-5068218ad9fd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:06:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b0d082bf-a952-4c37-850b-3ab003f66481 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "37c93c2a-1397-4b04-aef1-5068218ad9fd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:06:48 user nova-compute[74348]: INFO nova.compute.manager [None req-b0d082bf-a952-4c37-850b-3ab003f66481 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Detaching volume 5d3034db-c569-4cd9-ad54-142be23d7dea
Nov 22 08:06:48 user nova-compute[74348]: INFO nova.virt.block_device [None req-b0d082bf-a952-4c37-850b-3ab003f66481 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Attempting to driver detach volume 5d3034db-c569-4cd9-ad54-142be23d7dea from mountpoint /dev/vdb
Nov 22 08:06:48 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b0d082bf-a952-4c37-850b-3ab003f66481 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Attempting to detach device vdb from instance 37c93c2a-1397-4b04-aef1-5068218ad9fd from the persistent domain config. {{(pid=74348) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 08:06:48 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-b0d082bf-a952-4c37-850b-3ab003f66481 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:06:48 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:06:48 user nova-compute[74348]:   <source dev="/dev/sdc"/>
Nov 22 08:06:48 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:06:48 user nova-compute[74348]:   <serial>5d3034db-c569-4cd9-ad54-142be23d7dea</serial>
Nov 22 08:06:48 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 22 08:06:48 user nova-compute[74348]: </disk>
Nov 22 08:06:48 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:06:48 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-b0d082bf-a952-4c37-850b-3ab003f66481 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Successfully detached device vdb from instance 37c93c2a-1397-4b04-aef1-5068218ad9fd from the persistent domain config.
Nov 22 08:06:48 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b0d082bf-a952-4c37-850b-3ab003f66481 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 37c93c2a-1397-4b04-aef1-5068218ad9fd from the live domain config. {{(pid=74348) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 08:06:48 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-b0d082bf-a952-4c37-850b-3ab003f66481 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:06:48 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:06:48 user nova-compute[74348]:   <source dev="/dev/sdc"/>
Nov 22 08:06:48 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:06:48 user nova-compute[74348]:   <serial>5d3034db-c569-4cd9-ad54-142be23d7dea</serial>
Nov 22 08:06:48 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 22 08:06:48 user nova-compute[74348]: </disk>
Nov 22 08:06:48 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:06:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b0d082bf-a952-4c37-850b-3ab003f66481 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 37c93c2a-1397-4b04-aef1-5068218ad9fd {{(pid=74348) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 08:06:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG nova.compute.manager [req-6f41319e-d8cd-488f-80b9-ff90d68a9791 req-163fcc18-549a-47f5-a897-12dd50eb7f3a service nova] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Received event network-changed-9122ca7d-1ee6-4cae-be01-8b846027d7d8 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG nova.compute.manager [req-6f41319e-d8cd-488f-80b9-ff90d68a9791 req-163fcc18-549a-47f5-a897-12dd50eb7f3a service nova] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Refreshing instance network info cache due to event network-changed-9122ca7d-1ee6-4cae-be01-8b846027d7d8. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-6f41319e-d8cd-488f-80b9-ff90d68a9791 req-163fcc18-549a-47f5-a897-12dd50eb7f3a service nova] Acquiring lock "refresh_cache-a19d2696-fccb-4b94-8a42-a76b35b32582" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-6f41319e-d8cd-488f-80b9-ff90d68a9791 req-163fcc18-549a-47f5-a897-12dd50eb7f3a service nova] Acquired lock "refresh_cache-a19d2696-fccb-4b94-8a42-a76b35b32582" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG nova.network.neutron [req-6f41319e-d8cd-488f-80b9-ff90d68a9791 req-163fcc18-549a-47f5-a897-12dd50eb7f3a service nova] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Refreshing network info cache for port 9122ca7d-1ee6-4cae-be01-8b846027d7d8 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:06:59 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-500c6a80-957c-434d-971e-dc7f7404bc78 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b6698b0d-0d43-47ea-bcdc-d99201d9833c is timed out.
Nov 22 08:06:59 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-500c6a80-957c-434d-971e-dc7f7404bc78 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Successfully detached device vdb from instance b6698b0d-0d43-47ea-bcdc-d99201d9833c from the live domain config.
Nov 22 08:06:59 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-500c6a80-957c-434d-971e-dc7f7404bc78 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c6a80-957c-434d-971e-dc7f7404bc78 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CTugBDcX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:06:59 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-500c6a80-957c-434d-971e-dc7f7404bc78 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:06:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-500c6a80-957c-434d-971e-dc7f7404bc78 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-500c6a80-957c-434d-971e-dc7f7404bc78 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b97b7b-90a2-40e6-8845-5aed8f64a622]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c6a80-957c-434d-971e-dc7f7404bc78 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 08:06:59 user nova-compute[74348]: No targets found.
Nov 22 08:06:59 user nova-compute[74348]: iSNS:
Nov 22 08:06:59 user nova-compute[74348]: No targets found.
Nov 22 08:06:59 user nova-compute[74348]: STATIC:
Nov 22 08:06:59 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a
Nov 22 08:06:59 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:06:59 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:06:59 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8
Nov 22 08:06:59 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:06:59 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:06:59 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea
Nov 22 08:06:59 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:06:59 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:06:59 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5
Nov 22 08:06:59 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:06:59 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:06:59 user nova-compute[74348]: FIRMWARE:
Nov 22 08:06:59 user nova-compute[74348]: No targets found.
Nov 22 08:06:59 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c6a80-957c-434d-971e-dc7f7404bc78 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 08:06:59 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 08:06:59 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c6a80-957c-434d-971e-dc7f7404bc78 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cefb31e-63d0-4fd3-8928-e0a931f9df05]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[916c87c6-6d3e-45a0-b48f-1660dda4c318]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c6a80-957c-434d-971e-dc7f7404bc78 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:06:59 user nova-compute[74348]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)
Nov 22 08:06:59 user nova-compute[74348]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5 (non-flash)
Nov 22 08:06:59 user nova-compute[74348]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)
Nov 22 08:06:59 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c6a80-957c-434d-971e-dc7f7404bc78 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:06:59 user nova-compute[74348]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)
Nov 22 08:06:59 user nova-compute[74348]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5 (non-flash)
Nov 22 08:06:59 user nova-compute[74348]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)
Nov 22 08:06:59 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c6a80-957c-434d-971e-dc7f7404bc78 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f224c7bd750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5'): ({'sdd'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-500c6a80-957c-434d-971e-dc7f7404bc78 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Removing single pathed devices sdd {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Acquiring lock "a19d2696-fccb-4b94-8a42-a76b35b32582" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "a19d2696-fccb-4b94-8a42-a76b35b32582" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb20384-f425-41a0-b1eb-1acbd1db1e18]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG nova.objects.instance [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lazy-loading 'flavor' on Instance uuid a19d2696-fccb-4b94-8a42-a76b35b32582 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[928fcc6e-2c19-445e-b77d-9f7b6e665b0d]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-500c6a80-957c-434d-971e-dc7f7404bc78 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Flushing IO for device /dev/sdd {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:59 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Ignoring supplied device name: /dev/vdb
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[12af6c5d-7c4d-4c20-abd0-6677d7d37764]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-500c6a80-957c-434d-971e-dc7f7404bc78 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "a19d2696-fccb-4b94-8a42-a76b35b32582" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.058s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd6ef43-adb3-45ed-aa75-eefc1ccc18da]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-500c6a80-957c-434d-971e-dc7f7404bc78 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-500c6a80-957c-434d-971e-dc7f7404bc78 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] SCSI volumes sdd have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c6a80-957c-434d-971e-dc7f7404bc78 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd3452b-047c-4fa2-bdf1-b13f8005fb31]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c6a80-957c-434d-971e-dc7f7404bc78 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5 -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG nova.network.neutron [req-6f41319e-d8cd-488f-80b9-ff90d68a9791 req-163fcc18-549a-47f5-a897-12dd50eb7f3a service nova] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Updated VIF entry in instance network info cache for port 9122ca7d-1ee6-4cae-be01-8b846027d7d8. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG nova.network.neutron [req-6f41319e-d8cd-488f-80b9-ff90d68a9791 req-163fcc18-549a-47f5-a897-12dd50eb7f3a service nova] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Updating instance_info_cache with network_info: [{"id": "9122ca7d-1ee6-4cae-be01-8b846027d7d8", "address": "fa:16:3e:f7:7e:99", "network": {"id": "59f6f7a7-7076-40e9-8db7-944f89ecb7e5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1331190296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c0496e87c6a468fab4258553c68b8d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9122ca7d-1e", "ovs_interfaceid": "9122ca7d-1ee6-4cae-be01-8b846027d7d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e3c188-5a67-4b34-ae08-8db2d27044c2]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c6a80-957c-434d-971e-dc7f7404bc78 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5, portal: 172.16.0.220,3260]
Nov 22 08:06:59 user nova-compute[74348]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5, portal: 172.16.0.220,3260] successful.
Nov 22 08:06:59 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5 -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f60c0c47-ef14-4229-8dae-a89bf78009d5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b762ced-d86c-4b8f-a5cd-e838a0f72dc1]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c6a80-957c-434d-971e-dc7f7404bc78 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-500c6a80-957c-434d-971e-dc7f7404bc78 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c6a80-957c-434d-971e-dc7f7404bc78 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] <== disconnect_volume: return (345ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-500c6a80-957c-434d-971e-dc7f7404bc78 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Acquiring lock "a19d2696-fccb-4b94-8a42-a76b35b32582" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "a19d2696-fccb-4b94-8a42-a76b35b32582" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:06:59 user nova-compute[74348]: INFO nova.compute.manager [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Attaching volume 403b055a-b502-474c-92d5-5ab72126df0d to /dev/vdb
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-6f41319e-d8cd-488f-80b9-ff90d68a9791 req-163fcc18-549a-47f5-a897-12dd50eb7f3a service nova] Releasing lock "refresh_cache-a19d2696-fccb-4b94-8a42-a76b35b32582" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG os_brick.utils [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'itQRJXCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:06:59 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:06:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:06:59 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:06:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:06:59 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc1a2fc-14e1-4135-8f8c-70f7257286f4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1e8073-d61e-4c87-a5dc-4141b519b555]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 -p 172.16.0.220:3260" returned: 21 in 0.032s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6fbb95-08ba-4995-a6a2-42734062e42e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 08:06:59 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:06:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7cb03b-a9f0-48ee-8124-6a7a548f2bc6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d4a94e-abe0-4010-89c7-d3796220000e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2455e099-0f19-4b6c-ba0a-4147287c0031]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030] added
Nov 22 08:07:00 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:07:00 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 08:07:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f454e779-65b7-4144-8606-ecbf537d9cca]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf0bd8d-5f0a-4a7f-a274-879bc1188a38]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG os_brick.utils [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Updating existing volume attachment record: cc099855-38f1-4ad5-a121-40c145c79451 {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[637b7288-76f6-494a-8443-ececfe1a53b2]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v itQRJXCb {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v itQRJXCb" returned: 0 in 0.027s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa10c0e8-3290-4b7a-a2fd-b5c0b995d51f]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'itQRJXCb'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4e3738-c931-4a5e-bbe8-94264a5bed66]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f207b1f-4a85-44eb-8e03-3d7696c753b2]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:07:00 user nova-compute[74348]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)
Nov 22 08:07:00 user nova-compute[74348]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)
Nov 22 08:07:00 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:07:00 user nova-compute[74348]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)
Nov 22 08:07:00 user nova-compute[74348]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)
Nov 22 08:07:00 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7f7d3a-8c83-4819-b87c-e3a0bf084ea5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030, portal: 172.16.0.220,3260]
Nov 22 08:07:00 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030, portal: 172.16.0.220,3260] successful.
Nov 22 08:07:00 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3aa2a4-81e4-40a9-a613-a6c9f5d6686f]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc40e3c2-9b88-4bc9-b083-76aae123c966]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:07:00 user nova-compute[74348]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)
Nov 22 08:07:00 user nova-compute[74348]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)
Nov 22 08:07:00 user nova-compute[74348]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 (non-flash)
Nov 22 08:07:00 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:07:00 user nova-compute[74348]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)
Nov 22 08:07:00 user nova-compute[74348]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)
Nov 22 08:07:00 user nova-compute[74348]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 (non-flash)
Nov 22 08:07:00 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b579000-b009-4228-808d-43a771d9c82b]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:07:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'itQRJXCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 08:07:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.422s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:07:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] <== connect_volume: return (1424ms) {'type': 'block', 'scsi_wwn': '23339376132613339', 'path': '/dev/sdd'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:07:01 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339376132613339', 'path': '/dev/sdd'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 08:07:01 user nova-compute[74348]: DEBUG nova.objects.instance [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lazy-loading 'flavor' on Instance uuid 4fcddbef-dfaf-48a5-8561-26b8857fdbd6 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:07:01 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 08:07:01 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:07:01 user nova-compute[74348]:   <source dev="/dev/sdd"/>
Nov 22 08:07:01 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:07:01 user nova-compute[74348]:   <serial>4fe21fec-f8eb-4806-a4b7-c1837032b030</serial>
Nov 22 08:07:01 user nova-compute[74348]: </disk>
Nov 22 08:07:01 user nova-compute[74348]:  {{(pid=74348) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 08:07:01 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:07:01 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:07:01 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] No VIF found with MAC fa:16:3e:b3:59:21, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:07:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d9344468-da92-450a-918b-337c17c224d2 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.440s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:07:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:04 user nova-compute[74348]: DEBUG nova.compute.manager [req-6f1b9ae9-1698-4a9f-b2f6-6c271db0a036 req-c6b12258-9f57-4d03-ac16-81b15605a3bf service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Received event network-changed-71e66d69-de38-4524-8517-ce8bba4a01e0 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:07:04 user nova-compute[74348]: DEBUG nova.compute.manager [req-6f1b9ae9-1698-4a9f-b2f6-6c271db0a036 req-c6b12258-9f57-4d03-ac16-81b15605a3bf service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Refreshing instance network info cache due to event network-changed-71e66d69-de38-4524-8517-ce8bba4a01e0. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:07:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-6f1b9ae9-1698-4a9f-b2f6-6c271db0a036 req-c6b12258-9f57-4d03-ac16-81b15605a3bf service nova] Acquiring lock "refresh_cache-4fcddbef-dfaf-48a5-8561-26b8857fdbd6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:07:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-6f1b9ae9-1698-4a9f-b2f6-6c271db0a036 req-c6b12258-9f57-4d03-ac16-81b15605a3bf service nova] Acquired lock "refresh_cache-4fcddbef-dfaf-48a5-8561-26b8857fdbd6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:07:04 user nova-compute[74348]: DEBUG nova.network.neutron [req-6f1b9ae9-1698-4a9f-b2f6-6c271db0a036 req-c6b12258-9f57-4d03-ac16-81b15605a3bf service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Refreshing network info cache for port 71e66d69-de38-4524-8517-ce8bba4a01e0 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:07:05 user nova-compute[74348]: DEBUG nova.objects.instance [None req-500c6a80-957c-434d-971e-dc7f7404bc78 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lazy-loading 'flavor' on Instance uuid b6698b0d-0d43-47ea-bcdc-d99201d9833c {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:07:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-500c6a80-957c-434d-971e-dc7f7404bc78 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 26.325s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:07:05 user nova-compute[74348]: DEBUG nova.network.neutron [req-6f1b9ae9-1698-4a9f-b2f6-6c271db0a036 req-c6b12258-9f57-4d03-ac16-81b15605a3bf service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Updated VIF entry in instance network info cache for port 71e66d69-de38-4524-8517-ce8bba4a01e0. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:07:05 user nova-compute[74348]: DEBUG nova.network.neutron [req-6f1b9ae9-1698-4a9f-b2f6-6c271db0a036 req-c6b12258-9f57-4d03-ac16-81b15605a3bf service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Updating instance_info_cache with network_info: [{"id": "71e66d69-de38-4524-8517-ce8bba4a01e0", "address": "fa:16:3e:b3:59:21", "network": {"id": "442abc57-45e5-4cd7-878e-979afa78c421", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1395369508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d76d03d17cc4e5bb52a32a2f8fbd629", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71e66d69-de", "ovs_interfaceid": "71e66d69-de38-4524-8517-ce8bba4a01e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:07:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-6f1b9ae9-1698-4a9f-b2f6-6c271db0a036 req-c6b12258-9f57-4d03-ac16-81b15605a3bf service nova] Releasing lock "refresh_cache-4fcddbef-dfaf-48a5-8561-26b8857fdbd6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:07:07 user nova-compute[74348]: DEBUG nova.compute.manager [req-4b0f6fb7-dab2-4870-a480-7c12384c0cb0 req-42e8239f-79c4-4682-82a5-bfbdceac56e1 service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Received event network-changed-71e66d69-de38-4524-8517-ce8bba4a01e0 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:07:07 user nova-compute[74348]: DEBUG nova.compute.manager [req-4b0f6fb7-dab2-4870-a480-7c12384c0cb0 req-42e8239f-79c4-4682-82a5-bfbdceac56e1 service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Refreshing instance network info cache due to event network-changed-71e66d69-de38-4524-8517-ce8bba4a01e0. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:07:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4b0f6fb7-dab2-4870-a480-7c12384c0cb0 req-42e8239f-79c4-4682-82a5-bfbdceac56e1 service nova] Acquiring lock "refresh_cache-4fcddbef-dfaf-48a5-8561-26b8857fdbd6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:07:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4b0f6fb7-dab2-4870-a480-7c12384c0cb0 req-42e8239f-79c4-4682-82a5-bfbdceac56e1 service nova] Acquired lock "refresh_cache-4fcddbef-dfaf-48a5-8561-26b8857fdbd6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:07:07 user nova-compute[74348]: DEBUG nova.network.neutron [req-4b0f6fb7-dab2-4870-a480-7c12384c0cb0 req-42e8239f-79c4-4682-82a5-bfbdceac56e1 service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Refreshing network info cache for port 71e66d69-de38-4524-8517-ce8bba4a01e0 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:07:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-cf3e1671-fd28-4f3d-9379-319d09f5b933 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Acquiring lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:07:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-cf3e1671-fd28-4f3d-9379-319d09f5b933 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:07:07 user nova-compute[74348]: INFO nova.compute.manager [None req-cf3e1671-fd28-4f3d-9379-319d09f5b933 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Rebooting instance
Nov 22 08:07:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-cf3e1671-fd28-4f3d-9379-319d09f5b933 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Acquiring lock "refresh_cache-4fcddbef-dfaf-48a5-8561-26b8857fdbd6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:07:07 user nova-compute[74348]: DEBUG nova.network.neutron [req-4b0f6fb7-dab2-4870-a480-7c12384c0cb0 req-42e8239f-79c4-4682-82a5-bfbdceac56e1 service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Updated VIF entry in instance network info cache for port 71e66d69-de38-4524-8517-ce8bba4a01e0. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:07:07 user nova-compute[74348]: DEBUG nova.network.neutron [req-4b0f6fb7-dab2-4870-a480-7c12384c0cb0 req-42e8239f-79c4-4682-82a5-bfbdceac56e1 service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Updating instance_info_cache with network_info: [{"id": "71e66d69-de38-4524-8517-ce8bba4a01e0", "address": "fa:16:3e:b3:59:21", "network": {"id": "442abc57-45e5-4cd7-878e-979afa78c421", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1395369508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d76d03d17cc4e5bb52a32a2f8fbd629", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71e66d69-de", "ovs_interfaceid": "71e66d69-de38-4524-8517-ce8bba4a01e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:07:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4b0f6fb7-dab2-4870-a480-7c12384c0cb0 req-42e8239f-79c4-4682-82a5-bfbdceac56e1 service nova] Releasing lock "refresh_cache-4fcddbef-dfaf-48a5-8561-26b8857fdbd6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:07:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-cf3e1671-fd28-4f3d-9379-319d09f5b933 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Acquired lock "refresh_cache-4fcddbef-dfaf-48a5-8561-26b8857fdbd6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:07:07 user nova-compute[74348]: DEBUG nova.network.neutron [None req-cf3e1671-fd28-4f3d-9379-319d09f5b933 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:07:08 user nova-compute[74348]: DEBUG nova.network.neutron [None req-cf3e1671-fd28-4f3d-9379-319d09f5b933 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Updating instance_info_cache with network_info: [{"id": "71e66d69-de38-4524-8517-ce8bba4a01e0", "address": "fa:16:3e:b3:59:21", "network": {"id": "442abc57-45e5-4cd7-878e-979afa78c421", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1395369508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d76d03d17cc4e5bb52a32a2f8fbd629", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71e66d69-de", "ovs_interfaceid": "71e66d69-de38-4524-8517-ce8bba4a01e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:07:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-cf3e1671-fd28-4f3d-9379-319d09f5b933 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Releasing lock "refresh_cache-4fcddbef-dfaf-48a5-8561-26b8857fdbd6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:07:08 user nova-compute[74348]: DEBUG nova.compute.manager [None req-cf3e1671-fd28-4f3d-9379-319d09f5b933 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:09 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-b0d082bf-a952-4c37-850b-3ab003f66481 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 37c93c2a-1397-4b04-aef1-5068218ad9fd is timed out.
Nov 22 08:07:09 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-b0d082bf-a952-4c37-850b-3ab003f66481 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Successfully detached device vdb from instance 37c93c2a-1397-4b04-aef1-5068218ad9fd from the live domain config.
Nov 22 08:07:09 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0d082bf-a952-4c37-850b-3ab003f66481 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d082bf-a952-4c37-850b-3ab003f66481 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mfrDalSe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:07:09 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-b0d082bf-a952-4c37-850b-3ab003f66481 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:07:09 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-b0d082bf-a952-4c37-850b-3ab003f66481 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-b0d082bf-a952-4c37-850b-3ab003f66481 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b058fb6e-21c1-4fe8-8081-eb3534f61eb2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d082bf-a952-4c37-850b-3ab003f66481 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 08:07:09 user nova-compute[74348]: No targets found.
Nov 22 08:07:09 user nova-compute[74348]: iSNS:
Nov 22 08:07:09 user nova-compute[74348]: No targets found.
Nov 22 08:07:09 user nova-compute[74348]: STATIC:
Nov 22 08:07:09 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a
Nov 22 08:07:09 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:07:09 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:07:09 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8
Nov 22 08:07:09 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:07:09 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:07:09 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea
Nov 22 08:07:09 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:07:09 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:07:09 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030
Nov 22 08:07:09 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:07:09 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:07:09 user nova-compute[74348]: FIRMWARE:
Nov 22 08:07:09 user nova-compute[74348]: No targets found.
Nov 22 08:07:09 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d082bf-a952-4c37-850b-3ab003f66481 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 08:07:09 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 08:07:09 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d082bf-a952-4c37-850b-3ab003f66481 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6e08bf-47cf-4236-98e1-9a1acffa1bf6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17a3ada-a052-4bc4-b7ee-4ed9ae570649]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d082bf-a952-4c37-850b-3ab003f66481 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:07:09 user nova-compute[74348]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)
Nov 22 08:07:09 user nova-compute[74348]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)
Nov 22 08:07:09 user nova-compute[74348]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 (non-flash)
Nov 22 08:07:09 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d082bf-a952-4c37-850b-3ab003f66481 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:07:09 user nova-compute[74348]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea (non-flash)
Nov 22 08:07:09 user nova-compute[74348]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)
Nov 22 08:07:09 user nova-compute[74348]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 (non-flash)
Nov 22 08:07:09 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d082bf-a952-4c37-850b-3ab003f66481 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f224c692290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea'): ({'sdc'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-b0d082bf-a952-4c37-850b-3ab003f66481 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Removing single pathed devices sdc {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc140cda-9de6-45dd-ac97-41d1c19f080a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c083e657-e68e-4cd0-9e49-bd533f3e28df]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-b0d082bf-a952-4c37-850b-3ab003f66481 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Flushing IO for device /dev/sdc {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f891787d-03c6-48cf-a33d-29b55558dc20]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-b0d082bf-a952-4c37-850b-3ab003f66481 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7802221d-c8a4-4b7a-87f0-27a0cfc2dbb1]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-b0d082bf-a952-4c37-850b-3ab003f66481 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-b0d082bf-a952-4c37-850b-3ab003f66481 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] SCSI volumes sdc have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d082bf-a952-4c37-850b-3ab003f66481 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0310cf70-3741-4877-b54d-2e6a934f3db0]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d082bf-a952-4c37-850b-3ab003f66481 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[585c0a1f-5afa-48db-873d-efc6a0fb5090]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d082bf-a952-4c37-850b-3ab003f66481 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea, portal: 172.16.0.220,3260]
Nov 22 08:07:09 user nova-compute[74348]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea, portal: 172.16.0.220,3260] successful.
Nov 22 08:07:09 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d3034db-c569-4cd9-ad54-142be23d7dea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b3204a-27cd-49be-b400-db82fb803138]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d082bf-a952-4c37-850b-3ab003f66481 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-b0d082bf-a952-4c37-850b-3ab003f66481 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d082bf-a952-4c37-850b-3ab003f66481 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] <== disconnect_volume: return (313ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:07:09 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0d082bf-a952-4c37-850b-3ab003f66481 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 08:07:10 user nova-compute[74348]: DEBUG nova.objects.instance [None req-b0d082bf-a952-4c37-850b-3ab003f66481 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lazy-loading 'flavor' on Instance uuid 37c93c2a-1397-4b04-aef1-5068218ad9fd {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:07:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b0d082bf-a952-4c37-850b-3ab003f66481 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "37c93c2a-1397-4b04-aef1-5068218ad9fd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.696s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:07:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:11 user nova-compute[74348]: DEBUG nova.compute.manager [req-6941115d-6526-455f-987d-5b4a067d0171 req-db325fb9-180e-4f7d-9dc5-c63d21b9b72e service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Received event network-vif-unplugged-71e66d69-de38-4524-8517-ce8bba4a01e0 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:07:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-6941115d-6526-455f-987d-5b4a067d0171 req-db325fb9-180e-4f7d-9dc5-c63d21b9b72e service nova] Acquiring lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:07:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-6941115d-6526-455f-987d-5b4a067d0171 req-db325fb9-180e-4f7d-9dc5-c63d21b9b72e service nova] Lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:07:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-6941115d-6526-455f-987d-5b4a067d0171 req-db325fb9-180e-4f7d-9dc5-c63d21b9b72e service nova] Lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:07:11 user nova-compute[74348]: DEBUG nova.compute.manager [req-6941115d-6526-455f-987d-5b4a067d0171 req-db325fb9-180e-4f7d-9dc5-c63d21b9b72e service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] No waiting events found dispatching network-vif-unplugged-71e66d69-de38-4524-8517-ce8bba4a01e0 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:07:11 user nova-compute[74348]: WARNING nova.compute.manager [req-6941115d-6526-455f-987d-5b4a067d0171 req-db325fb9-180e-4f7d-9dc5-c63d21b9b72e service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Received unexpected event network-vif-unplugged-71e66d69-de38-4524-8517-ce8bba4a01e0 for instance with vm_state active and task_state reboot_started.
Nov 22 08:07:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1739c755-328f-4a1e-831b-813f5864a386 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquiring lock "37c93c2a-1397-4b04-aef1-5068218ad9fd" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:07:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1739c755-328f-4a1e-831b-813f5864a386 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "37c93c2a-1397-4b04-aef1-5068218ad9fd" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:07:11 user nova-compute[74348]: DEBUG nova.compute.manager [None req-1739c755-328f-4a1e-831b-813f5864a386 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:07:11 user nova-compute[74348]: DEBUG nova.compute.manager [None req-1739c755-328f-4a1e-831b-813f5864a386 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74348) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 22 08:07:11 user nova-compute[74348]: DEBUG nova.objects.instance [None req-1739c755-328f-4a1e-831b-813f5864a386 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lazy-loading 'flavor' on Instance uuid 37c93c2a-1397-4b04-aef1-5068218ad9fd {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:07:11 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-cf3e1671-fd28-4f3d-9379-319d09f5b933 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Instance shutdown successfully.
Nov 22 08:07:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:12 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Instance destroyed successfully.
Nov 22 08:07:12 user nova-compute[74348]: DEBUG nova.compute.manager [None req-1739c755-328f-4a1e-831b-813f5864a386 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:07:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1739c755-328f-4a1e-831b-813f5864a386 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "37c93c2a-1397-4b04-aef1-5068218ad9fd" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.301s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:07:13 user nova-compute[74348]: DEBUG nova.compute.manager [req-c9160033-61e4-44cb-b029-c13b506a719b req-7dc5b148-0a39-47e0-ab5e-3638db393e61 service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Received event network-vif-plugged-71e66d69-de38-4524-8517-ce8bba4a01e0 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:07:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c9160033-61e4-44cb-b029-c13b506a719b req-7dc5b148-0a39-47e0-ab5e-3638db393e61 service nova] Acquiring lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:07:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c9160033-61e4-44cb-b029-c13b506a719b req-7dc5b148-0a39-47e0-ab5e-3638db393e61 service nova] Lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:07:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c9160033-61e4-44cb-b029-c13b506a719b req-7dc5b148-0a39-47e0-ab5e-3638db393e61 service nova] Lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:07:13 user nova-compute[74348]: DEBUG nova.compute.manager [req-c9160033-61e4-44cb-b029-c13b506a719b req-7dc5b148-0a39-47e0-ab5e-3638db393e61 service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] No waiting events found dispatching network-vif-plugged-71e66d69-de38-4524-8517-ce8bba4a01e0 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:07:13 user nova-compute[74348]: WARNING nova.compute.manager [req-c9160033-61e4-44cb-b029-c13b506a719b req-7dc5b148-0a39-47e0-ab5e-3638db393e61 service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Received unexpected event network-vif-plugged-71e66d69-de38-4524-8517-ce8bba4a01e0 for instance with vm_state active and task_state reboot_started.
Nov 22 08:07:13 user nova-compute[74348]: DEBUG nova.compute.manager [req-c9160033-61e4-44cb-b029-c13b506a719b req-7dc5b148-0a39-47e0-ab5e-3638db393e61 service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Received event network-vif-unplugged-acc2d56f-6884-403d-b2e5-2eb64c40047f {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:07:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c9160033-61e4-44cb-b029-c13b506a719b req-7dc5b148-0a39-47e0-ab5e-3638db393e61 service nova] Acquiring lock "37c93c2a-1397-4b04-aef1-5068218ad9fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:07:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c9160033-61e4-44cb-b029-c13b506a719b req-7dc5b148-0a39-47e0-ab5e-3638db393e61 service nova] Lock "37c93c2a-1397-4b04-aef1-5068218ad9fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:07:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c9160033-61e4-44cb-b029-c13b506a719b req-7dc5b148-0a39-47e0-ab5e-3638db393e61 service nova] Lock "37c93c2a-1397-4b04-aef1-5068218ad9fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:07:13 user nova-compute[74348]: DEBUG nova.compute.manager [req-c9160033-61e4-44cb-b029-c13b506a719b req-7dc5b148-0a39-47e0-ab5e-3638db393e61 service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] No waiting events found dispatching network-vif-unplugged-acc2d56f-6884-403d-b2e5-2eb64c40047f {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:07:13 user nova-compute[74348]: WARNING nova.compute.manager [req-c9160033-61e4-44cb-b029-c13b506a719b req-7dc5b148-0a39-47e0-ab5e-3638db393e61 service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Received unexpected event network-vif-unplugged-acc2d56f-6884-403d-b2e5-2eb64c40047f for instance with vm_state stopped and task_state None.
Nov 22 08:07:13 user nova-compute[74348]: DEBUG nova.compute.manager [req-c9160033-61e4-44cb-b029-c13b506a719b req-7dc5b148-0a39-47e0-ab5e-3638db393e61 service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Received event network-vif-plugged-acc2d56f-6884-403d-b2e5-2eb64c40047f {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:07:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c9160033-61e4-44cb-b029-c13b506a719b req-7dc5b148-0a39-47e0-ab5e-3638db393e61 service nova] Acquiring lock "37c93c2a-1397-4b04-aef1-5068218ad9fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:07:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c9160033-61e4-44cb-b029-c13b506a719b req-7dc5b148-0a39-47e0-ab5e-3638db393e61 service nova] Lock "37c93c2a-1397-4b04-aef1-5068218ad9fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:07:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c9160033-61e4-44cb-b029-c13b506a719b req-7dc5b148-0a39-47e0-ab5e-3638db393e61 service nova] Lock "37c93c2a-1397-4b04-aef1-5068218ad9fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:07:13 user nova-compute[74348]: DEBUG nova.compute.manager [req-c9160033-61e4-44cb-b029-c13b506a719b req-7dc5b148-0a39-47e0-ab5e-3638db393e61 service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] No waiting events found dispatching network-vif-plugged-acc2d56f-6884-403d-b2e5-2eb64c40047f {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:07:13 user nova-compute[74348]: WARNING nova.compute.manager [req-c9160033-61e4-44cb-b029-c13b506a719b req-7dc5b148-0a39-47e0-ab5e-3638db393e61 service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Received unexpected event network-vif-plugged-acc2d56f-6884-403d-b2e5-2eb64c40047f for instance with vm_state stopped and task_state None.
Nov 22 08:07:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:15 user nova-compute[74348]: DEBUG nova.compute.manager [req-9b43c169-c0c4-4588-9a57-fd5dea4eff77 req-3ee1d4ae-606b-4069-b778-9c12b15f65ff service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Received event network-vif-plugged-71e66d69-de38-4524-8517-ce8bba4a01e0 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:07:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9b43c169-c0c4-4588-9a57-fd5dea4eff77 req-3ee1d4ae-606b-4069-b778-9c12b15f65ff service nova] Acquiring lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:07:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9b43c169-c0c4-4588-9a57-fd5dea4eff77 req-3ee1d4ae-606b-4069-b778-9c12b15f65ff service nova] Lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:07:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9b43c169-c0c4-4588-9a57-fd5dea4eff77 req-3ee1d4ae-606b-4069-b778-9c12b15f65ff service nova] Lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:07:15 user nova-compute[74348]: DEBUG nova.compute.manager [req-9b43c169-c0c4-4588-9a57-fd5dea4eff77 req-3ee1d4ae-606b-4069-b778-9c12b15f65ff service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] No waiting events found dispatching network-vif-plugged-71e66d69-de38-4524-8517-ce8bba4a01e0 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:07:15 user nova-compute[74348]: WARNING nova.compute.manager [req-9b43c169-c0c4-4588-9a57-fd5dea4eff77 req-3ee1d4ae-606b-4069-b778-9c12b15f65ff service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Received unexpected event network-vif-plugged-71e66d69-de38-4524-8517-ce8bba4a01e0 for instance with vm_state active and task_state reboot_started.
Nov 22 08:07:15 user nova-compute[74348]: DEBUG nova.compute.manager [req-9b43c169-c0c4-4588-9a57-fd5dea4eff77 req-3ee1d4ae-606b-4069-b778-9c12b15f65ff service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Received event network-vif-plugged-71e66d69-de38-4524-8517-ce8bba4a01e0 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:07:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9b43c169-c0c4-4588-9a57-fd5dea4eff77 req-3ee1d4ae-606b-4069-b778-9c12b15f65ff service nova] Acquiring lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:07:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9b43c169-c0c4-4588-9a57-fd5dea4eff77 req-3ee1d4ae-606b-4069-b778-9c12b15f65ff service nova] Lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:07:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9b43c169-c0c4-4588-9a57-fd5dea4eff77 req-3ee1d4ae-606b-4069-b778-9c12b15f65ff service nova] Lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:07:15 user nova-compute[74348]: DEBUG nova.compute.manager [req-9b43c169-c0c4-4588-9a57-fd5dea4eff77 req-3ee1d4ae-606b-4069-b778-9c12b15f65ff service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] No waiting events found dispatching network-vif-plugged-71e66d69-de38-4524-8517-ce8bba4a01e0 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:07:15 user nova-compute[74348]: WARNING nova.compute.manager [req-9b43c169-c0c4-4588-9a57-fd5dea4eff77 req-3ee1d4ae-606b-4069-b778-9c12b15f65ff service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Received unexpected event network-vif-plugged-71e66d69-de38-4524-8517-ce8bba4a01e0 for instance with vm_state active and task_state reboot_started.
Nov 22 08:07:15 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Instance running successfully.
Nov 22 08:07:15 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-cf3e1671-fd28-4f3d-9379-319d09f5b933 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Instance soft rebooted successfully.
Nov 22 08:07:15 user nova-compute[74348]: DEBUG nova.compute.manager [None req-cf3e1671-fd28-4f3d-9379-319d09f5b933 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:07:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-cf3e1671-fd28-4f3d-9379-319d09f5b933 tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.971s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EkWPwXTu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:07:16 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:07:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:07:16 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:07:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:07:16 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 08:07:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b68c248-cbee-4c50-a661-7dd30cbcc153]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 08:07:16 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbaa8ff4-bcad-4754-88ec-c1a2d5141fbc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d] added
Nov 22 08:07:16 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46ff5ef-1ca6-41fe-bcf4-a120ddd2c69c]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46a414c-9b49-4eee-a612-ca2a7e575efe]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EkWPwXTu {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EkWPwXTu" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb09cde-fcf6-48aa-96e5-46bafeecc4fc]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EkWPwXTu'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9a342e-f12b-47a3-adfe-6e14166c525d]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdeb70c4-4de3-485a-b0da-67d2d4d699ed]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:07:16 user nova-compute[74348]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)
Nov 22 08:07:16 user nova-compute[74348]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 (non-flash)
Nov 22 08:07:16 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:07:16 user nova-compute[74348]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)
Nov 22 08:07:16 user nova-compute[74348]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 (non-flash)
Nov 22 08:07:16 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da31237-a55c-429e-b2f8-77dca5d1d34d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d, portal: 172.16.0.220,3260]
Nov 22 08:07:16 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d, portal: 172.16.0.220,3260] successful.
Nov 22 08:07:16 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba736c8-b24a-47f2-a41e-ae6226df5270]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a81c269-535f-4fad-94f3-f382c9061f56]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:07:16 user nova-compute[74348]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)
Nov 22 08:07:16 user nova-compute[74348]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 (non-flash)
Nov 22 08:07:16 user nova-compute[74348]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d (non-flash)
Nov 22 08:07:16 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:07:16 user nova-compute[74348]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)
Nov 22 08:07:16 user nova-compute[74348]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 (non-flash)
Nov 22 08:07:16 user nova-compute[74348]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d (non-flash)
Nov 22 08:07:16 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0940d728-6917-4177-947f-b0da1dffeaa9]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:07:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EkWPwXTu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 08:07:17 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:07:17 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23930336635383831', 'path': '/dev/sdc'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:07:17 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930336635383831', 'path': '/dev/sdc'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 08:07:17 user nova-compute[74348]: DEBUG nova.objects.instance [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lazy-loading 'flavor' on Instance uuid a19d2696-fccb-4b94-8a42-a76b35b32582 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:07:17 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 08:07:17 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:07:17 user nova-compute[74348]:   <source dev="/dev/sdc"/>
Nov 22 08:07:17 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:07:17 user nova-compute[74348]:   <serial>403b055a-b502-474c-92d5-5ab72126df0d</serial>
Nov 22 08:07:17 user nova-compute[74348]: </disk>
Nov 22 08:07:17 user nova-compute[74348]:  {{(pid=74348) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 08:07:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:07:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:07:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] No VIF found with MAC fa:16:3e:f7:7e:99, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:07:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1ee9fa52-3c81-405e-835a-835a96196635 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "a19d2696-fccb-4b94-8a42-a76b35b32582" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.437s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:07:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:24 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:24 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:28 user nova-compute[74348]: INFO nova.compute.manager [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Rescuing
Nov 22 08:07:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquiring lock "refresh_cache-555f4246-d4b2-4f2f-b91c-dda8fe47264c" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:07:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquired lock "refresh_cache-555f4246-d4b2-4f2f-b91c-dda8fe47264c" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:07:28 user nova-compute[74348]: DEBUG nova.network.neutron [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:07:28 user nova-compute[74348]: DEBUG nova.network.neutron [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Updating instance_info_cache with network_info: [{"id": "8e4fc0fe-f03b-4816-8a6a-c20a8eba5296", "address": "fa:16:3e:01:d5:cd", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4fc0fe-f0", "ovs_interfaceid": "8e4fc0fe-f03b-4816-8a6a-c20a8eba5296", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:07:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Releasing lock "refresh_cache-555f4246-d4b2-4f2f-b91c-dda8fe47264c" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:07:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:29 user nova-compute[74348]: DEBUG nova.compute.manager [req-26897381-4eb6-4b23-adaf-dc5970722037 req-2cb7e006-d1e7-46e6-a99f-f9dc93b97019 service nova] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Received event network-vif-unplugged-8e4fc0fe-f03b-4816-8a6a-c20a8eba5296 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:07:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-26897381-4eb6-4b23-adaf-dc5970722037 req-2cb7e006-d1e7-46e6-a99f-f9dc93b97019 service nova] Acquiring lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:07:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-26897381-4eb6-4b23-adaf-dc5970722037 req-2cb7e006-d1e7-46e6-a99f-f9dc93b97019 service nova] Lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:07:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-26897381-4eb6-4b23-adaf-dc5970722037 req-2cb7e006-d1e7-46e6-a99f-f9dc93b97019 service nova] Lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:07:29 user nova-compute[74348]: DEBUG nova.compute.manager [req-26897381-4eb6-4b23-adaf-dc5970722037 req-2cb7e006-d1e7-46e6-a99f-f9dc93b97019 service nova] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] No waiting events found dispatching network-vif-unplugged-8e4fc0fe-f03b-4816-8a6a-c20a8eba5296 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:07:29 user nova-compute[74348]: WARNING nova.compute.manager [req-26897381-4eb6-4b23-adaf-dc5970722037 req-2cb7e006-d1e7-46e6-a99f-f9dc93b97019 service nova] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Received unexpected event network-vif-unplugged-8e4fc0fe-f03b-4816-8a6a-c20a8eba5296 for instance with vm_state active and task_state rescuing.
Nov 22 08:07:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:29 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Instance destroyed successfully.
Nov 22 08:07:29 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Attempting rescue
Nov 22 08:07:29 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74348) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 22 08:07:29 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Instance directory exists: not creating {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 22 08:07:29 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Creating image(s)
Nov 22 08:07:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquiring lock "/opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:07:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "/opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:07:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "/opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:07:29 user nova-compute[74348]: DEBUG nova.objects.instance [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lazy-loading 'trusted_certs' on Instance uuid 555f4246-d4b2-4f2f-b91c-dda8fe47264c {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:07:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquiring lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:07:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:07:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.205s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk.rescue {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk.rescue" returned: 0 in 0.059s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:07:30 user nova-compute[74348]: DEBUG nova.objects.instance [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lazy-loading 'migration_context' on Instance uuid 555f4246-d4b2-4f2f-b91c-dda8fe47264c {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:07:30 user nova-compute[74348]: DEBUG nova.objects.base [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Object Instance<555f4246-d4b2-4f2f-b91c-dda8fe47264c> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:07:30 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 08:07:30 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Start _get_guest_xml network_info=[{"id": "8e4fc0fe-f03b-4816-8a6a-c20a8eba5296", "address": "fa:16:3e:01:d5:cd", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "vif_mac": "fa:16:3e:01:d5:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4fc0fe-f0", "ovs_interfaceid": "8e4fc0fe-f03b-4816-8a6a-c20a8eba5296", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 08:07:30 user nova-compute[74348]: DEBUG nova.objects.instance [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lazy-loading 'resources' on Instance uuid 555f4246-d4b2-4f2f-b91c-dda8fe47264c {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:07:30 user nova-compute[74348]: DEBUG nova.objects.base [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Object Instance<555f4246-d4b2-4f2f-b91c-dda8fe47264c> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:07:30 user nova-compute[74348]: DEBUG nova.objects.instance [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lazy-loading 'numa_topology' on Instance uuid 555f4246-d4b2-4f2f-b91c-dda8fe47264c {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:07:30 user nova-compute[74348]: DEBUG nova.objects.base [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Object Instance<555f4246-d4b2-4f2f-b91c-dda8fe47264c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:07:30 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:07:30 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:07:30 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 08:07:30 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 08:07:30 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 08:07:30 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 08:07:30 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 08:07:30 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 08:07:30 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 08:07:30 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 08:07:30 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 08:07:30 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 08:07:30 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 08:07:30 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 08:07:30 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 08:07:30 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 08:07:30 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 08:07:30 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 08:07:30 user nova-compute[74348]: DEBUG nova.objects.instance [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lazy-loading 'vcpu_model' on Instance uuid 555f4246-d4b2-4f2f-b91c-dda8fe47264c {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:07:30 user nova-compute[74348]: DEBUG nova.objects.base [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Object Instance<555f4246-d4b2-4f2f-b91c-dda8fe47264c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:07:30 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:02:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-305514770',display_name='tempest-ServerRescueNegativeTestJSON-server-305514770',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-305514770',id=28,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:02:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d975b772fea4ed98b1b3ad284e51a65',ramdisk_id='',reservation_id='r-rd38z59i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1773499839',owner_user_name='tempest-ServerRescueNegativeTestJSON-1773499839-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:02:52Z,user_data=None,user_id='0b3c6587d0764b9fae5782792aec5d92',uuid=555f4246-d4b2-4f2f-b91c-dda8fe47264c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e4fc0fe-f03b-4816-8a6a-c20a8eba5296", "address": "fa:16:3e:01:d5:cd", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "vif_mac": "fa:16:3e:01:d5:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4fc0fe-f0", "ovs_interfaceid": "8e4fc0fe-f03b-4816-8a6a-c20a8eba5296", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 08:07:30 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Converting VIF {"id": "8e4fc0fe-f03b-4816-8a6a-c20a8eba5296", "address": "fa:16:3e:01:d5:cd", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "vif_mac": "fa:16:3e:01:d5:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4fc0fe-f0", "ovs_interfaceid": "8e4fc0fe-f03b-4816-8a6a-c20a8eba5296", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:07:30 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:d5:cd,bridge_name='br-int',has_traffic_filtering=True,id=8e4fc0fe-f03b-4816-8a6a-c20a8eba5296,network=Network(246d8f55-a1eb-4883-906c-69f15289caef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e4fc0fe-f0') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:07:30 user nova-compute[74348]: DEBUG nova.objects.instance [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lazy-loading 'pci_devices' on Instance uuid 555f4246-d4b2-4f2f-b91c-dda8fe47264c {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:07:30 user nova-compute[74348]: DEBUG nova.objects.base [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Object Instance<555f4246-d4b2-4f2f-b91c-dda8fe47264c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:07:30 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] End _get_guest_xml xml=<domain type="kvm">
Nov 22 08:07:30 user nova-compute[74348]:   <uuid>555f4246-d4b2-4f2f-b91c-dda8fe47264c</uuid>
Nov 22 08:07:30 user nova-compute[74348]:   <name>instance-0000001c</name>
Nov 22 08:07:30 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 08:07:30 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 08:07:30 user nova-compute[74348]:   <metadata>
Nov 22 08:07:30 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 08:07:30 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 08:07:30 user nova-compute[74348]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-305514770</nova:name>
Nov 22 08:07:30 user nova-compute[74348]:       <nova:creationTime>2023-11-22 08:07:30</nova:creationTime>
Nov 22 08:07:30 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 08:07:30 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 08:07:30 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 08:07:30 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 08:07:30 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 08:07:30 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 08:07:30 user nova-compute[74348]:       </nova:flavor>
Nov 22 08:07:30 user nova-compute[74348]:       <nova:owner>
Nov 22 08:07:30 user nova-compute[74348]:         <nova:user uuid="0b3c6587d0764b9fae5782792aec5d92">tempest-ServerRescueNegativeTestJSON-1773499839-project-member</nova:user>
Nov 22 08:07:30 user nova-compute[74348]:         <nova:project uuid="5d975b772fea4ed98b1b3ad284e51a65">tempest-ServerRescueNegativeTestJSON-1773499839</nova:project>
Nov 22 08:07:30 user nova-compute[74348]:       </nova:owner>
Nov 22 08:07:30 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 08:07:30 user nova-compute[74348]:       <nova:ports>
Nov 22 08:07:30 user nova-compute[74348]:         <nova:port uuid="8e4fc0fe-f03b-4816-8a6a-c20a8eba5296">
Nov 22 08:07:30 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 22 08:07:30 user nova-compute[74348]:         </nova:port>
Nov 22 08:07:30 user nova-compute[74348]:       </nova:ports>
Nov 22 08:07:30 user nova-compute[74348]:     </nova:instance>
Nov 22 08:07:30 user nova-compute[74348]:   </metadata>
Nov 22 08:07:30 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 08:07:30 user nova-compute[74348]:     <system>
Nov 22 08:07:30 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 08:07:30 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 08:07:30 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 08:07:30 user nova-compute[74348]:       <entry name="serial">555f4246-d4b2-4f2f-b91c-dda8fe47264c</entry>
Nov 22 08:07:30 user nova-compute[74348]:       <entry name="uuid">555f4246-d4b2-4f2f-b91c-dda8fe47264c</entry>
Nov 22 08:07:30 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 08:07:30 user nova-compute[74348]:     </system>
Nov 22 08:07:30 user nova-compute[74348]:   </sysinfo>
Nov 22 08:07:30 user nova-compute[74348]:   <os>
Nov 22 08:07:30 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 08:07:30 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 08:07:30 user nova-compute[74348]:   </os>
Nov 22 08:07:30 user nova-compute[74348]:   <features>
Nov 22 08:07:30 user nova-compute[74348]:     <acpi/>
Nov 22 08:07:30 user nova-compute[74348]:     <apic/>
Nov 22 08:07:30 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 08:07:30 user nova-compute[74348]:   </features>
Nov 22 08:07:30 user nova-compute[74348]:   <clock offset="utc">
Nov 22 08:07:30 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 08:07:30 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 08:07:30 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 08:07:30 user nova-compute[74348]:   </clock>
Nov 22 08:07:30 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 08:07:30 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 08:07:30 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 08:07:30 user nova-compute[74348]:   </cpu>
Nov 22 08:07:30 user nova-compute[74348]:   <devices>
Nov 22 08:07:30 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 08:07:30 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 08:07:30 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk.rescue"/>
Nov 22 08:07:30 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 08:07:30 user nova-compute[74348]:     </disk>
Nov 22 08:07:30 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 08:07:30 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 08:07:30 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk"/>
Nov 22 08:07:30 user nova-compute[74348]:       <target dev="vdb" bus="virtio"/>
Nov 22 08:07:30 user nova-compute[74348]:     </disk>
Nov 22 08:07:30 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 08:07:30 user nova-compute[74348]:       <mac address="fa:16:3e:01:d5:cd"/>
Nov 22 08:07:30 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:07:30 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 08:07:30 user nova-compute[74348]:       <target dev="tap8e4fc0fe-f0"/>
Nov 22 08:07:30 user nova-compute[74348]:     </interface>
Nov 22 08:07:30 user nova-compute[74348]:     <serial type="pty">
Nov 22 08:07:30 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/console.log" append="off"/>
Nov 22 08:07:30 user nova-compute[74348]:     </serial>
Nov 22 08:07:30 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 08:07:30 user nova-compute[74348]:     <video>
Nov 22 08:07:30 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:07:30 user nova-compute[74348]:     </video>
Nov 22 08:07:30 user nova-compute[74348]:     <rng model="virtio">
Nov 22 08:07:30 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 08:07:30 user nova-compute[74348]:     </rng>
Nov 22 08:07:30 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 08:07:30 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 08:07:30 user nova-compute[74348]:       <stats period="10"/>
Nov 22 08:07:30 user nova-compute[74348]:     </memballoon>
Nov 22 08:07:30 user nova-compute[74348]:   </devices>
Nov 22 08:07:30 user nova-compute[74348]: </domain>
Nov 22 08:07:30 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 08:07:30 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Instance destroyed successfully.
Nov 22 08:07:30 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:07:30 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:07:30 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] No VIF found with MAC fa:16:3e:01:d5:cd, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:07:31 user nova-compute[74348]: DEBUG nova.compute.manager [req-7fe9b4f4-8096-409f-927a-ffd44cc75334 req-974bea7f-ff6d-4fbf-8d07-b2364cfe1e08 service nova] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Received event network-vif-plugged-8e4fc0fe-f03b-4816-8a6a-c20a8eba5296 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:07:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-7fe9b4f4-8096-409f-927a-ffd44cc75334 req-974bea7f-ff6d-4fbf-8d07-b2364cfe1e08 service nova] Acquiring lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:07:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-7fe9b4f4-8096-409f-927a-ffd44cc75334 req-974bea7f-ff6d-4fbf-8d07-b2364cfe1e08 service nova] Lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:07:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-7fe9b4f4-8096-409f-927a-ffd44cc75334 req-974bea7f-ff6d-4fbf-8d07-b2364cfe1e08 service nova] Lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:07:31 user nova-compute[74348]: DEBUG nova.compute.manager [req-7fe9b4f4-8096-409f-927a-ffd44cc75334 req-974bea7f-ff6d-4fbf-8d07-b2364cfe1e08 service nova] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] No waiting events found dispatching network-vif-plugged-8e4fc0fe-f03b-4816-8a6a-c20a8eba5296 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:07:31 user nova-compute[74348]: WARNING nova.compute.manager [req-7fe9b4f4-8096-409f-927a-ffd44cc75334 req-974bea7f-ff6d-4fbf-8d07-b2364cfe1e08 service nova] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Received unexpected event network-vif-plugged-8e4fc0fe-f03b-4816-8a6a-c20a8eba5296 for instance with vm_state active and task_state rescuing.
Nov 22 08:07:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Acquiring lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:07:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:07:32 user nova-compute[74348]: DEBUG nova.objects.instance [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lazy-loading 'flavor' on Instance uuid b6698b0d-0d43-47ea-bcdc-d99201d9833c {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:07:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:07:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Acquiring lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:07:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:07:32 user nova-compute[74348]: INFO nova.compute.manager [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Attaching volume 9e1c63c0-cd9e-4279-805d-566ed1930b3d to /dev/vdb
Nov 22 08:07:32 user nova-compute[74348]: DEBUG os_brick.utils [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:07:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:32 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba12b90-d573-4cbd-a6c4-b282fd924591]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:32 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[92be9065-4813-4e80-9d9f-ee7cab3337e9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:32 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[de602761-40cd-4190-b721-3f5797848003]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:32 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de63826-3a35-45ed-826e-62c25d743c58]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:07:32 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 08:07:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:07:32 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 08:07:32 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c76844-d89b-4db6-94d9-b70c0ff7a306]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:32 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 08:07:32 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 08:07:32 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 08:07:32 user nova-compute[74348]: DEBUG os_brick.utils [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:07:32 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Updating existing volume attachment record: 2e65f3f1-a908-4ba1-8ba4-c7ddb6e18b37 {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 08:07:33 user nova-compute[74348]: DEBUG nova.compute.manager [req-dbc327bf-d006-4494-9d4f-5c45b02481f5 req-fd1fb29c-489f-4cd1-bb50-bc84417bc72a service nova] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Received event network-vif-plugged-8e4fc0fe-f03b-4816-8a6a-c20a8eba5296 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:07:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-dbc327bf-d006-4494-9d4f-5c45b02481f5 req-fd1fb29c-489f-4cd1-bb50-bc84417bc72a service nova] Acquiring lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:07:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-dbc327bf-d006-4494-9d4f-5c45b02481f5 req-fd1fb29c-489f-4cd1-bb50-bc84417bc72a service nova] Lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:07:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-dbc327bf-d006-4494-9d4f-5c45b02481f5 req-fd1fb29c-489f-4cd1-bb50-bc84417bc72a service nova] Lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:07:33 user nova-compute[74348]: DEBUG nova.compute.manager [req-dbc327bf-d006-4494-9d4f-5c45b02481f5 req-fd1fb29c-489f-4cd1-bb50-bc84417bc72a service nova] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] No waiting events found dispatching network-vif-plugged-8e4fc0fe-f03b-4816-8a6a-c20a8eba5296 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:07:33 user nova-compute[74348]: WARNING nova.compute.manager [req-dbc327bf-d006-4494-9d4f-5c45b02481f5 req-fd1fb29c-489f-4cd1-bb50-bc84417bc72a service nova] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Received unexpected event network-vif-plugged-8e4fc0fe-f03b-4816-8a6a-c20a8eba5296 for instance with vm_state active and task_state rescuing.
Nov 22 08:07:33 user nova-compute[74348]: DEBUG nova.compute.manager [req-dbc327bf-d006-4494-9d4f-5c45b02481f5 req-fd1fb29c-489f-4cd1-bb50-bc84417bc72a service nova] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Received event network-vif-plugged-8e4fc0fe-f03b-4816-8a6a-c20a8eba5296 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:07:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-dbc327bf-d006-4494-9d4f-5c45b02481f5 req-fd1fb29c-489f-4cd1-bb50-bc84417bc72a service nova] Acquiring lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:07:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-dbc327bf-d006-4494-9d4f-5c45b02481f5 req-fd1fb29c-489f-4cd1-bb50-bc84417bc72a service nova] Lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:07:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-dbc327bf-d006-4494-9d4f-5c45b02481f5 req-fd1fb29c-489f-4cd1-bb50-bc84417bc72a service nova] Lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:07:33 user nova-compute[74348]: DEBUG nova.compute.manager [req-dbc327bf-d006-4494-9d4f-5c45b02481f5 req-fd1fb29c-489f-4cd1-bb50-bc84417bc72a service nova] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] No waiting events found dispatching network-vif-plugged-8e4fc0fe-f03b-4816-8a6a-c20a8eba5296 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:07:33 user nova-compute[74348]: WARNING nova.compute.manager [req-dbc327bf-d006-4494-9d4f-5c45b02481f5 req-fd1fb29c-489f-4cd1-bb50-bc84417bc72a service nova] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Received unexpected event network-vif-plugged-8e4fc0fe-f03b-4816-8a6a-c20a8eba5296 for instance with vm_state active and task_state rescuing.
Nov 22 08:07:33 user nova-compute[74348]: DEBUG nova.compute.manager [None req-6849003e-e1d6-4337-b4a3-c961c95c5468 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:07:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:37 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:07:38 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:07:38 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:07:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-37c93c2a-1397-4b04-aef1-5068218ad9fd" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:07:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-37c93c2a-1397-4b04-aef1-5068218ad9fd" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:07:38 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 08:07:39 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:39 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Updating instance_info_cache with network_info: [{"id": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "address": "fa:16:3e:62:f2:83", "network": {"id": "606a7c22-1285-47e8-bfa0-f09dbd7cb9ac", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-63336037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d1a2eb68ef4c0aa5ef081fe10877a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc2d56f-68", "ovs_interfaceid": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:07:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-37c93c2a-1397-4b04-aef1-5068218ad9fd" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:07:39 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 08:07:39 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:07:39 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-24efea10-732c-4c56-93c4-d3695012b2bd tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Acquiring lock "a19d2696-fccb-4b94-8a42-a76b35b32582" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:07:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-24efea10-732c-4c56-93c4-d3695012b2bd tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "a19d2696-fccb-4b94-8a42-a76b35b32582" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:07:40 user nova-compute[74348]: INFO nova.compute.manager [None req-24efea10-732c-4c56-93c4-d3695012b2bd tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Detaching volume 403b055a-b502-474c-92d5-5ab72126df0d
Nov 22 08:07:40 user nova-compute[74348]: INFO nova.virt.block_device [None req-24efea10-732c-4c56-93c4-d3695012b2bd tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Attempting to driver detach volume 403b055a-b502-474c-92d5-5ab72126df0d from mountpoint /dev/vdb
Nov 22 08:07:40 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-24efea10-732c-4c56-93c4-d3695012b2bd tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Attempting to detach device vdb from instance a19d2696-fccb-4b94-8a42-a76b35b32582 from the persistent domain config. {{(pid=74348) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 08:07:40 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-24efea10-732c-4c56-93c4-d3695012b2bd tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:07:40 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:07:40 user nova-compute[74348]:   <source dev="/dev/sdc"/>
Nov 22 08:07:40 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:07:40 user nova-compute[74348]:   <serial>403b055a-b502-474c-92d5-5ab72126df0d</serial>
Nov 22 08:07:40 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 08:07:40 user nova-compute[74348]: </disk>
Nov 22 08:07:40 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:07:40 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-24efea10-732c-4c56-93c4-d3695012b2bd tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Successfully detached device vdb from instance a19d2696-fccb-4b94-8a42-a76b35b32582 from the persistent domain config.
Nov 22 08:07:40 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-24efea10-732c-4c56-93c4-d3695012b2bd tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a19d2696-fccb-4b94-8a42-a76b35b32582 from the live domain config. {{(pid=74348) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 08:07:40 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-24efea10-732c-4c56-93c4-d3695012b2bd tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:07:40 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:07:40 user nova-compute[74348]:   <source dev="/dev/sdc"/>
Nov 22 08:07:40 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:07:40 user nova-compute[74348]:   <serial>403b055a-b502-474c-92d5-5ab72126df0d</serial>
Nov 22 08:07:40 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 08:07:40 user nova-compute[74348]: </disk>
Nov 22 08:07:40 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:07:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-cfeef42a-95f3-4b58-bc27-bcf9a78f5e34 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Acquiring lock "a19d2696-fccb-4b94-8a42-a76b35b32582" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:07:40 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-24efea10-732c-4c56-93c4-d3695012b2bd tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a19d2696-fccb-4b94-8a42-a76b35b32582 {{(pid=74348) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 08:07:41 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:07:41 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:07:41 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:07:42 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:07:43 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:07:43 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:07:43 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:07:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:07:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:07:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:07:43 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:07:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:43 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:44 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:44 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:07:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6698b0d-0d43-47ea-bcdc-d99201d9833c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:44 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6698b0d-0d43-47ea-bcdc-d99201d9833c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6698b0d-0d43-47ea-bcdc-d99201d9833c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6698b0d-0d43-47ea-bcdc-d99201d9833c/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:45 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:07:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk.rescue --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:45 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 08:07:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eGkUfXHz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:07:45 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:07:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:07:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:07:45 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:07:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:07:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:07:45 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 08:07:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:45 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6572a59-e729-4846-b403-c0bdfe621bc2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 08:07:45 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:07:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:45 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90f333a-0086-449c-a99e-ed315cc5cb90]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d] added
Nov 22 08:07:45 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:07:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:45 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c84ffd-d56c-4809-b961-aaa6a4d156f7]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:07:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk.rescue --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.067s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:45 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c7f585-979c-4506-8084-abc7875c155f]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:07:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eGkUfXHz {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eGkUfXHz" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:45 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9378f44-4e7c-43e3-8ff3-0cfbefa35369]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eGkUfXHz'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:07:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:45 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6183d19f-4829-4070-a4ed-272aa3791c66]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:07:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:45 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[41742b50-80a4-4aba-af39-3c886b7397cb]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:07:45 user nova-compute[74348]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)
Nov 22 08:07:45 user nova-compute[74348]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 (non-flash)
Nov 22 08:07:45 user nova-compute[74348]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d (non-flash)
Nov 22 08:07:45 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:07:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:07:45 user nova-compute[74348]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)
Nov 22 08:07:45 user nova-compute[74348]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 (non-flash)
Nov 22 08:07:45 user nova-compute[74348]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d (non-flash)
Nov 22 08:07:45 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:07:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:46 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89dfebb-e459-4f8d-91e4-42ae0da85561]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d, portal: 172.16.0.220,3260]
Nov 22 08:07:46 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d, portal: 172.16.0.220,3260] successful.
Nov 22 08:07:46 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:07:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:46 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[965c5715-05e5-4484-9334-519c3a7cbff5]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:07:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:46 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[990f5785-d8ca-4b1b-b9e9-f22e0350274a]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:07:46 user nova-compute[74348]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)
Nov 22 08:07:46 user nova-compute[74348]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 (non-flash)
Nov 22 08:07:46 user nova-compute[74348]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d (non-flash)
Nov 22 08:07:46 user nova-compute[74348]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d (non-flash)
Nov 22 08:07:46 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:07:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:07:46 user nova-compute[74348]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)
Nov 22 08:07:46 user nova-compute[74348]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 (non-flash)
Nov 22 08:07:46 user nova-compute[74348]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d (non-flash)
Nov 22 08:07:46 user nova-compute[74348]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d (non-flash)
Nov 22 08:07:46 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:07:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.448s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:07:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 08:07:46 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] HCTL ('37', '-', '-', 0) found on session 41 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 08:07:46 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 08:07:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:46 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36d3260-ae94-4ae2-a740-bd262252263b]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:07:46 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Searching for a device in session 41 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:07:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eGkUfXHz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 08:07:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19d2696-fccb-4b94-8a42-a76b35b32582/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19d2696-fccb-4b94-8a42-a76b35b32582/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19d2696-fccb-4b94-8a42-a76b35b32582/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:47 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.490s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:07:47 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] <== connect_volume: return (1494ms) {'type': 'block', 'scsi_wwn': '26566646537383065', 'path': '/dev/sdf'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:07:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566646537383065', 'path': '/dev/sdf'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 08:07:47 user nova-compute[74348]: DEBUG nova.objects.instance [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lazy-loading 'flavor' on Instance uuid b6698b0d-0d43-47ea-bcdc-d99201d9833c {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:07:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 08:07:47 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:07:47 user nova-compute[74348]:   <source dev="/dev/sdf"/>
Nov 22 08:07:47 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:07:47 user nova-compute[74348]:   <serial>9e1c63c0-cd9e-4279-805d-566ed1930b3d</serial>
Nov 22 08:07:47 user nova-compute[74348]: </disk>
Nov 22 08:07:47 user nova-compute[74348]:  {{(pid=74348) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 08:07:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19d2696-fccb-4b94-8a42-a76b35b32582/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:07:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:07:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] No VIF found with MAC fa:16:3e:d2:53:6d, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:07:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9711bbfa-ffb1-4cf6-ba8f-654a4df520e7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.540s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:07:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fcddbef-dfaf-48a5-8561-26b8857fdbd6/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fcddbef-dfaf-48a5-8561-26b8857fdbd6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fcddbef-dfaf-48a5-8561-26b8857fdbd6/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:07:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fcddbef-dfaf-48a5-8561-26b8857fdbd6/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:07:48 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:07:48 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:07:48 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:07:48 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=7590MB free_disk=24.73959732055664GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:07:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:07:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:07:49 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 765f8c47-c042-4430-8d35-07926ad693fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:07:49 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance b8f84c0b-fab5-4900-bf65-270c9c06baf8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:07:49 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 37c93c2a-1397-4b04-aef1-5068218ad9fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:07:49 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 5006cff5-4b67-405d-b6b1-4c355f82d920 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:07:49 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 555f4246-d4b2-4f2f-b91c-dda8fe47264c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:07:49 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance ba74ca7d-2875-426c-a485-d908af865bae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:07:49 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance b6698b0d-0d43-47ea-bcdc-d99201d9833c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:07:49 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 016c8f4b-a226-4226-ba56-8a2b28cea146 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:07:49 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 4fcddbef-dfaf-48a5-8561-26b8857fdbd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:07:49 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance a19d2696-fccb-4b94-8a42-a76b35b32582 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:07:49 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance b95b6cae-1885-43e8-b589-ee89854100a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:07:49 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:07:49 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:07:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:49 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:07:49 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:07:49 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:07:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.520s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:07:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:50 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-be9bf293-6b5f-47a7-907d-94ab25293711 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Acquiring lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:07:50 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-be9bf293-6b5f-47a7-907d-94ab25293711 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:07:50 user nova-compute[74348]: INFO nova.compute.manager [None req-be9bf293-6b5f-47a7-907d-94ab25293711 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Detaching volume 9e1c63c0-cd9e-4279-805d-566ed1930b3d
Nov 22 08:07:50 user nova-compute[74348]: INFO nova.virt.block_device [None req-be9bf293-6b5f-47a7-907d-94ab25293711 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Attempting to driver detach volume 9e1c63c0-cd9e-4279-805d-566ed1930b3d from mountpoint /dev/vdb
Nov 22 08:07:50 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-be9bf293-6b5f-47a7-907d-94ab25293711 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Attempting to detach device vdb from instance b6698b0d-0d43-47ea-bcdc-d99201d9833c from the persistent domain config. {{(pid=74348) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 08:07:50 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-be9bf293-6b5f-47a7-907d-94ab25293711 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:07:50 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:07:50 user nova-compute[74348]:   <source dev="/dev/sdf"/>
Nov 22 08:07:50 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:07:50 user nova-compute[74348]:   <serial>9e1c63c0-cd9e-4279-805d-566ed1930b3d</serial>
Nov 22 08:07:50 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 08:07:50 user nova-compute[74348]: </disk>
Nov 22 08:07:50 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:07:50 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-be9bf293-6b5f-47a7-907d-94ab25293711 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Successfully detached device vdb from instance b6698b0d-0d43-47ea-bcdc-d99201d9833c from the persistent domain config.
Nov 22 08:07:50 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-be9bf293-6b5f-47a7-907d-94ab25293711 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b6698b0d-0d43-47ea-bcdc-d99201d9833c from the live domain config. {{(pid=74348) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 08:07:50 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-be9bf293-6b5f-47a7-907d-94ab25293711 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:07:50 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:07:50 user nova-compute[74348]:   <source dev="/dev/sdf"/>
Nov 22 08:07:50 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:07:50 user nova-compute[74348]:   <serial>9e1c63c0-cd9e-4279-805d-566ed1930b3d</serial>
Nov 22 08:07:50 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 08:07:50 user nova-compute[74348]: </disk>
Nov 22 08:07:50 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:07:51 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-be9bf293-6b5f-47a7-907d-94ab25293711 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b6698b0d-0d43-47ea-bcdc-d99201d9833c {{(pid=74348) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 08:07:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:59 user nova-compute[74348]: DEBUG nova.compute.manager [None req-373a003f-8ff9-492b-be06-0ec9a40cfe22 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:07:59 user nova-compute[74348]: INFO nova.compute.manager [None req-373a003f-8ff9-492b-be06-0ec9a40cfe22 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] instance snapshotting
Nov 22 08:07:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:07:59 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-373a003f-8ff9-492b-be06-0ec9a40cfe22 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Beginning live snapshot process
Nov 22 08:08:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-373a003f-8ff9-492b-be06-0ec9a40cfe22 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk --force-share --output=json -f qcow2 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-373a003f-8ff9-492b-be06-0ec9a40cfe22 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk --force-share --output=json -f qcow2" returned: 0 in 0.242s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-373a003f-8ff9-492b-be06-0ec9a40cfe22 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk --force-share --output=json -f qcow2 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-373a003f-8ff9-492b-be06-0ec9a40cfe22 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk --force-share --output=json -f qcow2" returned: 0 in 0.190s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-373a003f-8ff9-492b-be06-0ec9a40cfe22 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-373a003f-8ff9-492b-be06-0ec9a40cfe22 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.176s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-373a003f-8ff9-492b-be06-0ec9a40cfe22 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpsx2x4q8o/9e00ee232ef34140a7ef91cba264aec6.delta 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-373a003f-8ff9-492b-be06-0ec9a40cfe22 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpsx2x4q8o/9e00ee232ef34140a7ef91cba264aec6.delta 1073741824" returned: 0 in 0.058s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:00 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-373a003f-8ff9-492b-be06-0ec9a40cfe22 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 22 08:08:00 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-24efea10-732c-4c56-93c4-d3695012b2bd tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a19d2696-fccb-4b94-8a42-a76b35b32582 is timed out.
Nov 22 08:08:00 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-24efea10-732c-4c56-93c4-d3695012b2bd tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Successfully detached device vdb from instance a19d2696-fccb-4b94-8a42-a76b35b32582 from the live domain config.
Nov 22 08:08:00 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24efea10-732c-4c56-93c4-d3695012b2bd tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 08:08:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-24efea10-732c-4c56-93c4-d3695012b2bd tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EkWPwXTu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:08:00 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-24efea10-732c-4c56-93c4-d3695012b2bd tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:08:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-24efea10-732c-4c56-93c4-d3695012b2bd tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:08:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-24efea10-732c-4c56-93c4-d3695012b2bd tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:08:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[50030ff1-c026-4481-9736-6432835edffb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:08:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-24efea10-732c-4c56-93c4-d3695012b2bd tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 08:08:00 user nova-compute[74348]: No targets found.
Nov 22 08:08:00 user nova-compute[74348]: iSNS:
Nov 22 08:08:00 user nova-compute[74348]: No targets found.
Nov 22 08:08:00 user nova-compute[74348]: STATIC:
Nov 22 08:08:00 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a
Nov 22 08:08:00 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:08:00 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:08:00 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d
Nov 22 08:08:00 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:08:00 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:08:00 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8
Nov 22 08:08:00 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:08:00 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:08:00 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d
Nov 22 08:08:00 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:08:00 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:08:00 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030
Nov 22 08:08:00 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:08:00 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:08:00 user nova-compute[74348]: FIRMWARE:
Nov 22 08:08:00 user nova-compute[74348]: No targets found.
Nov 22 08:08:00 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:08:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-24efea10-732c-4c56-93c4-d3695012b2bd tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 08:08:00 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 08:08:00 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 08:08:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-24efea10-732c-4c56-93c4-d3695012b2bd tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 08:08:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fa3575-bb0b-4706-91ee-74483886d9f0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:08:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4143133-f9d1-43b2-8374-798f386f422a]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:08:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-24efea10-732c-4c56-93c4-d3695012b2bd tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:08:00 user nova-compute[74348]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)
Nov 22 08:08:00 user nova-compute[74348]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 (non-flash)
Nov 22 08:08:00 user nova-compute[74348]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d (non-flash)
Nov 22 08:08:00 user nova-compute[74348]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d (non-flash)
Nov 22 08:08:00 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:08:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-24efea10-732c-4c56-93c4-d3695012b2bd tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:08:00 user nova-compute[74348]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)
Nov 22 08:08:00 user nova-compute[74348]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 (non-flash)
Nov 22 08:08:00 user nova-compute[74348]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d (non-flash)
Nov 22 08:08:00 user nova-compute[74348]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d (non-flash)
Nov 22 08:08:00 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:08:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-24efea10-732c-4c56-93c4-d3695012b2bd tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f222833aa70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d'): ({'sdc'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 08:08:00 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-24efea10-732c-4c56-93c4-d3695012b2bd tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Removing single pathed devices sdc {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 08:08:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32208b7-cd15-4c7b-a24c-7a9e2acb10c7]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:08:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc870ff-3971-40fc-a3ca-b3df45c0be5c]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:08:00 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-24efea10-732c-4c56-93c4-d3695012b2bd tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Flushing IO for device /dev/sdc {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 08:08:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea63758-32ed-48a1-9a83-64121cc8af40]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:08:00 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-24efea10-732c-4c56-93c4-d3695012b2bd tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 08:08:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:01 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3f377a-06a6-401c-9914-5ffb3dbf03fa]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:08:01 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-24efea10-732c-4c56-93c4-d3695012b2bd tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 08:08:01 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-24efea10-732c-4c56-93c4-d3695012b2bd tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] SCSI volumes sdc have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 08:08:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-24efea10-732c-4c56-93c4-d3695012b2bd tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 08:08:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:01 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[28929f4d-06d2-4993-8ff2-adaa8f211a62]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:08:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-24efea10-732c-4c56-93c4-d3695012b2bd tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:08:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:01 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9f5d22-1a1e-4259-802a-2180d75c9286]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:08:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-24efea10-732c-4c56-93c4-d3695012b2bd tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d, portal: 172.16.0.220,3260]
Nov 22 08:08:01 user nova-compute[74348]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d, portal: 172.16.0.220,3260] successful.
Nov 22 08:08:01 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:08:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:01 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee3fff7-4a14-49e6-97e0-c2468196b8f7]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:08:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-24efea10-732c-4c56-93c4-d3695012b2bd tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:08:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-24efea10-732c-4c56-93c4-d3695012b2bd tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:08:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-24efea10-732c-4c56-93c4-d3695012b2bd tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] <== disconnect_volume: return (366ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:08:01 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24efea10-732c-4c56-93c4-d3695012b2bd tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 08:08:01 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-373a003f-8ff9-492b-be06-0ec9a40cfe22 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74348) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 08:08:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-373a003f-8ff9-492b-be06-0ec9a40cfe22 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74348) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 08:08:02 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-373a003f-8ff9-492b-be06-0ec9a40cfe22 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 22 08:08:02 user nova-compute[74348]: DEBUG nova.privsep.utils [None req-373a003f-8ff9-492b-be06-0ec9a40cfe22 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74348) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 08:08:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-373a003f-8ff9-492b-be06-0ec9a40cfe22 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpsx2x4q8o/9e00ee232ef34140a7ef91cba264aec6.delta /opt/stack/data/nova/instances/snapshots/tmpsx2x4q8o/9e00ee232ef34140a7ef91cba264aec6 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:02 user nova-compute[74348]: DEBUG nova.objects.instance [None req-24efea10-732c-4c56-93c4-d3695012b2bd tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lazy-loading 'flavor' on Instance uuid a19d2696-fccb-4b94-8a42-a76b35b32582 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:08:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-24efea10-732c-4c56-93c4-d3695012b2bd tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "a19d2696-fccb-4b94-8a42-a76b35b32582" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.347s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:08:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-cfeef42a-95f3-4b58-bc27-bcf9a78f5e34 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "a19d2696-fccb-4b94-8a42-a76b35b32582" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 22.164s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:08:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-cfeef42a-95f3-4b58-bc27-bcf9a78f5e34 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Acquiring lock "a19d2696-fccb-4b94-8a42-a76b35b32582-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:08:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-cfeef42a-95f3-4b58-bc27-bcf9a78f5e34 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "a19d2696-fccb-4b94-8a42-a76b35b32582-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:08:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-cfeef42a-95f3-4b58-bc27-bcf9a78f5e34 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "a19d2696-fccb-4b94-8a42-a76b35b32582-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:08:02 user nova-compute[74348]: INFO nova.compute.manager [None req-cfeef42a-95f3-4b58-bc27-bcf9a78f5e34 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Terminating instance
Nov 22 08:08:02 user nova-compute[74348]: DEBUG nova.compute.manager [None req-cfeef42a-95f3-4b58-bc27-bcf9a78f5e34 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 08:08:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-373a003f-8ff9-492b-be06-0ec9a40cfe22 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpsx2x4q8o/9e00ee232ef34140a7ef91cba264aec6.delta /opt/stack/data/nova/instances/snapshots/tmpsx2x4q8o/9e00ee232ef34140a7ef91cba264aec6" returned: 0 in 0.645s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:02 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-373a003f-8ff9-492b-be06-0ec9a40cfe22 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Snapshot extracted, beginning image upload
Nov 22 08:08:02 user nova-compute[74348]: DEBUG nova.compute.manager [req-cacb7045-270d-47dd-b4fd-7ddd33801b6f req-44ed2505-70d0-479b-a1a3-20581da184dc service nova] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Received event network-vif-unplugged-9122ca7d-1ee6-4cae-be01-8b846027d7d8 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:08:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-cacb7045-270d-47dd-b4fd-7ddd33801b6f req-44ed2505-70d0-479b-a1a3-20581da184dc service nova] Acquiring lock "a19d2696-fccb-4b94-8a42-a76b35b32582-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:08:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-cacb7045-270d-47dd-b4fd-7ddd33801b6f req-44ed2505-70d0-479b-a1a3-20581da184dc service nova] Lock "a19d2696-fccb-4b94-8a42-a76b35b32582-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:08:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-cacb7045-270d-47dd-b4fd-7ddd33801b6f req-44ed2505-70d0-479b-a1a3-20581da184dc service nova] Lock "a19d2696-fccb-4b94-8a42-a76b35b32582-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:08:02 user nova-compute[74348]: DEBUG nova.compute.manager [req-cacb7045-270d-47dd-b4fd-7ddd33801b6f req-44ed2505-70d0-479b-a1a3-20581da184dc service nova] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] No waiting events found dispatching network-vif-unplugged-9122ca7d-1ee6-4cae-be01-8b846027d7d8 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:08:02 user nova-compute[74348]: DEBUG nova.compute.manager [req-cacb7045-270d-47dd-b4fd-7ddd33801b6f req-44ed2505-70d0-479b-a1a3-20581da184dc service nova] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Received event network-vif-unplugged-9122ca7d-1ee6-4cae-be01-8b846027d7d8 for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 08:08:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:03 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Instance destroyed successfully.
Nov 22 08:08:03 user nova-compute[74348]: DEBUG nova.objects.instance [None req-cfeef42a-95f3-4b58-bc27-bcf9a78f5e34 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lazy-loading 'resources' on Instance uuid a19d2696-fccb-4b94-8a42-a76b35b32582 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:08:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-cfeef42a-95f3-4b58-bc27-bcf9a78f5e34 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:05:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1152938346',display_name='tempest-VolumesSnapshotTestJSON-instance-1152938346',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1152938346',id=35,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpj1Nj+5hiXkSZp4vwIXH7tCa5FsYWMg1RoOkU/A/Ai/p/gmdsXCnEFmB5uKidYPSbLvy9fNriNEwlPea7nvBZPRl/Ydc7pyuK1SiHyUpAdAtJgK7skFdjP+imkMe9kfg==',key_name='tempest-keypair-1653635626',keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:05:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6c0496e87c6a468fab4258553c68b8d3',ramdisk_id='',reservation_id='r-st5dd2jn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-451679750',owner_user_name='tempest-VolumesSnapshotTestJSON-451679750-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T08:05:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='932048022f98418b9ac1d99a356fa39d',uuid=a19d2696-fccb-4b94-8a42-a76b35b32582,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9122ca7d-1ee6-4cae-be01-8b846027d7d8", "address": "fa:16:3e:f7:7e:99", "network": {"id": "59f6f7a7-7076-40e9-8db7-944f89ecb7e5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1331190296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c0496e87c6a468fab4258553c68b8d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9122ca7d-1e", "ovs_interfaceid": "9122ca7d-1ee6-4cae-be01-8b846027d7d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:08:03 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-cfeef42a-95f3-4b58-bc27-bcf9a78f5e34 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Converting VIF {"id": "9122ca7d-1ee6-4cae-be01-8b846027d7d8", "address": "fa:16:3e:f7:7e:99", "network": {"id": "59f6f7a7-7076-40e9-8db7-944f89ecb7e5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1331190296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c0496e87c6a468fab4258553c68b8d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9122ca7d-1e", "ovs_interfaceid": "9122ca7d-1ee6-4cae-be01-8b846027d7d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:08:03 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-cfeef42a-95f3-4b58-bc27-bcf9a78f5e34 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:7e:99,bridge_name='br-int',has_traffic_filtering=True,id=9122ca7d-1ee6-4cae-be01-8b846027d7d8,network=Network(59f6f7a7-7076-40e9-8db7-944f89ecb7e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9122ca7d-1e') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:08:03 user nova-compute[74348]: DEBUG os_vif [None req-cfeef42a-95f3-4b58-bc27-bcf9a78f5e34 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:7e:99,bridge_name='br-int',has_traffic_filtering=True,id=9122ca7d-1ee6-4cae-be01-8b846027d7d8,network=Network(59f6f7a7-7076-40e9-8db7-944f89ecb7e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9122ca7d-1e') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:08:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9122ca7d-1e, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:08:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:08:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4733eedd-f3b0-4fb6-ad58-2069f17657e2) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:08:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:08:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:03 user nova-compute[74348]: INFO os_vif [None req-cfeef42a-95f3-4b58-bc27-bcf9a78f5e34 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:7e:99,bridge_name='br-int',has_traffic_filtering=True,id=9122ca7d-1ee6-4cae-be01-8b846027d7d8,network=Network(59f6f7a7-7076-40e9-8db7-944f89ecb7e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9122ca7d-1e')
Nov 22 08:08:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfeef42a-95f3-4b58-bc27-bcf9a78f5e34 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 08:08:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfeef42a-95f3-4b58-bc27-bcf9a78f5e34 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EkWPwXTu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:08:03 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-cfeef42a-95f3-4b58-bc27-bcf9a78f5e34 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:08:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-cfeef42a-95f3-4b58-bc27-bcf9a78f5e34 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:08:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-cfeef42a-95f3-4b58-bc27-bcf9a78f5e34 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:08:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:03 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9868aaa2-731c-458e-9999-320f7acb7f47]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:08:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfeef42a-95f3-4b58-bc27-bcf9a78f5e34 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 08:08:03 user nova-compute[74348]: No targets found.
Nov 22 08:08:03 user nova-compute[74348]: iSNS:
Nov 22 08:08:03 user nova-compute[74348]: No targets found.
Nov 22 08:08:03 user nova-compute[74348]: STATIC:
Nov 22 08:08:03 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a
Nov 22 08:08:03 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:08:03 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:08:03 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8
Nov 22 08:08:03 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:08:03 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:08:03 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d
Nov 22 08:08:03 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:08:03 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:08:03 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030
Nov 22 08:08:03 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:08:03 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:08:03 user nova-compute[74348]: FIRMWARE:
Nov 22 08:08:03 user nova-compute[74348]: No targets found.
Nov 22 08:08:03 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:08:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfeef42a-95f3-4b58-bc27-bcf9a78f5e34 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 08:08:03 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 08:08:03 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 08:08:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfeef42a-95f3-4b58-bc27-bcf9a78f5e34 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:403b055a-b502-474c-92d5-5ab72126df0d', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 08:08:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:03 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3501b246-2d50-4165-b455-634310031deb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:08:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:03 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f54641-98b6-40c9-9012-2d39d35d915e]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:08:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfeef42a-95f3-4b58-bc27-bcf9a78f5e34 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:08:03 user nova-compute[74348]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)
Nov 22 08:08:03 user nova-compute[74348]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 (non-flash)
Nov 22 08:08:03 user nova-compute[74348]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d (non-flash)
Nov 22 08:08:03 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:08:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfeef42a-95f3-4b58-bc27-bcf9a78f5e34 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:08:03 user nova-compute[74348]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)
Nov 22 08:08:03 user nova-compute[74348]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 (non-flash)
Nov 22 08:08:03 user nova-compute[74348]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d (non-flash)
Nov 22 08:08:03 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:08:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfeef42a-95f3-4b58-bc27-bcf9a78f5e34 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f222833aef0>, {}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 08:08:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfeef42a-95f3-4b58-bc27-bcf9a78f5e34 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Disconnecting from: [] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 08:08:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-cfeef42a-95f3-4b58-bc27-bcf9a78f5e34 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.100s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:08:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfeef42a-95f3-4b58-bc27-bcf9a78f5e34 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] <== disconnect_volume: return (101ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:08:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfeef42a-95f3-4b58-bc27-bcf9a78f5e34 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 08:08:03 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-cfeef42a-95f3-4b58-bc27-bcf9a78f5e34 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Deleting instance files /opt/stack/data/nova/instances/a19d2696-fccb-4b94-8a42-a76b35b32582_del
Nov 22 08:08:03 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-cfeef42a-95f3-4b58-bc27-bcf9a78f5e34 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Deletion of /opt/stack/data/nova/instances/a19d2696-fccb-4b94-8a42-a76b35b32582_del complete
Nov 22 08:08:03 user nova-compute[74348]: INFO nova.compute.manager [None req-cfeef42a-95f3-4b58-bc27-bcf9a78f5e34 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 22 08:08:03 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-cfeef42a-95f3-4b58-bc27-bcf9a78f5e34 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 08:08:03 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 08:08:03 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 08:08:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:04 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:08:04 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Took 0.92 seconds to deallocate network for instance.
Nov 22 08:08:04 user nova-compute[74348]: WARNING nova.volume.cinder [None req-cfeef42a-95f3-4b58-bc27-bcf9a78f5e34 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Attachment cc099855-38f1-4ad5-a121-40c145c79451 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = cc099855-38f1-4ad5-a121-40c145c79451. (HTTP 404) (Request-ID: req-70d19a61-9203-498b-b1e9-b4bf40ba904f)
Nov 22 08:08:04 user nova-compute[74348]: INFO nova.compute.manager [None req-cfeef42a-95f3-4b58-bc27-bcf9a78f5e34 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Took 0.03 seconds to detach 1 volumes for instance.
Nov 22 08:08:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-cfeef42a-95f3-4b58-bc27-bcf9a78f5e34 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:08:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-cfeef42a-95f3-4b58-bc27-bcf9a78f5e34 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:08:04 user nova-compute[74348]: DEBUG nova.compute.manager [req-e1437ea2-45fa-45e9-be74-7294a35ebe76 req-c5f76846-2fa0-4d32-8a85-77bf8e52372c service nova] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Received event network-vif-deleted-9122ca7d-1ee6-4cae-be01-8b846027d7d8 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:08:04 user nova-compute[74348]: DEBUG nova.compute.manager [req-49dc696a-3d0c-42e2-aa74-aff7ee91094c req-61e27bbc-91c7-4c1b-8919-f3465972f99c service nova] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Received event network-vif-plugged-9122ca7d-1ee6-4cae-be01-8b846027d7d8 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:08:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-49dc696a-3d0c-42e2-aa74-aff7ee91094c req-61e27bbc-91c7-4c1b-8919-f3465972f99c service nova] Acquiring lock "a19d2696-fccb-4b94-8a42-a76b35b32582-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:08:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-49dc696a-3d0c-42e2-aa74-aff7ee91094c req-61e27bbc-91c7-4c1b-8919-f3465972f99c service nova] Lock "a19d2696-fccb-4b94-8a42-a76b35b32582-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:08:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-49dc696a-3d0c-42e2-aa74-aff7ee91094c req-61e27bbc-91c7-4c1b-8919-f3465972f99c service nova] Lock "a19d2696-fccb-4b94-8a42-a76b35b32582-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:08:05 user nova-compute[74348]: DEBUG nova.compute.manager [req-49dc696a-3d0c-42e2-aa74-aff7ee91094c req-61e27bbc-91c7-4c1b-8919-f3465972f99c service nova] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] No waiting events found dispatching network-vif-plugged-9122ca7d-1ee6-4cae-be01-8b846027d7d8 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:08:05 user nova-compute[74348]: WARNING nova.compute.manager [req-49dc696a-3d0c-42e2-aa74-aff7ee91094c req-61e27bbc-91c7-4c1b-8919-f3465972f99c service nova] [instance: a19d2696-fccb-4b94-8a42-a76b35b32582] Received unexpected event network-vif-plugged-9122ca7d-1ee6-4cae-be01-8b846027d7d8 for instance with vm_state deleted and task_state None.
Nov 22 08:08:05 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-cfeef42a-95f3-4b58-bc27-bcf9a78f5e34 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:08:05 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-cfeef42a-95f3-4b58-bc27-bcf9a78f5e34 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:08:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-cfeef42a-95f3-4b58-bc27-bcf9a78f5e34 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.372s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:08:05 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-cfeef42a-95f3-4b58-bc27-bcf9a78f5e34 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Deleted allocations for instance a19d2696-fccb-4b94-8a42-a76b35b32582
Nov 22 08:08:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-cfeef42a-95f3-4b58-bc27-bcf9a78f5e34 tempest-VolumesSnapshotTestJSON-451679750 tempest-VolumesSnapshotTestJSON-451679750-project-member] Lock "a19d2696-fccb-4b94-8a42-a76b35b32582" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.787s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:08:05 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-373a003f-8ff9-492b-be06-0ec9a40cfe22 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Snapshot image upload complete
Nov 22 08:08:05 user nova-compute[74348]: INFO nova.compute.manager [None req-373a003f-8ff9-492b-be06-0ec9a40cfe22 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Took 6.40 seconds to snapshot the instance on the hypervisor.
Nov 22 08:08:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:11 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-be9bf293-6b5f-47a7-907d-94ab25293711 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b6698b0d-0d43-47ea-bcdc-d99201d9833c is timed out.
Nov 22 08:08:11 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-be9bf293-6b5f-47a7-907d-94ab25293711 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Successfully detached device vdb from instance b6698b0d-0d43-47ea-bcdc-d99201d9833c from the live domain config.
Nov 22 08:08:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be9bf293-6b5f-47a7-907d-94ab25293711 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9bf293-6b5f-47a7-907d-94ab25293711 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eGkUfXHz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:08:11 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-be9bf293-6b5f-47a7-907d-94ab25293711 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:08:11 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-be9bf293-6b5f-47a7-907d-94ab25293711 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-be9bf293-6b5f-47a7-907d-94ab25293711 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0752c24-0110-476c-8f2e-2ed7eb6f07b1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9bf293-6b5f-47a7-907d-94ab25293711 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 08:08:11 user nova-compute[74348]: No targets found.
Nov 22 08:08:11 user nova-compute[74348]: iSNS:
Nov 22 08:08:11 user nova-compute[74348]: No targets found.
Nov 22 08:08:11 user nova-compute[74348]: STATIC:
Nov 22 08:08:11 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a
Nov 22 08:08:11 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:08:11 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:08:11 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8
Nov 22 08:08:11 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:08:11 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:08:11 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d
Nov 22 08:08:11 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:08:11 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:08:11 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030
Nov 22 08:08:11 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:08:11 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:08:11 user nova-compute[74348]: FIRMWARE:
Nov 22 08:08:11 user nova-compute[74348]: No targets found.
Nov 22 08:08:11 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9bf293-6b5f-47a7-907d-94ab25293711 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 08:08:11 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 08:08:11 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9bf293-6b5f-47a7-907d-94ab25293711 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[720fecee-9e01-4d97-950f-3fcd2c47929c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b472dc-93a7-42b7-81a2-537b771c6134]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9bf293-6b5f-47a7-907d-94ab25293711 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:08:11 user nova-compute[74348]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)
Nov 22 08:08:11 user nova-compute[74348]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 (non-flash)
Nov 22 08:08:11 user nova-compute[74348]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d (non-flash)
Nov 22 08:08:11 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9bf293-6b5f-47a7-907d-94ab25293711 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:08:11 user nova-compute[74348]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)
Nov 22 08:08:11 user nova-compute[74348]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 (non-flash)
Nov 22 08:08:11 user nova-compute[74348]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d (non-flash)
Nov 22 08:08:11 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9bf293-6b5f-47a7-907d-94ab25293711 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f22283a1e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d'): ({'sdf'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-be9bf293-6b5f-47a7-907d-94ab25293711 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Removing single pathed devices sdf {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d497b16-bbc7-492f-a46d-604a7d60d18a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98253ca-d5f6-48b9-ae4f-e9b97af01a8e]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-be9bf293-6b5f-47a7-907d-94ab25293711 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Flushing IO for device /dev/sdf {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb1683b-afa6-4300-b1c0-fea2ff0bbbc5]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-be9bf293-6b5f-47a7-907d-94ab25293711 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[06cd73ee-75f7-40f2-a380-6a0f856593ec]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-be9bf293-6b5f-47a7-907d-94ab25293711 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-be9bf293-6b5f-47a7-907d-94ab25293711 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] SCSI volumes sdf have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9bf293-6b5f-47a7-907d-94ab25293711 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa3a38f-8105-415d-9c98-78ff959f27e0]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9bf293-6b5f-47a7-907d-94ab25293711 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9bfcb3c-b4e3-4634-be51-00cd3cec6394]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9bf293-6b5f-47a7-907d-94ab25293711 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d, portal: 172.16.0.220,3260]
Nov 22 08:08:11 user nova-compute[74348]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d, portal: 172.16.0.220,3260] successful.
Nov 22 08:08:11 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e1c63c0-cd9e-4279-805d-566ed1930b3d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b23c40-2e23-4b67-aed5-75f48901a392]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9bf293-6b5f-47a7-907d-94ab25293711 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-be9bf293-6b5f-47a7-907d-94ab25293711 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9bf293-6b5f-47a7-907d-94ab25293711 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] <== disconnect_volume: return (309ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:08:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be9bf293-6b5f-47a7-907d-94ab25293711 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 08:08:12 user nova-compute[74348]: DEBUG nova.objects.instance [None req-be9bf293-6b5f-47a7-907d-94ab25293711 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lazy-loading 'flavor' on Instance uuid b6698b0d-0d43-47ea-bcdc-d99201d9833c {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:08:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-be9bf293-6b5f-47a7-907d-94ab25293711 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.997s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:08:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:08:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:24 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:24 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Acquiring lock "3b0e2761-c6aa-45a5-980a-da40a415c8d0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:08:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Lock "3b0e2761-c6aa-45a5-980a-da40a415c8d0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:08:35 user nova-compute[74348]: DEBUG nova.compute.manager [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 08:08:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:08:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:08:35 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 08:08:35 user nova-compute[74348]: INFO nova.compute.claims [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Claim successful on node user
Nov 22 08:08:36 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:08:36 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:08:36 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:08:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.695s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:08:36 user nova-compute[74348]: DEBUG nova.compute.manager [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 08:08:36 user nova-compute[74348]: DEBUG nova.compute.manager [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 08:08:36 user nova-compute[74348]: DEBUG nova.network.neutron [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 08:08:36 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 08:08:36 user nova-compute[74348]: DEBUG nova.compute.manager [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 08:08:36 user nova-compute[74348]: DEBUG nova.policy [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bf9cb24417584aed8ba7f2fb1ab1df40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e26410148c64dfdaf46ebf656cbbd95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 08:08:36 user nova-compute[74348]: DEBUG nova.compute.manager [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 08:08:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 08:08:36 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Creating image(s)
Nov 22 08:08:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Acquiring lock "/opt/stack/data/nova/instances/3b0e2761-c6aa-45a5-980a-da40a415c8d0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:08:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Lock "/opt/stack/data/nova/instances/3b0e2761-c6aa-45a5-980a-da40a415c8d0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:08:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Lock "/opt/stack/data/nova/instances/3b0e2761-c6aa-45a5-980a-da40a415c8d0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:08:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.196s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Acquiring lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:08:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:08:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.186s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/3b0e2761-c6aa-45a5-980a-da40a415c8d0/disk 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/3b0e2761-c6aa-45a5-980a-da40a415c8d0/disk 1073741824" returned: 0 in 0.056s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:08:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:37 user nova-compute[74348]: DEBUG nova.network.neutron [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Successfully created port: 2803cb98-f4d6-4f8e-879d-650a73f35141 {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 08:08:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.202s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:37 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3b0e2761-c6aa-45a5-980a-da40a415c8d0/disk. size=1073741824 {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 08:08:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0e2761-c6aa-45a5-980a-da40a415c8d0/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0e2761-c6aa-45a5-980a-da40a415c8d0/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:37 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Cannot resize image /opt/stack/data/nova/instances/3b0e2761-c6aa-45a5-980a-da40a415c8d0/disk to a smaller size. {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 08:08:37 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 08:08:37 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Ensure instance console log exists: /opt/stack/data/nova/instances/3b0e2761-c6aa-45a5-980a-da40a415c8d0/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 08:08:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:08:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:08:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG nova.network.neutron [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Successfully updated port: 2803cb98-f4d6-4f8e-879d-650a73f35141 {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Acquiring lock "refresh_cache-3b0e2761-c6aa-45a5-980a-da40a415c8d0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Acquired lock "refresh_cache-3b0e2761-c6aa-45a5-980a-da40a415c8d0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG nova.network.neutron [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG nova.compute.manager [req-c41f8b87-6c0d-433b-acfe-9f6304b67b4a req-bcb2df06-5a3e-414b-8ae9-c9238d462648 service nova] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Received event network-changed-2803cb98-f4d6-4f8e-879d-650a73f35141 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG nova.compute.manager [req-c41f8b87-6c0d-433b-acfe-9f6304b67b4a req-bcb2df06-5a3e-414b-8ae9-c9238d462648 service nova] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Refreshing instance network info cache due to event network-changed-2803cb98-f4d6-4f8e-879d-650a73f35141. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c41f8b87-6c0d-433b-acfe-9f6304b67b4a req-bcb2df06-5a3e-414b-8ae9-c9238d462648 service nova] Acquiring lock "refresh_cache-3b0e2761-c6aa-45a5-980a-da40a415c8d0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG nova.network.neutron [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG nova.network.neutron [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Updating instance_info_cache with network_info: [{"id": "2803cb98-f4d6-4f8e-879d-650a73f35141", "address": "fa:16:3e:0e:ff:2e", "network": {"id": "70010ceb-a29f-4178-baca-95da22a59148", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1903564927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e26410148c64dfdaf46ebf656cbbd95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2803cb98-f4", "ovs_interfaceid": "2803cb98-f4d6-4f8e-879d-650a73f35141", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Releasing lock "refresh_cache-3b0e2761-c6aa-45a5-980a-da40a415c8d0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG nova.compute.manager [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Instance network_info: |[{"id": "2803cb98-f4d6-4f8e-879d-650a73f35141", "address": "fa:16:3e:0e:ff:2e", "network": {"id": "70010ceb-a29f-4178-baca-95da22a59148", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1903564927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e26410148c64dfdaf46ebf656cbbd95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2803cb98-f4", "ovs_interfaceid": "2803cb98-f4d6-4f8e-879d-650a73f35141", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c41f8b87-6c0d-433b-acfe-9f6304b67b4a req-bcb2df06-5a3e-414b-8ae9-c9238d462648 service nova] Acquired lock "refresh_cache-3b0e2761-c6aa-45a5-980a-da40a415c8d0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG nova.network.neutron [req-c41f8b87-6c0d-433b-acfe-9f6304b67b4a req-bcb2df06-5a3e-414b-8ae9-c9238d462648 service nova] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Refreshing network info cache for port 2803cb98-f4d6-4f8e-879d-650a73f35141 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Start _get_guest_xml network_info=[{"id": "2803cb98-f4d6-4f8e-879d-650a73f35141", "address": "fa:16:3e:0e:ff:2e", "network": {"id": "70010ceb-a29f-4178-baca-95da22a59148", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1903564927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e26410148c64dfdaf46ebf656cbbd95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2803cb98-f4", "ovs_interfaceid": "2803cb98-f4d6-4f8e-879d-650a73f35141", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 08:08:38 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:08:38 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:08:38 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:08:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1122936641',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1122936641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1122936',id=37,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmg8AHHrhWpoC3fZXCXtkSqixDD2bvVaSqaOqYty3uaRwGYTQYcVQ2ESt8f5s1NUWH8Y9P7XbiVL09/p5CRniHCV6BT4s9RXoT/5SVZdYAVQ1dRy5YqeeZMStzzTJ5bOQ==',key_name='tempest-keypair-1403920496',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e26410148c64dfdaf46ebf656cbbd95',ramdisk_id='',reservation_id='r-49vvgw4f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2076547253',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:08:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf9cb24417584aed8ba7f2fb1ab1df40',uuid=3b0e2761-c6aa-45a5-980a-da40a415c8d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2803cb98-f4d6-4f8e-879d-650a73f35141", "address": "fa:16:3e:0e:ff:2e", "network": {"id": "70010ceb-a29f-4178-baca-95da22a59148", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1903564927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e26410148c64dfdaf46ebf656cbbd95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2803cb98-f4", "ovs_interfaceid": "2803cb98-f4d6-4f8e-879d-650a73f35141", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Converting VIF {"id": "2803cb98-f4d6-4f8e-879d-650a73f35141", "address": "fa:16:3e:0e:ff:2e", "network": {"id": "70010ceb-a29f-4178-baca-95da22a59148", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1903564927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e26410148c64dfdaf46ebf656cbbd95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2803cb98-f4", "ovs_interfaceid": "2803cb98-f4d6-4f8e-879d-650a73f35141", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ff:2e,bridge_name='br-int',has_traffic_filtering=True,id=2803cb98-f4d6-4f8e-879d-650a73f35141,network=Network(70010ceb-a29f-4178-baca-95da22a59148),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2803cb98-f4') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG nova.objects.instance [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b0e2761-c6aa-45a5-980a-da40a415c8d0 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] End _get_guest_xml xml=<domain type="kvm">
Nov 22 08:08:38 user nova-compute[74348]:   <uuid>3b0e2761-c6aa-45a5-980a-da40a415c8d0</uuid>
Nov 22 08:08:38 user nova-compute[74348]:   <name>instance-00000025</name>
Nov 22 08:08:38 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 08:08:38 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 08:08:38 user nova-compute[74348]:   <metadata>
Nov 22 08:08:38 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 08:08:38 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 08:08:38 user nova-compute[74348]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1122936641</nova:name>
Nov 22 08:08:38 user nova-compute[74348]:       <nova:creationTime>2023-11-22 08:08:38</nova:creationTime>
Nov 22 08:08:38 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 08:08:38 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 08:08:38 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 08:08:38 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 08:08:38 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 08:08:38 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 08:08:38 user nova-compute[74348]:       </nova:flavor>
Nov 22 08:08:38 user nova-compute[74348]:       <nova:owner>
Nov 22 08:08:38 user nova-compute[74348]:         <nova:user uuid="bf9cb24417584aed8ba7f2fb1ab1df40">tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member</nova:user>
Nov 22 08:08:38 user nova-compute[74348]:         <nova:project uuid="3e26410148c64dfdaf46ebf656cbbd95">tempest-TestServerVolumeAttachScenarioOldVersion-2076547253</nova:project>
Nov 22 08:08:38 user nova-compute[74348]:       </nova:owner>
Nov 22 08:08:38 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 08:08:38 user nova-compute[74348]:       <nova:ports>
Nov 22 08:08:38 user nova-compute[74348]:         <nova:port uuid="2803cb98-f4d6-4f8e-879d-650a73f35141">
Nov 22 08:08:38 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 22 08:08:38 user nova-compute[74348]:         </nova:port>
Nov 22 08:08:38 user nova-compute[74348]:       </nova:ports>
Nov 22 08:08:38 user nova-compute[74348]:     </nova:instance>
Nov 22 08:08:38 user nova-compute[74348]:   </metadata>
Nov 22 08:08:38 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 08:08:38 user nova-compute[74348]:     <system>
Nov 22 08:08:38 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 08:08:38 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 08:08:38 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 08:08:38 user nova-compute[74348]:       <entry name="serial">3b0e2761-c6aa-45a5-980a-da40a415c8d0</entry>
Nov 22 08:08:38 user nova-compute[74348]:       <entry name="uuid">3b0e2761-c6aa-45a5-980a-da40a415c8d0</entry>
Nov 22 08:08:38 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 08:08:38 user nova-compute[74348]:     </system>
Nov 22 08:08:38 user nova-compute[74348]:   </sysinfo>
Nov 22 08:08:38 user nova-compute[74348]:   <os>
Nov 22 08:08:38 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 08:08:38 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 08:08:38 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 08:08:38 user nova-compute[74348]:   </os>
Nov 22 08:08:38 user nova-compute[74348]:   <features>
Nov 22 08:08:38 user nova-compute[74348]:     <acpi/>
Nov 22 08:08:38 user nova-compute[74348]:     <apic/>
Nov 22 08:08:38 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 08:08:38 user nova-compute[74348]:   </features>
Nov 22 08:08:38 user nova-compute[74348]:   <clock offset="utc">
Nov 22 08:08:38 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 08:08:38 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 08:08:38 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 08:08:38 user nova-compute[74348]:   </clock>
Nov 22 08:08:38 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 08:08:38 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 08:08:38 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 08:08:38 user nova-compute[74348]:   </cpu>
Nov 22 08:08:38 user nova-compute[74348]:   <devices>
Nov 22 08:08:38 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 08:08:38 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 08:08:38 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/3b0e2761-c6aa-45a5-980a-da40a415c8d0/disk"/>
Nov 22 08:08:38 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 08:08:38 user nova-compute[74348]:     </disk>
Nov 22 08:08:38 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 08:08:38 user nova-compute[74348]:       <mac address="fa:16:3e:0e:ff:2e"/>
Nov 22 08:08:38 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:08:38 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 08:08:38 user nova-compute[74348]:       <target dev="tap2803cb98-f4"/>
Nov 22 08:08:38 user nova-compute[74348]:     </interface>
Nov 22 08:08:38 user nova-compute[74348]:     <serial type="pty">
Nov 22 08:08:38 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/3b0e2761-c6aa-45a5-980a-da40a415c8d0/console.log" append="off"/>
Nov 22 08:08:38 user nova-compute[74348]:     </serial>
Nov 22 08:08:38 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 08:08:38 user nova-compute[74348]:     <video>
Nov 22 08:08:38 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:08:38 user nova-compute[74348]:     </video>
Nov 22 08:08:38 user nova-compute[74348]:     <rng model="virtio">
Nov 22 08:08:38 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 08:08:38 user nova-compute[74348]:     </rng>
Nov 22 08:08:38 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 08:08:38 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 08:08:38 user nova-compute[74348]:       <stats period="10"/>
Nov 22 08:08:38 user nova-compute[74348]:     </memballoon>
Nov 22 08:08:38 user nova-compute[74348]:   </devices>
Nov 22 08:08:38 user nova-compute[74348]: </domain>
Nov 22 08:08:38 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:08:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1122936641',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1122936641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1122936',id=37,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmg8AHHrhWpoC3fZXCXtkSqixDD2bvVaSqaOqYty3uaRwGYTQYcVQ2ESt8f5s1NUWH8Y9P7XbiVL09/p5CRniHCV6BT4s9RXoT/5SVZdYAVQ1dRy5YqeeZMStzzTJ5bOQ==',key_name='tempest-keypair-1403920496',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e26410148c64dfdaf46ebf656cbbd95',ramdisk_id='',reservation_id='r-49vvgw4f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2076547253',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:08:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf9cb24417584aed8ba7f2fb1ab1df40',uuid=3b0e2761-c6aa-45a5-980a-da40a415c8d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2803cb98-f4d6-4f8e-879d-650a73f35141", "address": "fa:16:3e:0e:ff:2e", "network": {"id": "70010ceb-a29f-4178-baca-95da22a59148", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1903564927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e26410148c64dfdaf46ebf656cbbd95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2803cb98-f4", "ovs_interfaceid": "2803cb98-f4d6-4f8e-879d-650a73f35141", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Converting VIF {"id": "2803cb98-f4d6-4f8e-879d-650a73f35141", "address": "fa:16:3e:0e:ff:2e", "network": {"id": "70010ceb-a29f-4178-baca-95da22a59148", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1903564927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e26410148c64dfdaf46ebf656cbbd95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2803cb98-f4", "ovs_interfaceid": "2803cb98-f4d6-4f8e-879d-650a73f35141", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ff:2e,bridge_name='br-int',has_traffic_filtering=True,id=2803cb98-f4d6-4f8e-879d-650a73f35141,network=Network(70010ceb-a29f-4178-baca-95da22a59148),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2803cb98-f4') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG os_vif [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ff:2e,bridge_name='br-int',has_traffic_filtering=True,id=2803cb98-f4d6-4f8e-879d-650a73f35141,network=Network(70010ceb-a29f-4178-baca-95da22a59148),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2803cb98-f4') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '82bfb6a0-f3b1-5390-98fa-7250b5f13f80', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2803cb98-f4, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2803cb98-f4, col_values=(('qos', UUID('6946f087-afe0-4769-b45a-e602fce49d07')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2803cb98-f4, col_values=(('external_ids', {'iface-id': '2803cb98-f4d6-4f8e-879d-650a73f35141', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:ff:2e', 'vm-uuid': '3b0e2761-c6aa-45a5-980a-da40a415c8d0'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:38 user nova-compute[74348]: INFO os_vif [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ff:2e,bridge_name='br-int',has_traffic_filtering=True,id=2803cb98-f4d6-4f8e-879d-650a73f35141,network=Network(70010ceb-a29f-4178-baca-95da22a59148),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2803cb98-f4')
Nov 22 08:08:38 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:08:38 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] No VIF found with MAC fa:16:3e:0e:ff:2e, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:08:39 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:39 user nova-compute[74348]: DEBUG nova.network.neutron [req-c41f8b87-6c0d-433b-acfe-9f6304b67b4a req-bcb2df06-5a3e-414b-8ae9-c9238d462648 service nova] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Updated VIF entry in instance network info cache for port 2803cb98-f4d6-4f8e-879d-650a73f35141. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:08:39 user nova-compute[74348]: DEBUG nova.network.neutron [req-c41f8b87-6c0d-433b-acfe-9f6304b67b4a req-bcb2df06-5a3e-414b-8ae9-c9238d462648 service nova] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Updating instance_info_cache with network_info: [{"id": "2803cb98-f4d6-4f8e-879d-650a73f35141", "address": "fa:16:3e:0e:ff:2e", "network": {"id": "70010ceb-a29f-4178-baca-95da22a59148", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1903564927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e26410148c64dfdaf46ebf656cbbd95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2803cb98-f4", "ovs_interfaceid": "2803cb98-f4d6-4f8e-879d-650a73f35141", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:08:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c41f8b87-6c0d-433b-acfe-9f6304b67b4a req-bcb2df06-5a3e-414b-8ae9-c9238d462648 service nova] Releasing lock "refresh_cache-3b0e2761-c6aa-45a5-980a-da40a415c8d0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:08:39 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:08:40 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:40 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:40 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:40 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:40 user nova-compute[74348]: DEBUG nova.compute.manager [req-735040e2-9c37-4b95-9330-1bda10cb5189 req-6283defe-5247-4946-8703-821e6515d64d service nova] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Received event network-vif-plugged-2803cb98-f4d6-4f8e-879d-650a73f35141 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:08:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-735040e2-9c37-4b95-9330-1bda10cb5189 req-6283defe-5247-4946-8703-821e6515d64d service nova] Acquiring lock "3b0e2761-c6aa-45a5-980a-da40a415c8d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:08:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-735040e2-9c37-4b95-9330-1bda10cb5189 req-6283defe-5247-4946-8703-821e6515d64d service nova] Lock "3b0e2761-c6aa-45a5-980a-da40a415c8d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:08:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-735040e2-9c37-4b95-9330-1bda10cb5189 req-6283defe-5247-4946-8703-821e6515d64d service nova] Lock "3b0e2761-c6aa-45a5-980a-da40a415c8d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:08:40 user nova-compute[74348]: DEBUG nova.compute.manager [req-735040e2-9c37-4b95-9330-1bda10cb5189 req-6283defe-5247-4946-8703-821e6515d64d service nova] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] No waiting events found dispatching network-vif-plugged-2803cb98-f4d6-4f8e-879d-650a73f35141 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:08:40 user nova-compute[74348]: WARNING nova.compute.manager [req-735040e2-9c37-4b95-9330-1bda10cb5189 req-6283defe-5247-4946-8703-821e6515d64d service nova] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Received unexpected event network-vif-plugged-2803cb98-f4d6-4f8e-879d-650a73f35141 for instance with vm_state building and task_state spawning.
Nov 22 08:08:40 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:08:40 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:08:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-5006cff5-4b67-405d-b6b1-4c355f82d920" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:08:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-5006cff5-4b67-405d-b6b1-4c355f82d920" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:08:40 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 08:08:40 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:40 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:40 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:41 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Updating instance_info_cache with network_info: [{"id": "db42bd08-8f0c-4e24-82c6-579bed0476bf", "address": "fa:16:3e:4e:f8:01", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb42bd08-8f", "ovs_interfaceid": "db42bd08-8f0c-4e24-82c6-579bed0476bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:08:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-5006cff5-4b67-405d-b6b1-4c355f82d920" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:08:41 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 08:08:41 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:08:42 user nova-compute[74348]: DEBUG nova.compute.manager [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 08:08:42 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 08:08:42 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Instance spawned successfully.
Nov 22 08:08:42 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 08:08:42 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:08:42 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:08:42 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:08:42 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:08:42 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:08:42 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:08:42 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:08:42 user nova-compute[74348]: DEBUG nova.compute.manager [req-63792591-6e43-4c6e-bdf3-67c94933d1d0 req-670cfc2a-f6f0-4c50-8f3e-c8dc840006ad service nova] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Received event network-vif-plugged-2803cb98-f4d6-4f8e-879d-650a73f35141 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:08:42 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-63792591-6e43-4c6e-bdf3-67c94933d1d0 req-670cfc2a-f6f0-4c50-8f3e-c8dc840006ad service nova] Acquiring lock "3b0e2761-c6aa-45a5-980a-da40a415c8d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:08:42 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-63792591-6e43-4c6e-bdf3-67c94933d1d0 req-670cfc2a-f6f0-4c50-8f3e-c8dc840006ad service nova] Lock "3b0e2761-c6aa-45a5-980a-da40a415c8d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:08:42 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-63792591-6e43-4c6e-bdf3-67c94933d1d0 req-670cfc2a-f6f0-4c50-8f3e-c8dc840006ad service nova] Lock "3b0e2761-c6aa-45a5-980a-da40a415c8d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:08:42 user nova-compute[74348]: DEBUG nova.compute.manager [req-63792591-6e43-4c6e-bdf3-67c94933d1d0 req-670cfc2a-f6f0-4c50-8f3e-c8dc840006ad service nova] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] No waiting events found dispatching network-vif-plugged-2803cb98-f4d6-4f8e-879d-650a73f35141 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:08:42 user nova-compute[74348]: WARNING nova.compute.manager [req-63792591-6e43-4c6e-bdf3-67c94933d1d0 req-670cfc2a-f6f0-4c50-8f3e-c8dc840006ad service nova] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Received unexpected event network-vif-plugged-2803cb98-f4d6-4f8e-879d-650a73f35141 for instance with vm_state building and task_state spawning.
Nov 22 08:08:42 user nova-compute[74348]: INFO nova.compute.manager [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Took 5.65 seconds to spawn the instance on the hypervisor.
Nov 22 08:08:42 user nova-compute[74348]: DEBUG nova.compute.manager [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:08:42 user nova-compute[74348]: INFO nova.compute.manager [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Took 6.69 seconds to build instance.
Nov 22 08:08:42 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-24155f13-1615-42b6-928c-340c46807323 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Lock "3b0e2761-c6aa-45a5-980a-da40a415c8d0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.791s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:08:43 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:08:43 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:08:43 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:08:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Acquiring lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:08:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:08:43 user nova-compute[74348]: DEBUG nova.objects.instance [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lazy-loading 'flavor' on Instance uuid b6698b0d-0d43-47ea-bcdc-d99201d9833c {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:08:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:08:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Acquiring lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:08:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:08:44 user nova-compute[74348]: INFO nova.compute.manager [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Attaching volume 508f1f11-18de-48f2-937a-21a82e8d95ac to /dev/vdb
Nov 22 08:08:44 user nova-compute[74348]: DEBUG os_brick.utils [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:08:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:44 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6132f8-e5f9-4b3c-b305-e4bb356c1fa5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:08:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:44 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ae4939-c847-49de-bcc7-7007fb4306d1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:08:44 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:44 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7081f62a-301a-4036-b95d-048b94ea3a30]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:08:44 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6adf9e7-2e0c-4170-8863-1fcc16b1152f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:08:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:08:44 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 08:08:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:08:44 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 08:08:44 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f147459-ba28-4f12-90ff-ee4c139381b0]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:08:44 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 08:08:44 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 08:08:44 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 08:08:44 user nova-compute[74348]: DEBUG os_brick.utils [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:08:44 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Updating existing volume attachment record: ab776d25-8fa2-48ed-89cf-3c4bfee6a5e0 {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 08:08:45 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:08:45 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:08:45 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:08:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:08:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:08:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:08:45 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:08:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:46 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:08:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6698b0d-0d43-47ea-bcdc-d99201d9833c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6698b0d-0d43-47ea-bcdc-d99201d9833c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6698b0d-0d43-47ea-bcdc-d99201d9833c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6698b0d-0d43-47ea-bcdc-d99201d9833c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:08:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk.rescue --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk.rescue --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk.rescue --force-share --output=json" returned: 0 in 0.225s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json" returned: 0 in 0.233s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0e2761-c6aa-45a5-980a-da40a415c8d0/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0e2761-c6aa-45a5-980a-da40a415c8d0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0e2761-c6aa-45a5-980a-da40a415c8d0/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0e2761-c6aa-45a5-980a-da40a415c8d0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fcddbef-dfaf-48a5-8561-26b8857fdbd6/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fcddbef-dfaf-48a5-8561-26b8857fdbd6/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fcddbef-dfaf-48a5-8561-26b8857fdbd6/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fcddbef-dfaf-48a5-8561-26b8857fdbd6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:50 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:08:50 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:08:50 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:08:50 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=7762MB free_disk=24.70330047607422GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:08:50 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:08:50 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 765f8c47-c042-4430-8d35-07926ad693fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance b8f84c0b-fab5-4900-bf65-270c9c06baf8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 37c93c2a-1397-4b04-aef1-5068218ad9fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 5006cff5-4b67-405d-b6b1-4c355f82d920 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 555f4246-d4b2-4f2f-b91c-dda8fe47264c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance ba74ca7d-2875-426c-a485-d908af865bae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance b6698b0d-0d43-47ea-bcdc-d99201d9833c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 016c8f4b-a226-4226-ba56-8a2b28cea146 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 4fcddbef-dfaf-48a5-8561-26b8857fdbd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance b95b6cae-1885-43e8-b589-ee89854100a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 3b0e2761-c6aa-45a5-980a-da40a415c8d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Refreshing inventories for resource provider 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Updating ProviderTree inventory for provider 52690f6a-773f-4e8d-be85-d278b6522975 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Updating inventory in ProviderTree for provider 52690f6a-773f-4e8d-be85-d278b6522975 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Refreshing aggregate associations for resource provider 52690f6a-773f-4e8d-be85-d278b6522975, aggregates: None {{(pid=74348) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Refreshing trait associations for resource provider 52690f6a-773f-4e8d-be85-d278b6522975, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=74348) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IEgpQexi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:08:51 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:08:51 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:08:51 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:08:51 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:08:51 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 08:08:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c70f98-776b-4e21-b768-b4aafc2ee593]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 08:08:51 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69aa77e-5662-4c56-bc0d-13a1952570c6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac] added
Nov 22 08:08:51 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4514c2f-a5ee-4bdd-a42d-8545614183bf]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51ff777-01d3-46b3-8170-d142f32a4831]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IEgpQexi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IEgpQexi" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19f6282-425c-4136-b298-8ac0f61283e3]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IEgpQexi'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70b1d4f-dc97-4303-8507-c35a97a6d1b3]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66cc777-29b0-4f0a-9999-5e19c035e069]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:08:51 user nova-compute[74348]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)
Nov 22 08:08:51 user nova-compute[74348]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 (non-flash)
Nov 22 08:08:51 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:08:51 user nova-compute[74348]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)
Nov 22 08:08:51 user nova-compute[74348]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 (non-flash)
Nov 22 08:08:51 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c6802a-f73e-4494-850d-5574fb18030b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac, portal: 172.16.0.220,3260]
Nov 22 08:08:51 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac, portal: 172.16.0.220,3260] successful.
Nov 22 08:08:51 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e0ac0a-6c9e-4083-9281-359a21a48e23]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce2b97d-c143-418c-b393-d8146480c8fc]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:08:51 user nova-compute[74348]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)
Nov 22 08:08:51 user nova-compute[74348]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 (non-flash)
Nov 22 08:08:51 user nova-compute[74348]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac (non-flash)
Nov 22 08:08:51 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:08:51 user nova-compute[74348]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)
Nov 22 08:08:51 user nova-compute[74348]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 (non-flash)
Nov 22 08:08:51 user nova-compute[74348]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac (non-flash)
Nov 22 08:08:51 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.834s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.026s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0356b29f-3815-413a-91b8-56bd3703cfcb]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:08:51 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IEgpQexi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 08:08:52 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:08:52 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '26231613565623238', 'path': '/dev/sdc'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:08:52 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231613565623238', 'path': '/dev/sdc'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 08:08:52 user nova-compute[74348]: DEBUG nova.objects.instance [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lazy-loading 'flavor' on Instance uuid b6698b0d-0d43-47ea-bcdc-d99201d9833c {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:08:52 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 08:08:52 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:08:52 user nova-compute[74348]:   <source dev="/dev/sdc"/>
Nov 22 08:08:52 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:08:52 user nova-compute[74348]:   <serial>508f1f11-18de-48f2-937a-21a82e8d95ac</serial>
Nov 22 08:08:52 user nova-compute[74348]: </disk>
Nov 22 08:08:52 user nova-compute[74348]:  {{(pid=74348) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 08:08:53 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:08:53 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:08:53 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] No VIF found with MAC fa:16:3e:d2:53:6d, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:08:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-affd97a0-0c92-4564-acea-f2b459ef895d tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.261s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:08:53 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:08:53 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Cleaning up deleted instances {{(pid=74348) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 22 08:08:53 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] There are 0 instances to clean {{(pid=74348) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 22 08:08:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d284b65a-054f-4cad-a9c3-bf69d678b43b tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Acquiring lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:08:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d284b65a-054f-4cad-a9c3-bf69d678b43b tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:08:55 user nova-compute[74348]: INFO nova.compute.manager [None req-d284b65a-054f-4cad-a9c3-bf69d678b43b tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Detaching volume 508f1f11-18de-48f2-937a-21a82e8d95ac
Nov 22 08:08:55 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:08:55 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74348) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 22 08:08:55 user nova-compute[74348]: INFO nova.virt.block_device [None req-d284b65a-054f-4cad-a9c3-bf69d678b43b tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Attempting to driver detach volume 508f1f11-18de-48f2-937a-21a82e8d95ac from mountpoint /dev/vdb
Nov 22 08:08:55 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-d284b65a-054f-4cad-a9c3-bf69d678b43b tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Attempting to detach device vdb from instance b6698b0d-0d43-47ea-bcdc-d99201d9833c from the persistent domain config. {{(pid=74348) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 08:08:55 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-d284b65a-054f-4cad-a9c3-bf69d678b43b tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:08:55 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:08:55 user nova-compute[74348]:   <source dev="/dev/sdc"/>
Nov 22 08:08:55 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:08:55 user nova-compute[74348]:   <serial>508f1f11-18de-48f2-937a-21a82e8d95ac</serial>
Nov 22 08:08:55 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 08:08:55 user nova-compute[74348]: </disk>
Nov 22 08:08:55 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:08:55 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-d284b65a-054f-4cad-a9c3-bf69d678b43b tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Successfully detached device vdb from instance b6698b0d-0d43-47ea-bcdc-d99201d9833c from the persistent domain config.
Nov 22 08:08:55 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-d284b65a-054f-4cad-a9c3-bf69d678b43b tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b6698b0d-0d43-47ea-bcdc-d99201d9833c from the live domain config. {{(pid=74348) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 08:08:55 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-d284b65a-054f-4cad-a9c3-bf69d678b43b tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:08:55 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:08:55 user nova-compute[74348]:   <source dev="/dev/sdc"/>
Nov 22 08:08:55 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:08:55 user nova-compute[74348]:   <serial>508f1f11-18de-48f2-937a-21a82e8d95ac</serial>
Nov 22 08:08:55 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 08:08:55 user nova-compute[74348]: </disk>
Nov 22 08:08:55 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:08:56 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-d284b65a-054f-4cad-a9c3-bf69d678b43b tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b6698b0d-0d43-47ea-bcdc-d99201d9833c {{(pid=74348) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 08:08:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:08:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:00 user nova-compute[74348]: DEBUG nova.compute.manager [req-685a73c3-9601-444f-b400-4210400ae32e req-26ae0b68-3986-4164-ae2c-c7b99dcfefd7 service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Received event network-changed-71e66d69-de38-4524-8517-ce8bba4a01e0 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:09:00 user nova-compute[74348]: DEBUG nova.compute.manager [req-685a73c3-9601-444f-b400-4210400ae32e req-26ae0b68-3986-4164-ae2c-c7b99dcfefd7 service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Refreshing instance network info cache due to event network-changed-71e66d69-de38-4524-8517-ce8bba4a01e0. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:09:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-685a73c3-9601-444f-b400-4210400ae32e req-26ae0b68-3986-4164-ae2c-c7b99dcfefd7 service nova] Acquiring lock "refresh_cache-4fcddbef-dfaf-48a5-8561-26b8857fdbd6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:09:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-685a73c3-9601-444f-b400-4210400ae32e req-26ae0b68-3986-4164-ae2c-c7b99dcfefd7 service nova] Acquired lock "refresh_cache-4fcddbef-dfaf-48a5-8561-26b8857fdbd6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:09:00 user nova-compute[74348]: DEBUG nova.network.neutron [req-685a73c3-9601-444f-b400-4210400ae32e req-26ae0b68-3986-4164-ae2c-c7b99dcfefd7 service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Refreshing network info cache for port 71e66d69-de38-4524-8517-ce8bba4a01e0 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:09:00 user nova-compute[74348]: DEBUG nova.network.neutron [req-685a73c3-9601-444f-b400-4210400ae32e req-26ae0b68-3986-4164-ae2c-c7b99dcfefd7 service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Updated VIF entry in instance network info cache for port 71e66d69-de38-4524-8517-ce8bba4a01e0. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:09:00 user nova-compute[74348]: DEBUG nova.network.neutron [req-685a73c3-9601-444f-b400-4210400ae32e req-26ae0b68-3986-4164-ae2c-c7b99dcfefd7 service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Updating instance_info_cache with network_info: [{"id": "71e66d69-de38-4524-8517-ce8bba4a01e0", "address": "fa:16:3e:b3:59:21", "network": {"id": "442abc57-45e5-4cd7-878e-979afa78c421", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1395369508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d76d03d17cc4e5bb52a32a2f8fbd629", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71e66d69-de", "ovs_interfaceid": "71e66d69-de38-4524-8517-ce8bba4a01e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:09:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-685a73c3-9601-444f-b400-4210400ae32e req-26ae0b68-3986-4164-ae2c-c7b99dcfefd7 service nova] Releasing lock "refresh_cache-4fcddbef-dfaf-48a5-8561-26b8857fdbd6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:09:01 user nova-compute[74348]: DEBUG nova.compute.manager [req-84db899e-900b-41ad-9926-1c2766b7ce4a req-6b7320d6-4aef-4736-91d0-91d40a99008c service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Received event network-changed-71e66d69-de38-4524-8517-ce8bba4a01e0 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:09:01 user nova-compute[74348]: DEBUG nova.compute.manager [req-84db899e-900b-41ad-9926-1c2766b7ce4a req-6b7320d6-4aef-4736-91d0-91d40a99008c service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Refreshing instance network info cache due to event network-changed-71e66d69-de38-4524-8517-ce8bba4a01e0. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:09:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-84db899e-900b-41ad-9926-1c2766b7ce4a req-6b7320d6-4aef-4736-91d0-91d40a99008c service nova] Acquiring lock "refresh_cache-4fcddbef-dfaf-48a5-8561-26b8857fdbd6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:09:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-84db899e-900b-41ad-9926-1c2766b7ce4a req-6b7320d6-4aef-4736-91d0-91d40a99008c service nova] Acquired lock "refresh_cache-4fcddbef-dfaf-48a5-8561-26b8857fdbd6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:09:01 user nova-compute[74348]: DEBUG nova.network.neutron [req-84db899e-900b-41ad-9926-1c2766b7ce4a req-6b7320d6-4aef-4736-91d0-91d40a99008c service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Refreshing network info cache for port 71e66d69-de38-4524-8517-ce8bba4a01e0 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:09:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e148e045-22f9-4bce-909a-999a411b164b tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Acquiring lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:09:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e148e045-22f9-4bce-909a-999a411b164b tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:09:01 user nova-compute[74348]: INFO nova.compute.manager [None req-e148e045-22f9-4bce-909a-999a411b164b tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Detaching volume 4fe21fec-f8eb-4806-a4b7-c1837032b030
Nov 22 08:09:01 user nova-compute[74348]: INFO nova.virt.block_device [None req-e148e045-22f9-4bce-909a-999a411b164b tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Attempting to driver detach volume 4fe21fec-f8eb-4806-a4b7-c1837032b030 from mountpoint /dev/vdb
Nov 22 08:09:01 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e148e045-22f9-4bce-909a-999a411b164b tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Attempting to detach device vdb from instance 4fcddbef-dfaf-48a5-8561-26b8857fdbd6 from the persistent domain config. {{(pid=74348) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 08:09:01 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-e148e045-22f9-4bce-909a-999a411b164b tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:09:01 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:09:01 user nova-compute[74348]:   <source dev="/dev/sdd"/>
Nov 22 08:09:01 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:09:01 user nova-compute[74348]:   <serial>4fe21fec-f8eb-4806-a4b7-c1837032b030</serial>
Nov 22 08:09:01 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 08:09:01 user nova-compute[74348]: </disk>
Nov 22 08:09:01 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:09:01 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-e148e045-22f9-4bce-909a-999a411b164b tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Successfully detached device vdb from instance 4fcddbef-dfaf-48a5-8561-26b8857fdbd6 from the persistent domain config.
Nov 22 08:09:01 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e148e045-22f9-4bce-909a-999a411b164b tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4fcddbef-dfaf-48a5-8561-26b8857fdbd6 from the live domain config. {{(pid=74348) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 08:09:01 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-e148e045-22f9-4bce-909a-999a411b164b tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:09:01 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:09:01 user nova-compute[74348]:   <source dev="/dev/sdd"/>
Nov 22 08:09:01 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:09:01 user nova-compute[74348]:   <serial>4fe21fec-f8eb-4806-a4b7-c1837032b030</serial>
Nov 22 08:09:01 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 08:09:01 user nova-compute[74348]: </disk>
Nov 22 08:09:01 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:09:01 user nova-compute[74348]: DEBUG nova.network.neutron [req-84db899e-900b-41ad-9926-1c2766b7ce4a req-6b7320d6-4aef-4736-91d0-91d40a99008c service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Updated VIF entry in instance network info cache for port 71e66d69-de38-4524-8517-ce8bba4a01e0. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:09:01 user nova-compute[74348]: DEBUG nova.network.neutron [req-84db899e-900b-41ad-9926-1c2766b7ce4a req-6b7320d6-4aef-4736-91d0-91d40a99008c service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Updating instance_info_cache with network_info: [{"id": "71e66d69-de38-4524-8517-ce8bba4a01e0", "address": "fa:16:3e:b3:59:21", "network": {"id": "442abc57-45e5-4cd7-878e-979afa78c421", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1395369508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d76d03d17cc4e5bb52a32a2f8fbd629", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71e66d69-de", "ovs_interfaceid": "71e66d69-de38-4524-8517-ce8bba4a01e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:09:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-84db899e-900b-41ad-9926-1c2766b7ce4a req-6b7320d6-4aef-4736-91d0-91d40a99008c service nova] Releasing lock "refresh_cache-4fcddbef-dfaf-48a5-8561-26b8857fdbd6" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:09:01 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-e148e045-22f9-4bce-909a-999a411b164b tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4fcddbef-dfaf-48a5-8561-26b8857fdbd6 {{(pid=74348) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 08:09:02 user nova-compute[74348]: DEBUG nova.objects.instance [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lazy-loading 'flavor' on Instance uuid 37c93c2a-1397-4b04-aef1-5068218ad9fd {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:09:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquiring lock "refresh_cache-37c93c2a-1397-4b04-aef1-5068218ad9fd" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:09:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquired lock "refresh_cache-37c93c2a-1397-4b04-aef1-5068218ad9fd" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:09:02 user nova-compute[74348]: DEBUG nova.network.neutron [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:09:02 user nova-compute[74348]: DEBUG nova.objects.instance [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lazy-loading 'info_cache' on Instance uuid 37c93c2a-1397-4b04-aef1-5068218ad9fd {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:09:02 user nova-compute[74348]: DEBUG nova.objects.base [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Object Instance<37c93c2a-1397-4b04-aef1-5068218ad9fd> lazy-loaded attributes: flavor,info_cache {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG nova.network.neutron [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Updating instance_info_cache with network_info: [{"id": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "address": "fa:16:3e:62:f2:83", "network": {"id": "606a7c22-1285-47e8-bfa0-f09dbd7cb9ac", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-63336037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d1a2eb68ef4c0aa5ef081fe10877a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc2d56f-68", "ovs_interfaceid": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Releasing lock "refresh_cache-37c93c2a-1397-4b04-aef1-5068218ad9fd" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:09:03 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Instance destroyed successfully.
Nov 22 08:09:03 user nova-compute[74348]: DEBUG nova.objects.instance [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lazy-loading 'resources' on Instance uuid 37c93c2a-1397-4b04-aef1-5068218ad9fd {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG nova.objects.base [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Object Instance<37c93c2a-1397-4b04-aef1-5068218ad9fd> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:00:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1956019398',display_name='tempest-AttachVolumeTestJSON-server-1956019398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1956019398',id=25,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwMcyh7MC6umn3uaanqgBLVw0olRPhsYeJZiuWM01oPuW2lMJM3v/uqqmw2CyNdCKwv23YM7ilvhBeMmJnwDV2ZnrEjaT/V3wGmEnZHbCJZSu5Yo+sT9JeBTaahsZul6Q==',key_name='tempest-keypair-1490397787',keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:01:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e2d1a2eb68ef4c0aa5ef081fe10877a9',ramdisk_id='',reservation_id='r-37qth7ay',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-608656879',owner_user_name='tempest-AttachVolumeTestJSON-608656879-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T08:07:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae8c7082420f4b85a9009ff82296d8cb',uuid=37c93c2a-1397-4b04-aef1-5068218ad9fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "address": "fa:16:3e:62:f2:83", "network": {"id": "606a7c22-1285-47e8-bfa0-f09dbd7cb9ac", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-63336037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d1a2eb68ef4c0aa5ef081fe10877a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc2d56f-68", "ovs_interfaceid": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Converting VIF {"id": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "address": "fa:16:3e:62:f2:83", "network": {"id": "606a7c22-1285-47e8-bfa0-f09dbd7cb9ac", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-63336037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d1a2eb68ef4c0aa5ef081fe10877a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc2d56f-68", "ovs_interfaceid": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:f2:83,bridge_name='br-int',has_traffic_filtering=True,id=acc2d56f-6884-403d-b2e5-2eb64c40047f,network=Network(606a7c22-1285-47e8-bfa0-f09dbd7cb9ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc2d56f-68') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG os_vif [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:f2:83,bridge_name='br-int',has_traffic_filtering=True,id=acc2d56f-6884-403d-b2e5-2eb64c40047f,network=Network(606a7c22-1285-47e8-bfa0-f09dbd7cb9ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc2d56f-68') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapacc2d56f-68, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f31436ce-b3fa-4fe9-8560-bcd42ee42b9c) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:03 user nova-compute[74348]: INFO os_vif [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:f2:83,bridge_name='br-int',has_traffic_filtering=True,id=acc2d56f-6884-403d-b2e5-2eb64c40047f,network=Network(606a7c22-1285-47e8-bfa0-f09dbd7cb9ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc2d56f-68')
Nov 22 08:09:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Start _get_guest_xml network_info=[{"id": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "address": "fa:16:3e:62:f2:83", "network": {"id": "606a7c22-1285-47e8-bfa0-f09dbd7cb9ac", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-63336037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d1a2eb68ef4c0aa5ef081fe10877a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc2d56f-68", "ovs_interfaceid": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG nova.objects.instance [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lazy-loading 'numa_topology' on Instance uuid 37c93c2a-1397-4b04-aef1-5068218ad9fd {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG nova.objects.base [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Object Instance<37c93c2a-1397-4b04-aef1-5068218ad9fd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:09:03 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:09:03 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:09:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG nova.objects.instance [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lazy-loading 'vcpu_model' on Instance uuid 37c93c2a-1397-4b04-aef1-5068218ad9fd {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG nova.objects.base [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Object Instance<37c93c2a-1397-4b04-aef1-5068218ad9fd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:00:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1956019398',display_name='tempest-AttachVolumeTestJSON-server-1956019398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1956019398',id=25,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwMcyh7MC6umn3uaanqgBLVw0olRPhsYeJZiuWM01oPuW2lMJM3v/uqqmw2CyNdCKwv23YM7ilvhBeMmJnwDV2ZnrEjaT/V3wGmEnZHbCJZSu5Yo+sT9JeBTaahsZul6Q==',key_name='tempest-keypair-1490397787',keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:01:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e2d1a2eb68ef4c0aa5ef081fe10877a9',ramdisk_id='',reservation_id='r-37qth7ay',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-608656879',owner_user_name='tempest-AttachVolumeTestJSON-608656879-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T08:07:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae8c7082420f4b85a9009ff82296d8cb',uuid=37c93c2a-1397-4b04-aef1-5068218ad9fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "address": "fa:16:3e:62:f2:83", "network": {"id": "606a7c22-1285-47e8-bfa0-f09dbd7cb9ac", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-63336037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d1a2eb68ef4c0aa5ef081fe10877a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc2d56f-68", "ovs_interfaceid": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Converting VIF {"id": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "address": "fa:16:3e:62:f2:83", "network": {"id": "606a7c22-1285-47e8-bfa0-f09dbd7cb9ac", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-63336037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d1a2eb68ef4c0aa5ef081fe10877a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc2d56f-68", "ovs_interfaceid": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:f2:83,bridge_name='br-int',has_traffic_filtering=True,id=acc2d56f-6884-403d-b2e5-2eb64c40047f,network=Network(606a7c22-1285-47e8-bfa0-f09dbd7cb9ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc2d56f-68') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG nova.objects.instance [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lazy-loading 'pci_devices' on Instance uuid 37c93c2a-1397-4b04-aef1-5068218ad9fd {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG nova.objects.base [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Object Instance<37c93c2a-1397-4b04-aef1-5068218ad9fd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] End _get_guest_xml xml=<domain type="kvm">
Nov 22 08:09:03 user nova-compute[74348]:   <uuid>37c93c2a-1397-4b04-aef1-5068218ad9fd</uuid>
Nov 22 08:09:03 user nova-compute[74348]:   <name>instance-00000019</name>
Nov 22 08:09:03 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 08:09:03 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 08:09:03 user nova-compute[74348]:   <metadata>
Nov 22 08:09:03 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 08:09:03 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 08:09:03 user nova-compute[74348]:       <nova:name>tempest-AttachVolumeTestJSON-server-1956019398</nova:name>
Nov 22 08:09:03 user nova-compute[74348]:       <nova:creationTime>2023-11-22 08:09:03</nova:creationTime>
Nov 22 08:09:03 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 08:09:03 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 08:09:03 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 08:09:03 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 08:09:03 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 08:09:03 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 08:09:03 user nova-compute[74348]:       </nova:flavor>
Nov 22 08:09:03 user nova-compute[74348]:       <nova:owner>
Nov 22 08:09:03 user nova-compute[74348]:         <nova:user uuid="ae8c7082420f4b85a9009ff82296d8cb">tempest-AttachVolumeTestJSON-608656879-project-member</nova:user>
Nov 22 08:09:03 user nova-compute[74348]:         <nova:project uuid="e2d1a2eb68ef4c0aa5ef081fe10877a9">tempest-AttachVolumeTestJSON-608656879</nova:project>
Nov 22 08:09:03 user nova-compute[74348]:       </nova:owner>
Nov 22 08:09:03 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 08:09:03 user nova-compute[74348]:       <nova:ports>
Nov 22 08:09:03 user nova-compute[74348]:         <nova:port uuid="acc2d56f-6884-403d-b2e5-2eb64c40047f">
Nov 22 08:09:03 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 22 08:09:03 user nova-compute[74348]:         </nova:port>
Nov 22 08:09:03 user nova-compute[74348]:       </nova:ports>
Nov 22 08:09:03 user nova-compute[74348]:     </nova:instance>
Nov 22 08:09:03 user nova-compute[74348]:   </metadata>
Nov 22 08:09:03 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 08:09:03 user nova-compute[74348]:     <system>
Nov 22 08:09:03 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 08:09:03 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 08:09:03 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 08:09:03 user nova-compute[74348]:       <entry name="serial">37c93c2a-1397-4b04-aef1-5068218ad9fd</entry>
Nov 22 08:09:03 user nova-compute[74348]:       <entry name="uuid">37c93c2a-1397-4b04-aef1-5068218ad9fd</entry>
Nov 22 08:09:03 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 08:09:03 user nova-compute[74348]:     </system>
Nov 22 08:09:03 user nova-compute[74348]:   </sysinfo>
Nov 22 08:09:03 user nova-compute[74348]:   <os>
Nov 22 08:09:03 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 08:09:03 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 08:09:03 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 08:09:03 user nova-compute[74348]:   </os>
Nov 22 08:09:03 user nova-compute[74348]:   <features>
Nov 22 08:09:03 user nova-compute[74348]:     <acpi/>
Nov 22 08:09:03 user nova-compute[74348]:     <apic/>
Nov 22 08:09:03 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 08:09:03 user nova-compute[74348]:   </features>
Nov 22 08:09:03 user nova-compute[74348]:   <clock offset="utc">
Nov 22 08:09:03 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 08:09:03 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 08:09:03 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 08:09:03 user nova-compute[74348]:   </clock>
Nov 22 08:09:03 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 08:09:03 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 08:09:03 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 08:09:03 user nova-compute[74348]:   </cpu>
Nov 22 08:09:03 user nova-compute[74348]:   <devices>
Nov 22 08:09:03 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 08:09:03 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 08:09:03 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk"/>
Nov 22 08:09:03 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 08:09:03 user nova-compute[74348]:     </disk>
Nov 22 08:09:03 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 08:09:03 user nova-compute[74348]:       <mac address="fa:16:3e:62:f2:83"/>
Nov 22 08:09:03 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:09:03 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 08:09:03 user nova-compute[74348]:       <target dev="tapacc2d56f-68"/>
Nov 22 08:09:03 user nova-compute[74348]:     </interface>
Nov 22 08:09:03 user nova-compute[74348]:     <serial type="pty">
Nov 22 08:09:03 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/console.log" append="off"/>
Nov 22 08:09:03 user nova-compute[74348]:     </serial>
Nov 22 08:09:03 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 08:09:03 user nova-compute[74348]:     <video>
Nov 22 08:09:03 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:09:03 user nova-compute[74348]:     </video>
Nov 22 08:09:03 user nova-compute[74348]:     <rng model="virtio">
Nov 22 08:09:03 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 08:09:03 user nova-compute[74348]:     </rng>
Nov 22 08:09:03 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 08:09:03 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 08:09:03 user nova-compute[74348]:       <stats period="10"/>
Nov 22 08:09:03 user nova-compute[74348]:     </memballoon>
Nov 22 08:09:03 user nova-compute[74348]:   </devices>
Nov 22 08:09:03 user nova-compute[74348]: </domain>
Nov 22 08:09:03 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG nova.objects.instance [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lazy-loading 'trusted_certs' on Instance uuid 37c93c2a-1397-4b04-aef1-5068218ad9fd {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG nova.objects.base [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Object Instance<37c93c2a-1397-4b04-aef1-5068218ad9fd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.182s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:04 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Checking if we can resize image /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk. size=1073741824 {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 08:09:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:04 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Cannot resize image /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk to a smaller size. {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 08:09:04 user nova-compute[74348]: DEBUG nova.objects.instance [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lazy-loading 'migration_context' on Instance uuid 37c93c2a-1397-4b04-aef1-5068218ad9fd {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:09:04 user nova-compute[74348]: DEBUG nova.objects.base [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Object Instance<37c93c2a-1397-4b04-aef1-5068218ad9fd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:09:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:00:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1956019398',display_name='tempest-AttachVolumeTestJSON-server-1956019398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1956019398',id=25,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwMcyh7MC6umn3uaanqgBLVw0olRPhsYeJZiuWM01oPuW2lMJM3v/uqqmw2CyNdCKwv23YM7ilvhBeMmJnwDV2ZnrEjaT/V3wGmEnZHbCJZSu5Yo+sT9JeBTaahsZul6Q==',key_name='tempest-keypair-1490397787',keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:01:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='e2d1a2eb68ef4c0aa5ef081fe10877a9',ramdisk_id='',reservation_id='r-37qth7ay',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-608656879',owner_user_name='tempest-AttachVolumeTestJSON-608656879-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:07:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae8c7082420f4b85a9009ff82296d8cb',uuid=37c93c2a-1397-4b04-aef1-5068218ad9fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "address": "fa:16:3e:62:f2:83", "network": {"id": "606a7c22-1285-47e8-bfa0-f09dbd7cb9ac", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-63336037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d1a2eb68ef4c0aa5ef081fe10877a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc2d56f-68", "ovs_interfaceid": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 08:09:04 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Converting VIF {"id": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "address": "fa:16:3e:62:f2:83", "network": {"id": "606a7c22-1285-47e8-bfa0-f09dbd7cb9ac", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-63336037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d1a2eb68ef4c0aa5ef081fe10877a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc2d56f-68", "ovs_interfaceid": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:09:04 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:f2:83,bridge_name='br-int',has_traffic_filtering=True,id=acc2d56f-6884-403d-b2e5-2eb64c40047f,network=Network(606a7c22-1285-47e8-bfa0-f09dbd7cb9ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc2d56f-68') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:09:04 user nova-compute[74348]: DEBUG os_vif [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:f2:83,bridge_name='br-int',has_traffic_filtering=True,id=acc2d56f-6884-403d-b2e5-2eb64c40047f,network=Network(606a7c22-1285-47e8-bfa0-f09dbd7cb9ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc2d56f-68') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 08:09:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:09:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 08:09:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4a180c9d-5588-5a6b-b08e-82b4a489dd60', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:09:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:09:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapacc2d56f-68, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:09:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapacc2d56f-68, col_values=(('qos', UUID('d5269483-5fdc-4a6c-804e-c3391988a670')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:09:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapacc2d56f-68, col_values=(('external_ids', {'iface-id': 'acc2d56f-6884-403d-b2e5-2eb64c40047f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:f2:83', 'vm-uuid': '37c93c2a-1397-4b04-aef1-5068218ad9fd'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:09:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:09:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:04 user nova-compute[74348]: INFO os_vif [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:f2:83,bridge_name='br-int',has_traffic_filtering=True,id=acc2d56f-6884-403d-b2e5-2eb64c40047f,network=Network(606a7c22-1285-47e8-bfa0-f09dbd7cb9ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc2d56f-68')
Nov 22 08:09:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:05 user nova-compute[74348]: DEBUG nova.compute.manager [req-094c49e5-a115-4e49-bd5f-649f17a526c5 req-4b98ffa8-c21b-4207-aafb-4ed7b2f385bb service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Received event network-vif-plugged-acc2d56f-6884-403d-b2e5-2eb64c40047f {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:09:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-094c49e5-a115-4e49-bd5f-649f17a526c5 req-4b98ffa8-c21b-4207-aafb-4ed7b2f385bb service nova] Acquiring lock "37c93c2a-1397-4b04-aef1-5068218ad9fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:09:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-094c49e5-a115-4e49-bd5f-649f17a526c5 req-4b98ffa8-c21b-4207-aafb-4ed7b2f385bb service nova] Lock "37c93c2a-1397-4b04-aef1-5068218ad9fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:09:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-094c49e5-a115-4e49-bd5f-649f17a526c5 req-4b98ffa8-c21b-4207-aafb-4ed7b2f385bb service nova] Lock "37c93c2a-1397-4b04-aef1-5068218ad9fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:09:05 user nova-compute[74348]: DEBUG nova.compute.manager [req-094c49e5-a115-4e49-bd5f-649f17a526c5 req-4b98ffa8-c21b-4207-aafb-4ed7b2f385bb service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] No waiting events found dispatching network-vif-plugged-acc2d56f-6884-403d-b2e5-2eb64c40047f {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:09:05 user nova-compute[74348]: WARNING nova.compute.manager [req-094c49e5-a115-4e49-bd5f-649f17a526c5 req-4b98ffa8-c21b-4207-aafb-4ed7b2f385bb service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Received unexpected event network-vif-plugged-acc2d56f-6884-403d-b2e5-2eb64c40047f for instance with vm_state stopped and task_state powering-on.
Nov 22 08:09:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:07 user nova-compute[74348]: DEBUG nova.compute.manager [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 08:09:07 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Instance rebooted successfully.
Nov 22 08:09:07 user nova-compute[74348]: DEBUG nova.compute.manager [None req-fcac2ed3-83af-4b62-8449-c11738fb3da0 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:09:07 user nova-compute[74348]: DEBUG nova.compute.manager [req-58d031f6-8669-4be5-a2f3-2b7c4ef4f33e req-3f63a69b-4ebf-4a26-bf7a-ec270b18ab1c service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Received event network-vif-plugged-acc2d56f-6884-403d-b2e5-2eb64c40047f {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:09:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-58d031f6-8669-4be5-a2f3-2b7c4ef4f33e req-3f63a69b-4ebf-4a26-bf7a-ec270b18ab1c service nova] Acquiring lock "37c93c2a-1397-4b04-aef1-5068218ad9fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:09:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-58d031f6-8669-4be5-a2f3-2b7c4ef4f33e req-3f63a69b-4ebf-4a26-bf7a-ec270b18ab1c service nova] Lock "37c93c2a-1397-4b04-aef1-5068218ad9fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:09:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-58d031f6-8669-4be5-a2f3-2b7c4ef4f33e req-3f63a69b-4ebf-4a26-bf7a-ec270b18ab1c service nova] Lock "37c93c2a-1397-4b04-aef1-5068218ad9fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:09:07 user nova-compute[74348]: DEBUG nova.compute.manager [req-58d031f6-8669-4be5-a2f3-2b7c4ef4f33e req-3f63a69b-4ebf-4a26-bf7a-ec270b18ab1c service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] No waiting events found dispatching network-vif-plugged-acc2d56f-6884-403d-b2e5-2eb64c40047f {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:09:07 user nova-compute[74348]: WARNING nova.compute.manager [req-58d031f6-8669-4be5-a2f3-2b7c4ef4f33e req-3f63a69b-4ebf-4a26-bf7a-ec270b18ab1c service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Received unexpected event network-vif-plugged-acc2d56f-6884-403d-b2e5-2eb64c40047f for instance with vm_state active and task_state None.
Nov 22 08:09:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "b998bedf-ee29-48a1-a14b-449add115c39" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:09:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "b998bedf-ee29-48a1-a14b-449add115c39" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:09:08 user nova-compute[74348]: DEBUG nova.compute.manager [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 08:09:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:09:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:09:08 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 08:09:08 user nova-compute[74348]: INFO nova.compute.claims [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Claim successful on node user
Nov 22 08:09:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:09 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:09:09 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:09:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.595s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:09:09 user nova-compute[74348]: DEBUG nova.compute.manager [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 08:09:09 user nova-compute[74348]: DEBUG nova.compute.manager [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 08:09:09 user nova-compute[74348]: DEBUG nova.network.neutron [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 08:09:09 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 08:09:09 user nova-compute[74348]: DEBUG nova.compute.manager [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 08:09:09 user nova-compute[74348]: INFO nova.virt.block_device [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Booting with volume-backed-image 7abe07a9-4f70-41a1-a0fc-c06f9c8dd109 at /dev/vda
Nov 22 08:09:09 user nova-compute[74348]: DEBUG nova.policy [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1d5c8274eca14965b6cbfe22110f904d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31d898cdc69494a8825e8d93a0d04bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 08:09:10 user nova-compute[74348]: DEBUG nova.network.neutron [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Successfully created port: ee377706-a70f-4d29-96be-4d56daedb95a {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 08:09:10 user nova-compute[74348]: DEBUG nova.network.neutron [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Successfully updated port: ee377706-a70f-4d29-96be-4d56daedb95a {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 08:09:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "refresh_cache-b998bedf-ee29-48a1-a14b-449add115c39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:09:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquired lock "refresh_cache-b998bedf-ee29-48a1-a14b-449add115c39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:09:11 user nova-compute[74348]: DEBUG nova.network.neutron [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:09:11 user nova-compute[74348]: DEBUG nova.compute.manager [req-3ed80630-3c96-4171-a501-864a06e3a05c req-1f628aca-e08b-48b0-a07b-a815f3f47195 service nova] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Received event network-changed-ee377706-a70f-4d29-96be-4d56daedb95a {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:09:11 user nova-compute[74348]: DEBUG nova.compute.manager [req-3ed80630-3c96-4171-a501-864a06e3a05c req-1f628aca-e08b-48b0-a07b-a815f3f47195 service nova] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Refreshing instance network info cache due to event network-changed-ee377706-a70f-4d29-96be-4d56daedb95a. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:09:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3ed80630-3c96-4171-a501-864a06e3a05c req-1f628aca-e08b-48b0-a07b-a815f3f47195 service nova] Acquiring lock "refresh_cache-b998bedf-ee29-48a1-a14b-449add115c39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:09:11 user nova-compute[74348]: DEBUG nova.network.neutron [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 08:09:11 user nova-compute[74348]: DEBUG nova.network.neutron [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Updating instance_info_cache with network_info: [{"id": "ee377706-a70f-4d29-96be-4d56daedb95a", "address": "fa:16:3e:a1:2b:05", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee377706-a7", "ovs_interfaceid": "ee377706-a70f-4d29-96be-4d56daedb95a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:09:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Releasing lock "refresh_cache-b998bedf-ee29-48a1-a14b-449add115c39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:09:11 user nova-compute[74348]: DEBUG nova.compute.manager [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Instance network_info: |[{"id": "ee377706-a70f-4d29-96be-4d56daedb95a", "address": "fa:16:3e:a1:2b:05", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee377706-a7", "ovs_interfaceid": "ee377706-a70f-4d29-96be-4d56daedb95a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 08:09:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3ed80630-3c96-4171-a501-864a06e3a05c req-1f628aca-e08b-48b0-a07b-a815f3f47195 service nova] Acquired lock "refresh_cache-b998bedf-ee29-48a1-a14b-449add115c39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:09:11 user nova-compute[74348]: DEBUG nova.network.neutron [req-3ed80630-3c96-4171-a501-864a06e3a05c req-1f628aca-e08b-48b0-a07b-a815f3f47195 service nova] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Refreshing network info cache for port ee377706-a70f-4d29-96be-4d56daedb95a {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:09:11 user nova-compute[74348]: DEBUG nova.network.neutron [req-3ed80630-3c96-4171-a501-864a06e3a05c req-1f628aca-e08b-48b0-a07b-a815f3f47195 service nova] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Updated VIF entry in instance network info cache for port ee377706-a70f-4d29-96be-4d56daedb95a. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:09:11 user nova-compute[74348]: DEBUG nova.network.neutron [req-3ed80630-3c96-4171-a501-864a06e3a05c req-1f628aca-e08b-48b0-a07b-a815f3f47195 service nova] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Updating instance_info_cache with network_info: [{"id": "ee377706-a70f-4d29-96be-4d56daedb95a", "address": "fa:16:3e:a1:2b:05", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee377706-a7", "ovs_interfaceid": "ee377706-a70f-4d29-96be-4d56daedb95a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:09:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3ed80630-3c96-4171-a501-864a06e3a05c req-1f628aca-e08b-48b0-a07b-a815f3f47195 service nova] Releasing lock "refresh_cache-b998bedf-ee29-48a1-a14b-449add115c39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:09:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:15 user nova-compute[74348]: DEBUG os_brick.utils [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:09:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ca86cf-ca68-4dd9-9c94-01ebe63f2c90]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d872557d-8bb0-469c-b0a6-b9f3ee8d0fe6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a814c778-f1cb-40fa-8fc0-0c18dfe453c8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ffd5ea-d4e2-46e3-a6e4-deac5311552b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:09:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 08:09:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:09:15 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 08:09:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf3f264-8a96-4c45-a312-6e0776e69f00]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 08:09:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 08:09:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 08:09:15 user nova-compute[74348]: DEBUG os_brick.utils [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:09:15 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Updating existing volume attachment record: 3dfb79e2-d372-4cc9-95ce-b586f87acce2 {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 08:09:16 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-d284b65a-054f-4cad-a9c3-bf69d678b43b tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b6698b0d-0d43-47ea-bcdc-d99201d9833c is timed out.
Nov 22 08:09:16 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-d284b65a-054f-4cad-a9c3-bf69d678b43b tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Successfully detached device vdb from instance b6698b0d-0d43-47ea-bcdc-d99201d9833c from the live domain config.
Nov 22 08:09:16 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d284b65a-054f-4cad-a9c3-bf69d678b43b tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d284b65a-054f-4cad-a9c3-bf69d678b43b tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IEgpQexi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:09:16 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-d284b65a-054f-4cad-a9c3-bf69d678b43b tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:09:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-d284b65a-054f-4cad-a9c3-bf69d678b43b tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-d284b65a-054f-4cad-a9c3-bf69d678b43b tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0997fe-d02d-4079-965e-3b2b12cdbf32]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d284b65a-054f-4cad-a9c3-bf69d678b43b tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 08:09:16 user nova-compute[74348]: No targets found.
Nov 22 08:09:16 user nova-compute[74348]: iSNS:
Nov 22 08:09:16 user nova-compute[74348]: No targets found.
Nov 22 08:09:16 user nova-compute[74348]: STATIC:
Nov 22 08:09:16 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a
Nov 22 08:09:16 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:09:16 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:09:16 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8
Nov 22 08:09:16 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:09:16 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:09:16 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac
Nov 22 08:09:16 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:09:16 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:09:16 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030
Nov 22 08:09:16 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:09:16 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:09:16 user nova-compute[74348]: FIRMWARE:
Nov 22 08:09:16 user nova-compute[74348]: No targets found.
Nov 22 08:09:16 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d284b65a-054f-4cad-a9c3-bf69d678b43b tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 08:09:16 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 08:09:16 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d284b65a-054f-4cad-a9c3-bf69d678b43b tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2771cda3-4159-4791-9b06-da4f0e858f33]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05fd02c-93b8-44d7-9b22-6986940121fb]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d284b65a-054f-4cad-a9c3-bf69d678b43b tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:09:16 user nova-compute[74348]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)
Nov 22 08:09:16 user nova-compute[74348]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 (non-flash)
Nov 22 08:09:16 user nova-compute[74348]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac (non-flash)
Nov 22 08:09:16 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d284b65a-054f-4cad-a9c3-bf69d678b43b tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:09:16 user nova-compute[74348]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)
Nov 22 08:09:16 user nova-compute[74348]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 (non-flash)
Nov 22 08:09:16 user nova-compute[74348]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac (non-flash)
Nov 22 08:09:16 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d284b65a-054f-4cad-a9c3-bf69d678b43b tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f222836c790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac'): ({'sdc'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-d284b65a-054f-4cad-a9c3-bf69d678b43b tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Removing single pathed devices sdc {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9dda13-aefa-44f2-8f92-ae9276f1d92c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[92685eac-363f-42de-82ad-6acfd80d1e18]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-d284b65a-054f-4cad-a9c3-bf69d678b43b tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Flushing IO for device /dev/sdc {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[982bdb35-016e-49f0-8597-350e7902233f]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-d284b65a-054f-4cad-a9c3-bf69d678b43b tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.031s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6a214f-b689-4e90-928f-a969356e947d]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-d284b65a-054f-4cad-a9c3-bf69d678b43b tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-d284b65a-054f-4cad-a9c3-bf69d678b43b tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] SCSI volumes sdc have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d284b65a-054f-4cad-a9c3-bf69d678b43b tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d782d64-a675-4d6c-85f5-2794a05045ec]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d284b65a-054f-4cad-a9c3-bf69d678b43b tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0623477-b5b2-4894-bf03-83ee43e046aa]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d284b65a-054f-4cad-a9c3-bf69d678b43b tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac, portal: 172.16.0.220,3260]
Nov 22 08:09:16 user nova-compute[74348]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac, portal: 172.16.0.220,3260] successful.
Nov 22 08:09:16 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:508f1f11-18de-48f2-937a-21a82e8d95ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0c83a4-d7d7-4cbd-a439-23d366202f12]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d284b65a-054f-4cad-a9c3-bf69d678b43b tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-d284b65a-054f-4cad-a9c3-bf69d678b43b tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d284b65a-054f-4cad-a9c3-bf69d678b43b tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] <== disconnect_volume: return (344ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:09:16 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d284b65a-054f-4cad-a9c3-bf69d678b43b tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 08:09:17 user nova-compute[74348]: DEBUG nova.objects.instance [None req-d284b65a-054f-4cad-a9c3-bf69d678b43b tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lazy-loading 'flavor' on Instance uuid b6698b0d-0d43-47ea-bcdc-d99201d9833c {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:09:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d284b65a-054f-4cad-a9c3-bf69d678b43b tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.092s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:09:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:19 user nova-compute[74348]: INFO nova.compute.manager [None req-a053b5f9-fd72-4dac-a427-b06eece6aa5d tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Unrescuing
Nov 22 08:09:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-a053b5f9-fd72-4dac-a427-b06eece6aa5d tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquiring lock "refresh_cache-555f4246-d4b2-4f2f-b91c-dda8fe47264c" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:09:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-a053b5f9-fd72-4dac-a427-b06eece6aa5d tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquired lock "refresh_cache-555f4246-d4b2-4f2f-b91c-dda8fe47264c" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:09:19 user nova-compute[74348]: DEBUG nova.network.neutron [None req-a053b5f9-fd72-4dac-a427-b06eece6aa5d tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:09:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-958e7ea4-31cc-4e8f-be1d-6f9fd97eaffc tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "016c8f4b-a226-4226-ba56-8a2b28cea146" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:09:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-958e7ea4-31cc-4e8f-be1d-6f9fd97eaffc tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "016c8f4b-a226-4226-ba56-8a2b28cea146" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:09:19 user nova-compute[74348]: INFO nova.compute.manager [None req-958e7ea4-31cc-4e8f-be1d-6f9fd97eaffc tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Detaching volume e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a
Nov 22 08:09:19 user nova-compute[74348]: INFO nova.virt.block_device [None req-958e7ea4-31cc-4e8f-be1d-6f9fd97eaffc tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Attempting to driver detach volume e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a from mountpoint /dev/vdb
Nov 22 08:09:19 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-958e7ea4-31cc-4e8f-be1d-6f9fd97eaffc tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Attempting to detach device vdb from instance 016c8f4b-a226-4226-ba56-8a2b28cea146 from the persistent domain config. {{(pid=74348) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 08:09:19 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-958e7ea4-31cc-4e8f-be1d-6f9fd97eaffc tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:09:19 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:09:19 user nova-compute[74348]:   <source dev="/dev/sde"/>
Nov 22 08:09:19 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:09:19 user nova-compute[74348]:   <serial>e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a</serial>
Nov 22 08:09:19 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 22 08:09:19 user nova-compute[74348]: </disk>
Nov 22 08:09:19 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:09:19 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-958e7ea4-31cc-4e8f-be1d-6f9fd97eaffc tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Successfully detached device vdb from instance 016c8f4b-a226-4226-ba56-8a2b28cea146 from the persistent domain config.
Nov 22 08:09:19 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-958e7ea4-31cc-4e8f-be1d-6f9fd97eaffc tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 016c8f4b-a226-4226-ba56-8a2b28cea146 from the live domain config. {{(pid=74348) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 08:09:19 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-958e7ea4-31cc-4e8f-be1d-6f9fd97eaffc tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:09:19 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:09:19 user nova-compute[74348]:   <source dev="/dev/sde"/>
Nov 22 08:09:19 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:09:19 user nova-compute[74348]:   <serial>e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a</serial>
Nov 22 08:09:19 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 22 08:09:19 user nova-compute[74348]: </disk>
Nov 22 08:09:19 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:09:19 user nova-compute[74348]: DEBUG nova.network.neutron [None req-a053b5f9-fd72-4dac-a427-b06eece6aa5d tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Updating instance_info_cache with network_info: [{"id": "8e4fc0fe-f03b-4816-8a6a-c20a8eba5296", "address": "fa:16:3e:01:d5:cd", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4fc0fe-f0", "ovs_interfaceid": "8e4fc0fe-f03b-4816-8a6a-c20a8eba5296", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:09:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-a053b5f9-fd72-4dac-a427-b06eece6aa5d tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Releasing lock "refresh_cache-555f4246-d4b2-4f2f-b91c-dda8fe47264c" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:09:19 user nova-compute[74348]: DEBUG nova.objects.instance [None req-a053b5f9-fd72-4dac-a427-b06eece6aa5d tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lazy-loading 'flavor' on Instance uuid 555f4246-d4b2-4f2f-b91c-dda8fe47264c {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:09:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-958e7ea4-31cc-4e8f-be1d-6f9fd97eaffc tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 016c8f4b-a226-4226-ba56-8a2b28cea146 {{(pid=74348) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 08:09:20 user nova-compute[74348]: DEBUG nova.compute.manager [req-b1c229d7-afbb-4e05-9963-0ec64b1c3bcf req-6d88f52b-169b-4e64-875e-5ce0dbf699ab service nova] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Received event network-vif-unplugged-8e4fc0fe-f03b-4816-8a6a-c20a8eba5296 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:09:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b1c229d7-afbb-4e05-9963-0ec64b1c3bcf req-6d88f52b-169b-4e64-875e-5ce0dbf699ab service nova] Acquiring lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:09:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b1c229d7-afbb-4e05-9963-0ec64b1c3bcf req-6d88f52b-169b-4e64-875e-5ce0dbf699ab service nova] Lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:09:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b1c229d7-afbb-4e05-9963-0ec64b1c3bcf req-6d88f52b-169b-4e64-875e-5ce0dbf699ab service nova] Lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:09:20 user nova-compute[74348]: DEBUG nova.compute.manager [req-b1c229d7-afbb-4e05-9963-0ec64b1c3bcf req-6d88f52b-169b-4e64-875e-5ce0dbf699ab service nova] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] No waiting events found dispatching network-vif-unplugged-8e4fc0fe-f03b-4816-8a6a-c20a8eba5296 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:09:20 user nova-compute[74348]: WARNING nova.compute.manager [req-b1c229d7-afbb-4e05-9963-0ec64b1c3bcf req-6d88f52b-169b-4e64-875e-5ce0dbf699ab service nova] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Received unexpected event network-vif-unplugged-8e4fc0fe-f03b-4816-8a6a-c20a8eba5296 for instance with vm_state rescued and task_state unrescuing.
Nov 22 08:09:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:20 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Instance destroyed successfully.
Nov 22 08:09:21 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-e148e045-22f9-4bce-909a-999a411b164b tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4fcddbef-dfaf-48a5-8561-26b8857fdbd6 is timed out.
Nov 22 08:09:21 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-e148e045-22f9-4bce-909a-999a411b164b tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Successfully detached device vdb from instance 4fcddbef-dfaf-48a5-8561-26b8857fdbd6 from the live domain config.
Nov 22 08:09:21 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e148e045-22f9-4bce-909a-999a411b164b tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 08:09:21 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-e148e045-22f9-4bce-909a-999a411b164b tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'itQRJXCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:09:21 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-e148e045-22f9-4bce-909a-999a411b164b tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:09:21 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-e148e045-22f9-4bce-909a-999a411b164b tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:09:21 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-e148e045-22f9-4bce-909a-999a411b164b tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:09:21 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:21 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:21 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8827abfa-2d3e-4af4-8eb8-0c26142376a0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:21 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-e148e045-22f9-4bce-909a-999a411b164b tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 08:09:21 user nova-compute[74348]: No targets found.
Nov 22 08:09:21 user nova-compute[74348]: iSNS:
Nov 22 08:09:21 user nova-compute[74348]: No targets found.
Nov 22 08:09:21 user nova-compute[74348]: STATIC:
Nov 22 08:09:21 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a
Nov 22 08:09:21 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:09:21 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:09:21 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8
Nov 22 08:09:21 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:09:21 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:09:21 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030
Nov 22 08:09:21 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:09:21 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:09:21 user nova-compute[74348]: FIRMWARE:
Nov 22 08:09:21 user nova-compute[74348]: No targets found.
Nov 22 08:09:21 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:09:21 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-e148e045-22f9-4bce-909a-999a411b164b tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 08:09:21 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 08:09:21 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 08:09:21 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-e148e045-22f9-4bce-909a-999a411b164b tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 08:09:21 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:21 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:21 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[de567c4d-c3b5-4270-877f-0069a9a088c5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[802a3295-dce8-449a-9ea8-e0a719bf3233]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-e148e045-22f9-4bce-909a-999a411b164b tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:09:22 user nova-compute[74348]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)
Nov 22 08:09:22 user nova-compute[74348]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 (non-flash)
Nov 22 08:09:22 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-e148e045-22f9-4bce-909a-999a411b164b tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:09:22 user nova-compute[74348]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)
Nov 22 08:09:22 user nova-compute[74348]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 (non-flash)
Nov 22 08:09:22 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-e148e045-22f9-4bce-909a-999a411b164b tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2228369120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030'): ({'sdd'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-e148e045-22f9-4bce-909a-999a411b164b tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Removing single pathed devices sdd {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30d3b14-9502-4c21-8dab-2365ac6b65aa]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[794f8908-4599-41b9-b360-7dde6c76ca4d]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-e148e045-22f9-4bce-909a-999a411b164b tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Flushing IO for device /dev/sdd {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG nova.compute.manager [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 08:09:22 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Creating image(s)
Nov 22 08:09:22 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Did not create local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Ensure instance console log exists: /opt/stack/data/nova/instances/b998bedf-ee29-48a1-a14b-449add115c39/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Start _get_guest_xml network_info=[{"id": "ee377706-a70f-4d29-96be-4d56daedb95a", "address": "fa:16:3e:a1:2b:05", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee377706-a7", "ovs_interfaceid": "ee377706-a70f-4d29-96be-4d56daedb95a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LlaMmJwv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b998bedf-ee29-48a1-a14b-449add115c39', 'attached_at': '', 'detached_at': '', 'volume_id': 'd5b8e56f-87c3-4657-991f-ad58f3089336', 'serial': 'd5b8e56f-87c3-4657-991f-ad58f3089336'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '3dfb79e2-d372-4cc9-95ce-b586f87acce2', 'volume_type': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e8f758-1f0f-426e-b0f3-a025f70b96dc]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-e148e045-22f9-4bce-909a-999a411b164b tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:22 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:09:22 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:09:22 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LlaMmJwv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:09:22 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:09:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8121f02e-6706-4562-8437-296f684b0c1e]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-e148e045-22f9-4bce-909a-999a411b164b tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-e148e045-22f9-4bce-909a-999a411b164b tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] SCSI volumes sdd have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-e148e045-22f9-4bce-909a-999a411b164b tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5c867e-9908-4b83-810f-c1f83d562eda]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-e148e045-22f9-4bce-909a-999a411b164b tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ddf58c1-a752-4900-9e5c-9241cd697601]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-e148e045-22f9-4bce-909a-999a411b164b tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030, portal: 172.16.0.220,3260]
Nov 22 08:09:22 user nova-compute[74348]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030, portal: 172.16.0.220,3260] successful.
Nov 22 08:09:22 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fe21fec-f8eb-4806-a4b7-c1837032b030 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[15477e52-abf3-4ca8-a01d-60dec9886b55]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-e148e045-22f9-4bce-909a-999a411b164b tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-e148e045-22f9-4bce-909a-999a411b164b tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-e148e045-22f9-4bce-909a-999a411b164b tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] <== disconnect_volume: return (373ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e148e045-22f9-4bce-909a-999a411b164b tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.123s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:09:22 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:09:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.055s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:09:22 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 08:09:22 user nova-compute[74348]: DEBUG nova.compute.manager [req-d3291b85-f1ce-4b67-8a16-bd2dde9ab3f1 req-15dc0407-39ed-4627-a29f-e9078e1f3564 service nova] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Received event network-vif-plugged-8e4fc0fe-f03b-4816-8a6a-c20a8eba5296 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d3291b85-f1ce-4b67-8a16-bd2dde9ab3f1 req-15dc0407-39ed-4627-a29f-e9078e1f3564 service nova] Acquiring lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d3291b85-f1ce-4b67-8a16-bd2dde9ab3f1 req-15dc0407-39ed-4627-a29f-e9078e1f3564 service nova] Lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d3291b85-f1ce-4b67-8a16-bd2dde9ab3f1 req-15dc0407-39ed-4627-a29f-e9078e1f3564 service nova] Lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG nova.compute.manager [req-d3291b85-f1ce-4b67-8a16-bd2dde9ab3f1 req-15dc0407-39ed-4627-a29f-e9078e1f3564 service nova] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] No waiting events found dispatching network-vif-plugged-8e4fc0fe-f03b-4816-8a6a-c20a8eba5296 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:09:22 user nova-compute[74348]: WARNING nova.compute.manager [req-d3291b85-f1ce-4b67-8a16-bd2dde9ab3f1 req-15dc0407-39ed-4627-a29f-e9078e1f3564 service nova] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Received unexpected event network-vif-plugged-8e4fc0fe-f03b-4816-8a6a-c20a8eba5296 for instance with vm_state rescued and task_state unrescuing.
Nov 22 08:09:22 user nova-compute[74348]: DEBUG nova.compute.manager [req-d3291b85-f1ce-4b67-8a16-bd2dde9ab3f1 req-15dc0407-39ed-4627-a29f-e9078e1f3564 service nova] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Received event network-vif-plugged-8e4fc0fe-f03b-4816-8a6a-c20a8eba5296 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d3291b85-f1ce-4b67-8a16-bd2dde9ab3f1 req-15dc0407-39ed-4627-a29f-e9078e1f3564 service nova] Acquiring lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d3291b85-f1ce-4b67-8a16-bd2dde9ab3f1 req-15dc0407-39ed-4627-a29f-e9078e1f3564 service nova] Lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.010s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d3291b85-f1ce-4b67-8a16-bd2dde9ab3f1 req-15dc0407-39ed-4627-a29f-e9078e1f3564 service nova] Lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG nova.compute.manager [req-d3291b85-f1ce-4b67-8a16-bd2dde9ab3f1 req-15dc0407-39ed-4627-a29f-e9078e1f3564 service nova] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] No waiting events found dispatching network-vif-plugged-8e4fc0fe-f03b-4816-8a6a-c20a8eba5296 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:09:22 user nova-compute[74348]: WARNING nova.compute.manager [req-d3291b85-f1ce-4b67-8a16-bd2dde9ab3f1 req-15dc0407-39ed-4627-a29f-e9078e1f3564 service nova] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Received unexpected event network-vif-plugged-8e4fc0fe-f03b-4816-8a6a-c20a8eba5296 for instance with vm_state rescued and task_state unrescuing.
Nov 22 08:09:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe9e80d-7c3d-47b3-bac3-5e9ac2af53ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 08:09:22 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f3eb49-06b7-43c2-867d-d21c9c63c4a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336] added
Nov 22 08:09:22 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7758e5c-c530-4c5c-a262-8e0fa4bbc785]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe21c0f-3238-4118-8255-06e7c883b7e1]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LlaMmJwv {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LlaMmJwv" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fd9e43-3cb6-40d6-876f-33dd41564c4a]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LlaMmJwv'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd43cb63-3e1a-433a-b896-c9ce32c14453]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8150324-91fc-4724-9384-d9b6fb4d7598]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:09:22 user nova-compute[74348]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)
Nov 22 08:09:22 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:09:22 user nova-compute[74348]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)
Nov 22 08:09:22 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fd45a5-ae8d-43b0-8b80-aa981fce37da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336, portal: 172.16.0.220,3260]
Nov 22 08:09:22 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336, portal: 172.16.0.220,3260] successful.
Nov 22 08:09:22 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fc20f5-4fd9-48e7-8975-dae18e51a8ee]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5520fb9-a1b0-4e00-be17-c3ec275592b1]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:09:22 user nova-compute[74348]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)
Nov 22 08:09:22 user nova-compute[74348]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)
Nov 22 08:09:22 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:09:22 user nova-compute[74348]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)
Nov 22 08:09:22 user nova-compute[74348]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)
Nov 22 08:09:22 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8928a41e-c350-4a78-9cee-31c2c3210cb0]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:09:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LlaMmJwv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 08:09:23 user nova-compute[74348]: DEBUG nova.objects.instance [None req-e148e045-22f9-4bce-909a-999a411b164b tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lazy-loading 'flavor' on Instance uuid 4fcddbef-dfaf-48a5-8561-26b8857fdbd6 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:09:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e148e045-22f9-4bce-909a-999a411b164b tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.958s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:09:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:09:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] <== connect_volume: return (1506ms) {'type': 'block', 'scsi_wwn': '26565623135353531', 'path': '/dev/sdc'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:09:23 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565623135353531', 'path': '/dev/sdc'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 08:09:23 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:09:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2080387933',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2080387933',id=38,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a31d898cdc69494a8825e8d93a0d04bc',ramdisk_id='',reservation_id='r-ra0klnf9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-502521972',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:09:10Z,user_data=None,user_id='1d5c8274eca14965b6cbfe22110f904d',uuid=b998bedf-ee29-48a1-a14b-449add115c39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee377706-a70f-4d29-96be-4d56daedb95a", "address": "fa:16:3e:a1:2b:05", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee377706-a7", "ovs_interfaceid": "ee377706-a70f-4d29-96be-4d56daedb95a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 08:09:23 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Converting VIF {"id": "ee377706-a70f-4d29-96be-4d56daedb95a", "address": "fa:16:3e:a1:2b:05", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee377706-a7", "ovs_interfaceid": "ee377706-a70f-4d29-96be-4d56daedb95a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:09:23 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:2b:05,bridge_name='br-int',has_traffic_filtering=True,id=ee377706-a70f-4d29-96be-4d56daedb95a,network=Network(6fe60468-191c-4d84-8dce-55c056f88936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee377706-a7') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:09:23 user nova-compute[74348]: DEBUG nova.objects.instance [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lazy-loading 'pci_devices' on Instance uuid b998bedf-ee29-48a1-a14b-449add115c39 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:09:23 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] End _get_guest_xml xml=<domain type="kvm">
Nov 22 08:09:23 user nova-compute[74348]:   <uuid>b998bedf-ee29-48a1-a14b-449add115c39</uuid>
Nov 22 08:09:23 user nova-compute[74348]:   <name>instance-00000026</name>
Nov 22 08:09:23 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 08:09:23 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 08:09:23 user nova-compute[74348]:   <metadata>
Nov 22 08:09:23 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 08:09:23 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 08:09:23 user nova-compute[74348]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2080387933</nova:name>
Nov 22 08:09:23 user nova-compute[74348]:       <nova:creationTime>2023-11-22 08:09:22</nova:creationTime>
Nov 22 08:09:23 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 08:09:23 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 08:09:23 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 08:09:23 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 08:09:23 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 08:09:23 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 08:09:23 user nova-compute[74348]:       </nova:flavor>
Nov 22 08:09:23 user nova-compute[74348]:       <nova:owner>
Nov 22 08:09:23 user nova-compute[74348]:         <nova:user uuid="1d5c8274eca14965b6cbfe22110f904d">tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member</nova:user>
Nov 22 08:09:23 user nova-compute[74348]:         <nova:project uuid="a31d898cdc69494a8825e8d93a0d04bc">tempest-ServerBootFromVolumeStableRescueTest-502521972</nova:project>
Nov 22 08:09:23 user nova-compute[74348]:       </nova:owner>
Nov 22 08:09:23 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 08:09:23 user nova-compute[74348]:       <nova:ports>
Nov 22 08:09:23 user nova-compute[74348]:         <nova:port uuid="ee377706-a70f-4d29-96be-4d56daedb95a">
Nov 22 08:09:23 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 22 08:09:23 user nova-compute[74348]:         </nova:port>
Nov 22 08:09:23 user nova-compute[74348]:       </nova:ports>
Nov 22 08:09:23 user nova-compute[74348]:     </nova:instance>
Nov 22 08:09:23 user nova-compute[74348]:   </metadata>
Nov 22 08:09:23 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 08:09:23 user nova-compute[74348]:     <system>
Nov 22 08:09:23 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 08:09:23 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 08:09:23 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 08:09:23 user nova-compute[74348]:       <entry name="serial">b998bedf-ee29-48a1-a14b-449add115c39</entry>
Nov 22 08:09:23 user nova-compute[74348]:       <entry name="uuid">b998bedf-ee29-48a1-a14b-449add115c39</entry>
Nov 22 08:09:23 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 08:09:23 user nova-compute[74348]:     </system>
Nov 22 08:09:23 user nova-compute[74348]:   </sysinfo>
Nov 22 08:09:23 user nova-compute[74348]:   <os>
Nov 22 08:09:23 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 08:09:23 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 08:09:23 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 08:09:23 user nova-compute[74348]:   </os>
Nov 22 08:09:23 user nova-compute[74348]:   <features>
Nov 22 08:09:23 user nova-compute[74348]:     <acpi/>
Nov 22 08:09:23 user nova-compute[74348]:     <apic/>
Nov 22 08:09:23 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 08:09:23 user nova-compute[74348]:   </features>
Nov 22 08:09:23 user nova-compute[74348]:   <clock offset="utc">
Nov 22 08:09:23 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 08:09:23 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 08:09:23 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 08:09:23 user nova-compute[74348]:   </clock>
Nov 22 08:09:23 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 08:09:23 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 08:09:23 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 08:09:23 user nova-compute[74348]:   </cpu>
Nov 22 08:09:23 user nova-compute[74348]:   <devices>
Nov 22 08:09:23 user nova-compute[74348]:     <disk type="block" device="disk">
Nov 22 08:09:23 user nova-compute[74348]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:09:23 user nova-compute[74348]:       <source dev="/dev/sdc"/>
Nov 22 08:09:23 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 08:09:23 user nova-compute[74348]:       <serial>d5b8e56f-87c3-4657-991f-ad58f3089336</serial>
Nov 22 08:09:23 user nova-compute[74348]:     </disk>
Nov 22 08:09:23 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 08:09:23 user nova-compute[74348]:       <mac address="fa:16:3e:a1:2b:05"/>
Nov 22 08:09:23 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:09:23 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 08:09:23 user nova-compute[74348]:       <target dev="tapee377706-a7"/>
Nov 22 08:09:23 user nova-compute[74348]:     </interface>
Nov 22 08:09:23 user nova-compute[74348]:     <serial type="pty">
Nov 22 08:09:23 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/b998bedf-ee29-48a1-a14b-449add115c39/console.log" append="off"/>
Nov 22 08:09:23 user nova-compute[74348]:     </serial>
Nov 22 08:09:23 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 08:09:23 user nova-compute[74348]:     <video>
Nov 22 08:09:23 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:09:23 user nova-compute[74348]:     </video>
Nov 22 08:09:23 user nova-compute[74348]:     <rng model="virtio">
Nov 22 08:09:23 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 08:09:23 user nova-compute[74348]:     </rng>
Nov 22 08:09:23 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 08:09:23 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 08:09:23 user nova-compute[74348]:       <stats period="10"/>
Nov 22 08:09:23 user nova-compute[74348]:     </memballoon>
Nov 22 08:09:23 user nova-compute[74348]:   </devices>
Nov 22 08:09:23 user nova-compute[74348]: </domain>
Nov 22 08:09:23 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 08:09:23 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:09:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2080387933',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2080387933',id=38,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a31d898cdc69494a8825e8d93a0d04bc',ramdisk_id='',reservation_id='r-ra0klnf9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-502521972',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:09:10Z,user_data=None,user_id='1d5c8274eca14965b6cbfe22110f904d',uuid=b998bedf-ee29-48a1-a14b-449add115c39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee377706-a70f-4d29-96be-4d56daedb95a", "address": "fa:16:3e:a1:2b:05", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee377706-a7", "ovs_interfaceid": "ee377706-a70f-4d29-96be-4d56daedb95a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 08:09:23 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Converting VIF {"id": "ee377706-a70f-4d29-96be-4d56daedb95a", "address": "fa:16:3e:a1:2b:05", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee377706-a7", "ovs_interfaceid": "ee377706-a70f-4d29-96be-4d56daedb95a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:09:23 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:2b:05,bridge_name='br-int',has_traffic_filtering=True,id=ee377706-a70f-4d29-96be-4d56daedb95a,network=Network(6fe60468-191c-4d84-8dce-55c056f88936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee377706-a7') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:09:23 user nova-compute[74348]: DEBUG os_vif [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:2b:05,bridge_name='br-int',has_traffic_filtering=True,id=ee377706-a70f-4d29-96be-4d56daedb95a,network=Network(6fe60468-191c-4d84-8dce-55c056f88936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee377706-a7') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 08:09:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:09:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 08:09:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'debddf25-393a-5708-ac01-70e7117b2d3a', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:09:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:09:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee377706-a7, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:09:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapee377706-a7, col_values=(('qos', UUID('e54383cc-96a1-4fc9-b426-63a295b51863')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:09:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapee377706-a7, col_values=(('external_ids', {'iface-id': 'ee377706-a70f-4d29-96be-4d56daedb95a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:2b:05', 'vm-uuid': 'b998bedf-ee29-48a1-a14b-449add115c39'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:09:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:09:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:23 user nova-compute[74348]: INFO os_vif [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:2b:05,bridge_name='br-int',has_traffic_filtering=True,id=ee377706-a70f-4d29-96be-4d56daedb95a,network=Network(6fe60468-191c-4d84-8dce-55c056f88936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee377706-a7')
Nov 22 08:09:23 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:09:23 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] No VIF found with MAC fa:16:3e:a1:2b:05, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:09:24 user nova-compute[74348]: DEBUG nova.compute.manager [None req-a053b5f9-fd72-4dac-a427-b06eece6aa5d tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:09:24 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:24 user nova-compute[74348]: DEBUG nova.compute.manager [req-4eff29c7-f50e-49f6-99cd-cbc90a7d607d req-4834113e-016a-4ade-8a0c-9019fa3e26af service nova] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Received event network-vif-plugged-8e4fc0fe-f03b-4816-8a6a-c20a8eba5296 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:09:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4eff29c7-f50e-49f6-99cd-cbc90a7d607d req-4834113e-016a-4ade-8a0c-9019fa3e26af service nova] Acquiring lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:09:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4eff29c7-f50e-49f6-99cd-cbc90a7d607d req-4834113e-016a-4ade-8a0c-9019fa3e26af service nova] Lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:09:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4eff29c7-f50e-49f6-99cd-cbc90a7d607d req-4834113e-016a-4ade-8a0c-9019fa3e26af service nova] Lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:09:24 user nova-compute[74348]: DEBUG nova.compute.manager [req-4eff29c7-f50e-49f6-99cd-cbc90a7d607d req-4834113e-016a-4ade-8a0c-9019fa3e26af service nova] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] No waiting events found dispatching network-vif-plugged-8e4fc0fe-f03b-4816-8a6a-c20a8eba5296 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:09:24 user nova-compute[74348]: WARNING nova.compute.manager [req-4eff29c7-f50e-49f6-99cd-cbc90a7d607d req-4834113e-016a-4ade-8a0c-9019fa3e26af service nova] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Received unexpected event network-vif-plugged-8e4fc0fe-f03b-4816-8a6a-c20a8eba5296 for instance with vm_state active and task_state None.
Nov 22 08:09:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:25 user nova-compute[74348]: DEBUG nova.compute.manager [req-77b95cf8-d93c-4bcb-83a2-b75d9eac2a33 req-85a56249-08d8-4c01-96bf-03792b2826e6 service nova] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Received event network-vif-plugged-ee377706-a70f-4d29-96be-4d56daedb95a {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:09:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-77b95cf8-d93c-4bcb-83a2-b75d9eac2a33 req-85a56249-08d8-4c01-96bf-03792b2826e6 service nova] Acquiring lock "b998bedf-ee29-48a1-a14b-449add115c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:09:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-77b95cf8-d93c-4bcb-83a2-b75d9eac2a33 req-85a56249-08d8-4c01-96bf-03792b2826e6 service nova] Lock "b998bedf-ee29-48a1-a14b-449add115c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:09:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-77b95cf8-d93c-4bcb-83a2-b75d9eac2a33 req-85a56249-08d8-4c01-96bf-03792b2826e6 service nova] Lock "b998bedf-ee29-48a1-a14b-449add115c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:09:25 user nova-compute[74348]: DEBUG nova.compute.manager [req-77b95cf8-d93c-4bcb-83a2-b75d9eac2a33 req-85a56249-08d8-4c01-96bf-03792b2826e6 service nova] [instance: b998bedf-ee29-48a1-a14b-449add115c39] No waiting events found dispatching network-vif-plugged-ee377706-a70f-4d29-96be-4d56daedb95a {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:09:25 user nova-compute[74348]: WARNING nova.compute.manager [req-77b95cf8-d93c-4bcb-83a2-b75d9eac2a33 req-85a56249-08d8-4c01-96bf-03792b2826e6 service nova] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Received unexpected event network-vif-plugged-ee377706-a70f-4d29-96be-4d56daedb95a for instance with vm_state building and task_state spawning.
Nov 22 08:09:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:27 user nova-compute[74348]: DEBUG nova.compute.manager [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 08:09:27 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 08:09:27 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Instance spawned successfully.
Nov 22 08:09:27 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 08:09:27 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:09:27 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:09:27 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:09:27 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:09:27 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:09:27 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:09:27 user nova-compute[74348]: INFO nova.compute.manager [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Took 5.46 seconds to spawn the instance on the hypervisor.
Nov 22 08:09:27 user nova-compute[74348]: DEBUG nova.compute.manager [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:09:27 user nova-compute[74348]: INFO nova.compute.manager [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Took 18.86 seconds to build instance.
Nov 22 08:09:27 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-462bc3f3-83ce-4ea6-a030-31f28325af04 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "b998bedf-ee29-48a1-a14b-449add115c39" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.965s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:09:27 user nova-compute[74348]: DEBUG nova.compute.manager [req-8314e3f2-3770-4fac-be1a-ec5d0c8258ce req-4779ea73-cee8-4ef3-8ae0-cfadf2d6eea8 service nova] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Received event network-vif-plugged-ee377706-a70f-4d29-96be-4d56daedb95a {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:09:27 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-8314e3f2-3770-4fac-be1a-ec5d0c8258ce req-4779ea73-cee8-4ef3-8ae0-cfadf2d6eea8 service nova] Acquiring lock "b998bedf-ee29-48a1-a14b-449add115c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:09:27 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-8314e3f2-3770-4fac-be1a-ec5d0c8258ce req-4779ea73-cee8-4ef3-8ae0-cfadf2d6eea8 service nova] Lock "b998bedf-ee29-48a1-a14b-449add115c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:09:27 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-8314e3f2-3770-4fac-be1a-ec5d0c8258ce req-4779ea73-cee8-4ef3-8ae0-cfadf2d6eea8 service nova] Lock "b998bedf-ee29-48a1-a14b-449add115c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:09:27 user nova-compute[74348]: DEBUG nova.compute.manager [req-8314e3f2-3770-4fac-be1a-ec5d0c8258ce req-4779ea73-cee8-4ef3-8ae0-cfadf2d6eea8 service nova] [instance: b998bedf-ee29-48a1-a14b-449add115c39] No waiting events found dispatching network-vif-plugged-ee377706-a70f-4d29-96be-4d56daedb95a {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:09:27 user nova-compute[74348]: WARNING nova.compute.manager [req-8314e3f2-3770-4fac-be1a-ec5d0c8258ce req-4779ea73-cee8-4ef3-8ae0-cfadf2d6eea8 service nova] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Received unexpected event network-vif-plugged-ee377706-a70f-4d29-96be-4d56daedb95a for instance with vm_state active and task_state None.
Nov 22 08:09:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._sync_power_states {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Triggering sync for uuid 765f8c47-c042-4430-8d35-07926ad693fe {{(pid=74348) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Triggering sync for uuid b8f84c0b-fab5-4900-bf65-270c9c06baf8 {{(pid=74348) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Triggering sync for uuid 37c93c2a-1397-4b04-aef1-5068218ad9fd {{(pid=74348) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Triggering sync for uuid 5006cff5-4b67-405d-b6b1-4c355f82d920 {{(pid=74348) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Triggering sync for uuid 555f4246-d4b2-4f2f-b91c-dda8fe47264c {{(pid=74348) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Triggering sync for uuid ba74ca7d-2875-426c-a485-d908af865bae {{(pid=74348) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Triggering sync for uuid b6698b0d-0d43-47ea-bcdc-d99201d9833c {{(pid=74348) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Triggering sync for uuid 016c8f4b-a226-4226-ba56-8a2b28cea146 {{(pid=74348) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Triggering sync for uuid 4fcddbef-dfaf-48a5-8561-26b8857fdbd6 {{(pid=74348) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Triggering sync for uuid b95b6cae-1885-43e8-b589-ee89854100a3 {{(pid=74348) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Triggering sync for uuid 3b0e2761-c6aa-45a5-980a-da40a415c8d0 {{(pid=74348) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Triggering sync for uuid b998bedf-ee29-48a1-a14b-449add115c39 {{(pid=74348) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "765f8c47-c042-4430-8d35-07926ad693fe" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "765f8c47-c042-4430-8d35-07926ad693fe" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "37c93c2a-1397-4b04-aef1-5068218ad9fd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "37c93c2a-1397-4b04-aef1-5068218ad9fd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "5006cff5-4b67-405d-b6b1-4c355f82d920" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "5006cff5-4b67-405d-b6b1-4c355f82d920" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "ba74ca7d-2875-426c-a485-d908af865bae" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "ba74ca7d-2875-426c-a485-d908af865bae" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "016c8f4b-a226-4226-ba56-8a2b28cea146" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "b95b6cae-1885-43e8-b589-ee89854100a3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "b95b6cae-1885-43e8-b589-ee89854100a3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "3b0e2761-c6aa-45a5-980a-da40a415c8d0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "3b0e2761-c6aa-45a5-980a-da40a415c8d0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "b998bedf-ee29-48a1-a14b-449add115c39" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "b998bedf-ee29-48a1-a14b-449add115c39" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "765f8c47-c042-4430-8d35-07926ad693fe" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "37c93c2a-1397-4b04-aef1-5068218ad9fd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "5006cff5-4b67-405d-b6b1-4c355f82d920" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "ba74ca7d-2875-426c-a485-d908af865bae" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "b95b6cae-1885-43e8-b589-ee89854100a3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "3b0e2761-c6aa-45a5-980a-da40a415c8d0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:09:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "b998bedf-ee29-48a1-a14b-449add115c39" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.102s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:09:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:39 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:39 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:09:40 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-958e7ea4-31cc-4e8f-be1d-6f9fd97eaffc tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 016c8f4b-a226-4226-ba56-8a2b28cea146 is timed out.
Nov 22 08:09:40 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-958e7ea4-31cc-4e8f-be1d-6f9fd97eaffc tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Successfully detached device vdb from instance 016c8f4b-a226-4226-ba56-8a2b28cea146 from the live domain config.
Nov 22 08:09:40 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-958e7ea4-31cc-4e8f-be1d-6f9fd97eaffc tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-958e7ea4-31cc-4e8f-be1d-6f9fd97eaffc tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bxSHZRyp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:09:40 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-958e7ea4-31cc-4e8f-be1d-6f9fd97eaffc tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:09:40 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-958e7ea4-31cc-4e8f-be1d-6f9fd97eaffc tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-958e7ea4-31cc-4e8f-be1d-6f9fd97eaffc tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23d609b-7827-4c17-85c2-772d56fc388d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-958e7ea4-31cc-4e8f-be1d-6f9fd97eaffc tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 08:09:40 user nova-compute[74348]: No targets found.
Nov 22 08:09:40 user nova-compute[74348]: iSNS:
Nov 22 08:09:40 user nova-compute[74348]: No targets found.
Nov 22 08:09:40 user nova-compute[74348]: STATIC:
Nov 22 08:09:40 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a
Nov 22 08:09:40 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:09:40 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:09:40 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8
Nov 22 08:09:40 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:09:40 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:09:40 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336
Nov 22 08:09:40 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:09:40 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:09:40 user nova-compute[74348]: FIRMWARE:
Nov 22 08:09:40 user nova-compute[74348]: No targets found.
Nov 22 08:09:40 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-958e7ea4-31cc-4e8f-be1d-6f9fd97eaffc tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 08:09:40 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 08:09:40 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-958e7ea4-31cc-4e8f-be1d-6f9fd97eaffc tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52c8308-975f-4eb3-aedd-09e4ea57d18f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa76babc-73b5-4d7a-9990-6da74c5477c2]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-958e7ea4-31cc-4e8f-be1d-6f9fd97eaffc tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:09:40 user nova-compute[74348]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)
Nov 22 08:09:40 user nova-compute[74348]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)
Nov 22 08:09:40 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-958e7ea4-31cc-4e8f-be1d-6f9fd97eaffc tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:09:40 user nova-compute[74348]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a (non-flash)
Nov 22 08:09:40 user nova-compute[74348]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)
Nov 22 08:09:40 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-958e7ea4-31cc-4e8f-be1d-6f9fd97eaffc tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f222836e5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a'): ({'sde'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-958e7ea4-31cc-4e8f-be1d-6f9fd97eaffc tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Removing single pathed devices sde {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb42de3d-821e-4fc8-9c1c-2d7af7eba4da]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[491f1666-06e6-4700-9f0f-0aad05f8fb0e]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-958e7ea4-31cc-4e8f-be1d-6f9fd97eaffc tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Flushing IO for device /dev/sde {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7730669-e68e-4c82-a20e-458c27fa5a2c]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-958e7ea4-31cc-4e8f-be1d-6f9fd97eaffc tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c995cefd-4d4e-425d-8817-d72856c1fb9e]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-958e7ea4-31cc-4e8f-be1d-6f9fd97eaffc tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-958e7ea4-31cc-4e8f-be1d-6f9fd97eaffc tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] SCSI volumes sde have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-958e7ea4-31cc-4e8f-be1d-6f9fd97eaffc tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[492317cc-d172-4941-b063-91f79e97afa9]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-958e7ea4-31cc-4e8f-be1d-6f9fd97eaffc tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7dc6625-7ba7-42ca-8522-114bf805471f]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-958e7ea4-31cc-4e8f-be1d-6f9fd97eaffc tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a, portal: 172.16.0.220,3260]
Nov 22 08:09:40 user nova-compute[74348]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a, portal: 172.16.0.220,3260] successful.
Nov 22 08:09:40 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9ef99-066d-4bcd-8a37-31a3a90c4c2a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9c5113-5160-4220-a019-cdcefaa05e5b]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-958e7ea4-31cc-4e8f-be1d-6f9fd97eaffc tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-958e7ea4-31cc-4e8f-be1d-6f9fd97eaffc tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-958e7ea4-31cc-4e8f-be1d-6f9fd97eaffc tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] <== disconnect_volume: return (299ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-958e7ea4-31cc-4e8f-be1d-6f9fd97eaffc tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-555f4246-d4b2-4f2f-b91c-dda8fe47264c" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-555f4246-d4b2-4f2f-b91c-dda8fe47264c" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:09:40 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 08:09:41 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Updating instance_info_cache with network_info: [{"id": "8e4fc0fe-f03b-4816-8a6a-c20a8eba5296", "address": "fa:16:3e:01:d5:cd", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4fc0fe-f0", "ovs_interfaceid": "8e4fc0fe-f03b-4816-8a6a-c20a8eba5296", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:09:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-555f4246-d4b2-4f2f-b91c-dda8fe47264c" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:09:41 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 08:09:41 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:09:41 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:09:41 user nova-compute[74348]: DEBUG nova.objects.instance [None req-958e7ea4-31cc-4e8f-be1d-6f9fd97eaffc tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lazy-loading 'flavor' on Instance uuid 016c8f4b-a226-4226-ba56-8a2b28cea146 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:09:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-958e7ea4-31cc-4e8f-be1d-6f9fd97eaffc tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "016c8f4b-a226-4226-ba56-8a2b28cea146" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.052s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:09:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "016c8f4b-a226-4226-ba56-8a2b28cea146" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 11.223s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:09:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "016c8f4b-a226-4226-ba56-8a2b28cea146" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:09:43 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:09:44 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:44 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:44 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:09:44 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:09:44 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:09:45 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:09:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:09:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:09:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:09:45 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:09:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:46 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:09:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6698b0d-0d43-47ea-bcdc-d99201d9833c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6698b0d-0d43-47ea-bcdc-d99201d9833c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6698b0d-0d43-47ea-bcdc-d99201d9833c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6698b0d-0d43-47ea-bcdc-d99201d9833c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Acquiring lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:09:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:09:48 user nova-compute[74348]: DEBUG nova.objects.instance [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lazy-loading 'flavor' on Instance uuid b6698b0d-0d43-47ea-bcdc-d99201d9833c {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:09:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.099s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:09:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Acquiring lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:09:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:09:48 user nova-compute[74348]: INFO nova.compute.manager [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Attaching volume e789ed04-af1a-4a31-bc0b-6ce47574dcb4 to /dev/vdb
Nov 22 08:09:48 user nova-compute[74348]: DEBUG os_brick.utils [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:09:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[062cd234-d442-465d-9e82-ff0097273007]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1517f092-01fe-402d-a4c9-4547eda62023]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a200cf99-3880-46c9-8533-867396ad8729]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c665fbc1-40fa-4ba1-93d4-57fff55bdc37]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:09:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 08:09:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:09:49 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 08:09:49 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fe9848-1e60-429b-b629-a67483001b19]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 08:09:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 08:09:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 08:09:49 user nova-compute[74348]: DEBUG os_brick.utils [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:09:49 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Updating existing volume attachment record: f85486ad-e79a-401f-925a-05600ff6268c {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 08:09:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0e2761-c6aa-45a5-980a-da40a415c8d0/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0e2761-c6aa-45a5-980a-da40a415c8d0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0e2761-c6aa-45a5-980a-da40a415c8d0/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0e2761-c6aa-45a5-980a-da40a415c8d0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:09:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fcddbef-dfaf-48a5-8561-26b8857fdbd6/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fcddbef-dfaf-48a5-8561-26b8857fdbd6/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fcddbef-dfaf-48a5-8561-26b8857fdbd6/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fcddbef-dfaf-48a5-8561-26b8857fdbd6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:50 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:09:50 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:09:50 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=7427MB free_disk=24.65456771850586GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:09:50 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:09:50 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:09:50 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 765f8c47-c042-4430-8d35-07926ad693fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:09:50 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance b8f84c0b-fab5-4900-bf65-270c9c06baf8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:09:50 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 37c93c2a-1397-4b04-aef1-5068218ad9fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:09:50 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 5006cff5-4b67-405d-b6b1-4c355f82d920 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:09:50 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 555f4246-d4b2-4f2f-b91c-dda8fe47264c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:09:50 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance ba74ca7d-2875-426c-a485-d908af865bae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:09:50 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance b6698b0d-0d43-47ea-bcdc-d99201d9833c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:09:50 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 016c8f4b-a226-4226-ba56-8a2b28cea146 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:09:50 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 4fcddbef-dfaf-48a5-8561-26b8857fdbd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:09:50 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance b95b6cae-1885-43e8-b589-ee89854100a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:09:50 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 3b0e2761-c6aa-45a5-980a-da40a415c8d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:09:50 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance b998bedf-ee29-48a1-a14b-449add115c39 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:09:50 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:09:50 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:09:50 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:09:50 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:09:50 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:09:50 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.579s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:09:52 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:09:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ccd62d0b-f70e-4c9b-bf72-240d20f45fac tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Acquiring lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:09:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ccd62d0b-f70e-4c9b-bf72-240d20f45fac tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:09:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ccd62d0b-f70e-4c9b-bf72-240d20f45fac tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Acquiring lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:09:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ccd62d0b-f70e-4c9b-bf72-240d20f45fac tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:09:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ccd62d0b-f70e-4c9b-bf72-240d20f45fac tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:09:54 user nova-compute[74348]: INFO nova.compute.manager [None req-ccd62d0b-f70e-4c9b-bf72-240d20f45fac tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Terminating instance
Nov 22 08:09:54 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ccd62d0b-f70e-4c9b-bf72-240d20f45fac tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ErfvdKei', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:09:55 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:09:55 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:09:55 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:09:55 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:09:55 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 08:09:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4 -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f88222-4133-4881-b8c0-5fd4eb12c28d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 08:09:55 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[06447c12-078a-4a1f-ad83-55639ab1425e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4] added
Nov 22 08:09:55 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG nova.compute.manager [req-756e49c1-bd00-4b3f-904a-b70bcd8ac16d req-ac198796-2235-40ca-a611-9e2df4984c6e service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Received event network-vif-unplugged-71e66d69-de38-4524-8517-ce8bba4a01e0 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-756e49c1-bd00-4b3f-904a-b70bcd8ac16d req-ac198796-2235-40ca-a611-9e2df4984c6e service nova] Acquiring lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-756e49c1-bd00-4b3f-904a-b70bcd8ac16d req-ac198796-2235-40ca-a611-9e2df4984c6e service nova] Lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-756e49c1-bd00-4b3f-904a-b70bcd8ac16d req-ac198796-2235-40ca-a611-9e2df4984c6e service nova] Lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG nova.compute.manager [req-756e49c1-bd00-4b3f-904a-b70bcd8ac16d req-ac198796-2235-40ca-a611-9e2df4984c6e service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] No waiting events found dispatching network-vif-unplugged-71e66d69-de38-4524-8517-ce8bba4a01e0 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG nova.compute.manager [req-756e49c1-bd00-4b3f-904a-b70bcd8ac16d req-ac198796-2235-40ca-a611-9e2df4984c6e service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Received event network-vif-unplugged-71e66d69-de38-4524-8517-ce8bba4a01e0 for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee923dc-6d19-45ce-93f0-bb5fe76f5323]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab29968-d11a-4f1d-8a16-991a4abf1c0d]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ErfvdKei {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ErfvdKei" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8095979-2209-47f7-bce3-b32b4276c2cc]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ErfvdKei'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4963df60-3666-45d7-8125-eb350f7e1ce0]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5e779d-7f50-457d-9fab-183b6f7ae0a9]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:09:55 user nova-compute[74348]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)
Nov 22 08:09:55 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:09:55 user nova-compute[74348]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)
Nov 22 08:09:55 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4 -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea26ab61-ba51-4892-a056-330ccca88aaa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4, portal: 172.16.0.220,3260]
Nov 22 08:09:55 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4, portal: 172.16.0.220,3260] successful.
Nov 22 08:09:55 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a56601d-527e-4680-98e4-d5c18267aa68]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[14943cb4-89d1-4a83-b5f1-752c72d7767f]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:09:55 user nova-compute[74348]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)
Nov 22 08:09:55 user nova-compute[74348]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4 (non-flash)
Nov 22 08:09:55 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:09:55 user nova-compute[74348]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)
Nov 22 08:09:55 user nova-compute[74348]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4 (non-flash)
Nov 22 08:09:55 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] HCTL ('35', '-', '-', 0) found on session 44 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5903ab-377c-4b22-a0f6-7f1f7cc52f3f]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ErfvdKei', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 08:09:55 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Instance destroyed successfully.
Nov 22 08:09:55 user nova-compute[74348]: DEBUG nova.objects.instance [None req-ccd62d0b-f70e-4c9b-bf72-240d20f45fac tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lazy-loading 'resources' on Instance uuid 4fcddbef-dfaf-48a5-8561-26b8857fdbd6 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-ccd62d0b-f70e-4c9b-bf72-240d20f45fac tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:04:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1735944942',display_name='tempest-TestMinimumBasicScenario-server-1735944942',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1735944942',id=34,image_ref='3a9f4e5f-c016-4fc5-ae4f-5f934efeb6ce',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTA5sa4ucGLk6R4bbbIS1Un+/U1MroRTEfh4B5VVfOPJgVXMPVHmu6UNRu1B4sNfygrP1h9ziVV8ro1ekYrcHpxDc5Z78t7um7MQh6+amXdg0qPuk+qNP8DoQe4H729tg==',key_name='tempest-TestMinimumBasicScenario-1985444712',keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:05:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d76d03d17cc4e5bb52a32a2f8fbd629',ramdisk_id='',reservation_id='r-bv7s35se',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3a9f4e5f-c016-4fc5-ae4f-5f934efeb6ce',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1824455706',owner_user_name='tempest-TestMinimumBasicScenario-1824455706-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T08:07:16Z,user_data=None,user_id='cbd1eed03be64a42b8ba9d0200b10692',uuid=4fcddbef-dfaf-48a5-8561-26b8857fdbd6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71e66d69-de38-4524-8517-ce8bba4a01e0", "address": "fa:16:3e:b3:59:21", "network": {"id": "442abc57-45e5-4cd7-878e-979afa78c421", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1395369508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d76d03d17cc4e5bb52a32a2f8fbd629", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71e66d69-de", "ovs_interfaceid": "71e66d69-de38-4524-8517-ce8bba4a01e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-ccd62d0b-f70e-4c9b-bf72-240d20f45fac tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Converting VIF {"id": "71e66d69-de38-4524-8517-ce8bba4a01e0", "address": "fa:16:3e:b3:59:21", "network": {"id": "442abc57-45e5-4cd7-878e-979afa78c421", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1395369508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d76d03d17cc4e5bb52a32a2f8fbd629", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71e66d69-de", "ovs_interfaceid": "71e66d69-de38-4524-8517-ce8bba4a01e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-ccd62d0b-f70e-4c9b-bf72-240d20f45fac tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:59:21,bridge_name='br-int',has_traffic_filtering=True,id=71e66d69-de38-4524-8517-ce8bba4a01e0,network=Network(442abc57-45e5-4cd7-878e-979afa78c421),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71e66d69-de') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG os_vif [None req-ccd62d0b-f70e-4c9b-bf72-240d20f45fac tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:59:21,bridge_name='br-int',has_traffic_filtering=True,id=71e66d69-de38-4524-8517-ce8bba4a01e0,network=Network(442abc57-45e5-4cd7-878e-979afa78c421),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71e66d69-de') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71e66d69-de, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=86073795-d955-44dd-a18f-388488a8e631) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:55 user nova-compute[74348]: INFO os_vif [None req-ccd62d0b-f70e-4c9b-bf72-240d20f45fac tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:59:21,bridge_name='br-int',has_traffic_filtering=True,id=71e66d69-de38-4524-8517-ce8bba4a01e0,network=Network(442abc57-45e5-4cd7-878e-979afa78c421),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71e66d69-de')
Nov 22 08:09:55 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-ccd62d0b-f70e-4c9b-bf72-240d20f45fac tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Deleting instance files /opt/stack/data/nova/instances/4fcddbef-dfaf-48a5-8561-26b8857fdbd6_del
Nov 22 08:09:55 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-ccd62d0b-f70e-4c9b-bf72-240d20f45fac tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Deletion of /opt/stack/data/nova/instances/4fcddbef-dfaf-48a5-8561-26b8857fdbd6_del complete
Nov 22 08:09:55 user nova-compute[74348]: INFO nova.compute.manager [None req-ccd62d0b-f70e-4c9b-bf72-240d20f45fac tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 22 08:09:55 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-ccd62d0b-f70e-4c9b-bf72-240d20f45fac tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 08:09:55 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 08:09:56 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:09:56 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Took 0.54 seconds to deallocate network for instance.
Nov 22 08:09:56 user nova-compute[74348]: DEBUG nova.compute.manager [req-06cdcf53-fddb-4aee-8467-c6e4c67d75dc req-cddaeaca-036a-4896-b2fe-10a925287802 service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Received event network-vif-deleted-71e66d69-de38-4524-8517-ce8bba4a01e0 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:09:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ccd62d0b-f70e-4c9b-bf72-240d20f45fac tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:09:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ccd62d0b-f70e-4c9b-bf72-240d20f45fac tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:09:56 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:09:56 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23130356166326137', 'path': '/dev/sdd'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:09:56 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130356166326137', 'path': '/dev/sdd'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 08:09:56 user nova-compute[74348]: DEBUG nova.objects.instance [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lazy-loading 'flavor' on Instance uuid b6698b0d-0d43-47ea-bcdc-d99201d9833c {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:09:56 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 08:09:56 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:09:56 user nova-compute[74348]:   <source dev="/dev/sdd"/>
Nov 22 08:09:56 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:09:56 user nova-compute[74348]:   <serial>e789ed04-af1a-4a31-bc0b-6ce47574dcb4</serial>
Nov 22 08:09:56 user nova-compute[74348]: </disk>
Nov 22 08:09:56 user nova-compute[74348]:  {{(pid=74348) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 08:09:57 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ccd62d0b-f70e-4c9b-bf72-240d20f45fac tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:09:57 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ccd62d0b-f70e-4c9b-bf72-240d20f45fac tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:09:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ccd62d0b-f70e-4c9b-bf72-240d20f45fac tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.624s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:09:57 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:09:57 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:09:57 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] No VIF found with MAC fa:16:3e:d2:53:6d, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:09:57 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-ccd62d0b-f70e-4c9b-bf72-240d20f45fac tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Deleted allocations for instance 4fcddbef-dfaf-48a5-8561-26b8857fdbd6
Nov 22 08:09:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ccd62d0b-f70e-4c9b-bf72-240d20f45fac tempest-TestMinimumBasicScenario-1824455706 tempest-TestMinimumBasicScenario-1824455706-project-member] Lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.274s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:09:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-24895f0c-fd41-472a-9778-652f108e3aa2 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.452s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:09:57 user nova-compute[74348]: DEBUG nova.compute.manager [req-3df5dddb-0c9a-434f-976e-ee9f2c1ca6be req-4e289afe-c9c6-4464-99d6-17953351ef91 service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Received event network-vif-plugged-71e66d69-de38-4524-8517-ce8bba4a01e0 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:09:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3df5dddb-0c9a-434f-976e-ee9f2c1ca6be req-4e289afe-c9c6-4464-99d6-17953351ef91 service nova] Acquiring lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:09:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3df5dddb-0c9a-434f-976e-ee9f2c1ca6be req-4e289afe-c9c6-4464-99d6-17953351ef91 service nova] Lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:09:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3df5dddb-0c9a-434f-976e-ee9f2c1ca6be req-4e289afe-c9c6-4464-99d6-17953351ef91 service nova] Lock "4fcddbef-dfaf-48a5-8561-26b8857fdbd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:09:57 user nova-compute[74348]: DEBUG nova.compute.manager [req-3df5dddb-0c9a-434f-976e-ee9f2c1ca6be req-4e289afe-c9c6-4464-99d6-17953351ef91 service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] No waiting events found dispatching network-vif-plugged-71e66d69-de38-4524-8517-ce8bba4a01e0 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:09:57 user nova-compute[74348]: WARNING nova.compute.manager [req-3df5dddb-0c9a-434f-976e-ee9f2c1ca6be req-4e289afe-c9c6-4464-99d6-17953351ef91 service nova] [instance: 4fcddbef-dfaf-48a5-8561-26b8857fdbd6] Received unexpected event network-vif-plugged-71e66d69-de38-4524-8517-ce8bba4a01e0 for instance with vm_state deleted and task_state None.
Nov 22 08:09:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-54200cc4-7638-4a14-b87f-9ab259c71e79 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Acquiring lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:09:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-54200cc4-7638-4a14-b87f-9ab259c71e79 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:09:59 user nova-compute[74348]: INFO nova.compute.manager [None req-54200cc4-7638-4a14-b87f-9ab259c71e79 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Detaching volume e789ed04-af1a-4a31-bc0b-6ce47574dcb4
Nov 22 08:09:59 user nova-compute[74348]: INFO nova.virt.block_device [None req-54200cc4-7638-4a14-b87f-9ab259c71e79 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Attempting to driver detach volume e789ed04-af1a-4a31-bc0b-6ce47574dcb4 from mountpoint /dev/vdb
Nov 22 08:09:59 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-54200cc4-7638-4a14-b87f-9ab259c71e79 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Attempting to detach device vdb from instance b6698b0d-0d43-47ea-bcdc-d99201d9833c from the persistent domain config. {{(pid=74348) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 08:09:59 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-54200cc4-7638-4a14-b87f-9ab259c71e79 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:09:59 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:09:59 user nova-compute[74348]:   <source dev="/dev/sdd"/>
Nov 22 08:09:59 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:09:59 user nova-compute[74348]:   <serial>e789ed04-af1a-4a31-bc0b-6ce47574dcb4</serial>
Nov 22 08:09:59 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 08:09:59 user nova-compute[74348]: </disk>
Nov 22 08:09:59 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:09:59 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-54200cc4-7638-4a14-b87f-9ab259c71e79 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Successfully detached device vdb from instance b6698b0d-0d43-47ea-bcdc-d99201d9833c from the persistent domain config.
Nov 22 08:09:59 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-54200cc4-7638-4a14-b87f-9ab259c71e79 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b6698b0d-0d43-47ea-bcdc-d99201d9833c from the live domain config. {{(pid=74348) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 08:09:59 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-54200cc4-7638-4a14-b87f-9ab259c71e79 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:09:59 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:09:59 user nova-compute[74348]:   <source dev="/dev/sdd"/>
Nov 22 08:09:59 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:09:59 user nova-compute[74348]:   <serial>e789ed04-af1a-4a31-bc0b-6ce47574dcb4</serial>
Nov 22 08:09:59 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 08:09:59 user nova-compute[74348]: </disk>
Nov 22 08:09:59 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:09:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:09:59 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-54200cc4-7638-4a14-b87f-9ab259c71e79 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b6698b0d-0d43-47ea-bcdc-d99201d9833c {{(pid=74348) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 08:10:00 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:10:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:10:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-a3c9bd30-e5ce-46f1-8dbd-012ed3500925 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "016c8f4b-a226-4226-ba56-8a2b28cea146" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:10:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-a3c9bd30-e5ce-46f1-8dbd-012ed3500925 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "016c8f4b-a226-4226-ba56-8a2b28cea146" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:10:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-a3c9bd30-e5ce-46f1-8dbd-012ed3500925 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "016c8f4b-a226-4226-ba56-8a2b28cea146-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:10:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-a3c9bd30-e5ce-46f1-8dbd-012ed3500925 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "016c8f4b-a226-4226-ba56-8a2b28cea146-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:10:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-a3c9bd30-e5ce-46f1-8dbd-012ed3500925 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "016c8f4b-a226-4226-ba56-8a2b28cea146-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:10:09 user nova-compute[74348]: INFO nova.compute.manager [None req-a3c9bd30-e5ce-46f1-8dbd-012ed3500925 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Terminating instance
Nov 22 08:10:09 user nova-compute[74348]: DEBUG nova.compute.manager [None req-a3c9bd30-e5ce-46f1-8dbd-012ed3500925 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 08:10:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:10:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:10:10 user nova-compute[74348]: DEBUG nova.compute.manager [req-75bd3382-0f45-4272-ba58-9c9a14ebaf39 req-62e481fd-3e9f-460e-a4dc-83f9462da9f5 service nova] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Received event network-vif-unplugged-014854c1-b4d7-4c60-830f-8aaa3f65c04c {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:10:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-75bd3382-0f45-4272-ba58-9c9a14ebaf39 req-62e481fd-3e9f-460e-a4dc-83f9462da9f5 service nova] Acquiring lock "016c8f4b-a226-4226-ba56-8a2b28cea146-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:10:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-75bd3382-0f45-4272-ba58-9c9a14ebaf39 req-62e481fd-3e9f-460e-a4dc-83f9462da9f5 service nova] Lock "016c8f4b-a226-4226-ba56-8a2b28cea146-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:10:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-75bd3382-0f45-4272-ba58-9c9a14ebaf39 req-62e481fd-3e9f-460e-a4dc-83f9462da9f5 service nova] Lock "016c8f4b-a226-4226-ba56-8a2b28cea146-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:10:10 user nova-compute[74348]: DEBUG nova.compute.manager [req-75bd3382-0f45-4272-ba58-9c9a14ebaf39 req-62e481fd-3e9f-460e-a4dc-83f9462da9f5 service nova] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] No waiting events found dispatching network-vif-unplugged-014854c1-b4d7-4c60-830f-8aaa3f65c04c {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:10:10 user nova-compute[74348]: DEBUG nova.compute.manager [req-75bd3382-0f45-4272-ba58-9c9a14ebaf39 req-62e481fd-3e9f-460e-a4dc-83f9462da9f5 service nova] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Received event network-vif-unplugged-014854c1-b4d7-4c60-830f-8aaa3f65c04c for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 08:10:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:10:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:10:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:10:10 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Instance destroyed successfully.
Nov 22 08:10:10 user nova-compute[74348]: DEBUG nova.objects.instance [None req-a3c9bd30-e5ce-46f1-8dbd-012ed3500925 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lazy-loading 'resources' on Instance uuid 016c8f4b-a226-4226-ba56-8a2b28cea146 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:10:10 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-a3c9bd30-e5ce-46f1-8dbd-012ed3500925 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-22T08:04:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1819188158',display_name='tempest-ServerActionsTestOtherA-server-580891727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1819188158',id=33,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNd3+zQ71IrK3H/CeT/5sXY1BokTseqCM2aIkmRs++g+CAAgDFEf4yV5acjjuqLPFktfJ9gL8iuTvbEWurIg6VoeZwI5FnuAIzcoEVdZSVWfuZAGh4IJYsK7izDsTE/MYw==',key_name='tempest-keypair-568155222',keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:06:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d62fda81543f461288e324458620d07c',ramdisk_id='',reservation_id='r-0gzl4a3w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-90817446',owner_user_name='tempest-ServerActionsTestOtherA-90817446-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T08:06:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43550ccf30be49aba6ed6de2caf9ae1e',uuid=016c8f4b-a226-4226-ba56-8a2b28cea146,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "014854c1-b4d7-4c60-830f-8aaa3f65c04c", "address": "fa:16:3e:b7:7f:68", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014854c1-b4", "ovs_interfaceid": "014854c1-b4d7-4c60-830f-8aaa3f65c04c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:10:10 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-a3c9bd30-e5ce-46f1-8dbd-012ed3500925 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Converting VIF {"id": "014854c1-b4d7-4c60-830f-8aaa3f65c04c", "address": "fa:16:3e:b7:7f:68", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014854c1-b4", "ovs_interfaceid": "014854c1-b4d7-4c60-830f-8aaa3f65c04c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:10:10 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-a3c9bd30-e5ce-46f1-8dbd-012ed3500925 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:7f:68,bridge_name='br-int',has_traffic_filtering=True,id=014854c1-b4d7-4c60-830f-8aaa3f65c04c,network=Network(9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap014854c1-b4') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:10:10 user nova-compute[74348]: DEBUG os_vif [None req-a3c9bd30-e5ce-46f1-8dbd-012ed3500925 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:7f:68,bridge_name='br-int',has_traffic_filtering=True,id=014854c1-b4d7-4c60-830f-8aaa3f65c04c,network=Network(9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap014854c1-b4') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:10:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:10:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap014854c1-b4, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:10:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:10:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:10:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:10:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dbbfac27-3cff-4b9d-9714-c559ac709ede) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:10:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:10:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:10:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:10:10 user nova-compute[74348]: INFO os_vif [None req-a3c9bd30-e5ce-46f1-8dbd-012ed3500925 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:7f:68,bridge_name='br-int',has_traffic_filtering=True,id=014854c1-b4d7-4c60-830f-8aaa3f65c04c,network=Network(9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap014854c1-b4')
Nov 22 08:10:10 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-a3c9bd30-e5ce-46f1-8dbd-012ed3500925 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Deleting instance files /opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146_del
Nov 22 08:10:10 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-a3c9bd30-e5ce-46f1-8dbd-012ed3500925 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Deletion of /opt/stack/data/nova/instances/016c8f4b-a226-4226-ba56-8a2b28cea146_del complete
Nov 22 08:10:10 user nova-compute[74348]: INFO nova.compute.manager [None req-a3c9bd30-e5ce-46f1-8dbd-012ed3500925 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Took 0.82 seconds to destroy the instance on the hypervisor.
Nov 22 08:10:10 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-a3c9bd30-e5ce-46f1-8dbd-012ed3500925 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 08:10:10 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 08:10:10 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 08:10:11 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:10:11 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Took 0.83 seconds to deallocate network for instance.
Nov 22 08:10:11 user nova-compute[74348]: DEBUG nova.compute.manager [req-f320b469-9530-4a7a-9a20-aae9e4c3944e req-3014b1fa-374c-4728-a095-0a38b9d4051f service nova] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Received event network-vif-deleted-014854c1-b4d7-4c60-830f-8aaa3f65c04c {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:10:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-a3c9bd30-e5ce-46f1-8dbd-012ed3500925 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:10:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-a3c9bd30-e5ce-46f1-8dbd-012ed3500925 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:10:11 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-a3c9bd30-e5ce-46f1-8dbd-012ed3500925 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:10:11 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-a3c9bd30-e5ce-46f1-8dbd-012ed3500925 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:10:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-a3c9bd30-e5ce-46f1-8dbd-012ed3500925 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:10:12 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-a3c9bd30-e5ce-46f1-8dbd-012ed3500925 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Deleted allocations for instance 016c8f4b-a226-4226-ba56-8a2b28cea146
Nov 22 08:10:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-a3c9bd30-e5ce-46f1-8dbd-012ed3500925 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "016c8f4b-a226-4226-ba56-8a2b28cea146" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.343s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:10:12 user nova-compute[74348]: DEBUG nova.compute.manager [req-a6b37d49-b912-46ff-8f6c-a16c2bf20b9b req-ca09e6f8-e06c-40ca-8b79-f0165a0a8fce service nova] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Received event network-vif-plugged-014854c1-b4d7-4c60-830f-8aaa3f65c04c {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:10:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a6b37d49-b912-46ff-8f6c-a16c2bf20b9b req-ca09e6f8-e06c-40ca-8b79-f0165a0a8fce service nova] Acquiring lock "016c8f4b-a226-4226-ba56-8a2b28cea146-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:10:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a6b37d49-b912-46ff-8f6c-a16c2bf20b9b req-ca09e6f8-e06c-40ca-8b79-f0165a0a8fce service nova] Lock "016c8f4b-a226-4226-ba56-8a2b28cea146-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:10:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a6b37d49-b912-46ff-8f6c-a16c2bf20b9b req-ca09e6f8-e06c-40ca-8b79-f0165a0a8fce service nova] Lock "016c8f4b-a226-4226-ba56-8a2b28cea146-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:10:12 user nova-compute[74348]: DEBUG nova.compute.manager [req-a6b37d49-b912-46ff-8f6c-a16c2bf20b9b req-ca09e6f8-e06c-40ca-8b79-f0165a0a8fce service nova] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] No waiting events found dispatching network-vif-plugged-014854c1-b4d7-4c60-830f-8aaa3f65c04c {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:10:12 user nova-compute[74348]: WARNING nova.compute.manager [req-a6b37d49-b912-46ff-8f6c-a16c2bf20b9b req-ca09e6f8-e06c-40ca-8b79-f0165a0a8fce service nova] [instance: 016c8f4b-a226-4226-ba56-8a2b28cea146] Received unexpected event network-vif-plugged-014854c1-b4d7-4c60-830f-8aaa3f65c04c for instance with vm_state deleted and task_state None.
Nov 22 08:10:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:10:19 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-54200cc4-7638-4a14-b87f-9ab259c71e79 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b6698b0d-0d43-47ea-bcdc-d99201d9833c is timed out.
Nov 22 08:10:19 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-54200cc4-7638-4a14-b87f-9ab259c71e79 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Successfully detached device vdb from instance b6698b0d-0d43-47ea-bcdc-d99201d9833c from the live domain config.
Nov 22 08:10:19 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54200cc4-7638-4a14-b87f-9ab259c71e79 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-54200cc4-7638-4a14-b87f-9ab259c71e79 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ErfvdKei', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:10:19 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-54200cc4-7638-4a14-b87f-9ab259c71e79 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:10:19 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-54200cc4-7638-4a14-b87f-9ab259c71e79 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-54200cc4-7638-4a14-b87f-9ab259c71e79 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27ad222-c8c5-472a-8bc5-8ae32f396fa0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-54200cc4-7638-4a14-b87f-9ab259c71e79 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 08:10:19 user nova-compute[74348]: No targets found.
Nov 22 08:10:19 user nova-compute[74348]: iSNS:
Nov 22 08:10:19 user nova-compute[74348]: No targets found.
Nov 22 08:10:19 user nova-compute[74348]: STATIC:
Nov 22 08:10:19 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4
Nov 22 08:10:19 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:10:19 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:10:19 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8
Nov 22 08:10:19 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:10:19 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:10:19 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336
Nov 22 08:10:19 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:10:19 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:10:19 user nova-compute[74348]: FIRMWARE:
Nov 22 08:10:19 user nova-compute[74348]: No targets found.
Nov 22 08:10:19 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-54200cc4-7638-4a14-b87f-9ab259c71e79 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 08:10:19 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 08:10:19 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-54200cc4-7638-4a14-b87f-9ab259c71e79 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[273d5d9c-88c5-4b07-8e78-636c86a9a210]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[57214110-659e-4b5c-9260-11c40077ab7d]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-54200cc4-7638-4a14-b87f-9ab259c71e79 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:10:19 user nova-compute[74348]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)
Nov 22 08:10:19 user nova-compute[74348]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4 (non-flash)
Nov 22 08:10:19 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-54200cc4-7638-4a14-b87f-9ab259c71e79 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:10:19 user nova-compute[74348]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)
Nov 22 08:10:19 user nova-compute[74348]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4 (non-flash)
Nov 22 08:10:19 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-54200cc4-7638-4a14-b87f-9ab259c71e79 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f225e0baf80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4'): ({'sdd'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-54200cc4-7638-4a14-b87f-9ab259c71e79 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Removing single pathed devices sdd {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[414bb713-5cbb-45e1-880c-85c4630bba74]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3e9bef-6afe-4ca6-a5ad-99b46d9b93b6]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-54200cc4-7638-4a14-b87f-9ab259c71e79 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Flushing IO for device /dev/sdd {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[07dff628-c637-491b-920d-ffba484d8a97]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-54200cc4-7638-4a14-b87f-9ab259c71e79 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.034s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4d973a-7443-40ac-917c-1afaf02c7b53]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-54200cc4-7638-4a14-b87f-9ab259c71e79 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-54200cc4-7638-4a14-b87f-9ab259c71e79 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] SCSI volumes sdd have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-54200cc4-7638-4a14-b87f-9ab259c71e79 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[48438e2f-006d-4c8a-b469-aa9d0bd830dc]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-54200cc4-7638-4a14-b87f-9ab259c71e79 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4 -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[496dc94c-f5f1-45b5-8e46-948f8d0e7bfa]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-54200cc4-7638-4a14-b87f-9ab259c71e79 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4, portal: 172.16.0.220,3260]
Nov 22 08:10:19 user nova-compute[74348]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4, portal: 172.16.0.220,3260] successful.
Nov 22 08:10:19 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4 -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e789ed04-af1a-4a31-bc0b-6ce47574dcb4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f5207b-6c9a-46b5-8941-de9dacc2f287]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-54200cc4-7638-4a14-b87f-9ab259c71e79 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-54200cc4-7638-4a14-b87f-9ab259c71e79 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-54200cc4-7638-4a14-b87f-9ab259c71e79 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] <== disconnect_volume: return (283ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:10:19 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54200cc4-7638-4a14-b87f-9ab259c71e79 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 08:10:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:10:20 user nova-compute[74348]: DEBUG nova.objects.instance [None req-54200cc4-7638-4a14-b87f-9ab259c71e79 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lazy-loading 'flavor' on Instance uuid b6698b0d-0d43-47ea-bcdc-d99201d9833c {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:10:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-54200cc4-7638-4a14-b87f-9ab259c71e79 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.673s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:10:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:10:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:10:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:10:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:10:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:10:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:10:26 user nova-compute[74348]: DEBUG nova.compute.manager [req-76519f9c-8255-48b0-861c-2b6a4d085333 req-a03cf9db-677d-4924-b00a-94037191c4d8 service nova] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Received event network-changed-2803cb98-f4d6-4f8e-879d-650a73f35141 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:10:26 user nova-compute[74348]: DEBUG nova.compute.manager [req-76519f9c-8255-48b0-861c-2b6a4d085333 req-a03cf9db-677d-4924-b00a-94037191c4d8 service nova] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Refreshing instance network info cache due to event network-changed-2803cb98-f4d6-4f8e-879d-650a73f35141. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:10:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-76519f9c-8255-48b0-861c-2b6a4d085333 req-a03cf9db-677d-4924-b00a-94037191c4d8 service nova] Acquiring lock "refresh_cache-3b0e2761-c6aa-45a5-980a-da40a415c8d0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:10:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-76519f9c-8255-48b0-861c-2b6a4d085333 req-a03cf9db-677d-4924-b00a-94037191c4d8 service nova] Acquired lock "refresh_cache-3b0e2761-c6aa-45a5-980a-da40a415c8d0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:10:26 user nova-compute[74348]: DEBUG nova.network.neutron [req-76519f9c-8255-48b0-861c-2b6a4d085333 req-a03cf9db-677d-4924-b00a-94037191c4d8 service nova] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Refreshing network info cache for port 2803cb98-f4d6-4f8e-879d-650a73f35141 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:10:27 user nova-compute[74348]: DEBUG nova.network.neutron [req-76519f9c-8255-48b0-861c-2b6a4d085333 req-a03cf9db-677d-4924-b00a-94037191c4d8 service nova] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Updated VIF entry in instance network info cache for port 2803cb98-f4d6-4f8e-879d-650a73f35141. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:10:27 user nova-compute[74348]: DEBUG nova.network.neutron [req-76519f9c-8255-48b0-861c-2b6a4d085333 req-a03cf9db-677d-4924-b00a-94037191c4d8 service nova] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Updating instance_info_cache with network_info: [{"id": "2803cb98-f4d6-4f8e-879d-650a73f35141", "address": "fa:16:3e:0e:ff:2e", "network": {"id": "70010ceb-a29f-4178-baca-95da22a59148", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1903564927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e26410148c64dfdaf46ebf656cbbd95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2803cb98-f4", "ovs_interfaceid": "2803cb98-f4d6-4f8e-879d-650a73f35141", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:10:27 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-76519f9c-8255-48b0-861c-2b6a4d085333 req-a03cf9db-677d-4924-b00a-94037191c4d8 service nova] Releasing lock "refresh_cache-3b0e2761-c6aa-45a5-980a-da40a415c8d0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:10:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:10:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Acquiring lock "3b0e2761-c6aa-45a5-980a-da40a415c8d0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:10:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Lock "3b0e2761-c6aa-45a5-980a-da40a415c8d0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:10:29 user nova-compute[74348]: DEBUG nova.objects.instance [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Lazy-loading 'flavor' on Instance uuid 3b0e2761-c6aa-45a5-980a-da40a415c8d0 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:10:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Lock "3b0e2761-c6aa-45a5-980a-da40a415c8d0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:10:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Acquiring lock "3b0e2761-c6aa-45a5-980a-da40a415c8d0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:10:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Lock "3b0e2761-c6aa-45a5-980a-da40a415c8d0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:10:29 user nova-compute[74348]: INFO nova.compute.manager [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Attaching volume 15437b61-c35c-4375-81eb-02b6f6939cdf to /dev/vdb
Nov 22 08:10:29 user nova-compute[74348]: DEBUG os_brick.utils [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:10:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:10:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:10:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef18b4f-9127-431a-8ba7-902e27380ed0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:10:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:10:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:10:30 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b518fa5-5624-42b0-b8bb-490e3df1d54f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:10:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:10:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:10:30 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1452e3b-d0aa-4c5a-a35f-91e1cfb205d0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:10:30 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf43c6b-053d-44ad-b724-18c55ee16fe5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:10:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:10:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:10:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 08:10:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:10:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:10:30 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 08:10:30 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[510985fc-cf6b-48ac-8be6-c94cd5d66e1a]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:10:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 08:10:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 08:10:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 08:10:30 user nova-compute[74348]: DEBUG os_brick.utils [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:10:30 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Updating existing volume attachment record: 5bbd34d8-4711-485c-b3cf-30c5562635ca {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 08:10:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:10:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:10:35 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KSZaQHGO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:10:36 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:10:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:10:36 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:10:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:10:36 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 08:10:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33c972e-45ea-47a0-afad-0c9e1acba0bb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 08:10:36 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69a5ae9-bff5-480f-8753-6f6c11765671]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf] added
Nov 22 08:10:36 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ce3911-8053-48cc-af8d-9ca113d1a6ae]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[537ce02c-9275-47fd-a262-f78216784753]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KSZaQHGO {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KSZaQHGO" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef52803f-61b1-4255-8d33-fc47db27a785]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KSZaQHGO'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc0035f-3356-41e2-91fc-769de1485b94]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b8dc31-18fe-43a1-98b7-90171dc068b0]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:10:36 user nova-compute[74348]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)
Nov 22 08:10:36 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:10:36 user nova-compute[74348]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)
Nov 22 08:10:36 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba3ca13-fa60-4b6d-84a8-d398321264c3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf, portal: 172.16.0.220,3260]
Nov 22 08:10:36 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf, portal: 172.16.0.220,3260] successful.
Nov 22 08:10:36 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a998c4-2282-4486-bc4e-eb7483eeae05]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c5d5aa-6ef0-4043-a13a-1f64ba94c0ed]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:10:36 user nova-compute[74348]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)
Nov 22 08:10:36 user nova-compute[74348]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf (non-flash)
Nov 22 08:10:36 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:10:36 user nova-compute[74348]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)
Nov 22 08:10:36 user nova-compute[74348]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf (non-flash)
Nov 22 08:10:36 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb84f92-e202-4d7c-947c-aa98ecb3f9eb]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:10:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KSZaQHGO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 08:10:37 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:10:37 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '26233393762316631', 'path': '/dev/sdd'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:10:37 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233393762316631', 'path': '/dev/sdd'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 08:10:37 user nova-compute[74348]: DEBUG nova.objects.instance [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Lazy-loading 'flavor' on Instance uuid 3b0e2761-c6aa-45a5-980a-da40a415c8d0 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:10:37 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 08:10:37 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:10:37 user nova-compute[74348]:   <source dev="/dev/sdd"/>
Nov 22 08:10:37 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:10:37 user nova-compute[74348]:   <serial>15437b61-c35c-4375-81eb-02b6f6939cdf</serial>
Nov 22 08:10:37 user nova-compute[74348]: </disk>
Nov 22 08:10:37 user nova-compute[74348]:  {{(pid=74348) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 08:10:37 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:10:37 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:10:37 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] No VIF found with MAC fa:16:3e:0e:ff:2e, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:10:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-dbc8272f-7ecc-4cac-ae0d-eab7e116892d tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Lock "3b0e2761-c6aa-45a5-980a-da40a415c8d0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.223s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:10:39 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:10:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-0faebb21-11bc-4cd6-b2f1-00586b8f5974 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Acquiring lock "3b0e2761-c6aa-45a5-980a-da40a415c8d0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:10:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-0faebb21-11bc-4cd6-b2f1-00586b8f5974 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Lock "3b0e2761-c6aa-45a5-980a-da40a415c8d0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:10:40 user nova-compute[74348]: INFO nova.compute.manager [None req-0faebb21-11bc-4cd6-b2f1-00586b8f5974 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Detaching volume 15437b61-c35c-4375-81eb-02b6f6939cdf
Nov 22 08:10:40 user nova-compute[74348]: INFO nova.virt.block_device [None req-0faebb21-11bc-4cd6-b2f1-00586b8f5974 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Attempting to driver detach volume 15437b61-c35c-4375-81eb-02b6f6939cdf from mountpoint /dev/vdb
Nov 22 08:10:40 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-0faebb21-11bc-4cd6-b2f1-00586b8f5974 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Attempting to detach device vdb from instance 3b0e2761-c6aa-45a5-980a-da40a415c8d0 from the persistent domain config. {{(pid=74348) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 08:10:40 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-0faebb21-11bc-4cd6-b2f1-00586b8f5974 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:10:40 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:10:40 user nova-compute[74348]:   <source dev="/dev/sdd"/>
Nov 22 08:10:40 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:10:40 user nova-compute[74348]:   <serial>15437b61-c35c-4375-81eb-02b6f6939cdf</serial>
Nov 22 08:10:40 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 08:10:40 user nova-compute[74348]: </disk>
Nov 22 08:10:40 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:10:40 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-0faebb21-11bc-4cd6-b2f1-00586b8f5974 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Successfully detached device vdb from instance 3b0e2761-c6aa-45a5-980a-da40a415c8d0 from the persistent domain config.
Nov 22 08:10:40 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-0faebb21-11bc-4cd6-b2f1-00586b8f5974 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3b0e2761-c6aa-45a5-980a-da40a415c8d0 from the live domain config. {{(pid=74348) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 08:10:40 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-0faebb21-11bc-4cd6-b2f1-00586b8f5974 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:10:40 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:10:40 user nova-compute[74348]:   <source dev="/dev/sdd"/>
Nov 22 08:10:40 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:10:40 user nova-compute[74348]:   <serial>15437b61-c35c-4375-81eb-02b6f6939cdf</serial>
Nov 22 08:10:40 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 08:10:40 user nova-compute[74348]: </disk>
Nov 22 08:10:40 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:10:40 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:10:40 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:10:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-ba74ca7d-2875-426c-a485-d908af865bae" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:10:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-ba74ca7d-2875-426c-a485-d908af865bae" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:10:40 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 08:10:40 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-0faebb21-11bc-4cd6-b2f1-00586b8f5974 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3b0e2761-c6aa-45a5-980a-da40a415c8d0 {{(pid=74348) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 08:10:40 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:10:40 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Updating instance_info_cache with network_info: [{"id": "674629a8-f3d5-41f1-a3d8-fbd957b97ad9", "address": "fa:16:3e:46:7e:d8", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap674629a8-f3", "ovs_interfaceid": "674629a8-f3d5-41f1-a3d8-fbd957b97ad9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:10:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-ba74ca7d-2875-426c-a485-d908af865bae" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:10:40 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 08:10:42 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:10:43 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:10:44 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:10:44 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:10:44 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:10:44 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:10:45 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:10:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:10:46 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:10:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:10:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:10:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:10:46 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:10:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:10:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:10:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:10:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:10:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:10:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:10:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:10:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:10:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:10:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6698b0d-0d43-47ea-bcdc-d99201d9833c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:10:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6698b0d-0d43-47ea-bcdc-d99201d9833c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:10:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6698b0d-0d43-47ea-bcdc-d99201d9833c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:10:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6698b0d-0d43-47ea-bcdc-d99201d9833c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:10:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:10:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:10:47 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:10:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:10:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:10:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:10:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:10:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:10:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:10:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:10:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:10:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:10:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:10:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:10:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:10:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:10:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:10:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:10:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:10:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:10:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:10:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:10:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0e2761-c6aa-45a5-980a-da40a415c8d0/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:10:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0e2761-c6aa-45a5-980a-da40a415c8d0/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:10:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0e2761-c6aa-45a5-980a-da40a415c8d0/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:10:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0e2761-c6aa-45a5-980a-da40a415c8d0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:10:50 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:10:50 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:10:50 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:10:50 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=7758MB free_disk=24.748031616210938GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:10:50 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:10:50 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:10:50 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:10:50 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 765f8c47-c042-4430-8d35-07926ad693fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:10:50 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance b8f84c0b-fab5-4900-bf65-270c9c06baf8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:10:50 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 37c93c2a-1397-4b04-aef1-5068218ad9fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:10:50 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 5006cff5-4b67-405d-b6b1-4c355f82d920 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:10:50 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 555f4246-d4b2-4f2f-b91c-dda8fe47264c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:10:50 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance ba74ca7d-2875-426c-a485-d908af865bae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:10:50 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance b6698b0d-0d43-47ea-bcdc-d99201d9833c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:10:50 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance b95b6cae-1885-43e8-b589-ee89854100a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:10:50 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 3b0e2761-c6aa-45a5-980a-da40a415c8d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:10:50 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance b998bedf-ee29-48a1-a14b-449add115c39 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:10:50 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:10:50 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:10:51 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:10:51 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:10:51 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:10:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.556s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:10:51 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:10:52 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:10:52 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:10:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c92d4a73-ef53-4a63-9d81-c83cb037df4f tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquiring lock "37c93c2a-1397-4b04-aef1-5068218ad9fd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:10:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c92d4a73-ef53-4a63-9d81-c83cb037df4f tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "37c93c2a-1397-4b04-aef1-5068218ad9fd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:10:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c92d4a73-ef53-4a63-9d81-c83cb037df4f tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquiring lock "37c93c2a-1397-4b04-aef1-5068218ad9fd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:10:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c92d4a73-ef53-4a63-9d81-c83cb037df4f tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "37c93c2a-1397-4b04-aef1-5068218ad9fd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:10:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c92d4a73-ef53-4a63-9d81-c83cb037df4f tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "37c93c2a-1397-4b04-aef1-5068218ad9fd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:10:53 user nova-compute[74348]: INFO nova.compute.manager [None req-c92d4a73-ef53-4a63-9d81-c83cb037df4f tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Terminating instance
Nov 22 08:10:53 user nova-compute[74348]: DEBUG nova.compute.manager [None req-c92d4a73-ef53-4a63-9d81-c83cb037df4f tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 08:10:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:10:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:10:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:10:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:10:54 user nova-compute[74348]: DEBUG nova.compute.manager [req-8e0f35c2-5910-40cf-b56a-da32b5d3e1ae req-e6c5f3f1-733a-4f97-b577-f7acf013a113 service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Received event network-vif-unplugged-acc2d56f-6884-403d-b2e5-2eb64c40047f {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:10:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-8e0f35c2-5910-40cf-b56a-da32b5d3e1ae req-e6c5f3f1-733a-4f97-b577-f7acf013a113 service nova] Acquiring lock "37c93c2a-1397-4b04-aef1-5068218ad9fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:10:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-8e0f35c2-5910-40cf-b56a-da32b5d3e1ae req-e6c5f3f1-733a-4f97-b577-f7acf013a113 service nova] Lock "37c93c2a-1397-4b04-aef1-5068218ad9fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:10:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-8e0f35c2-5910-40cf-b56a-da32b5d3e1ae req-e6c5f3f1-733a-4f97-b577-f7acf013a113 service nova] Lock "37c93c2a-1397-4b04-aef1-5068218ad9fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:10:54 user nova-compute[74348]: DEBUG nova.compute.manager [req-8e0f35c2-5910-40cf-b56a-da32b5d3e1ae req-e6c5f3f1-733a-4f97-b577-f7acf013a113 service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] No waiting events found dispatching network-vif-unplugged-acc2d56f-6884-403d-b2e5-2eb64c40047f {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:10:54 user nova-compute[74348]: DEBUG nova.compute.manager [req-8e0f35c2-5910-40cf-b56a-da32b5d3e1ae req-e6c5f3f1-733a-4f97-b577-f7acf013a113 service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Received event network-vif-unplugged-acc2d56f-6884-403d-b2e5-2eb64c40047f for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 08:10:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:10:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:10:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:10:54 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Instance destroyed successfully.
Nov 22 08:10:54 user nova-compute[74348]: DEBUG nova.objects.instance [None req-c92d4a73-ef53-4a63-9d81-c83cb037df4f tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lazy-loading 'resources' on Instance uuid 37c93c2a-1397-4b04-aef1-5068218ad9fd {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:10:54 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-c92d4a73-ef53-4a63-9d81-c83cb037df4f tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:00:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1956019398',display_name='tempest-AttachVolumeTestJSON-server-1956019398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1956019398',id=25,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwMcyh7MC6umn3uaanqgBLVw0olRPhsYeJZiuWM01oPuW2lMJM3v/uqqmw2CyNdCKwv23YM7ilvhBeMmJnwDV2ZnrEjaT/V3wGmEnZHbCJZSu5Yo+sT9JeBTaahsZul6Q==',key_name='tempest-keypair-1490397787',keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:01:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2d1a2eb68ef4c0aa5ef081fe10877a9',ramdisk_id='',reservation_id='r-37qth7ay',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-608656879',owner_user_name='tempest-AttachVolumeTestJSON-608656879-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T08:09:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae8c7082420f4b85a9009ff82296d8cb',uuid=37c93c2a-1397-4b04-aef1-5068218ad9fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "address": "fa:16:3e:62:f2:83", "network": {"id": "606a7c22-1285-47e8-bfa0-f09dbd7cb9ac", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-63336037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d1a2eb68ef4c0aa5ef081fe10877a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc2d56f-68", "ovs_interfaceid": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:10:54 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-c92d4a73-ef53-4a63-9d81-c83cb037df4f tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Converting VIF {"id": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "address": "fa:16:3e:62:f2:83", "network": {"id": "606a7c22-1285-47e8-bfa0-f09dbd7cb9ac", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-63336037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d1a2eb68ef4c0aa5ef081fe10877a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc2d56f-68", "ovs_interfaceid": "acc2d56f-6884-403d-b2e5-2eb64c40047f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:10:54 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-c92d4a73-ef53-4a63-9d81-c83cb037df4f tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:f2:83,bridge_name='br-int',has_traffic_filtering=True,id=acc2d56f-6884-403d-b2e5-2eb64c40047f,network=Network(606a7c22-1285-47e8-bfa0-f09dbd7cb9ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc2d56f-68') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:10:54 user nova-compute[74348]: DEBUG os_vif [None req-c92d4a73-ef53-4a63-9d81-c83cb037df4f tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:f2:83,bridge_name='br-int',has_traffic_filtering=True,id=acc2d56f-6884-403d-b2e5-2eb64c40047f,network=Network(606a7c22-1285-47e8-bfa0-f09dbd7cb9ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc2d56f-68') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:10:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:10:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapacc2d56f-68, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:10:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:10:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:10:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:10:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d5269483-5fdc-4a6c-804e-c3391988a670) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:10:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:10:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:10:54 user nova-compute[74348]: INFO os_vif [None req-c92d4a73-ef53-4a63-9d81-c83cb037df4f tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:f2:83,bridge_name='br-int',has_traffic_filtering=True,id=acc2d56f-6884-403d-b2e5-2eb64c40047f,network=Network(606a7c22-1285-47e8-bfa0-f09dbd7cb9ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc2d56f-68')
Nov 22 08:10:54 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-c92d4a73-ef53-4a63-9d81-c83cb037df4f tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Deleting instance files /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd_del
Nov 22 08:10:54 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-c92d4a73-ef53-4a63-9d81-c83cb037df4f tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Deletion of /opt/stack/data/nova/instances/37c93c2a-1397-4b04-aef1-5068218ad9fd_del complete
Nov 22 08:10:55 user nova-compute[74348]: INFO nova.compute.manager [None req-c92d4a73-ef53-4a63-9d81-c83cb037df4f tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Took 1.09 seconds to destroy the instance on the hypervisor.
Nov 22 08:10:55 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-c92d4a73-ef53-4a63-9d81-c83cb037df4f tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 08:10:55 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 08:10:55 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 08:10:55 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:10:55 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Took 0.89 seconds to deallocate network for instance.
Nov 22 08:10:55 user nova-compute[74348]: DEBUG nova.compute.manager [req-9a7c7384-5d93-43b6-8d24-dfa6bb568f6c req-41a2cd7f-39e9-4f49-97f4-f907b7e5eaf7 service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Received event network-vif-deleted-acc2d56f-6884-403d-b2e5-2eb64c40047f {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:10:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c92d4a73-ef53-4a63-9d81-c83cb037df4f tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:10:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c92d4a73-ef53-4a63-9d81-c83cb037df4f tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:10:56 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-c92d4a73-ef53-4a63-9d81-c83cb037df4f tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:10:56 user nova-compute[74348]: DEBUG nova.compute.manager [req-55ef18e8-319f-4d50-93d2-523c2e11213c req-06a2bef2-e725-430b-81fc-e573b71a5809 service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Received event network-vif-plugged-acc2d56f-6884-403d-b2e5-2eb64c40047f {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:10:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-55ef18e8-319f-4d50-93d2-523c2e11213c req-06a2bef2-e725-430b-81fc-e573b71a5809 service nova] Acquiring lock "37c93c2a-1397-4b04-aef1-5068218ad9fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:10:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-55ef18e8-319f-4d50-93d2-523c2e11213c req-06a2bef2-e725-430b-81fc-e573b71a5809 service nova] Lock "37c93c2a-1397-4b04-aef1-5068218ad9fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:10:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-55ef18e8-319f-4d50-93d2-523c2e11213c req-06a2bef2-e725-430b-81fc-e573b71a5809 service nova] Lock "37c93c2a-1397-4b04-aef1-5068218ad9fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:10:56 user nova-compute[74348]: DEBUG nova.compute.manager [req-55ef18e8-319f-4d50-93d2-523c2e11213c req-06a2bef2-e725-430b-81fc-e573b71a5809 service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] No waiting events found dispatching network-vif-plugged-acc2d56f-6884-403d-b2e5-2eb64c40047f {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:10:56 user nova-compute[74348]: WARNING nova.compute.manager [req-55ef18e8-319f-4d50-93d2-523c2e11213c req-06a2bef2-e725-430b-81fc-e573b71a5809 service nova] [instance: 37c93c2a-1397-4b04-aef1-5068218ad9fd] Received unexpected event network-vif-plugged-acc2d56f-6884-403d-b2e5-2eb64c40047f for instance with vm_state deleted and task_state None.
Nov 22 08:10:56 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-c92d4a73-ef53-4a63-9d81-c83cb037df4f tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:10:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c92d4a73-ef53-4a63-9d81-c83cb037df4f tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:10:56 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-c92d4a73-ef53-4a63-9d81-c83cb037df4f tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Deleted allocations for instance 37c93c2a-1397-4b04-aef1-5068218ad9fd
Nov 22 08:10:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c92d4a73-ef53-4a63-9d81-c83cb037df4f tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "37c93c2a-1397-4b04-aef1-5068218ad9fd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.644s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:10:59 user nova-compute[74348]: INFO nova.compute.manager [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Rescuing
Nov 22 08:10:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "refresh_cache-b998bedf-ee29-48a1-a14b-449add115c39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:10:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquired lock "refresh_cache-b998bedf-ee29-48a1-a14b-449add115c39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:10:59 user nova-compute[74348]: DEBUG nova.network.neutron [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:10:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:10:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:10:59 user nova-compute[74348]: DEBUG nova.network.neutron [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Updating instance_info_cache with network_info: [{"id": "ee377706-a70f-4d29-96be-4d56daedb95a", "address": "fa:16:3e:a1:2b:05", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee377706-a7", "ovs_interfaceid": "ee377706-a70f-4d29-96be-4d56daedb95a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:10:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Releasing lock "refresh_cache-b998bedf-ee29-48a1-a14b-449add115c39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG nova.compute.manager [req-511dba11-a0ac-45f9-98b9-3d5906f1df4f req-97a2b9a1-7f25-4da4-aa3f-b2b230bcaf36 service nova] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Received event network-vif-unplugged-ee377706-a70f-4d29-96be-4d56daedb95a {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-511dba11-a0ac-45f9-98b9-3d5906f1df4f req-97a2b9a1-7f25-4da4-aa3f-b2b230bcaf36 service nova] Acquiring lock "b998bedf-ee29-48a1-a14b-449add115c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-511dba11-a0ac-45f9-98b9-3d5906f1df4f req-97a2b9a1-7f25-4da4-aa3f-b2b230bcaf36 service nova] Lock "b998bedf-ee29-48a1-a14b-449add115c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-511dba11-a0ac-45f9-98b9-3d5906f1df4f req-97a2b9a1-7f25-4da4-aa3f-b2b230bcaf36 service nova] Lock "b998bedf-ee29-48a1-a14b-449add115c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG nova.compute.manager [req-511dba11-a0ac-45f9-98b9-3d5906f1df4f req-97a2b9a1-7f25-4da4-aa3f-b2b230bcaf36 service nova] [instance: b998bedf-ee29-48a1-a14b-449add115c39] No waiting events found dispatching network-vif-unplugged-ee377706-a70f-4d29-96be-4d56daedb95a {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:11:00 user nova-compute[74348]: WARNING nova.compute.manager [req-511dba11-a0ac-45f9-98b9-3d5906f1df4f req-97a2b9a1-7f25-4da4-aa3f-b2b230bcaf36 service nova] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Received unexpected event network-vif-unplugged-ee377706-a70f-4d29-96be-4d56daedb95a for instance with vm_state active and task_state rescuing.
Nov 22 08:11:00 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:00 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-0faebb21-11bc-4cd6-b2f1-00586b8f5974 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3b0e2761-c6aa-45a5-980a-da40a415c8d0 is timed out.
Nov 22 08:11:00 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-0faebb21-11bc-4cd6-b2f1-00586b8f5974 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Successfully detached device vdb from instance 3b0e2761-c6aa-45a5-980a-da40a415c8d0 from the live domain config.
Nov 22 08:11:00 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0faebb21-11bc-4cd6-b2f1-00586b8f5974 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0faebb21-11bc-4cd6-b2f1-00586b8f5974 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KSZaQHGO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:11:00 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-0faebb21-11bc-4cd6-b2f1-00586b8f5974 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:11:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-0faebb21-11bc-4cd6-b2f1-00586b8f5974 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-0faebb21-11bc-4cd6-b2f1-00586b8f5974 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ac9e96-282a-41f9-8438-1c1cc81ab71b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0faebb21-11bc-4cd6-b2f1-00586b8f5974 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 08:11:00 user nova-compute[74348]: No targets found.
Nov 22 08:11:00 user nova-compute[74348]: iSNS:
Nov 22 08:11:00 user nova-compute[74348]: No targets found.
Nov 22 08:11:00 user nova-compute[74348]: STATIC:
Nov 22 08:11:00 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf
Nov 22 08:11:00 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:11:00 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:11:00 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8
Nov 22 08:11:00 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:11:00 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:11:00 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336
Nov 22 08:11:00 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:11:00 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:11:00 user nova-compute[74348]: FIRMWARE:
Nov 22 08:11:00 user nova-compute[74348]: No targets found.
Nov 22 08:11:00 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0faebb21-11bc-4cd6-b2f1-00586b8f5974 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 08:11:00 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 08:11:00 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0faebb21-11bc-4cd6-b2f1-00586b8f5974 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[db312c0b-6276-4e6b-9357-dbd6af08332e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e335345e-9636-4550-8f56-5569215e9533]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0faebb21-11bc-4cd6-b2f1-00586b8f5974 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:11:00 user nova-compute[74348]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)
Nov 22 08:11:00 user nova-compute[74348]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf (non-flash)
Nov 22 08:11:00 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0faebb21-11bc-4cd6-b2f1-00586b8f5974 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:11:00 user nova-compute[74348]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)
Nov 22 08:11:00 user nova-compute[74348]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf (non-flash)
Nov 22 08:11:00 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0faebb21-11bc-4cd6-b2f1-00586b8f5974 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f22285beb00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf'): ({'sdd'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-0faebb21-11bc-4cd6-b2f1-00586b8f5974 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Removing single pathed devices sdd {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[bede3134-c4aa-40dd-9700-a053ad2d6d08]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f924887c-501b-49e6-ba40-44a99fc31d0a]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-0faebb21-11bc-4cd6-b2f1-00586b8f5974 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Flushing IO for device /dev/sdd {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb2321d-a562-4442-a500-9540503025a6]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-0faebb21-11bc-4cd6-b2f1-00586b8f5974 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2393dd65-56aa-4f41-be70-8a53f7d26300]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-0faebb21-11bc-4cd6-b2f1-00586b8f5974 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-0faebb21-11bc-4cd6-b2f1-00586b8f5974 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] SCSI volumes sdd have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0faebb21-11bc-4cd6-b2f1-00586b8f5974 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:00 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Instance destroyed successfully.
Nov 22 08:11:00 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Attempting a stable device rescue
Nov 22 08:11:00 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[819af4cc-64ba-493b-9ff2-a15646de5173]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0faebb21-11bc-4cd6-b2f1-00586b8f5974 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:11:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:01 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74348) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 22 08:11:01 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Instance directory exists: not creating {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 22 08:11:01 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Creating image(s)
Nov 22 08:11:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "/opt/stack/data/nova/instances/b998bedf-ee29-48a1-a14b-449add115c39/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:11:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "/opt/stack/data/nova/instances/b998bedf-ee29-48a1-a14b-449add115c39/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:11:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "/opt/stack/data/nova/instances/b998bedf-ee29-48a1-a14b-449add115c39/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:11:01 user nova-compute[74348]: DEBUG nova.objects.instance [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lazy-loading 'trusted_certs' on Instance uuid b998bedf-ee29-48a1-a14b-449add115c39 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:11:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:01 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28ddc38-e853-4d0c-92fd-067490051635]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:11:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0faebb21-11bc-4cd6-b2f1-00586b8f5974 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf, portal: 172.16.0.220,3260]
Nov 22 08:11:01 user nova-compute[74348]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf, portal: 172.16.0.220,3260] successful.
Nov 22 08:11:01 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:11:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "6745adfa35c492ddbf81ca32efdb81eeb7ca9e1a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:11:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "6745adfa35c492ddbf81ca32efdb81eeb7ca9e1a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:11:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15437b61-c35c-4375-81eb-02b6f6939cdf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:01 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[139ac4e8-9b96-4b70-af0b-61d45edc82c5]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:11:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0faebb21-11bc-4cd6-b2f1-00586b8f5974 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:11:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-0faebb21-11bc-4cd6-b2f1-00586b8f5974 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:11:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0faebb21-11bc-4cd6-b2f1-00586b8f5974 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] <== disconnect_volume: return (374ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:11:01 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0faebb21-11bc-4cd6-b2f1-00586b8f5974 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 08:11:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6745adfa35c492ddbf81ca32efdb81eeb7ca9e1a.part --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:02 user nova-compute[74348]: DEBUG nova.objects.instance [None req-0faebb21-11bc-4cd6-b2f1-00586b8f5974 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Lazy-loading 'flavor' on Instance uuid 3b0e2761-c6aa-45a5-980a-da40a415c8d0 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:11:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-0faebb21-11bc-4cd6-b2f1-00586b8f5974 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Lock "3b0e2761-c6aa-45a5-980a-da40a415c8d0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.250s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:11:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6745adfa35c492ddbf81ca32efdb81eeb7ca9e1a.part --force-share --output=json" returned: 0 in 0.193s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:02 user nova-compute[74348]: DEBUG nova.virt.images [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] 915fe43e-0ad2-4daf-8a78-0e8b1fb533be was qcow2, converting to raw {{(pid=74348) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 22 08:11:02 user nova-compute[74348]: DEBUG nova.privsep.utils [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74348) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 08:11:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6745adfa35c492ddbf81ca32efdb81eeb7ca9e1a.part /opt/stack/data/nova/instances/_base/6745adfa35c492ddbf81ca32efdb81eeb7ca9e1a.converted {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:02 user nova-compute[74348]: DEBUG nova.compute.manager [req-75583635-8028-4b51-807f-75c995375f88 req-6e4276e6-59d3-4476-aad6-90a830e7a5bf service nova] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Received event network-vif-plugged-ee377706-a70f-4d29-96be-4d56daedb95a {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:11:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-75583635-8028-4b51-807f-75c995375f88 req-6e4276e6-59d3-4476-aad6-90a830e7a5bf service nova] Acquiring lock "b998bedf-ee29-48a1-a14b-449add115c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:11:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-75583635-8028-4b51-807f-75c995375f88 req-6e4276e6-59d3-4476-aad6-90a830e7a5bf service nova] Lock "b998bedf-ee29-48a1-a14b-449add115c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:11:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-75583635-8028-4b51-807f-75c995375f88 req-6e4276e6-59d3-4476-aad6-90a830e7a5bf service nova] Lock "b998bedf-ee29-48a1-a14b-449add115c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:11:02 user nova-compute[74348]: DEBUG nova.compute.manager [req-75583635-8028-4b51-807f-75c995375f88 req-6e4276e6-59d3-4476-aad6-90a830e7a5bf service nova] [instance: b998bedf-ee29-48a1-a14b-449add115c39] No waiting events found dispatching network-vif-plugged-ee377706-a70f-4d29-96be-4d56daedb95a {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:11:02 user nova-compute[74348]: WARNING nova.compute.manager [req-75583635-8028-4b51-807f-75c995375f88 req-6e4276e6-59d3-4476-aad6-90a830e7a5bf service nova] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Received unexpected event network-vif-plugged-ee377706-a70f-4d29-96be-4d56daedb95a for instance with vm_state active and task_state rescuing.
Nov 22 08:11:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6745adfa35c492ddbf81ca32efdb81eeb7ca9e1a.part /opt/stack/data/nova/instances/_base/6745adfa35c492ddbf81ca32efdb81eeb7ca9e1a.converted" returned: 0 in 0.679s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6745adfa35c492ddbf81ca32efdb81eeb7ca9e1a.converted --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6745adfa35c492ddbf81ca32efdb81eeb7ca9e1a.converted --force-share --output=json" returned: 0 in 0.176s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "6745adfa35c492ddbf81ca32efdb81eeb7ca9e1a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.261s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "6745adfa35c492ddbf81ca32efdb81eeb7ca9e1a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "6745adfa35c492ddbf81ca32efdb81eeb7ca9e1a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6745adfa35c492ddbf81ca32efdb81eeb7ca9e1a --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6745adfa35c492ddbf81ca32efdb81eeb7ca9e1a --force-share --output=json" returned: 0 in 0.183s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6745adfa35c492ddbf81ca32efdb81eeb7ca9e1a,backing_fmt=raw /opt/stack/data/nova/instances/b998bedf-ee29-48a1-a14b-449add115c39/disk.rescue {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6745adfa35c492ddbf81ca32efdb81eeb7ca9e1a,backing_fmt=raw /opt/stack/data/nova/instances/b998bedf-ee29-48a1-a14b-449add115c39/disk.rescue" returned: 0 in 0.047s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "6745adfa35c492ddbf81ca32efdb81eeb7ca9e1a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG nova.objects.instance [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lazy-loading 'migration_context' on Instance uuid b998bedf-ee29-48a1-a14b-449add115c39 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG nova.objects.base [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Object Instance<b998bedf-ee29-48a1-a14b-449add115c39> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Start _get_guest_xml network_info=[{"id": "ee377706-a70f-4d29-96be-4d56daedb95a", "address": "fa:16:3e:a1:2b:05", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "vif_mac": "fa:16:3e:a1:2b:05"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee377706-a7", "ovs_interfaceid": "ee377706-a70f-4d29-96be-4d56daedb95a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '915fe43e-0ad2-4daf-8a78-0e8b1fb533be', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LlaMmJwv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'b998bedf-ee29-48a1-a14b-449add115c39', 'attached_at': '', 'detached_at': '', 'volume_id': 'd5b8e56f-87c3-4657-991f-ad58f3089336', 'serial': 'd5b8e56f-87c3-4657-991f-ad58f3089336'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '3dfb79e2-d372-4cc9-95ce-b586f87acce2', 'volume_type': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG nova.objects.instance [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lazy-loading 'resources' on Instance uuid b998bedf-ee29-48a1-a14b-449add115c39 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG nova.objects.base [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Object Instance<b998bedf-ee29-48a1-a14b-449add115c39> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG nova.objects.instance [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lazy-loading 'numa_topology' on Instance uuid b998bedf-ee29-48a1-a14b-449add115c39 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG nova.objects.base [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Object Instance<b998bedf-ee29-48a1-a14b-449add115c39> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:11:03 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:11:03 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:11:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG nova.objects.instance [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lazy-loading 'vcpu_model' on Instance uuid b998bedf-ee29-48a1-a14b-449add115c39 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG nova.objects.base [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Object Instance<b998bedf-ee29-48a1-a14b-449add115c39> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LlaMmJwv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:11:03 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:11:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:11:03 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:11:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:11:03 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 08:11:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae7199d-715f-4432-b842-00778d9963b4]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = LlaMmJwv\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 22 08:11:03 user nova-compute[74348]: node.name = iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336
Nov 22 08:11:03 user nova-compute[74348]: node.tpgt = -1
Nov 22 08:11:03 user nova-compute[74348]: node.startup = automatic
Nov 22 08:11:03 user nova-compute[74348]: node.leading_login = No
Nov 22 08:11:03 user nova-compute[74348]: iface.iscsi_ifacename = default
Nov 22 08:11:03 user nova-compute[74348]: iface.net_ifacename = <empty>
Nov 22 08:11:03 user nova-compute[74348]: iface.ipaddress = <empty>
Nov 22 08:11:03 user nova-compute[74348]: iface.prefix_len = 0
Nov 22 08:11:03 user nova-compute[74348]: iface.hwaddress = <empty>
Nov 22 08:11:03 user nova-compute[74348]: iface.transport_name = tcp
Nov 22 08:11:03 user nova-compute[74348]: iface.initiatorname = <empty>
Nov 22 08:11:03 user nova-compute[74348]: iface.state = <empty>
Nov 22 08:11:03 user nova-compute[74348]: iface.vlan_id = 0
Nov 22 08:11:03 user nova-compute[74348]: iface.vlan_priority = 0
Nov 22 08:11:03 user nova-compute[74348]: iface.vlan_state = <empty>
Nov 22 08:11:03 user nova-compute[74348]: iface.iface_num = 0
Nov 22 08:11:03 user nova-compute[74348]: iface.mtu = 0
Nov 22 08:11:03 user nova-compute[74348]: iface.port = 0
Nov 22 08:11:03 user nova-compute[74348]: iface.bootproto = <empty>
Nov 22 08:11:03 user nova-compute[74348]: iface.subnet_mask = <empty>
Nov 22 08:11:03 user nova-compute[74348]: iface.gateway = <empty>
Nov 22 08:11:03 user nova-compute[74348]: iface.dhcp_alt_client_id_state = <empty>
Nov 22 08:11:03 user nova-compute[74348]: iface.dhcp_alt_client_id = <empty>
Nov 22 08:11:03 user nova-compute[74348]: iface.dhcp_dns = <empty>
Nov 22 08:11:03 user nova-compute[74348]: iface.dhcp_learn_iqn = <empty>
Nov 22 08:11:03 user nova-compute[74348]: iface.dhcp_req_vendor_id_state = <empty>
Nov 22 08:11:03 user nova-compute[74348]: iface.dhcp_vendor_id_state = <empty>
Nov 22 08:11:03 user nova-compute[74348]: iface.dhcp_vendor_id = <empty>
Nov 22 08:11:03 user nova-compute[74348]: iface.dhcp_slp_da = <empty>
Nov 22 08:11:03 user nova-compute[74348]: iface.fragmentation = <empty>
Nov 22 08:11:03 user nova-compute[74348]: iface.gratuitous_arp = <empty>
Nov 22 08:11:03 user nova-compute[74348]: iface.incoming_forwarding = <empty>
Nov 22 08:11:03 user nova-compute[74348]: iface.tos_state = <empty>
Nov 22 08:11:03 user nova-compute[74348]: iface.tos = 0
Nov 22 08:11:03 user nova-compute[74348]: iface.ttl = 0
Nov 22 08:11:03 user nova-compute[74348]: iface.delayed_ack = <empty>
Nov 22 08:11:03 user nova-compute[74348]: iface.tcp_nagle = <empty>
Nov 22 08:11:03 user nova-compute[74348]: iface.tcp_wsf_state = <empty>
Nov 22 08:11:03 user nova-compute[74348]: iface.tcp_wsf = 0
Nov 22 08:11:03 user nova-compute[74348]: iface.tcp_timer_scale = 0
Nov 22 08:11:03 user nova-compute[74348]: iface.tcp_timestamp = <empty>
Nov 22 08:11:03 user nova-compute[74348]: iface.redirect = <empty>
Nov 22 08:11:03 user nova-compute[74348]: iface.def_task_mgmt_timeout = 0
Nov 22 08:11:03 user nova-compute[74348]: iface.header_digest = <empty>
Nov 22 08:11:03 user nova-compute[74348]: iface.data_digest = <empty>
Nov 22 08:11:03 user nova-compute[74348]: iface.immediate_data = <empty>
Nov 22 08:11:03 user nova-compute[74348]: iface.initial_r2t = <empty>
Nov 22 08:11:03 user nova-compute[74348]: iface.data_seq_inorder = <empty>
Nov 22 08:11:03 user nova-compute[74348]: iface.data_pdu_inorder = <empty>
Nov 22 08:11:03 user nova-compute[74348]: iface.erl = 0
Nov 22 08:11:03 user nova-compute[74348]: iface.max_receive_data_len = 0
Nov 22 08:11:03 user nova-compute[74348]: iface.first_burst_len = 0
Nov 22 08:11:03 user nova-compute[74348]: iface.max_outstanding_r2t = 0
Nov 22 08:11:03 user nova-compute[74348]: iface.max_burst_len = 0
Nov 22 08:11:03 user nova-compute[74348]: iface.chap_auth = <empty>
Nov 22 08:11:03 user nova-compute[74348]: iface.bidi_chap = <empty>
Nov 22 08:11:03 user nova-compute[74348]: iface.strict_login_compliance = <empty>
Nov 22 08:11:03 user nova-compute[74348]: iface.discovery_auth = <empty>
Nov 22 08:11:03 user nova-compute[74348]: iface.discovery_logout = <empty>
Nov 22 08:11:03 user nova-compute[74348]: node.discovery_address = <empty>
Nov 22 08:11:03 user nova-compute[74348]: node.discovery_port = 0
Nov 22 08:11:03 user nova-compute[74348]: node.discovery_type = static
Nov 22 08:11:03 user nova-compute[74348]: node.session.initial_cmdsn = 0
Nov 22 08:11:03 user nova-compute[74348]: node.session.initial_login_retry_max = 8
Nov 22 08:11:03 user nova-compute[74348]: node.session.xmit_thread_priority = -20
Nov 22 08:11:03 user nova-compute[74348]: node.session.cmds_max = 128
Nov 22 08:11:03 user nova-compute[74348]: node.session.queue_depth = 32
Nov 22 08:11:03 user nova-compute[74348]: node.session.nr_sessions = 1
Nov 22 08:11:03 user nova-compute[74348]: node.session.auth.authmethod = CHAP
Nov 22 08:11:03 user nova-compute[74348]: node.session.auth.username = LlaMmJwv
Nov 22 08:11:03 user nova-compute[74348]: node.session.auth.password = ***
Nov 22 08:11:03 user nova-compute[74348]: node.session.auth.username_in = <empty>
Nov 22 08:11:03 user nova-compute[74348]: node.session.auth.password_in = <empty>
Nov 22 08:11:03 user nova-compute[74348]: node.session.auth.chap_algs = MD5
Nov 22 08:11:03 user nova-compute[74348]: node.session.timeo.replacement_timeout = 120
Nov 22 08:11:03 user nova-compute[74348]: node.session.err_timeo.abort_timeout = 15
Nov 22 08:11:03 user nova-compute[74348]: node.session.err_timeo.lu_reset_timeout = 30
Nov 22 08:11:03 user nova-compute[74348]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 22 08:11:03 user nova-compute[74348]: node.session.err_timeo.host_reset_timeout = 60
Nov 22 08:11:03 user nova-compute[74348]: node.session.iscsi.FastAbort = Yes
Nov 22 08:11:03 user nova-compute[74348]: node.session.iscsi.InitialR2T = No
Nov 22 08:11:03 user nova-compute[74348]: node.session.iscsi.ImmediateData = Yes
Nov 22 08:11:03 user nova-compute[74348]: node.session.iscsi.FirstBurstLength = 262144
Nov 22 08:11:03 user nova-compute[74348]: node.session.iscsi.MaxBurstLength = 16776192
Nov 22 08:11:03 user nova-compute[74348]: node.session.iscsi.DefaultTime2Retain = 0
Nov 22 08:11:03 user nova-compute[74348]: node.session.iscsi.DefaultTime2Wait = 2
Nov 22 08:11:03 user nova-compute[74348]: node.session.iscsi.MaxConnections = 1
Nov 22 08:11:03 user nova-compute[74348]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 22 08:11:03 user nova-compute[74348]: node.session.iscsi.ERL = 0
Nov 22 08:11:03 user nova-compute[74348]: node.session.scan = manual
Nov 22 08:11:03 user nova-compute[74348]: node.session.reopen_max = 0
Nov 22 08:11:03 user nova-compute[74348]: node.conn[0].address = 172.16.0.220
Nov 22 08:11:03 user nova-compute[74348]: node.conn[0].port = 3260
Nov 22 08:11:03 user nova-compute[74348]: node.conn[0].startup = manual
Nov 22 08:11:03 user nova-compute[74348]: node.conn[0].tcp.window_size = 524288
Nov 22 08:11:03 user nova-compute[74348]: node.conn[0].tcp.type_of_service = 0
Nov 22 08:11:03 user nova-compute[74348]: node.conn[0].timeo.logout_timeout = 15
Nov 22 08:11:03 user nova-compute[74348]: node.conn[0].timeo.login_timeout = 15
Nov 22 08:11:03 user nova-compute[74348]: node.conn[0].timeo.auth_timeout = 45
Nov 22 08:11:03 user nova-compute[74348]: node.conn[0].timeo.noop_out_interval = 5
Nov 22 08:11:03 user nova-compute[74348]: node.conn[0].timeo.noop_out_timeout = 5
Nov 22 08:11:03 user nova-compute[74348]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 22 08:11:03 user nova-compute[74348]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 22 08:11:03 user nova-compute[74348]: node.conn[0].iscsi.HeaderDigest = None
Nov 22 08:11:03 user nova-compute[74348]: node.conn[0].iscsi.DataDigest = None
Nov 22 08:11:03 user nova-compute[74348]: node.conn[0].iscsi.IFMarker = No
Nov 22 08:11:03 user nova-compute[74348]: node.conn[0].iscsi.OFMarker = No
Nov 22 08:11:03 user nova-compute[74348]: # END RECORD
Nov 22 08:11:03 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35fb130-cd91-4f68-9183-f645449c80c4]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1a3f6c-820f-4f44-bacc-fd8f0d4c580c]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LlaMmJwv {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LlaMmJwv" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6136528-0803-402c-bc85-497dbf8a4f30]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LlaMmJwv'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[92590140-9858-4b45-9410-b9087409652c]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[106559e9-793b-4888-b518-ce718a0848a8]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:11:03 user nova-compute[74348]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)
Nov 22 08:11:03 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:11:03 user nova-compute[74348]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)
Nov 22 08:11:03 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.138s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] HCTL ('34', '0', '0', 0) found on session 43 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.013s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[73545cb1-4f54-4a5f-9e31-041c07810305]: (4, ('0 0 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Searching for a device in session 43 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LlaMmJwv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.159s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] <== connect_volume: return (160ms) {'type': 'block', 'scsi_wwn': '26565623135353531', 'path': '/dev/sdc'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565623135353531', 'path': '/dev/sdc'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:09:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2080387933',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2080387933',id=38,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:09:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a31d898cdc69494a8825e8d93a0d04bc',ramdisk_id='',reservation_id='r-ra0klnf9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-502521972',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:09:28Z,user_data=None,user_id='1d5c8274eca14965b6cbfe22110f904d',uuid=b998bedf-ee29-48a1-a14b-449add115c39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee377706-a70f-4d29-96be-4d56daedb95a", "address": "fa:16:3e:a1:2b:05", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "vif_mac": "fa:16:3e:a1:2b:05"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee377706-a7", "ovs_interfaceid": "ee377706-a70f-4d29-96be-4d56daedb95a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Converting VIF {"id": "ee377706-a70f-4d29-96be-4d56daedb95a", "address": "fa:16:3e:a1:2b:05", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "vif_mac": "fa:16:3e:a1:2b:05"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee377706-a7", "ovs_interfaceid": "ee377706-a70f-4d29-96be-4d56daedb95a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:2b:05,bridge_name='br-int',has_traffic_filtering=True,id=ee377706-a70f-4d29-96be-4d56daedb95a,network=Network(6fe60468-191c-4d84-8dce-55c056f88936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee377706-a7') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG nova.objects.instance [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lazy-loading 'pci_devices' on Instance uuid b998bedf-ee29-48a1-a14b-449add115c39 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG nova.objects.base [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Object Instance<b998bedf-ee29-48a1-a14b-449add115c39> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] End _get_guest_xml xml=<domain type="kvm">
Nov 22 08:11:03 user nova-compute[74348]:   <uuid>b998bedf-ee29-48a1-a14b-449add115c39</uuid>
Nov 22 08:11:03 user nova-compute[74348]:   <name>instance-00000026</name>
Nov 22 08:11:03 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 08:11:03 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 08:11:03 user nova-compute[74348]:   <metadata>
Nov 22 08:11:03 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 08:11:03 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 08:11:03 user nova-compute[74348]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2080387933</nova:name>
Nov 22 08:11:03 user nova-compute[74348]:       <nova:creationTime>2023-11-22 08:11:03</nova:creationTime>
Nov 22 08:11:03 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 08:11:03 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 08:11:03 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 08:11:03 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 08:11:03 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 08:11:03 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 08:11:03 user nova-compute[74348]:       </nova:flavor>
Nov 22 08:11:03 user nova-compute[74348]:       <nova:owner>
Nov 22 08:11:03 user nova-compute[74348]:         <nova:user uuid="1d5c8274eca14965b6cbfe22110f904d">tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member</nova:user>
Nov 22 08:11:03 user nova-compute[74348]:         <nova:project uuid="a31d898cdc69494a8825e8d93a0d04bc">tempest-ServerBootFromVolumeStableRescueTest-502521972</nova:project>
Nov 22 08:11:03 user nova-compute[74348]:       </nova:owner>
Nov 22 08:11:03 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 08:11:03 user nova-compute[74348]:       <nova:ports>
Nov 22 08:11:03 user nova-compute[74348]:         <nova:port uuid="ee377706-a70f-4d29-96be-4d56daedb95a">
Nov 22 08:11:03 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 22 08:11:03 user nova-compute[74348]:         </nova:port>
Nov 22 08:11:03 user nova-compute[74348]:       </nova:ports>
Nov 22 08:11:03 user nova-compute[74348]:     </nova:instance>
Nov 22 08:11:03 user nova-compute[74348]:   </metadata>
Nov 22 08:11:03 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 08:11:03 user nova-compute[74348]:     <system>
Nov 22 08:11:03 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 08:11:03 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 08:11:03 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 08:11:03 user nova-compute[74348]:       <entry name="serial">b998bedf-ee29-48a1-a14b-449add115c39</entry>
Nov 22 08:11:03 user nova-compute[74348]:       <entry name="uuid">b998bedf-ee29-48a1-a14b-449add115c39</entry>
Nov 22 08:11:03 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 08:11:03 user nova-compute[74348]:     </system>
Nov 22 08:11:03 user nova-compute[74348]:   </sysinfo>
Nov 22 08:11:03 user nova-compute[74348]:   <os>
Nov 22 08:11:03 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 08:11:03 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 08:11:03 user nova-compute[74348]:   </os>
Nov 22 08:11:03 user nova-compute[74348]:   <features>
Nov 22 08:11:03 user nova-compute[74348]:     <acpi/>
Nov 22 08:11:03 user nova-compute[74348]:     <apic/>
Nov 22 08:11:03 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 08:11:03 user nova-compute[74348]:   </features>
Nov 22 08:11:03 user nova-compute[74348]:   <clock offset="utc">
Nov 22 08:11:03 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 08:11:03 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 08:11:03 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 08:11:03 user nova-compute[74348]:   </clock>
Nov 22 08:11:03 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 08:11:03 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 08:11:03 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 08:11:03 user nova-compute[74348]:   </cpu>
Nov 22 08:11:03 user nova-compute[74348]:   <devices>
Nov 22 08:11:03 user nova-compute[74348]:     <disk type="block" device="disk">
Nov 22 08:11:03 user nova-compute[74348]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:11:03 user nova-compute[74348]:       <source dev="/dev/sdc"/>
Nov 22 08:11:03 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 08:11:03 user nova-compute[74348]:       <serial>d5b8e56f-87c3-4657-991f-ad58f3089336</serial>
Nov 22 08:11:03 user nova-compute[74348]:     </disk>
Nov 22 08:11:03 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 08:11:03 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 08:11:03 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/b998bedf-ee29-48a1-a14b-449add115c39/disk.rescue"/>
Nov 22 08:11:03 user nova-compute[74348]:       <target dev="vdb" bus="virtio"/>
Nov 22 08:11:03 user nova-compute[74348]:       <boot order="1"/>
Nov 22 08:11:03 user nova-compute[74348]:     </disk>
Nov 22 08:11:03 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 08:11:03 user nova-compute[74348]:       <mac address="fa:16:3e:a1:2b:05"/>
Nov 22 08:11:03 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:11:03 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 08:11:03 user nova-compute[74348]:       <target dev="tapee377706-a7"/>
Nov 22 08:11:03 user nova-compute[74348]:     </interface>
Nov 22 08:11:03 user nova-compute[74348]:     <serial type="pty">
Nov 22 08:11:03 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/b998bedf-ee29-48a1-a14b-449add115c39/console.log" append="off"/>
Nov 22 08:11:03 user nova-compute[74348]:     </serial>
Nov 22 08:11:03 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 08:11:03 user nova-compute[74348]:     <video>
Nov 22 08:11:03 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:11:03 user nova-compute[74348]:     </video>
Nov 22 08:11:03 user nova-compute[74348]:     <rng model="virtio">
Nov 22 08:11:03 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 08:11:03 user nova-compute[74348]:     </rng>
Nov 22 08:11:03 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 08:11:03 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 08:11:03 user nova-compute[74348]:       <stats period="10"/>
Nov 22 08:11:03 user nova-compute[74348]:     </memballoon>
Nov 22 08:11:03 user nova-compute[74348]:   </devices>
Nov 22 08:11:03 user nova-compute[74348]: </domain>
Nov 22 08:11:03 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 08:11:03 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Instance destroyed successfully.
Nov 22 08:11:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:11:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] No VIF found with MAC fa:16:3e:a1:2b:05, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:11:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:05 user nova-compute[74348]: DEBUG nova.compute.manager [req-be57c40c-0b8c-4d4c-ad3b-7a0f602d9124 req-8d7f2863-4bcf-4355-99df-9f93a0df26f6 service nova] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Received event network-vif-plugged-ee377706-a70f-4d29-96be-4d56daedb95a {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:11:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-be57c40c-0b8c-4d4c-ad3b-7a0f602d9124 req-8d7f2863-4bcf-4355-99df-9f93a0df26f6 service nova] Acquiring lock "b998bedf-ee29-48a1-a14b-449add115c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:11:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-be57c40c-0b8c-4d4c-ad3b-7a0f602d9124 req-8d7f2863-4bcf-4355-99df-9f93a0df26f6 service nova] Lock "b998bedf-ee29-48a1-a14b-449add115c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:11:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-be57c40c-0b8c-4d4c-ad3b-7a0f602d9124 req-8d7f2863-4bcf-4355-99df-9f93a0df26f6 service nova] Lock "b998bedf-ee29-48a1-a14b-449add115c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:11:05 user nova-compute[74348]: DEBUG nova.compute.manager [req-be57c40c-0b8c-4d4c-ad3b-7a0f602d9124 req-8d7f2863-4bcf-4355-99df-9f93a0df26f6 service nova] [instance: b998bedf-ee29-48a1-a14b-449add115c39] No waiting events found dispatching network-vif-plugged-ee377706-a70f-4d29-96be-4d56daedb95a {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:11:05 user nova-compute[74348]: WARNING nova.compute.manager [req-be57c40c-0b8c-4d4c-ad3b-7a0f602d9124 req-8d7f2863-4bcf-4355-99df-9f93a0df26f6 service nova] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Received unexpected event network-vif-plugged-ee377706-a70f-4d29-96be-4d56daedb95a for instance with vm_state active and task_state rescuing.
Nov 22 08:11:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:07 user nova-compute[74348]: DEBUG nova.compute.manager [req-1cc675a6-bcaf-4281-a6a7-21a4509b2da9 req-098ea671-b467-4074-ac3c-df8c1e32525c service nova] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Received event network-vif-plugged-ee377706-a70f-4d29-96be-4d56daedb95a {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:11:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-1cc675a6-bcaf-4281-a6a7-21a4509b2da9 req-098ea671-b467-4074-ac3c-df8c1e32525c service nova] Acquiring lock "b998bedf-ee29-48a1-a14b-449add115c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:11:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-1cc675a6-bcaf-4281-a6a7-21a4509b2da9 req-098ea671-b467-4074-ac3c-df8c1e32525c service nova] Lock "b998bedf-ee29-48a1-a14b-449add115c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:11:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-1cc675a6-bcaf-4281-a6a7-21a4509b2da9 req-098ea671-b467-4074-ac3c-df8c1e32525c service nova] Lock "b998bedf-ee29-48a1-a14b-449add115c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:11:07 user nova-compute[74348]: DEBUG nova.compute.manager [req-1cc675a6-bcaf-4281-a6a7-21a4509b2da9 req-098ea671-b467-4074-ac3c-df8c1e32525c service nova] [instance: b998bedf-ee29-48a1-a14b-449add115c39] No waiting events found dispatching network-vif-plugged-ee377706-a70f-4d29-96be-4d56daedb95a {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:11:07 user nova-compute[74348]: WARNING nova.compute.manager [req-1cc675a6-bcaf-4281-a6a7-21a4509b2da9 req-098ea671-b467-4074-ac3c-df8c1e32525c service nova] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Received unexpected event network-vif-plugged-ee377706-a70f-4d29-96be-4d56daedb95a for instance with vm_state active and task_state rescuing.
Nov 22 08:11:07 user nova-compute[74348]: DEBUG nova.compute.manager [None req-66c3ebe3-bc18-47bc-a26b-a35150c9df5a tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:11:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-02ffd886-66fa-45fd-8a67-16ee2d54c1f7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Acquiring lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:11:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-02ffd886-66fa-45fd-8a67-16ee2d54c1f7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:11:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-02ffd886-66fa-45fd-8a67-16ee2d54c1f7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Acquiring lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:11:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-02ffd886-66fa-45fd-8a67-16ee2d54c1f7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:11:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-02ffd886-66fa-45fd-8a67-16ee2d54c1f7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:11:13 user nova-compute[74348]: INFO nova.compute.manager [None req-02ffd886-66fa-45fd-8a67-16ee2d54c1f7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Terminating instance
Nov 22 08:11:13 user nova-compute[74348]: DEBUG nova.compute.manager [None req-02ffd886-66fa-45fd-8a67-16ee2d54c1f7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 08:11:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:13 user nova-compute[74348]: DEBUG nova.compute.manager [req-b742e288-01c1-45b7-a982-de1828dc4dd1 req-f2fa770d-b07a-4ebd-90c7-72cb4638c200 service nova] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Received event network-vif-unplugged-011479b6-f8d6-48e2-b215-789b56c4a2ad {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:11:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b742e288-01c1-45b7-a982-de1828dc4dd1 req-f2fa770d-b07a-4ebd-90c7-72cb4638c200 service nova] Acquiring lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:11:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b742e288-01c1-45b7-a982-de1828dc4dd1 req-f2fa770d-b07a-4ebd-90c7-72cb4638c200 service nova] Lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:11:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b742e288-01c1-45b7-a982-de1828dc4dd1 req-f2fa770d-b07a-4ebd-90c7-72cb4638c200 service nova] Lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:11:13 user nova-compute[74348]: DEBUG nova.compute.manager [req-b742e288-01c1-45b7-a982-de1828dc4dd1 req-f2fa770d-b07a-4ebd-90c7-72cb4638c200 service nova] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] No waiting events found dispatching network-vif-unplugged-011479b6-f8d6-48e2-b215-789b56c4a2ad {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:11:13 user nova-compute[74348]: DEBUG nova.compute.manager [req-b742e288-01c1-45b7-a982-de1828dc4dd1 req-f2fa770d-b07a-4ebd-90c7-72cb4638c200 service nova] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Received event network-vif-unplugged-011479b6-f8d6-48e2-b215-789b56c4a2ad for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 08:11:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:14 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Instance destroyed successfully.
Nov 22 08:11:14 user nova-compute[74348]: DEBUG nova.objects.instance [None req-02ffd886-66fa-45fd-8a67-16ee2d54c1f7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lazy-loading 'resources' on Instance uuid b6698b0d-0d43-47ea-bcdc-d99201d9833c {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:11:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-02ffd886-66fa-45fd-8a67-16ee2d54c1f7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:04:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-711501342',display_name='tempest-SnapshotDataIntegrityTests-server-711501342',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-711501342',id=32,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0UjRmrA11QF4OQL93dB+Swt9DFhVmUV4oNe6sLciKg1lbVfwOUMKh93Lnql5l725RnlXExRVHEhDTh4+G322cxaRnCRl4TzvIvjwqvrLgmQM8wSUyLDirVw6X7pdXwng==',key_name='tempest-keypair-1991121525',keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:04:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ba09a4f903c4c49909926e9114be418',ramdisk_id='',reservation_id='r-htxlgo9q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-572539985',owner_user_name='tempest-SnapshotDataIntegrityTests-572539985-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T08:04:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='08d86660380d4099badacce7e6e0cff7',uuid=b6698b0d-0d43-47ea-bcdc-d99201d9833c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "011479b6-f8d6-48e2-b215-789b56c4a2ad", "address": "fa:16:3e:d2:53:6d", "network": {"id": "19a6226e-acc6-4a08-8157-d6651b1f0362", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-53573870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba09a4f903c4c49909926e9114be418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap011479b6-f8", "ovs_interfaceid": "011479b6-f8d6-48e2-b215-789b56c4a2ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:11:14 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-02ffd886-66fa-45fd-8a67-16ee2d54c1f7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Converting VIF {"id": "011479b6-f8d6-48e2-b215-789b56c4a2ad", "address": "fa:16:3e:d2:53:6d", "network": {"id": "19a6226e-acc6-4a08-8157-d6651b1f0362", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-53573870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba09a4f903c4c49909926e9114be418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap011479b6-f8", "ovs_interfaceid": "011479b6-f8d6-48e2-b215-789b56c4a2ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:11:14 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-02ffd886-66fa-45fd-8a67-16ee2d54c1f7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:53:6d,bridge_name='br-int',has_traffic_filtering=True,id=011479b6-f8d6-48e2-b215-789b56c4a2ad,network=Network(19a6226e-acc6-4a08-8157-d6651b1f0362),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap011479b6-f8') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:11:14 user nova-compute[74348]: DEBUG os_vif [None req-02ffd886-66fa-45fd-8a67-16ee2d54c1f7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:53:6d,bridge_name='br-int',has_traffic_filtering=True,id=011479b6-f8d6-48e2-b215-789b56c4a2ad,network=Network(19a6226e-acc6-4a08-8157-d6651b1f0362),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap011479b6-f8') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:11:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap011479b6-f8, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:11:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:11:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1a3f32f8-f4ae-4cef-92e6-35722cad7823) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:11:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:14 user nova-compute[74348]: INFO os_vif [None req-02ffd886-66fa-45fd-8a67-16ee2d54c1f7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:53:6d,bridge_name='br-int',has_traffic_filtering=True,id=011479b6-f8d6-48e2-b215-789b56c4a2ad,network=Network(19a6226e-acc6-4a08-8157-d6651b1f0362),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap011479b6-f8')
Nov 22 08:11:14 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-02ffd886-66fa-45fd-8a67-16ee2d54c1f7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Deleting instance files /opt/stack/data/nova/instances/b6698b0d-0d43-47ea-bcdc-d99201d9833c_del
Nov 22 08:11:14 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-02ffd886-66fa-45fd-8a67-16ee2d54c1f7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Deletion of /opt/stack/data/nova/instances/b6698b0d-0d43-47ea-bcdc-d99201d9833c_del complete
Nov 22 08:11:14 user nova-compute[74348]: INFO nova.compute.manager [None req-02ffd886-66fa-45fd-8a67-16ee2d54c1f7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 22 08:11:14 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-02ffd886-66fa-45fd-8a67-16ee2d54c1f7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 08:11:14 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 08:11:14 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 08:11:15 user nova-compute[74348]: DEBUG nova.compute.manager [req-509a4f3c-dafb-4b61-b5a3-8fffe6397059 req-5b4b4f5b-4bc0-4be1-b5be-f76af2a6fdd8 service nova] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Received event network-vif-deleted-011479b6-f8d6-48e2-b215-789b56c4a2ad {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:11:15 user nova-compute[74348]: INFO nova.compute.manager [req-509a4f3c-dafb-4b61-b5a3-8fffe6397059 req-5b4b4f5b-4bc0-4be1-b5be-f76af2a6fdd8 service nova] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Neutron deleted interface 011479b6-f8d6-48e2-b215-789b56c4a2ad; detaching it from the instance and deleting it from the info cache
Nov 22 08:11:15 user nova-compute[74348]: DEBUG nova.network.neutron [req-509a4f3c-dafb-4b61-b5a3-8fffe6397059 req-5b4b4f5b-4bc0-4be1-b5be-f76af2a6fdd8 service nova] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:11:15 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:11:15 user nova-compute[74348]: DEBUG nova.compute.manager [req-509a4f3c-dafb-4b61-b5a3-8fffe6397059 req-5b4b4f5b-4bc0-4be1-b5be-f76af2a6fdd8 service nova] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Detach interface failed, port_id=011479b6-f8d6-48e2-b215-789b56c4a2ad, reason: Instance b6698b0d-0d43-47ea-bcdc-d99201d9833c could not be found. {{(pid=74348) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 08:11:15 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Took 1.22 seconds to deallocate network for instance.
Nov 22 08:11:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-02ffd886-66fa-45fd-8a67-16ee2d54c1f7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:11:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-02ffd886-66fa-45fd-8a67-16ee2d54c1f7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:11:15 user nova-compute[74348]: DEBUG nova.compute.manager [req-30283d79-c04f-40cd-8f79-fe40204d7531 req-71142796-d1d3-4949-87ba-7fdbbf6c37e0 service nova] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Received event network-vif-plugged-011479b6-f8d6-48e2-b215-789b56c4a2ad {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:11:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-30283d79-c04f-40cd-8f79-fe40204d7531 req-71142796-d1d3-4949-87ba-7fdbbf6c37e0 service nova] Acquiring lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:11:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-30283d79-c04f-40cd-8f79-fe40204d7531 req-71142796-d1d3-4949-87ba-7fdbbf6c37e0 service nova] Lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:11:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-30283d79-c04f-40cd-8f79-fe40204d7531 req-71142796-d1d3-4949-87ba-7fdbbf6c37e0 service nova] Lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:11:15 user nova-compute[74348]: DEBUG nova.compute.manager [req-30283d79-c04f-40cd-8f79-fe40204d7531 req-71142796-d1d3-4949-87ba-7fdbbf6c37e0 service nova] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] No waiting events found dispatching network-vif-plugged-011479b6-f8d6-48e2-b215-789b56c4a2ad {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:11:15 user nova-compute[74348]: WARNING nova.compute.manager [req-30283d79-c04f-40cd-8f79-fe40204d7531 req-71142796-d1d3-4949-87ba-7fdbbf6c37e0 service nova] [instance: b6698b0d-0d43-47ea-bcdc-d99201d9833c] Received unexpected event network-vif-plugged-011479b6-f8d6-48e2-b215-789b56c4a2ad for instance with vm_state deleted and task_state None.
Nov 22 08:11:15 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-02ffd886-66fa-45fd-8a67-16ee2d54c1f7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:11:15 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-02ffd886-66fa-45fd-8a67-16ee2d54c1f7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:11:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-02ffd886-66fa-45fd-8a67-16ee2d54c1f7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:11:15 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-02ffd886-66fa-45fd-8a67-16ee2d54c1f7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Deleted allocations for instance b6698b0d-0d43-47ea-bcdc-d99201d9833c
Nov 22 08:11:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-02ffd886-66fa-45fd-8a67-16ee2d54c1f7 tempest-SnapshotDataIntegrityTests-572539985 tempest-SnapshotDataIntegrityTests-572539985-project-member] Lock "b6698b0d-0d43-47ea-bcdc-d99201d9833c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.778s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:11:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquiring lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:11:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:11:16 user nova-compute[74348]: DEBUG nova.compute.manager [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 08:11:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:11:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:11:16 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 08:11:16 user nova-compute[74348]: INFO nova.compute.claims [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Claim successful on node user
Nov 22 08:11:16 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:11:16 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:11:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.499s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:11:17 user nova-compute[74348]: DEBUG nova.compute.manager [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 08:11:17 user nova-compute[74348]: DEBUG nova.compute.manager [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 08:11:17 user nova-compute[74348]: DEBUG nova.network.neutron [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 08:11:17 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 08:11:17 user nova-compute[74348]: DEBUG nova.compute.manager [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 08:11:17 user nova-compute[74348]: DEBUG nova.policy [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0b3c6587d0764b9fae5782792aec5d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d975b772fea4ed98b1b3ad284e51a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 08:11:17 user nova-compute[74348]: DEBUG nova.compute.manager [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 08:11:17 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 08:11:17 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Creating image(s)
Nov 22 08:11:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquiring lock "/opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:11:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "/opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:11:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "/opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:11:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.252s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquiring lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:11:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:11:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.185s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0/disk 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0/disk 1073741824" returned: 0 in 0.053s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:11:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:17 user nova-compute[74348]: DEBUG nova.network.neutron [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Successfully created port: 2b0fc463-3743-41e4-9846-ee4dc53689f4 {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 08:11:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.176s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:17 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0/disk. size=1073741824 {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 08:11:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Cannot resize image /opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0/disk to a smaller size. {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Ensure instance console log exists: /opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG nova.network.neutron [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Successfully updated port: 2b0fc463-3743-41e4-9846-ee4dc53689f4 {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquiring lock "refresh_cache-5c3f6262-19cf-41dd-bc6c-bdb006eb58a0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquired lock "refresh_cache-5c3f6262-19cf-41dd-bc6c-bdb006eb58a0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG nova.network.neutron [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG nova.compute.manager [req-789a712c-752d-4d1e-a09a-3a784b4aeffd req-66a1a852-684a-40b4-a21f-9f32d516d9fc service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Received event network-changed-2b0fc463-3743-41e4-9846-ee4dc53689f4 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG nova.compute.manager [req-789a712c-752d-4d1e-a09a-3a784b4aeffd req-66a1a852-684a-40b4-a21f-9f32d516d9fc service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Refreshing instance network info cache due to event network-changed-2b0fc463-3743-41e4-9846-ee4dc53689f4. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-789a712c-752d-4d1e-a09a-3a784b4aeffd req-66a1a852-684a-40b4-a21f-9f32d516d9fc service nova] Acquiring lock "refresh_cache-5c3f6262-19cf-41dd-bc6c-bdb006eb58a0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG nova.network.neutron [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG nova.network.neutron [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Updating instance_info_cache with network_info: [{"id": "2b0fc463-3743-41e4-9846-ee4dc53689f4", "address": "fa:16:3e:f9:d6:30", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0fc463-37", "ovs_interfaceid": "2b0fc463-3743-41e4-9846-ee4dc53689f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Releasing lock "refresh_cache-5c3f6262-19cf-41dd-bc6c-bdb006eb58a0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG nova.compute.manager [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Instance network_info: |[{"id": "2b0fc463-3743-41e4-9846-ee4dc53689f4", "address": "fa:16:3e:f9:d6:30", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0fc463-37", "ovs_interfaceid": "2b0fc463-3743-41e4-9846-ee4dc53689f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-789a712c-752d-4d1e-a09a-3a784b4aeffd req-66a1a852-684a-40b4-a21f-9f32d516d9fc service nova] Acquired lock "refresh_cache-5c3f6262-19cf-41dd-bc6c-bdb006eb58a0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG nova.network.neutron [req-789a712c-752d-4d1e-a09a-3a784b4aeffd req-66a1a852-684a-40b4-a21f-9f32d516d9fc service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Refreshing network info cache for port 2b0fc463-3743-41e4-9846-ee4dc53689f4 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Start _get_guest_xml network_info=[{"id": "2b0fc463-3743-41e4-9846-ee4dc53689f4", "address": "fa:16:3e:f9:d6:30", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0fc463-37", "ovs_interfaceid": "2b0fc463-3743-41e4-9846-ee4dc53689f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 08:11:18 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:11:18 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:11:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:11:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-408142113',display_name='tempest-ServerRescueNegativeTestJSON-server-408142113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-408142113',id=39,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTdFy9xJMY+tkSnPoKIcYDCTRFY7lXZyCDzt1jEfugDen4Y9Eg9lFwO8VHH6D0hbVNRZWrLT0z8c4BxzMBaNJFSTjxYBMTbpIsDK8ziRltd2xcFzudVT5cjnyNXosH5qQ==',key_name='tempest-keypair-1362649951',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d975b772fea4ed98b1b3ad284e51a65',ramdisk_id='',reservation_id='r-g0d4c2q4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1773499839',owner_user_name='tempest-ServerRescueNegativeTestJSON-1773499839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:11:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b3c6587d0764b9fae5782792aec5d92',uuid=5c3f6262-19cf-41dd-bc6c-bdb006eb58a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b0fc463-3743-41e4-9846-ee4dc53689f4", "address": "fa:16:3e:f9:d6:30", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0fc463-37", "ovs_interfaceid": "2b0fc463-3743-41e4-9846-ee4dc53689f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Converting VIF {"id": "2b0fc463-3743-41e4-9846-ee4dc53689f4", "address": "fa:16:3e:f9:d6:30", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0fc463-37", "ovs_interfaceid": "2b0fc463-3743-41e4-9846-ee4dc53689f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:d6:30,bridge_name='br-int',has_traffic_filtering=True,id=2b0fc463-3743-41e4-9846-ee4dc53689f4,network=Network(246d8f55-a1eb-4883-906c-69f15289caef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b0fc463-37') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG nova.objects.instance [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lazy-loading 'pci_devices' on Instance uuid 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] End _get_guest_xml xml=<domain type="kvm">
Nov 22 08:11:18 user nova-compute[74348]:   <uuid>5c3f6262-19cf-41dd-bc6c-bdb006eb58a0</uuid>
Nov 22 08:11:18 user nova-compute[74348]:   <name>instance-00000027</name>
Nov 22 08:11:18 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 08:11:18 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 08:11:18 user nova-compute[74348]:   <metadata>
Nov 22 08:11:18 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 08:11:18 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 08:11:18 user nova-compute[74348]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-408142113</nova:name>
Nov 22 08:11:18 user nova-compute[74348]:       <nova:creationTime>2023-11-22 08:11:18</nova:creationTime>
Nov 22 08:11:18 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 08:11:18 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 08:11:18 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 08:11:18 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 08:11:18 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 08:11:18 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 08:11:18 user nova-compute[74348]:       </nova:flavor>
Nov 22 08:11:18 user nova-compute[74348]:       <nova:owner>
Nov 22 08:11:18 user nova-compute[74348]:         <nova:user uuid="0b3c6587d0764b9fae5782792aec5d92">tempest-ServerRescueNegativeTestJSON-1773499839-project-member</nova:user>
Nov 22 08:11:18 user nova-compute[74348]:         <nova:project uuid="5d975b772fea4ed98b1b3ad284e51a65">tempest-ServerRescueNegativeTestJSON-1773499839</nova:project>
Nov 22 08:11:18 user nova-compute[74348]:       </nova:owner>
Nov 22 08:11:18 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 08:11:18 user nova-compute[74348]:       <nova:ports>
Nov 22 08:11:18 user nova-compute[74348]:         <nova:port uuid="2b0fc463-3743-41e4-9846-ee4dc53689f4">
Nov 22 08:11:18 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 22 08:11:18 user nova-compute[74348]:         </nova:port>
Nov 22 08:11:18 user nova-compute[74348]:       </nova:ports>
Nov 22 08:11:18 user nova-compute[74348]:     </nova:instance>
Nov 22 08:11:18 user nova-compute[74348]:   </metadata>
Nov 22 08:11:18 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 08:11:18 user nova-compute[74348]:     <system>
Nov 22 08:11:18 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 08:11:18 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 08:11:18 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 08:11:18 user nova-compute[74348]:       <entry name="serial">5c3f6262-19cf-41dd-bc6c-bdb006eb58a0</entry>
Nov 22 08:11:18 user nova-compute[74348]:       <entry name="uuid">5c3f6262-19cf-41dd-bc6c-bdb006eb58a0</entry>
Nov 22 08:11:18 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 08:11:18 user nova-compute[74348]:     </system>
Nov 22 08:11:18 user nova-compute[74348]:   </sysinfo>
Nov 22 08:11:18 user nova-compute[74348]:   <os>
Nov 22 08:11:18 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 08:11:18 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 08:11:18 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 08:11:18 user nova-compute[74348]:   </os>
Nov 22 08:11:18 user nova-compute[74348]:   <features>
Nov 22 08:11:18 user nova-compute[74348]:     <acpi/>
Nov 22 08:11:18 user nova-compute[74348]:     <apic/>
Nov 22 08:11:18 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 08:11:18 user nova-compute[74348]:   </features>
Nov 22 08:11:18 user nova-compute[74348]:   <clock offset="utc">
Nov 22 08:11:18 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 08:11:18 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 08:11:18 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 08:11:18 user nova-compute[74348]:   </clock>
Nov 22 08:11:18 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 08:11:18 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 08:11:18 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 08:11:18 user nova-compute[74348]:   </cpu>
Nov 22 08:11:18 user nova-compute[74348]:   <devices>
Nov 22 08:11:18 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 08:11:18 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 08:11:18 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0/disk"/>
Nov 22 08:11:18 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 08:11:18 user nova-compute[74348]:     </disk>
Nov 22 08:11:18 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 08:11:18 user nova-compute[74348]:       <mac address="fa:16:3e:f9:d6:30"/>
Nov 22 08:11:18 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:11:18 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 08:11:18 user nova-compute[74348]:       <target dev="tap2b0fc463-37"/>
Nov 22 08:11:18 user nova-compute[74348]:     </interface>
Nov 22 08:11:18 user nova-compute[74348]:     <serial type="pty">
Nov 22 08:11:18 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0/console.log" append="off"/>
Nov 22 08:11:18 user nova-compute[74348]:     </serial>
Nov 22 08:11:18 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 08:11:18 user nova-compute[74348]:     <video>
Nov 22 08:11:18 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:11:18 user nova-compute[74348]:     </video>
Nov 22 08:11:18 user nova-compute[74348]:     <rng model="virtio">
Nov 22 08:11:18 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 08:11:18 user nova-compute[74348]:     </rng>
Nov 22 08:11:18 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 08:11:18 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 08:11:18 user nova-compute[74348]:       <stats period="10"/>
Nov 22 08:11:18 user nova-compute[74348]:     </memballoon>
Nov 22 08:11:18 user nova-compute[74348]:   </devices>
Nov 22 08:11:18 user nova-compute[74348]: </domain>
Nov 22 08:11:18 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:11:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-408142113',display_name='tempest-ServerRescueNegativeTestJSON-server-408142113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-408142113',id=39,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTdFy9xJMY+tkSnPoKIcYDCTRFY7lXZyCDzt1jEfugDen4Y9Eg9lFwO8VHH6D0hbVNRZWrLT0z8c4BxzMBaNJFSTjxYBMTbpIsDK8ziRltd2xcFzudVT5cjnyNXosH5qQ==',key_name='tempest-keypair-1362649951',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d975b772fea4ed98b1b3ad284e51a65',ramdisk_id='',reservation_id='r-g0d4c2q4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1773499839',owner_user_name='tempest-ServerRescueNegativeTestJSON-1773499839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:11:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b3c6587d0764b9fae5782792aec5d92',uuid=5c3f6262-19cf-41dd-bc6c-bdb006eb58a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b0fc463-3743-41e4-9846-ee4dc53689f4", "address": "fa:16:3e:f9:d6:30", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0fc463-37", "ovs_interfaceid": "2b0fc463-3743-41e4-9846-ee4dc53689f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Converting VIF {"id": "2b0fc463-3743-41e4-9846-ee4dc53689f4", "address": "fa:16:3e:f9:d6:30", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0fc463-37", "ovs_interfaceid": "2b0fc463-3743-41e4-9846-ee4dc53689f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:d6:30,bridge_name='br-int',has_traffic_filtering=True,id=2b0fc463-3743-41e4-9846-ee4dc53689f4,network=Network(246d8f55-a1eb-4883-906c-69f15289caef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b0fc463-37') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG os_vif [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:d6:30,bridge_name='br-int',has_traffic_filtering=True,id=2b0fc463-3743-41e4-9846-ee4dc53689f4,network=Network(246d8f55-a1eb-4883-906c-69f15289caef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b0fc463-37') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '57c10b33-29dc-5d47-b296-826d3ce55ba6', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b0fc463-37, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2b0fc463-37, col_values=(('qos', UUID('b43a6de6-de5c-4ec1-bc8b-71f099d7fe0d')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2b0fc463-37, col_values=(('external_ids', {'iface-id': '2b0fc463-3743-41e4-9846-ee4dc53689f4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:d6:30', 'vm-uuid': '5c3f6262-19cf-41dd-bc6c-bdb006eb58a0'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:18 user nova-compute[74348]: INFO os_vif [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:d6:30,bridge_name='br-int',has_traffic_filtering=True,id=2b0fc463-3743-41e4-9846-ee4dc53689f4,network=Network(246d8f55-a1eb-4883-906c-69f15289caef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b0fc463-37')
Nov 22 08:11:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:11:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] No VIF found with MAC fa:16:3e:f9:d6:30, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:11:19 user nova-compute[74348]: DEBUG nova.network.neutron [req-789a712c-752d-4d1e-a09a-3a784b4aeffd req-66a1a852-684a-40b4-a21f-9f32d516d9fc service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Updated VIF entry in instance network info cache for port 2b0fc463-3743-41e4-9846-ee4dc53689f4. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:11:19 user nova-compute[74348]: DEBUG nova.network.neutron [req-789a712c-752d-4d1e-a09a-3a784b4aeffd req-66a1a852-684a-40b4-a21f-9f32d516d9fc service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Updating instance_info_cache with network_info: [{"id": "2b0fc463-3743-41e4-9846-ee4dc53689f4", "address": "fa:16:3e:f9:d6:30", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0fc463-37", "ovs_interfaceid": "2b0fc463-3743-41e4-9846-ee4dc53689f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:11:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-789a712c-752d-4d1e-a09a-3a784b4aeffd req-66a1a852-684a-40b4-a21f-9f32d516d9fc service nova] Releasing lock "refresh_cache-5c3f6262-19cf-41dd-bc6c-bdb006eb58a0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:11:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:20 user nova-compute[74348]: DEBUG nova.compute.manager [req-f5ea4b31-ed5f-4409-ac20-0d410f1b5923 req-3f94d2e1-4854-4dba-bd39-85c9995f680e service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Received event network-vif-plugged-2b0fc463-3743-41e4-9846-ee4dc53689f4 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:11:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f5ea4b31-ed5f-4409-ac20-0d410f1b5923 req-3f94d2e1-4854-4dba-bd39-85c9995f680e service nova] Acquiring lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:11:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f5ea4b31-ed5f-4409-ac20-0d410f1b5923 req-3f94d2e1-4854-4dba-bd39-85c9995f680e service nova] Lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:11:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f5ea4b31-ed5f-4409-ac20-0d410f1b5923 req-3f94d2e1-4854-4dba-bd39-85c9995f680e service nova] Lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:11:20 user nova-compute[74348]: DEBUG nova.compute.manager [req-f5ea4b31-ed5f-4409-ac20-0d410f1b5923 req-3f94d2e1-4854-4dba-bd39-85c9995f680e service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] No waiting events found dispatching network-vif-plugged-2b0fc463-3743-41e4-9846-ee4dc53689f4 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:11:20 user nova-compute[74348]: WARNING nova.compute.manager [req-f5ea4b31-ed5f-4409-ac20-0d410f1b5923 req-3f94d2e1-4854-4dba-bd39-85c9995f680e service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Received unexpected event network-vif-plugged-2b0fc463-3743-41e4-9846-ee4dc53689f4 for instance with vm_state building and task_state spawning.
Nov 22 08:11:22 user nova-compute[74348]: DEBUG nova.compute.manager [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 08:11:22 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 08:11:22 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Instance spawned successfully.
Nov 22 08:11:22 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 08:11:22 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:11:22 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:11:22 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:11:22 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:11:22 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:11:22 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:11:22 user nova-compute[74348]: DEBUG nova.compute.manager [req-10dcf29b-7e22-454c-bd42-82c0c04b9e88 req-fbfe9d54-8e2a-4bdb-bdeb-c6a3eacc957b service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Received event network-vif-plugged-2b0fc463-3743-41e4-9846-ee4dc53689f4 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:11:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-10dcf29b-7e22-454c-bd42-82c0c04b9e88 req-fbfe9d54-8e2a-4bdb-bdeb-c6a3eacc957b service nova] Acquiring lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:11:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-10dcf29b-7e22-454c-bd42-82c0c04b9e88 req-fbfe9d54-8e2a-4bdb-bdeb-c6a3eacc957b service nova] Lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:11:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-10dcf29b-7e22-454c-bd42-82c0c04b9e88 req-fbfe9d54-8e2a-4bdb-bdeb-c6a3eacc957b service nova] Lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:11:22 user nova-compute[74348]: DEBUG nova.compute.manager [req-10dcf29b-7e22-454c-bd42-82c0c04b9e88 req-fbfe9d54-8e2a-4bdb-bdeb-c6a3eacc957b service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] No waiting events found dispatching network-vif-plugged-2b0fc463-3743-41e4-9846-ee4dc53689f4 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:11:22 user nova-compute[74348]: WARNING nova.compute.manager [req-10dcf29b-7e22-454c-bd42-82c0c04b9e88 req-fbfe9d54-8e2a-4bdb-bdeb-c6a3eacc957b service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Received unexpected event network-vif-plugged-2b0fc463-3743-41e4-9846-ee4dc53689f4 for instance with vm_state building and task_state spawning.
Nov 22 08:11:22 user nova-compute[74348]: INFO nova.compute.manager [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Took 5.33 seconds to spawn the instance on the hypervisor.
Nov 22 08:11:22 user nova-compute[74348]: DEBUG nova.compute.manager [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:11:22 user nova-compute[74348]: INFO nova.compute.manager [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Took 6.12 seconds to build instance.
Nov 22 08:11:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-79c0a3e8-042f-4798-ae22-653f4793ca8c tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.220s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:11:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:24 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8d3fe117-4b61-4daf-b229-b081546309bb tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Acquiring lock "3b0e2761-c6aa-45a5-980a-da40a415c8d0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:11:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8d3fe117-4b61-4daf-b229-b081546309bb tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Lock "3b0e2761-c6aa-45a5-980a-da40a415c8d0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:11:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8d3fe117-4b61-4daf-b229-b081546309bb tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Acquiring lock "3b0e2761-c6aa-45a5-980a-da40a415c8d0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:11:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8d3fe117-4b61-4daf-b229-b081546309bb tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Lock "3b0e2761-c6aa-45a5-980a-da40a415c8d0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:11:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8d3fe117-4b61-4daf-b229-b081546309bb tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Lock "3b0e2761-c6aa-45a5-980a-da40a415c8d0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:11:33 user nova-compute[74348]: INFO nova.compute.manager [None req-8d3fe117-4b61-4daf-b229-b081546309bb tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Terminating instance
Nov 22 08:11:33 user nova-compute[74348]: DEBUG nova.compute.manager [None req-8d3fe117-4b61-4daf-b229-b081546309bb tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 08:11:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:11:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:34 user nova-compute[74348]: DEBUG nova.compute.manager [req-818fd41d-75fc-4d01-9c2f-84674a1ba129 req-f97c7956-74ae-4201-859f-bf1d692f67b1 service nova] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Received event network-vif-unplugged-2803cb98-f4d6-4f8e-879d-650a73f35141 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:11:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-818fd41d-75fc-4d01-9c2f-84674a1ba129 req-f97c7956-74ae-4201-859f-bf1d692f67b1 service nova] Acquiring lock "3b0e2761-c6aa-45a5-980a-da40a415c8d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:11:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-818fd41d-75fc-4d01-9c2f-84674a1ba129 req-f97c7956-74ae-4201-859f-bf1d692f67b1 service nova] Lock "3b0e2761-c6aa-45a5-980a-da40a415c8d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:11:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-818fd41d-75fc-4d01-9c2f-84674a1ba129 req-f97c7956-74ae-4201-859f-bf1d692f67b1 service nova] Lock "3b0e2761-c6aa-45a5-980a-da40a415c8d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:11:34 user nova-compute[74348]: DEBUG nova.compute.manager [req-818fd41d-75fc-4d01-9c2f-84674a1ba129 req-f97c7956-74ae-4201-859f-bf1d692f67b1 service nova] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] No waiting events found dispatching network-vif-unplugged-2803cb98-f4d6-4f8e-879d-650a73f35141 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:11:34 user nova-compute[74348]: DEBUG nova.compute.manager [req-818fd41d-75fc-4d01-9c2f-84674a1ba129 req-f97c7956-74ae-4201-859f-bf1d692f67b1 service nova] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Received event network-vif-unplugged-2803cb98-f4d6-4f8e-879d-650a73f35141 for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 08:11:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:34 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Instance destroyed successfully.
Nov 22 08:11:34 user nova-compute[74348]: DEBUG nova.objects.instance [None req-8d3fe117-4b61-4daf-b229-b081546309bb tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Lazy-loading 'resources' on Instance uuid 3b0e2761-c6aa-45a5-980a-da40a415c8d0 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:11:34 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-8d3fe117-4b61-4daf-b229-b081546309bb tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:08:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1122936641',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1122936641',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1122936',id=37,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmg8AHHrhWpoC3fZXCXtkSqixDD2bvVaSqaOqYty3uaRwGYTQYcVQ2ESt8f5s1NUWH8Y9P7XbiVL09/p5CRniHCV6BT4s9RXoT/5SVZdYAVQ1dRy5YqeeZMStzzTJ5bOQ==',key_name='tempest-keypair-1403920496',keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:08:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e26410148c64dfdaf46ebf656cbbd95',ramdisk_id='',reservation_id='r-49vvgw4f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2076547253',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T08:08:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf9cb24417584aed8ba7f2fb1ab1df40',uuid=3b0e2761-c6aa-45a5-980a-da40a415c8d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2803cb98-f4d6-4f8e-879d-650a73f35141", "address": "fa:16:3e:0e:ff:2e", "network": {"id": "70010ceb-a29f-4178-baca-95da22a59148", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1903564927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e26410148c64dfdaf46ebf656cbbd95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2803cb98-f4", "ovs_interfaceid": "2803cb98-f4d6-4f8e-879d-650a73f35141", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:11:34 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-8d3fe117-4b61-4daf-b229-b081546309bb tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Converting VIF {"id": "2803cb98-f4d6-4f8e-879d-650a73f35141", "address": "fa:16:3e:0e:ff:2e", "network": {"id": "70010ceb-a29f-4178-baca-95da22a59148", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1903564927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e26410148c64dfdaf46ebf656cbbd95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2803cb98-f4", "ovs_interfaceid": "2803cb98-f4d6-4f8e-879d-650a73f35141", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:11:34 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-8d3fe117-4b61-4daf-b229-b081546309bb tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:ff:2e,bridge_name='br-int',has_traffic_filtering=True,id=2803cb98-f4d6-4f8e-879d-650a73f35141,network=Network(70010ceb-a29f-4178-baca-95da22a59148),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2803cb98-f4') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:11:34 user nova-compute[74348]: DEBUG os_vif [None req-8d3fe117-4b61-4daf-b229-b081546309bb tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:ff:2e,bridge_name='br-int',has_traffic_filtering=True,id=2803cb98-f4d6-4f8e-879d-650a73f35141,network=Network(70010ceb-a29f-4178-baca-95da22a59148),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2803cb98-f4') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:11:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2803cb98-f4, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:11:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:11:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6946f087-afe0-4769-b45a-e602fce49d07) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:11:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:11:34 user nova-compute[74348]: INFO os_vif [None req-8d3fe117-4b61-4daf-b229-b081546309bb tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:ff:2e,bridge_name='br-int',has_traffic_filtering=True,id=2803cb98-f4d6-4f8e-879d-650a73f35141,network=Network(70010ceb-a29f-4178-baca-95da22a59148),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2803cb98-f4')
Nov 22 08:11:34 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-8d3fe117-4b61-4daf-b229-b081546309bb tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Deleting instance files /opt/stack/data/nova/instances/3b0e2761-c6aa-45a5-980a-da40a415c8d0_del
Nov 22 08:11:34 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-8d3fe117-4b61-4daf-b229-b081546309bb tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Deletion of /opt/stack/data/nova/instances/3b0e2761-c6aa-45a5-980a-da40a415c8d0_del complete
Nov 22 08:11:34 user nova-compute[74348]: INFO nova.compute.manager [None req-8d3fe117-4b61-4daf-b229-b081546309bb tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 22 08:11:34 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-8d3fe117-4b61-4daf-b229-b081546309bb tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 08:11:34 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 08:11:34 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 08:11:35 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:11:35 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Took 0.92 seconds to deallocate network for instance.
Nov 22 08:11:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8d3fe117-4b61-4daf-b229-b081546309bb tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:11:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8d3fe117-4b61-4daf-b229-b081546309bb tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:11:35 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-8d3fe117-4b61-4daf-b229-b081546309bb tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:11:35 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-8d3fe117-4b61-4daf-b229-b081546309bb tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:11:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8d3fe117-4b61-4daf-b229-b081546309bb tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.315s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:11:36 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-8d3fe117-4b61-4daf-b229-b081546309bb tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Deleted allocations for instance 3b0e2761-c6aa-45a5-980a-da40a415c8d0
Nov 22 08:11:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8d3fe117-4b61-4daf-b229-b081546309bb tempest-TestServerVolumeAttachScenarioOldVersion-2076547253 tempest-TestServerVolumeAttachScenarioOldVersion-2076547253-project-member] Lock "3b0e2761-c6aa-45a5-980a-da40a415c8d0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.321s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:11:36 user nova-compute[74348]: DEBUG nova.compute.manager [req-c02325c7-fac4-4e63-b4f9-375ace234cd5 req-ed2dad56-eb05-45ff-809d-7d7b192b5bba service nova] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Received event network-vif-plugged-2803cb98-f4d6-4f8e-879d-650a73f35141 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:11:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c02325c7-fac4-4e63-b4f9-375ace234cd5 req-ed2dad56-eb05-45ff-809d-7d7b192b5bba service nova] Acquiring lock "3b0e2761-c6aa-45a5-980a-da40a415c8d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:11:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c02325c7-fac4-4e63-b4f9-375ace234cd5 req-ed2dad56-eb05-45ff-809d-7d7b192b5bba service nova] Lock "3b0e2761-c6aa-45a5-980a-da40a415c8d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:11:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c02325c7-fac4-4e63-b4f9-375ace234cd5 req-ed2dad56-eb05-45ff-809d-7d7b192b5bba service nova] Lock "3b0e2761-c6aa-45a5-980a-da40a415c8d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:11:36 user nova-compute[74348]: DEBUG nova.compute.manager [req-c02325c7-fac4-4e63-b4f9-375ace234cd5 req-ed2dad56-eb05-45ff-809d-7d7b192b5bba service nova] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] No waiting events found dispatching network-vif-plugged-2803cb98-f4d6-4f8e-879d-650a73f35141 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:11:36 user nova-compute[74348]: WARNING nova.compute.manager [req-c02325c7-fac4-4e63-b4f9-375ace234cd5 req-ed2dad56-eb05-45ff-809d-7d7b192b5bba service nova] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Received unexpected event network-vif-plugged-2803cb98-f4d6-4f8e-879d-650a73f35141 for instance with vm_state deleted and task_state None.
Nov 22 08:11:36 user nova-compute[74348]: DEBUG nova.compute.manager [req-c02325c7-fac4-4e63-b4f9-375ace234cd5 req-ed2dad56-eb05-45ff-809d-7d7b192b5bba service nova] [instance: 3b0e2761-c6aa-45a5-980a-da40a415c8d0] Received event network-vif-deleted-2803cb98-f4d6-4f8e-879d-650a73f35141 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:11:39 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:39 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:41 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:11:41 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:11:41 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Didn't find any instances for network info cache update. {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 08:11:41 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:11:44 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:44 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:11:44 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:45 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:11:45 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:11:45 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:11:46 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:11:46 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:11:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquiring lock "dfa85b90-0b1e-4984-b89d-315a3590ec93" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:11:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "dfa85b90-0b1e-4984-b89d-315a3590ec93" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:11:47 user nova-compute[74348]: DEBUG nova.compute.manager [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 08:11:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:11:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:11:47 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 08:11:47 user nova-compute[74348]: INFO nova.compute.claims [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Claim successful on node user
Nov 22 08:11:47 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:11:47 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:11:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.626s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:11:48 user nova-compute[74348]: DEBUG nova.compute.manager [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 08:11:48 user nova-compute[74348]: DEBUG nova.compute.manager [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 08:11:48 user nova-compute[74348]: DEBUG nova.network.neutron [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 08:11:48 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 08:11:48 user nova-compute[74348]: DEBUG nova.compute.manager [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 08:11:48 user nova-compute[74348]: DEBUG nova.policy [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae8c7082420f4b85a9009ff82296d8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d1a2eb68ef4c0aa5ef081fe10877a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 08:11:48 user nova-compute[74348]: DEBUG nova.compute.manager [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 08:11:48 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 08:11:48 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Creating image(s)
Nov 22 08:11:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquiring lock "/opt/stack/data/nova/instances/dfa85b90-0b1e-4984-b89d-315a3590ec93/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:11:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "/opt/stack/data/nova/instances/dfa85b90-0b1e-4984-b89d-315a3590ec93/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:11:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "/opt/stack/data/nova/instances/dfa85b90-0b1e-4984-b89d-315a3590ec93/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:11:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.177s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquiring lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:11:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:11:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:48 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:11:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:11:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:11:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:11:48 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:11:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.184s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/dfa85b90-0b1e-4984-b89d-315a3590ec93/disk 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/dfa85b90-0b1e-4984-b89d-315a3590ec93/disk 1073741824" returned: 0 in 0.058s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:11:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:48 user nova-compute[74348]: DEBUG nova.network.neutron [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Successfully created port: 71861e5a-e368-4c2f-b960-7ec13f513fec {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 08:11:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.182s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:48 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dfa85b90-0b1e-4984-b89d-315a3590ec93/disk. size=1073741824 {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 08:11:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfa85b90-0b1e-4984-b89d-315a3590ec93/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfa85b90-0b1e-4984-b89d-315a3590ec93/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Cannot resize image /opt/stack/data/nova/instances/dfa85b90-0b1e-4984-b89d-315a3590ec93/disk to a smaller size. {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Ensure instance console log exists: /opt/stack/data/nova/instances/dfa85b90-0b1e-4984-b89d-315a3590ec93/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG nova.network.neutron [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Successfully updated port: 71861e5a-e368-4c2f-b960-7ec13f513fec {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquiring lock "refresh_cache-dfa85b90-0b1e-4984-b89d-315a3590ec93" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquired lock "refresh_cache-dfa85b90-0b1e-4984-b89d-315a3590ec93" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG nova.network.neutron [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG nova.compute.manager [req-af7c2164-9563-495e-a6a0-54653a642952 req-d0bbdffe-f1bb-4e1f-bdaf-3a3c9f5573f2 service nova] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Received event network-changed-71861e5a-e368-4c2f-b960-7ec13f513fec {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG nova.compute.manager [req-af7c2164-9563-495e-a6a0-54653a642952 req-d0bbdffe-f1bb-4e1f-bdaf-3a3c9f5573f2 service nova] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Refreshing instance network info cache due to event network-changed-71861e5a-e368-4c2f-b960-7ec13f513fec. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-af7c2164-9563-495e-a6a0-54653a642952 req-d0bbdffe-f1bb-4e1f-bdaf-3a3c9f5573f2 service nova] Acquiring lock "refresh_cache-dfa85b90-0b1e-4984-b89d-315a3590ec93" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG nova.network.neutron [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG nova.network.neutron [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Updating instance_info_cache with network_info: [{"id": "71861e5a-e368-4c2f-b960-7ec13f513fec", "address": "fa:16:3e:82:44:15", "network": {"id": "606a7c22-1285-47e8-bfa0-f09dbd7cb9ac", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-63336037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d1a2eb68ef4c0aa5ef081fe10877a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71861e5a-e3", "ovs_interfaceid": "71861e5a-e368-4c2f-b960-7ec13f513fec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Releasing lock "refresh_cache-dfa85b90-0b1e-4984-b89d-315a3590ec93" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG nova.compute.manager [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Instance network_info: |[{"id": "71861e5a-e368-4c2f-b960-7ec13f513fec", "address": "fa:16:3e:82:44:15", "network": {"id": "606a7c22-1285-47e8-bfa0-f09dbd7cb9ac", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-63336037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d1a2eb68ef4c0aa5ef081fe10877a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71861e5a-e3", "ovs_interfaceid": "71861e5a-e368-4c2f-b960-7ec13f513fec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-af7c2164-9563-495e-a6a0-54653a642952 req-d0bbdffe-f1bb-4e1f-bdaf-3a3c9f5573f2 service nova] Acquired lock "refresh_cache-dfa85b90-0b1e-4984-b89d-315a3590ec93" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG nova.network.neutron [req-af7c2164-9563-495e-a6a0-54653a642952 req-d0bbdffe-f1bb-4e1f-bdaf-3a3c9f5573f2 service nova] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Refreshing network info cache for port 71861e5a-e368-4c2f-b960-7ec13f513fec {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Start _get_guest_xml network_info=[{"id": "71861e5a-e368-4c2f-b960-7ec13f513fec", "address": "fa:16:3e:82:44:15", "network": {"id": "606a7c22-1285-47e8-bfa0-f09dbd7cb9ac", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-63336037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d1a2eb68ef4c0aa5ef081fe10877a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71861e5a-e3", "ovs_interfaceid": "71861e5a-e368-4c2f-b960-7ec13f513fec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 08:11:49 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:11:49 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:11:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:11:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1774797545',display_name='tempest-AttachVolumeTestJSON-server-1774797545',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1774797545',id=40,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTytNFrgh91MNlFVNxTrsW6WDKA0qttjwQd3oXWu6tzjsBiTLiRZq+JbSerC1vrEXEc7rf7co9vpI13vUvv6ktL52s5sDBn3ccI4O/F3GNejszbyW+2yuuVDnJR2Qr17w==',key_name='tempest-keypair-1139120022',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2d1a2eb68ef4c0aa5ef081fe10877a9',ramdisk_id='',reservation_id='r-a3bpejvz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-608656879',owner_user_name='tempest-AttachVolumeTestJSON-608656879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:11:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae8c7082420f4b85a9009ff82296d8cb',uuid=dfa85b90-0b1e-4984-b89d-315a3590ec93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71861e5a-e368-4c2f-b960-7ec13f513fec", "address": "fa:16:3e:82:44:15", "network": {"id": "606a7c22-1285-47e8-bfa0-f09dbd7cb9ac", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-63336037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d1a2eb68ef4c0aa5ef081fe10877a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71861e5a-e3", "ovs_interfaceid": "71861e5a-e368-4c2f-b960-7ec13f513fec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Converting VIF {"id": "71861e5a-e368-4c2f-b960-7ec13f513fec", "address": "fa:16:3e:82:44:15", "network": {"id": "606a7c22-1285-47e8-bfa0-f09dbd7cb9ac", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-63336037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d1a2eb68ef4c0aa5ef081fe10877a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71861e5a-e3", "ovs_interfaceid": "71861e5a-e368-4c2f-b960-7ec13f513fec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:44:15,bridge_name='br-int',has_traffic_filtering=True,id=71861e5a-e368-4c2f-b960-7ec13f513fec,network=Network(606a7c22-1285-47e8-bfa0-f09dbd7cb9ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71861e5a-e3') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG nova.objects.instance [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lazy-loading 'pci_devices' on Instance uuid dfa85b90-0b1e-4984-b89d-315a3590ec93 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] End _get_guest_xml xml=<domain type="kvm">
Nov 22 08:11:49 user nova-compute[74348]:   <uuid>dfa85b90-0b1e-4984-b89d-315a3590ec93</uuid>
Nov 22 08:11:49 user nova-compute[74348]:   <name>instance-00000028</name>
Nov 22 08:11:49 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 08:11:49 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 08:11:49 user nova-compute[74348]:   <metadata>
Nov 22 08:11:49 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 08:11:49 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 08:11:49 user nova-compute[74348]:       <nova:name>tempest-AttachVolumeTestJSON-server-1774797545</nova:name>
Nov 22 08:11:49 user nova-compute[74348]:       <nova:creationTime>2023-11-22 08:11:49</nova:creationTime>
Nov 22 08:11:49 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 08:11:49 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 08:11:49 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 08:11:49 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 08:11:49 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 08:11:49 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 08:11:49 user nova-compute[74348]:       </nova:flavor>
Nov 22 08:11:49 user nova-compute[74348]:       <nova:owner>
Nov 22 08:11:49 user nova-compute[74348]:         <nova:user uuid="ae8c7082420f4b85a9009ff82296d8cb">tempest-AttachVolumeTestJSON-608656879-project-member</nova:user>
Nov 22 08:11:49 user nova-compute[74348]:         <nova:project uuid="e2d1a2eb68ef4c0aa5ef081fe10877a9">tempest-AttachVolumeTestJSON-608656879</nova:project>
Nov 22 08:11:49 user nova-compute[74348]:       </nova:owner>
Nov 22 08:11:49 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 08:11:49 user nova-compute[74348]:       <nova:ports>
Nov 22 08:11:49 user nova-compute[74348]:         <nova:port uuid="71861e5a-e368-4c2f-b960-7ec13f513fec">
Nov 22 08:11:49 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 22 08:11:49 user nova-compute[74348]:         </nova:port>
Nov 22 08:11:49 user nova-compute[74348]:       </nova:ports>
Nov 22 08:11:49 user nova-compute[74348]:     </nova:instance>
Nov 22 08:11:49 user nova-compute[74348]:   </metadata>
Nov 22 08:11:49 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 08:11:49 user nova-compute[74348]:     <system>
Nov 22 08:11:49 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 08:11:49 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 08:11:49 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 08:11:49 user nova-compute[74348]:       <entry name="serial">dfa85b90-0b1e-4984-b89d-315a3590ec93</entry>
Nov 22 08:11:49 user nova-compute[74348]:       <entry name="uuid">dfa85b90-0b1e-4984-b89d-315a3590ec93</entry>
Nov 22 08:11:49 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 08:11:49 user nova-compute[74348]:     </system>
Nov 22 08:11:49 user nova-compute[74348]:   </sysinfo>
Nov 22 08:11:49 user nova-compute[74348]:   <os>
Nov 22 08:11:49 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 08:11:49 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 08:11:49 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 08:11:49 user nova-compute[74348]:   </os>
Nov 22 08:11:49 user nova-compute[74348]:   <features>
Nov 22 08:11:49 user nova-compute[74348]:     <acpi/>
Nov 22 08:11:49 user nova-compute[74348]:     <apic/>
Nov 22 08:11:49 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 08:11:49 user nova-compute[74348]:   </features>
Nov 22 08:11:49 user nova-compute[74348]:   <clock offset="utc">
Nov 22 08:11:49 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 08:11:49 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 08:11:49 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 08:11:49 user nova-compute[74348]:   </clock>
Nov 22 08:11:49 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 08:11:49 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 08:11:49 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 08:11:49 user nova-compute[74348]:   </cpu>
Nov 22 08:11:49 user nova-compute[74348]:   <devices>
Nov 22 08:11:49 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 08:11:49 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 08:11:49 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/dfa85b90-0b1e-4984-b89d-315a3590ec93/disk"/>
Nov 22 08:11:49 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 08:11:49 user nova-compute[74348]:     </disk>
Nov 22 08:11:49 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 08:11:49 user nova-compute[74348]:       <mac address="fa:16:3e:82:44:15"/>
Nov 22 08:11:49 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:11:49 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 08:11:49 user nova-compute[74348]:       <target dev="tap71861e5a-e3"/>
Nov 22 08:11:49 user nova-compute[74348]:     </interface>
Nov 22 08:11:49 user nova-compute[74348]:     <serial type="pty">
Nov 22 08:11:49 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/dfa85b90-0b1e-4984-b89d-315a3590ec93/console.log" append="off"/>
Nov 22 08:11:49 user nova-compute[74348]:     </serial>
Nov 22 08:11:49 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 08:11:49 user nova-compute[74348]:     <video>
Nov 22 08:11:49 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:11:49 user nova-compute[74348]:     </video>
Nov 22 08:11:49 user nova-compute[74348]:     <rng model="virtio">
Nov 22 08:11:49 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 08:11:49 user nova-compute[74348]:     </rng>
Nov 22 08:11:49 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 08:11:49 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 08:11:49 user nova-compute[74348]:       <stats period="10"/>
Nov 22 08:11:49 user nova-compute[74348]:     </memballoon>
Nov 22 08:11:49 user nova-compute[74348]:   </devices>
Nov 22 08:11:49 user nova-compute[74348]: </domain>
Nov 22 08:11:49 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:11:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1774797545',display_name='tempest-AttachVolumeTestJSON-server-1774797545',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1774797545',id=40,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTytNFrgh91MNlFVNxTrsW6WDKA0qttjwQd3oXWu6tzjsBiTLiRZq+JbSerC1vrEXEc7rf7co9vpI13vUvv6ktL52s5sDBn3ccI4O/F3GNejszbyW+2yuuVDnJR2Qr17w==',key_name='tempest-keypair-1139120022',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2d1a2eb68ef4c0aa5ef081fe10877a9',ramdisk_id='',reservation_id='r-a3bpejvz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-608656879',owner_user_name='tempest-AttachVolumeTestJSON-608656879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:11:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae8c7082420f4b85a9009ff82296d8cb',uuid=dfa85b90-0b1e-4984-b89d-315a3590ec93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71861e5a-e368-4c2f-b960-7ec13f513fec", "address": "fa:16:3e:82:44:15", "network": {"id": "606a7c22-1285-47e8-bfa0-f09dbd7cb9ac", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-63336037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d1a2eb68ef4c0aa5ef081fe10877a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71861e5a-e3", "ovs_interfaceid": "71861e5a-e368-4c2f-b960-7ec13f513fec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Converting VIF {"id": "71861e5a-e368-4c2f-b960-7ec13f513fec", "address": "fa:16:3e:82:44:15", "network": {"id": "606a7c22-1285-47e8-bfa0-f09dbd7cb9ac", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-63336037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d1a2eb68ef4c0aa5ef081fe10877a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71861e5a-e3", "ovs_interfaceid": "71861e5a-e368-4c2f-b960-7ec13f513fec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:44:15,bridge_name='br-int',has_traffic_filtering=True,id=71861e5a-e368-4c2f-b960-7ec13f513fec,network=Network(606a7c22-1285-47e8-bfa0-f09dbd7cb9ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71861e5a-e3') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG os_vif [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:44:15,bridge_name='br-int',has_traffic_filtering=True,id=71861e5a-e368-4c2f-b960-7ec13f513fec,network=Network(606a7c22-1285-47e8-bfa0-f09dbd7cb9ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71861e5a-e3') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd531cf5c-4eb4-5eb7-8564-960a61e1030f', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71861e5a-e3, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap71861e5a-e3, col_values=(('qos', UUID('2856a0cc-527f-4997-a496-cdb9f5f11da2')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap71861e5a-e3, col_values=(('external_ids', {'iface-id': '71861e5a-e368-4c2f-b960-7ec13f513fec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:44:15', 'vm-uuid': 'dfa85b90-0b1e-4984-b89d-315a3590ec93'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:11:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:49 user nova-compute[74348]: INFO os_vif [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:44:15,bridge_name='br-int',has_traffic_filtering=True,id=71861e5a-e368-4c2f-b960-7ec13f513fec,network=Network(606a7c22-1285-47e8-bfa0-f09dbd7cb9ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71861e5a-e3')
Nov 22 08:11:50 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:11:50 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] No VIF found with MAC fa:16:3e:82:44:15, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:11:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:50 user nova-compute[74348]: DEBUG nova.network.neutron [req-af7c2164-9563-495e-a6a0-54653a642952 req-d0bbdffe-f1bb-4e1f-bdaf-3a3c9f5573f2 service nova] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Updated VIF entry in instance network info cache for port 71861e5a-e368-4c2f-b960-7ec13f513fec. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:11:50 user nova-compute[74348]: DEBUG nova.network.neutron [req-af7c2164-9563-495e-a6a0-54653a642952 req-d0bbdffe-f1bb-4e1f-bdaf-3a3c9f5573f2 service nova] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Updating instance_info_cache with network_info: [{"id": "71861e5a-e368-4c2f-b960-7ec13f513fec", "address": "fa:16:3e:82:44:15", "network": {"id": "606a7c22-1285-47e8-bfa0-f09dbd7cb9ac", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-63336037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d1a2eb68ef4c0aa5ef081fe10877a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71861e5a-e3", "ovs_interfaceid": "71861e5a-e368-4c2f-b960-7ec13f513fec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:11:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:50 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-af7c2164-9563-495e-a6a0-54653a642952 req-d0bbdffe-f1bb-4e1f-bdaf-3a3c9f5573f2 service nova] Releasing lock "refresh_cache-dfa85b90-0b1e-4984-b89d-315a3590ec93" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:11:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json" returned: 0 in 0.165s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:51 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:51 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:51 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:51 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:51 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:11:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b998bedf-ee29-48a1-a14b-449add115c39/disk.rescue --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:51 user nova-compute[74348]: DEBUG nova.compute.manager [req-a275e042-467a-4a0a-adbb-9d527e1ede47 req-0ce8641e-c8dd-41f9-8bcf-31e50ac442af service nova] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Received event network-vif-plugged-71861e5a-e368-4c2f-b960-7ec13f513fec {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:11:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a275e042-467a-4a0a-adbb-9d527e1ede47 req-0ce8641e-c8dd-41f9-8bcf-31e50ac442af service nova] Acquiring lock "dfa85b90-0b1e-4984-b89d-315a3590ec93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:11:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a275e042-467a-4a0a-adbb-9d527e1ede47 req-0ce8641e-c8dd-41f9-8bcf-31e50ac442af service nova] Lock "dfa85b90-0b1e-4984-b89d-315a3590ec93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:11:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a275e042-467a-4a0a-adbb-9d527e1ede47 req-0ce8641e-c8dd-41f9-8bcf-31e50ac442af service nova] Lock "dfa85b90-0b1e-4984-b89d-315a3590ec93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:11:51 user nova-compute[74348]: DEBUG nova.compute.manager [req-a275e042-467a-4a0a-adbb-9d527e1ede47 req-0ce8641e-c8dd-41f9-8bcf-31e50ac442af service nova] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] No waiting events found dispatching network-vif-plugged-71861e5a-e368-4c2f-b960-7ec13f513fec {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:11:51 user nova-compute[74348]: WARNING nova.compute.manager [req-a275e042-467a-4a0a-adbb-9d527e1ede47 req-0ce8641e-c8dd-41f9-8bcf-31e50ac442af service nova] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Received unexpected event network-vif-plugged-71861e5a-e368-4c2f-b960-7ec13f513fec for instance with vm_state building and task_state spawning.
Nov 22 08:11:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b998bedf-ee29-48a1-a14b-449add115c39/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b998bedf-ee29-48a1-a14b-449add115c39/disk.rescue --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:11:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b998bedf-ee29-48a1-a14b-449add115c39/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:11:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:53 user nova-compute[74348]: DEBUG nova.compute.manager [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 08:11:53 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 08:11:53 user nova-compute[74348]: DEBUG nova.compute.manager [req-551956d2-e598-4e56-a3f1-7216abf1e5f4 req-26f17836-f8d3-4b9d-a5e3-1c576375eb3e service nova] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Received event network-vif-plugged-71861e5a-e368-4c2f-b960-7ec13f513fec {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:11:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-551956d2-e598-4e56-a3f1-7216abf1e5f4 req-26f17836-f8d3-4b9d-a5e3-1c576375eb3e service nova] Acquiring lock "dfa85b90-0b1e-4984-b89d-315a3590ec93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:11:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-551956d2-e598-4e56-a3f1-7216abf1e5f4 req-26f17836-f8d3-4b9d-a5e3-1c576375eb3e service nova] Lock "dfa85b90-0b1e-4984-b89d-315a3590ec93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:11:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-551956d2-e598-4e56-a3f1-7216abf1e5f4 req-26f17836-f8d3-4b9d-a5e3-1c576375eb3e service nova] Lock "dfa85b90-0b1e-4984-b89d-315a3590ec93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:11:53 user nova-compute[74348]: DEBUG nova.compute.manager [req-551956d2-e598-4e56-a3f1-7216abf1e5f4 req-26f17836-f8d3-4b9d-a5e3-1c576375eb3e service nova] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] No waiting events found dispatching network-vif-plugged-71861e5a-e368-4c2f-b960-7ec13f513fec {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:11:53 user nova-compute[74348]: WARNING nova.compute.manager [req-551956d2-e598-4e56-a3f1-7216abf1e5f4 req-26f17836-f8d3-4b9d-a5e3-1c576375eb3e service nova] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Received unexpected event network-vif-plugged-71861e5a-e368-4c2f-b960-7ec13f513fec for instance with vm_state building and task_state spawning.
Nov 22 08:11:53 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:11:53 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:11:53 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=8016MB free_disk=24.696971893310547GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:11:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:11:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:11:53 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Instance spawned successfully.
Nov 22 08:11:53 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 08:11:53 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:11:53 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:11:53 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:11:53 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:11:53 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:11:53 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:11:53 user nova-compute[74348]: INFO nova.compute.manager [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Took 5.46 seconds to spawn the instance on the hypervisor.
Nov 22 08:11:53 user nova-compute[74348]: DEBUG nova.compute.manager [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:11:53 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 765f8c47-c042-4430-8d35-07926ad693fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:11:53 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance b8f84c0b-fab5-4900-bf65-270c9c06baf8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:11:53 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 5006cff5-4b67-405d-b6b1-4c355f82d920 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:11:53 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 555f4246-d4b2-4f2f-b91c-dda8fe47264c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:11:53 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance ba74ca7d-2875-426c-a485-d908af865bae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:11:53 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance b95b6cae-1885-43e8-b589-ee89854100a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:11:53 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance b998bedf-ee29-48a1-a14b-449add115c39 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:11:53 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:11:53 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance dfa85b90-0b1e-4984-b89d-315a3590ec93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:11:53 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:11:53 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:11:53 user nova-compute[74348]: INFO nova.compute.manager [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Took 6.44 seconds to build instance.
Nov 22 08:11:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f05a8c22-d3e4-4f50-8344-443532dfc5f2 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "dfa85b90-0b1e-4984-b89d-315a3590ec93" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.536s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:11:53 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:11:53 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:11:54 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:11:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.418s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:11:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:11:55 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:11:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:12:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:12:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:12:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:12:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "54d11b82-543c-4166-bf31-5e4e94eb830f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:12:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "54d11b82-543c-4166-bf31-5e4e94eb830f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:12:08 user nova-compute[74348]: DEBUG nova.compute.manager [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 08:12:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:12:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:12:08 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 08:12:08 user nova-compute[74348]: INFO nova.compute.claims [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Claim successful on node user
Nov 22 08:12:09 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:12:09 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:12:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.373s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:12:09 user nova-compute[74348]: DEBUG nova.compute.manager [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 08:12:09 user nova-compute[74348]: DEBUG nova.compute.manager [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 08:12:09 user nova-compute[74348]: DEBUG nova.network.neutron [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 08:12:09 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 08:12:09 user nova-compute[74348]: DEBUG nova.compute.manager [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 08:12:09 user nova-compute[74348]: INFO nova.virt.block_device [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Booting with volume 060663bf-6a7e-4962-9df6-d7a401fcb290 at /dev/vda
Nov 22 08:12:09 user nova-compute[74348]: DEBUG nova.policy [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '43550ccf30be49aba6ed6de2caf9ae1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62fda81543f461288e324458620d07c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 08:12:09 user nova-compute[74348]: DEBUG os_brick.utils [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:12:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:12:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:12:09 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff21d7c-a389-4b85-9092-1526da64d43c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:12:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:12:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:12:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:12:09 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b108a4b5-b9ed-4e7a-ad4e-e9dcdf373852]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:12:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:12:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:12:09 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5241a6d8-2bc5-4c48-bcdc-e47c5bdfab55]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:12:09 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c52485-416a-473a-9f5e-6e90987777aa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:12:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:12:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:12:09 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 08:12:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:12:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:12:09 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 08:12:09 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[99007b48-2572-47f4-93c9-8fe53c160279]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:12:09 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 08:12:09 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 08:12:09 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 08:12:09 user nova-compute[74348]: DEBUG os_brick.utils [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:12:09 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Updating existing volume attachment record: 52f25c3e-bb2f-46c2-b231-4348089bf456 {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 08:12:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:12:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:12:10 user nova-compute[74348]: DEBUG nova.network.neutron [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Successfully created port: fe9fc32d-b2f0-4770-8473-de9e3a5816c9 {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 08:12:11 user nova-compute[74348]: DEBUG nova.network.neutron [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Successfully updated port: fe9fc32d-b2f0-4770-8473-de9e3a5816c9 {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 08:12:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "refresh_cache-54d11b82-543c-4166-bf31-5e4e94eb830f" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:12:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquired lock "refresh_cache-54d11b82-543c-4166-bf31-5e4e94eb830f" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:12:11 user nova-compute[74348]: DEBUG nova.network.neutron [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:12:11 user nova-compute[74348]: DEBUG nova.compute.manager [req-3601ad36-4e6f-43fd-ba95-4cded0ee9d01 req-b6e20ad3-0aa1-4bc3-b638-8efdc9b88d6d service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Received event network-changed-fe9fc32d-b2f0-4770-8473-de9e3a5816c9 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:12:11 user nova-compute[74348]: DEBUG nova.compute.manager [req-3601ad36-4e6f-43fd-ba95-4cded0ee9d01 req-b6e20ad3-0aa1-4bc3-b638-8efdc9b88d6d service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Refreshing instance network info cache due to event network-changed-fe9fc32d-b2f0-4770-8473-de9e3a5816c9. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:12:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3601ad36-4e6f-43fd-ba95-4cded0ee9d01 req-b6e20ad3-0aa1-4bc3-b638-8efdc9b88d6d service nova] Acquiring lock "refresh_cache-54d11b82-543c-4166-bf31-5e4e94eb830f" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:12:11 user nova-compute[74348]: DEBUG nova.network.neutron [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 08:12:11 user nova-compute[74348]: DEBUG nova.network.neutron [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Updating instance_info_cache with network_info: [{"id": "fe9fc32d-b2f0-4770-8473-de9e3a5816c9", "address": "fa:16:3e:b9:17:27", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9fc32d-b2", "ovs_interfaceid": "fe9fc32d-b2f0-4770-8473-de9e3a5816c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:12:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Releasing lock "refresh_cache-54d11b82-543c-4166-bf31-5e4e94eb830f" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:12:11 user nova-compute[74348]: DEBUG nova.compute.manager [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Instance network_info: |[{"id": "fe9fc32d-b2f0-4770-8473-de9e3a5816c9", "address": "fa:16:3e:b9:17:27", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9fc32d-b2", "ovs_interfaceid": "fe9fc32d-b2f0-4770-8473-de9e3a5816c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 08:12:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3601ad36-4e6f-43fd-ba95-4cded0ee9d01 req-b6e20ad3-0aa1-4bc3-b638-8efdc9b88d6d service nova] Acquired lock "refresh_cache-54d11b82-543c-4166-bf31-5e4e94eb830f" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:12:11 user nova-compute[74348]: DEBUG nova.network.neutron [req-3601ad36-4e6f-43fd-ba95-4cded0ee9d01 req-b6e20ad3-0aa1-4bc3-b638-8efdc9b88d6d service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Refreshing network info cache for port fe9fc32d-b2f0-4770-8473-de9e3a5816c9 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:12:12 user nova-compute[74348]: DEBUG nova.network.neutron [req-3601ad36-4e6f-43fd-ba95-4cded0ee9d01 req-b6e20ad3-0aa1-4bc3-b638-8efdc9b88d6d service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Updated VIF entry in instance network info cache for port fe9fc32d-b2f0-4770-8473-de9e3a5816c9. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:12:12 user nova-compute[74348]: DEBUG nova.network.neutron [req-3601ad36-4e6f-43fd-ba95-4cded0ee9d01 req-b6e20ad3-0aa1-4bc3-b638-8efdc9b88d6d service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Updating instance_info_cache with network_info: [{"id": "fe9fc32d-b2f0-4770-8473-de9e3a5816c9", "address": "fa:16:3e:b9:17:27", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9fc32d-b2", "ovs_interfaceid": "fe9fc32d-b2f0-4770-8473-de9e3a5816c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:12:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3601ad36-4e6f-43fd-ba95-4cded0ee9d01 req-b6e20ad3-0aa1-4bc3-b638-8efdc9b88d6d service nova] Releasing lock "refresh_cache-54d11b82-543c-4166-bf31-5e4e94eb830f" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:12:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:12:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:12:15 user nova-compute[74348]: DEBUG nova.compute.manager [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 08:12:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 08:12:15 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Creating image(s)
Nov 22 08:12:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Did not create local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 08:12:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Ensure instance console log exists: /opt/stack/data/nova/instances/54d11b82-543c-4166-bf31-5e4e94eb830f/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 08:12:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:12:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:12:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:12:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Start _get_guest_xml network_info=[{"id": "fe9fc32d-b2f0-4770-8473-de9e3a5816c9", "address": "fa:16:3e:b9:17:27", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9fc32d-b2", "ovs_interfaceid": "fe9fc32d-b2f0-4770-8473-de9e3a5816c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RSKrQjYE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '54d11b82-543c-4166-bf31-5e4e94eb830f', 'attached_at': '', 'detached_at': '', 'volume_id': '060663bf-6a7e-4962-9df6-d7a401fcb290', 'serial': '060663bf-6a7e-4962-9df6-d7a401fcb290'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '52f25c3e-bb2f-46c2-b231-4348089bf456', 'volume_type': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 08:12:15 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:12:15 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:12:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 08:12:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 08:12:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 08:12:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 08:12:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 08:12:15 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 08:12:15 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 08:12:15 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 08:12:15 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 08:12:15 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 08:12:15 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 08:12:15 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 08:12:15 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 08:12:15 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 08:12:15 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 08:12:15 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RSKrQjYE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:12:16 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:12:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:12:16 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:12:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:12:16 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 08:12:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b266be29-e7af-445c-88a3-5c0d36fd45f7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 08:12:16 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[49aba1ed-ad86-4809-ad5c-8b10016af8b6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290] added
Nov 22 08:12:16 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ae45b6-8bf2-4952-be28-8d6c6b0f53ff]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[557ea883-7206-484a-8e82-e7c6c3f3683c]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RSKrQjYE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RSKrQjYE" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebcfa7ff-b74a-471a-b628-68ea581c1470]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RSKrQjYE'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6cc834-ec15-46ce-8de1-433548df9364]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[04477723-9a6c-45bb-88bd-e56a0e705dfd]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:12:16 user nova-compute[74348]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)
Nov 22 08:12:16 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:12:16 user nova-compute[74348]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)
Nov 22 08:12:16 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4dc35d4-8c49-4cbe-a378-b6391646e873]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290, portal: 172.16.0.220,3260]
Nov 22 08:12:16 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290, portal: 172.16.0.220,3260] successful.
Nov 22 08:12:16 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32b5d70-99c8-47cd-a293-2243c1362703]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[edaf9fdc-e4b3-4af2-b004-31cb3e470fab]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:12:16 user nova-compute[74348]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)
Nov 22 08:12:16 user nova-compute[74348]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)
Nov 22 08:12:16 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:12:16 user nova-compute[74348]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)
Nov 22 08:12:16 user nova-compute[74348]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)
Nov 22 08:12:16 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3250927b-c759-4ea9-909e-a175dc8b2566]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:12:16 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: None {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:12:17 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:12:17 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RSKrQjYE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 08:12:17 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:12:17 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '26430353431373361', 'path': '/dev/sdd'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:12:17 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430353431373361', 'path': '/dev/sdd'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 08:12:17 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:12:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-68334599',display_name='tempest-ServerActionsTestOtherA-server-68334599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-68334599',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOnwiyyOG0pLFwcj345c4IzhM/kyBtQaUAH7E3RkvN6illtA9ZAkzh5oMECX0856YNQ2Mjloaz2SuvdsQL10sz9Itf7PAs6pZTbAEN/oI0ibl2evR0cUOwfMcOEuxLp2g==',key_name='tempest-keypair-1143468972',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d62fda81543f461288e324458620d07c',ramdisk_id='',reservation_id='r-5wioe4l0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-90817446',owner_user_name='tempest-ServerActionsTestOtherA-90817446-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:12:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43550ccf30be49aba6ed6de2caf9ae1e',uuid=54d11b82-543c-4166-bf31-5e4e94eb830f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe9fc32d-b2f0-4770-8473-de9e3a5816c9", "address": "fa:16:3e:b9:17:27", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9fc32d-b2", "ovs_interfaceid": "fe9fc32d-b2f0-4770-8473-de9e3a5816c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 08:12:17 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Converting VIF {"id": "fe9fc32d-b2f0-4770-8473-de9e3a5816c9", "address": "fa:16:3e:b9:17:27", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9fc32d-b2", "ovs_interfaceid": "fe9fc32d-b2f0-4770-8473-de9e3a5816c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:12:17 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:17:27,bridge_name='br-int',has_traffic_filtering=True,id=fe9fc32d-b2f0-4770-8473-de9e3a5816c9,network=Network(9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9fc32d-b2') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:12:17 user nova-compute[74348]: DEBUG nova.objects.instance [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lazy-loading 'pci_devices' on Instance uuid 54d11b82-543c-4166-bf31-5e4e94eb830f {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:12:17 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] End _get_guest_xml xml=<domain type="kvm">
Nov 22 08:12:17 user nova-compute[74348]:   <uuid>54d11b82-543c-4166-bf31-5e4e94eb830f</uuid>
Nov 22 08:12:17 user nova-compute[74348]:   <name>instance-00000029</name>
Nov 22 08:12:17 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 08:12:17 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 08:12:17 user nova-compute[74348]:   <metadata>
Nov 22 08:12:17 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 08:12:17 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 08:12:17 user nova-compute[74348]:       <nova:name>tempest-ServerActionsTestOtherA-server-68334599</nova:name>
Nov 22 08:12:17 user nova-compute[74348]:       <nova:creationTime>2023-11-22 08:12:15</nova:creationTime>
Nov 22 08:12:17 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 08:12:17 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 08:12:17 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 08:12:17 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 08:12:17 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 08:12:17 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 08:12:17 user nova-compute[74348]:       </nova:flavor>
Nov 22 08:12:17 user nova-compute[74348]:       <nova:owner>
Nov 22 08:12:17 user nova-compute[74348]:         <nova:user uuid="43550ccf30be49aba6ed6de2caf9ae1e">tempest-ServerActionsTestOtherA-90817446-project-member</nova:user>
Nov 22 08:12:17 user nova-compute[74348]:         <nova:project uuid="d62fda81543f461288e324458620d07c">tempest-ServerActionsTestOtherA-90817446</nova:project>
Nov 22 08:12:17 user nova-compute[74348]:       </nova:owner>
Nov 22 08:12:17 user nova-compute[74348]:       <nova:ports>
Nov 22 08:12:17 user nova-compute[74348]:         <nova:port uuid="fe9fc32d-b2f0-4770-8473-de9e3a5816c9">
Nov 22 08:12:17 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 22 08:12:17 user nova-compute[74348]:         </nova:port>
Nov 22 08:12:17 user nova-compute[74348]:       </nova:ports>
Nov 22 08:12:17 user nova-compute[74348]:     </nova:instance>
Nov 22 08:12:17 user nova-compute[74348]:   </metadata>
Nov 22 08:12:17 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 08:12:17 user nova-compute[74348]:     <system>
Nov 22 08:12:17 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 08:12:17 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 08:12:17 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 08:12:17 user nova-compute[74348]:       <entry name="serial">54d11b82-543c-4166-bf31-5e4e94eb830f</entry>
Nov 22 08:12:17 user nova-compute[74348]:       <entry name="uuid">54d11b82-543c-4166-bf31-5e4e94eb830f</entry>
Nov 22 08:12:17 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 08:12:17 user nova-compute[74348]:     </system>
Nov 22 08:12:17 user nova-compute[74348]:   </sysinfo>
Nov 22 08:12:17 user nova-compute[74348]:   <os>
Nov 22 08:12:17 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 08:12:17 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 08:12:17 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 08:12:17 user nova-compute[74348]:   </os>
Nov 22 08:12:17 user nova-compute[74348]:   <features>
Nov 22 08:12:17 user nova-compute[74348]:     <acpi/>
Nov 22 08:12:17 user nova-compute[74348]:     <apic/>
Nov 22 08:12:17 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 08:12:17 user nova-compute[74348]:   </features>
Nov 22 08:12:17 user nova-compute[74348]:   <clock offset="utc">
Nov 22 08:12:17 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 08:12:17 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 08:12:17 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 08:12:17 user nova-compute[74348]:   </clock>
Nov 22 08:12:17 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 08:12:17 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 08:12:17 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 08:12:17 user nova-compute[74348]:   </cpu>
Nov 22 08:12:17 user nova-compute[74348]:   <devices>
Nov 22 08:12:17 user nova-compute[74348]:     <disk type="block" device="disk">
Nov 22 08:12:17 user nova-compute[74348]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:12:17 user nova-compute[74348]:       <source dev="/dev/sdd"/>
Nov 22 08:12:17 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 08:12:17 user nova-compute[74348]:       <serial>060663bf-6a7e-4962-9df6-d7a401fcb290</serial>
Nov 22 08:12:17 user nova-compute[74348]:     </disk>
Nov 22 08:12:17 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 08:12:17 user nova-compute[74348]:       <mac address="fa:16:3e:b9:17:27"/>
Nov 22 08:12:17 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:12:17 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 08:12:17 user nova-compute[74348]:       <target dev="tapfe9fc32d-b2"/>
Nov 22 08:12:17 user nova-compute[74348]:     </interface>
Nov 22 08:12:17 user nova-compute[74348]:     <serial type="pty">
Nov 22 08:12:17 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/54d11b82-543c-4166-bf31-5e4e94eb830f/console.log" append="off"/>
Nov 22 08:12:17 user nova-compute[74348]:     </serial>
Nov 22 08:12:17 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 08:12:17 user nova-compute[74348]:     <video>
Nov 22 08:12:17 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:12:17 user nova-compute[74348]:     </video>
Nov 22 08:12:17 user nova-compute[74348]:     <rng model="virtio">
Nov 22 08:12:17 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 08:12:17 user nova-compute[74348]:     </rng>
Nov 22 08:12:17 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 08:12:17 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 08:12:17 user nova-compute[74348]:       <stats period="10"/>
Nov 22 08:12:17 user nova-compute[74348]:     </memballoon>
Nov 22 08:12:17 user nova-compute[74348]:   </devices>
Nov 22 08:12:17 user nova-compute[74348]: </domain>
Nov 22 08:12:17 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 08:12:17 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:12:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-68334599',display_name='tempest-ServerActionsTestOtherA-server-68334599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-68334599',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOnwiyyOG0pLFwcj345c4IzhM/kyBtQaUAH7E3RkvN6illtA9ZAkzh5oMECX0856YNQ2Mjloaz2SuvdsQL10sz9Itf7PAs6pZTbAEN/oI0ibl2evR0cUOwfMcOEuxLp2g==',key_name='tempest-keypair-1143468972',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d62fda81543f461288e324458620d07c',ramdisk_id='',reservation_id='r-5wioe4l0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-90817446',owner_user_name='tempest-ServerActionsTestOtherA-90817446-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:12:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43550ccf30be49aba6ed6de2caf9ae1e',uuid=54d11b82-543c-4166-bf31-5e4e94eb830f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe9fc32d-b2f0-4770-8473-de9e3a5816c9", "address": "fa:16:3e:b9:17:27", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9fc32d-b2", "ovs_interfaceid": "fe9fc32d-b2f0-4770-8473-de9e3a5816c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 08:12:17 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Converting VIF {"id": "fe9fc32d-b2f0-4770-8473-de9e3a5816c9", "address": "fa:16:3e:b9:17:27", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9fc32d-b2", "ovs_interfaceid": "fe9fc32d-b2f0-4770-8473-de9e3a5816c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:12:17 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:17:27,bridge_name='br-int',has_traffic_filtering=True,id=fe9fc32d-b2f0-4770-8473-de9e3a5816c9,network=Network(9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9fc32d-b2') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:12:17 user nova-compute[74348]: DEBUG os_vif [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:17:27,bridge_name='br-int',has_traffic_filtering=True,id=fe9fc32d-b2f0-4770-8473-de9e3a5816c9,network=Network(9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9fc32d-b2') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 08:12:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:12:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:12:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 08:12:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:12:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1a203ccd-4c17-51dc-9e6e-ccb4ba2cc280', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:12:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:12:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:12:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:12:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe9fc32d-b2, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:12:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe9fc32d-b2, col_values=(('qos', UUID('51d13f00-e059-421a-bf68-4dd639fd5676')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:12:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe9fc32d-b2, col_values=(('external_ids', {'iface-id': 'fe9fc32d-b2f0-4770-8473-de9e3a5816c9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:17:27', 'vm-uuid': '54d11b82-543c-4166-bf31-5e4e94eb830f'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:12:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:12:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:12:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:12:17 user nova-compute[74348]: INFO os_vif [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:17:27,bridge_name='br-int',has_traffic_filtering=True,id=fe9fc32d-b2f0-4770-8473-de9e3a5816c9,network=Network(9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9fc32d-b2')
Nov 22 08:12:17 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:12:17 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] No VIF found with MAC fa:16:3e:b9:17:27, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:12:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:12:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:12:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:12:18 user nova-compute[74348]: DEBUG nova.compute.manager [req-490d7163-27a1-4839-962e-f3bf9d6ccf3f req-f8d94520-d01f-4111-84b3-6aab28bfeb77 service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Received event network-vif-plugged-fe9fc32d-b2f0-4770-8473-de9e3a5816c9 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:12:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-490d7163-27a1-4839-962e-f3bf9d6ccf3f req-f8d94520-d01f-4111-84b3-6aab28bfeb77 service nova] Acquiring lock "54d11b82-543c-4166-bf31-5e4e94eb830f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:12:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-490d7163-27a1-4839-962e-f3bf9d6ccf3f req-f8d94520-d01f-4111-84b3-6aab28bfeb77 service nova] Lock "54d11b82-543c-4166-bf31-5e4e94eb830f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:12:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-490d7163-27a1-4839-962e-f3bf9d6ccf3f req-f8d94520-d01f-4111-84b3-6aab28bfeb77 service nova] Lock "54d11b82-543c-4166-bf31-5e4e94eb830f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:12:18 user nova-compute[74348]: DEBUG nova.compute.manager [req-490d7163-27a1-4839-962e-f3bf9d6ccf3f req-f8d94520-d01f-4111-84b3-6aab28bfeb77 service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] No waiting events found dispatching network-vif-plugged-fe9fc32d-b2f0-4770-8473-de9e3a5816c9 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:12:18 user nova-compute[74348]: WARNING nova.compute.manager [req-490d7163-27a1-4839-962e-f3bf9d6ccf3f req-f8d94520-d01f-4111-84b3-6aab28bfeb77 service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Received unexpected event network-vif-plugged-fe9fc32d-b2f0-4770-8473-de9e3a5816c9 for instance with vm_state building and task_state spawning.
Nov 22 08:12:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:12:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:12:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:12:20 user nova-compute[74348]: DEBUG nova.compute.manager [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 08:12:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 08:12:20 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Instance spawned successfully.
Nov 22 08:12:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 08:12:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:12:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:12:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:12:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:12:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:12:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:12:20 user nova-compute[74348]: INFO nova.compute.manager [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Took 4.86 seconds to spawn the instance on the hypervisor.
Nov 22 08:12:20 user nova-compute[74348]: DEBUG nova.compute.manager [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:12:20 user nova-compute[74348]: INFO nova.compute.manager [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Took 12.04 seconds to build instance.
Nov 22 08:12:20 user nova-compute[74348]: DEBUG nova.compute.manager [req-2c165989-62a1-4169-9bcc-2aaf054da5a7 req-b2d6891d-6248-4f78-b085-e7b12344c072 service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Received event network-vif-plugged-fe9fc32d-b2f0-4770-8473-de9e3a5816c9 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:12:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2c165989-62a1-4169-9bcc-2aaf054da5a7 req-b2d6891d-6248-4f78-b085-e7b12344c072 service nova] Acquiring lock "54d11b82-543c-4166-bf31-5e4e94eb830f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:12:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2c165989-62a1-4169-9bcc-2aaf054da5a7 req-b2d6891d-6248-4f78-b085-e7b12344c072 service nova] Lock "54d11b82-543c-4166-bf31-5e4e94eb830f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:12:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2c165989-62a1-4169-9bcc-2aaf054da5a7 req-b2d6891d-6248-4f78-b085-e7b12344c072 service nova] Lock "54d11b82-543c-4166-bf31-5e4e94eb830f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:12:20 user nova-compute[74348]: DEBUG nova.compute.manager [req-2c165989-62a1-4169-9bcc-2aaf054da5a7 req-b2d6891d-6248-4f78-b085-e7b12344c072 service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] No waiting events found dispatching network-vif-plugged-fe9fc32d-b2f0-4770-8473-de9e3a5816c9 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:12:20 user nova-compute[74348]: WARNING nova.compute.manager [req-2c165989-62a1-4169-9bcc-2aaf054da5a7 req-b2d6891d-6248-4f78-b085-e7b12344c072 service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Received unexpected event network-vif-plugged-fe9fc32d-b2f0-4770-8473-de9e3a5816c9 for instance with vm_state active and task_state None.
Nov 22 08:12:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-5c34cb97-51fa-49ad-a2e7-403273b0dc39 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "54d11b82-543c-4166-bf31-5e4e94eb830f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.132s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:12:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:12:24 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:12:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:12:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:12:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:12:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:12:37 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:12:39 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:12:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:12:42 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:12:42 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:12:42 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Rebuilding the list of instances to heal {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 08:12:42 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-765f8c47-c042-4430-8d35-07926ad693fe" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:12:42 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-765f8c47-c042-4430-8d35-07926ad693fe" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:12:42 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 08:12:42 user nova-compute[74348]: DEBUG nova.objects.instance [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lazy-loading 'info_cache' on Instance uuid 765f8c47-c042-4430-8d35-07926ad693fe {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:12:43 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Updating instance_info_cache with network_info: [{"id": "3ee3f6b1-b929-404a-b3bb-6ece1c2d1052", "address": "fa:16:3e:60:74:68", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee3f6b1-b9", "ovs_interfaceid": "3ee3f6b1-b929-404a-b3bb-6ece1c2d1052", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:12:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-765f8c47-c042-4430-8d35-07926ad693fe" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:12:43 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 08:12:43 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:12:44 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:12:44 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:12:45 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:12:45 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:12:45 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:12:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:12:48 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:12:48 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:12:49 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:12:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:12:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:12:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:12:49 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:12:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:12:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:12:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:12:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:12:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:12:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:12:50 user nova-compute[74348]: INFO nova.compute.manager [None req-ee01689a-961a-4947-8a84-8c5a9c9fae41 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Unrescuing
Nov 22 08:12:50 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ee01689a-961a-4947-8a84-8c5a9c9fae41 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "refresh_cache-b998bedf-ee29-48a1-a14b-449add115c39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:12:50 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ee01689a-961a-4947-8a84-8c5a9c9fae41 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquired lock "refresh_cache-b998bedf-ee29-48a1-a14b-449add115c39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:12:50 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ee01689a-961a-4947-8a84-8c5a9c9fae41 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:12:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:12:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:12:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:12:50 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:12:50 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:12:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:12:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:12:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:12:50 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ee01689a-961a-4947-8a84-8c5a9c9fae41 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Updating instance_info_cache with network_info: [{"id": "ee377706-a70f-4d29-96be-4d56daedb95a", "address": "fa:16:3e:a1:2b:05", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee377706-a7", "ovs_interfaceid": "ee377706-a70f-4d29-96be-4d56daedb95a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:12:50 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ee01689a-961a-4947-8a84-8c5a9c9fae41 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Releasing lock "refresh_cache-b998bedf-ee29-48a1-a14b-449add115c39" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:12:50 user nova-compute[74348]: DEBUG nova.objects.instance [None req-ee01689a-961a-4947-8a84-8c5a9c9fae41 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lazy-loading 'flavor' on Instance uuid b998bedf-ee29-48a1-a14b-449add115c39 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:12:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:12:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:12:51 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:12:51 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:12:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:12:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:12:51 user nova-compute[74348]: DEBUG nova.compute.manager [req-3dce1e3b-b640-4ff3-99c5-aaece19793fb req-2c0d8bd1-38bf-48d9-885f-878b9b22530b service nova] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Received event network-vif-unplugged-ee377706-a70f-4d29-96be-4d56daedb95a {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:12:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3dce1e3b-b640-4ff3-99c5-aaece19793fb req-2c0d8bd1-38bf-48d9-885f-878b9b22530b service nova] Acquiring lock "b998bedf-ee29-48a1-a14b-449add115c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:12:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3dce1e3b-b640-4ff3-99c5-aaece19793fb req-2c0d8bd1-38bf-48d9-885f-878b9b22530b service nova] Lock "b998bedf-ee29-48a1-a14b-449add115c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:12:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3dce1e3b-b640-4ff3-99c5-aaece19793fb req-2c0d8bd1-38bf-48d9-885f-878b9b22530b service nova] Lock "b998bedf-ee29-48a1-a14b-449add115c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:12:51 user nova-compute[74348]: DEBUG nova.compute.manager [req-3dce1e3b-b640-4ff3-99c5-aaece19793fb req-2c0d8bd1-38bf-48d9-885f-878b9b22530b service nova] [instance: b998bedf-ee29-48a1-a14b-449add115c39] No waiting events found dispatching network-vif-unplugged-ee377706-a70f-4d29-96be-4d56daedb95a {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:12:51 user nova-compute[74348]: WARNING nova.compute.manager [req-3dce1e3b-b640-4ff3-99c5-aaece19793fb req-2c0d8bd1-38bf-48d9-885f-878b9b22530b service nova] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Received unexpected event network-vif-unplugged-ee377706-a70f-4d29-96be-4d56daedb95a for instance with vm_state rescued and task_state unrescuing.
Nov 22 08:12:51 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:12:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:12:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:12:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:12:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:12:51 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Instance destroyed successfully.
Nov 22 08:12:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:12:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:12:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:12:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:12:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:12:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:12:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:12:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:12:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:12:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:12:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfa85b90-0b1e-4984-b89d-315a3590ec93/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:12:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfa85b90-0b1e-4984-b89d-315a3590ec93/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:12:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfa85b90-0b1e-4984-b89d-315a3590ec93/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:12:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfa85b90-0b1e-4984-b89d-315a3590ec93/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:12:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:12:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:12:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:12:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:12:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:12:53 user nova-compute[74348]: DEBUG nova.compute.manager [req-97cb8152-80d0-4c5c-8d35-389d2bbc584f req-c5593470-9486-4ad5-9207-815171d3e944 service nova] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Received event network-vif-plugged-ee377706-a70f-4d29-96be-4d56daedb95a {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:12:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-97cb8152-80d0-4c5c-8d35-389d2bbc584f req-c5593470-9486-4ad5-9207-815171d3e944 service nova] Acquiring lock "b998bedf-ee29-48a1-a14b-449add115c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:12:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-97cb8152-80d0-4c5c-8d35-389d2bbc584f req-c5593470-9486-4ad5-9207-815171d3e944 service nova] Lock "b998bedf-ee29-48a1-a14b-449add115c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:12:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-97cb8152-80d0-4c5c-8d35-389d2bbc584f req-c5593470-9486-4ad5-9207-815171d3e944 service nova] Lock "b998bedf-ee29-48a1-a14b-449add115c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:12:53 user nova-compute[74348]: DEBUG nova.compute.manager [req-97cb8152-80d0-4c5c-8d35-389d2bbc584f req-c5593470-9486-4ad5-9207-815171d3e944 service nova] [instance: b998bedf-ee29-48a1-a14b-449add115c39] No waiting events found dispatching network-vif-plugged-ee377706-a70f-4d29-96be-4d56daedb95a {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:12:53 user nova-compute[74348]: WARNING nova.compute.manager [req-97cb8152-80d0-4c5c-8d35-389d2bbc584f req-c5593470-9486-4ad5-9207-815171d3e944 service nova] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Received unexpected event network-vif-plugged-ee377706-a70f-4d29-96be-4d56daedb95a for instance with vm_state rescued and task_state unrescuing.
Nov 22 08:12:53 user nova-compute[74348]: DEBUG nova.compute.manager [req-97cb8152-80d0-4c5c-8d35-389d2bbc584f req-c5593470-9486-4ad5-9207-815171d3e944 service nova] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Received event network-vif-plugged-ee377706-a70f-4d29-96be-4d56daedb95a {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:12:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-97cb8152-80d0-4c5c-8d35-389d2bbc584f req-c5593470-9486-4ad5-9207-815171d3e944 service nova] Acquiring lock "b998bedf-ee29-48a1-a14b-449add115c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:12:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-97cb8152-80d0-4c5c-8d35-389d2bbc584f req-c5593470-9486-4ad5-9207-815171d3e944 service nova] Lock "b998bedf-ee29-48a1-a14b-449add115c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:12:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-97cb8152-80d0-4c5c-8d35-389d2bbc584f req-c5593470-9486-4ad5-9207-815171d3e944 service nova] Lock "b998bedf-ee29-48a1-a14b-449add115c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:12:53 user nova-compute[74348]: DEBUG nova.compute.manager [req-97cb8152-80d0-4c5c-8d35-389d2bbc584f req-c5593470-9486-4ad5-9207-815171d3e944 service nova] [instance: b998bedf-ee29-48a1-a14b-449add115c39] No waiting events found dispatching network-vif-plugged-ee377706-a70f-4d29-96be-4d56daedb95a {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:12:53 user nova-compute[74348]: WARNING nova.compute.manager [req-97cb8152-80d0-4c5c-8d35-389d2bbc584f req-c5593470-9486-4ad5-9207-815171d3e944 service nova] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Received unexpected event network-vif-plugged-ee377706-a70f-4d29-96be-4d56daedb95a for instance with vm_state rescued and task_state unrescuing.
Nov 22 08:12:53 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:12:55 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:12:55 user nova-compute[74348]: DEBUG nova.compute.manager [req-2538d796-8994-4392-bb39-06c453e9e30f req-6546cf39-9974-44ea-9929-cb7f06125116 service nova] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Received event network-vif-plugged-ee377706-a70f-4d29-96be-4d56daedb95a {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:12:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2538d796-8994-4392-bb39-06c453e9e30f req-6546cf39-9974-44ea-9929-cb7f06125116 service nova] Acquiring lock "b998bedf-ee29-48a1-a14b-449add115c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:12:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2538d796-8994-4392-bb39-06c453e9e30f req-6546cf39-9974-44ea-9929-cb7f06125116 service nova] Lock "b998bedf-ee29-48a1-a14b-449add115c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:12:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2538d796-8994-4392-bb39-06c453e9e30f req-6546cf39-9974-44ea-9929-cb7f06125116 service nova] Lock "b998bedf-ee29-48a1-a14b-449add115c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:12:55 user nova-compute[74348]: DEBUG nova.compute.manager [req-2538d796-8994-4392-bb39-06c453e9e30f req-6546cf39-9974-44ea-9929-cb7f06125116 service nova] [instance: b998bedf-ee29-48a1-a14b-449add115c39] No waiting events found dispatching network-vif-plugged-ee377706-a70f-4d29-96be-4d56daedb95a {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:12:55 user nova-compute[74348]: WARNING nova.compute.manager [req-2538d796-8994-4392-bb39-06c453e9e30f req-6546cf39-9974-44ea-9929-cb7f06125116 service nova] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Received unexpected event network-vif-plugged-ee377706-a70f-4d29-96be-4d56daedb95a for instance with vm_state rescued and task_state unrescuing.
Nov 22 08:12:55 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ee01689a-961a-4947-8a84-8c5a9c9fae41 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:12:55 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:12:55 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:12:55 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=7851MB free_disk=24.65639877319336GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:12:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:12:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:12:55 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 765f8c47-c042-4430-8d35-07926ad693fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:12:55 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance b8f84c0b-fab5-4900-bf65-270c9c06baf8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:12:55 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 5006cff5-4b67-405d-b6b1-4c355f82d920 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:12:55 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 555f4246-d4b2-4f2f-b91c-dda8fe47264c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:12:55 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance ba74ca7d-2875-426c-a485-d908af865bae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:12:55 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance b95b6cae-1885-43e8-b589-ee89854100a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:12:55 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance b998bedf-ee29-48a1-a14b-449add115c39 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:12:55 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:12:55 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance dfa85b90-0b1e-4984-b89d-315a3590ec93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:12:55 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 54d11b82-543c-4166-bf31-5e4e94eb830f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:12:55 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:12:55 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:12:56 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:12:56 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:12:56 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:12:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.481s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:12:57 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:12:57 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:12:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:13:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:13:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:13:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:13:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:13:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:13:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:13:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:13:07 user nova-compute[74348]: DEBUG nova.compute.manager [req-6a06425a-1a49-4170-8720-d11e88fac13c req-0fedcc4d-159a-4967-b744-3defeade745d service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Received event network-changed-2b0fc463-3743-41e4-9846-ee4dc53689f4 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:13:07 user nova-compute[74348]: DEBUG nova.compute.manager [req-6a06425a-1a49-4170-8720-d11e88fac13c req-0fedcc4d-159a-4967-b744-3defeade745d service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Refreshing instance network info cache due to event network-changed-2b0fc463-3743-41e4-9846-ee4dc53689f4. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:13:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-6a06425a-1a49-4170-8720-d11e88fac13c req-0fedcc4d-159a-4967-b744-3defeade745d service nova] Acquiring lock "refresh_cache-5c3f6262-19cf-41dd-bc6c-bdb006eb58a0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:13:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-6a06425a-1a49-4170-8720-d11e88fac13c req-0fedcc4d-159a-4967-b744-3defeade745d service nova] Acquired lock "refresh_cache-5c3f6262-19cf-41dd-bc6c-bdb006eb58a0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:13:07 user nova-compute[74348]: DEBUG nova.network.neutron [req-6a06425a-1a49-4170-8720-d11e88fac13c req-0fedcc4d-159a-4967-b744-3defeade745d service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Refreshing network info cache for port 2b0fc463-3743-41e4-9846-ee4dc53689f4 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:13:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquiring lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:13:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:13:07 user nova-compute[74348]: DEBUG nova.objects.instance [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lazy-loading 'flavor' on Instance uuid 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:13:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:13:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquiring lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:13:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:13:08 user nova-compute[74348]: INFO nova.compute.manager [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Attaching volume 6eb1715a-579b-43af-96ad-d629a5706c30 to /dev/vdb
Nov 22 08:13:08 user nova-compute[74348]: DEBUG nova.network.neutron [req-6a06425a-1a49-4170-8720-d11e88fac13c req-0fedcc4d-159a-4967-b744-3defeade745d service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Updated VIF entry in instance network info cache for port 2b0fc463-3743-41e4-9846-ee4dc53689f4. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:13:08 user nova-compute[74348]: DEBUG nova.network.neutron [req-6a06425a-1a49-4170-8720-d11e88fac13c req-0fedcc4d-159a-4967-b744-3defeade745d service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Updating instance_info_cache with network_info: [{"id": "2b0fc463-3743-41e4-9846-ee4dc53689f4", "address": "fa:16:3e:f9:d6:30", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0fc463-37", "ovs_interfaceid": "2b0fc463-3743-41e4-9846-ee4dc53689f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:13:08 user nova-compute[74348]: DEBUG os_brick.utils [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:13:08 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:08 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:08 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6927d2-60bd-405a-80d3-028cac55a0b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:13:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-6a06425a-1a49-4170-8720-d11e88fac13c req-0fedcc4d-159a-4967-b744-3defeade745d service nova] Releasing lock "refresh_cache-5c3f6262-19cf-41dd-bc6c-bdb006eb58a0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:13:08 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:08 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:08 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b49dba-d5f0-442d-9337-118bc98c3e8f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:13:08 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:08 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:08 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67ee1a4-7225-45ea-a1cc-59f1a210fc01]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:13:08 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86bcd96-6f3a-4658-9016-8258f68dbb40]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:13:08 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:08 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:13:08 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 08:13:08 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:08 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:13:08 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 08:13:08 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fb5054-b012-4c13-ac93-45ce80696812]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:13:08 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 08:13:08 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 08:13:08 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 08:13:08 user nova-compute[74348]: DEBUG os_brick.utils [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:13:08 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Updating existing volume attachment record: d2a09fea-27d7-4815-a947-5620b4b416f5 {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 08:13:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:13:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:13:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:13:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hwgVSAlC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:13:15 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:13:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:13:15 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:13:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:13:15 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 08:13:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64a7405-568c-40df-9284-a66a8f84d74e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 08:13:15 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a653db6a-6166-4818-86ba-d1c5ef93852f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30] added
Nov 22 08:13:15 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[794f10e3-0511-4255-bcf0-86763b04dbc0]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e732791-81eb-4e24-9fc2-182bb5acf87d]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hwgVSAlC {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hwgVSAlC" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bf09af-f06d-4391-9386-141825a27a3b]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hwgVSAlC'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[969caab9-ffb2-4725-87d5-c512e652c2b9]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b8b761-03ca-43bc-aba4-11edad2f2f62]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:13:15 user nova-compute[74348]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)
Nov 22 08:13:15 user nova-compute[74348]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)
Nov 22 08:13:15 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:13:15 user nova-compute[74348]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)
Nov 22 08:13:15 user nova-compute[74348]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)
Nov 22 08:13:15 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cede94-2d7f-4e1c-b0f3-7c6fa34f7a10]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30, portal: 172.16.0.220,3260]
Nov 22 08:13:15 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30, portal: 172.16.0.220,3260] successful.
Nov 22 08:13:15 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[92882aff-a075-406a-aac4-ce4e8a2f2ab4]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7008b1-cd26-4538-acf2-6ac2e0bcdaff]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:13:15 user nova-compute[74348]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)
Nov 22 08:13:15 user nova-compute[74348]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)
Nov 22 08:13:15 user nova-compute[74348]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 (non-flash)
Nov 22 08:13:15 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:13:15 user nova-compute[74348]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)
Nov 22 08:13:15 user nova-compute[74348]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)
Nov 22 08:13:15 user nova-compute[74348]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 (non-flash)
Nov 22 08:13:15 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] HCTL ('36', '-', '-', 0) found on session 48 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[21de3e1d-3e5a-4d53-8b7c-8a81ce964caf]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:13:15 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Searching for a device in session 48 and hctl ['36', '*', '*', 0] yield: None {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:13:16 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Searching for a device in session 48 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:13:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hwgVSAlC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 08:13:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:13:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23434643737633637', 'path': '/dev/sde'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:13:16 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434643737633637', 'path': '/dev/sde'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 08:13:16 user nova-compute[74348]: DEBUG nova.objects.instance [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lazy-loading 'flavor' on Instance uuid 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:13:16 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 08:13:16 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:13:16 user nova-compute[74348]:   <source dev="/dev/sde"/>
Nov 22 08:13:16 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:13:16 user nova-compute[74348]:   <serial>6eb1715a-579b-43af-96ad-d629a5706c30</serial>
Nov 22 08:13:16 user nova-compute[74348]: </disk>
Nov 22 08:13:16 user nova-compute[74348]:  {{(pid=74348) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 08:13:17 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:13:17 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:13:17 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] No VIF found with MAC fa:16:3e:f9:d6:30, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:13:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-17eaccf9-18d4-4ccf-9c0b-814b866bd9b3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.309s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:13:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:13:18 user nova-compute[74348]: INFO nova.compute.manager [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Rescuing
Nov 22 08:13:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquiring lock "refresh_cache-5c3f6262-19cf-41dd-bc6c-bdb006eb58a0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:13:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquired lock "refresh_cache-5c3f6262-19cf-41dd-bc6c-bdb006eb58a0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:13:18 user nova-compute[74348]: DEBUG nova.network.neutron [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:13:18 user nova-compute[74348]: DEBUG nova.network.neutron [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Updating instance_info_cache with network_info: [{"id": "2b0fc463-3743-41e4-9846-ee4dc53689f4", "address": "fa:16:3e:f9:d6:30", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0fc463-37", "ovs_interfaceid": "2b0fc463-3743-41e4-9846-ee4dc53689f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:13:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Releasing lock "refresh_cache-5c3f6262-19cf-41dd-bc6c-bdb006eb58a0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:13:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:13:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:13:19 user nova-compute[74348]: DEBUG nova.compute.manager [req-7c651bd7-8772-41c5-acff-c34acb178936 req-b30e625d-7c1c-4428-9a18-dc6b50a98644 service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Received event network-vif-unplugged-2b0fc463-3743-41e4-9846-ee4dc53689f4 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:13:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-7c651bd7-8772-41c5-acff-c34acb178936 req-b30e625d-7c1c-4428-9a18-dc6b50a98644 service nova] Acquiring lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:13:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-7c651bd7-8772-41c5-acff-c34acb178936 req-b30e625d-7c1c-4428-9a18-dc6b50a98644 service nova] Lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:13:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-7c651bd7-8772-41c5-acff-c34acb178936 req-b30e625d-7c1c-4428-9a18-dc6b50a98644 service nova] Lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:13:19 user nova-compute[74348]: DEBUG nova.compute.manager [req-7c651bd7-8772-41c5-acff-c34acb178936 req-b30e625d-7c1c-4428-9a18-dc6b50a98644 service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] No waiting events found dispatching network-vif-unplugged-2b0fc463-3743-41e4-9846-ee4dc53689f4 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:13:19 user nova-compute[74348]: WARNING nova.compute.manager [req-7c651bd7-8772-41c5-acff-c34acb178936 req-b30e625d-7c1c-4428-9a18-dc6b50a98644 service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Received unexpected event network-vif-unplugged-2b0fc463-3743-41e4-9846-ee4dc53689f4 for instance with vm_state active and task_state rescuing.
Nov 22 08:13:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:13:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:13:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:13:19 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Instance destroyed successfully.
Nov 22 08:13:19 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Attempting rescue
Nov 22 08:13:19 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74348) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 22 08:13:19 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Instance directory exists: not creating {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 22 08:13:19 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Creating image(s)
Nov 22 08:13:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquiring lock "/opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:13:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "/opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:13:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "/opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:13:19 user nova-compute[74348]: DEBUG nova.objects.instance [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:13:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquiring lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:13:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:13:19 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:20 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.189s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:20 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0/disk.rescue {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:20 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0/disk.rescue" returned: 0 in 0.059s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:13:20 user nova-compute[74348]: DEBUG nova.objects.instance [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lazy-loading 'migration_context' on Instance uuid 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:13:20 user nova-compute[74348]: DEBUG nova.objects.base [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Object Instance<5c3f6262-19cf-41dd-bc6c-bdb006eb58a0> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:13:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 08:13:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Start _get_guest_xml network_info=[{"id": "2b0fc463-3743-41e4-9846-ee4dc53689f4", "address": "fa:16:3e:f9:d6:30", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "vif_mac": "fa:16:3e:f9:d6:30"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0fc463-37", "ovs_interfaceid": "2b0fc463-3743-41e4-9846-ee4dc53689f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 08:13:20 user nova-compute[74348]: DEBUG nova.objects.instance [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lazy-loading 'resources' on Instance uuid 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:13:20 user nova-compute[74348]: DEBUG nova.objects.base [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Object Instance<5c3f6262-19cf-41dd-bc6c-bdb006eb58a0> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:13:20 user nova-compute[74348]: DEBUG nova.objects.instance [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lazy-loading 'numa_topology' on Instance uuid 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:13:20 user nova-compute[74348]: DEBUG nova.objects.base [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Object Instance<5c3f6262-19cf-41dd-bc6c-bdb006eb58a0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:13:20 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:13:20 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:13:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 08:13:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 08:13:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 08:13:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 08:13:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 08:13:20 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 08:13:20 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 08:13:20 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 08:13:20 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 08:13:20 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 08:13:20 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 08:13:20 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 08:13:20 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 08:13:20 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 08:13:20 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 08:13:20 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 08:13:20 user nova-compute[74348]: DEBUG nova.objects.instance [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:13:20 user nova-compute[74348]: DEBUG nova.objects.base [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Object Instance<5c3f6262-19cf-41dd-bc6c-bdb006eb58a0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:13:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:11:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-408142113',display_name='tempest-ServerRescueNegativeTestJSON-server-408142113',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-408142113',id=39,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTdFy9xJMY+tkSnPoKIcYDCTRFY7lXZyCDzt1jEfugDen4Y9Eg9lFwO8VHH6D0hbVNRZWrLT0z8c4BxzMBaNJFSTjxYBMTbpIsDK8ziRltd2xcFzudVT5cjnyNXosH5qQ==',key_name='tempest-keypair-1362649951',keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:11:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d975b772fea4ed98b1b3ad284e51a65',ramdisk_id='',reservation_id='r-g0d4c2q4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1773499839',owner_user_name='tempest-ServerRescueNegativeTestJSON-1773499839-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:11:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b3c6587d0764b9fae5782792aec5d92',uuid=5c3f6262-19cf-41dd-bc6c-bdb006eb58a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b0fc463-3743-41e4-9846-ee4dc53689f4", "address": "fa:16:3e:f9:d6:30", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "vif_mac": "fa:16:3e:f9:d6:30"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0fc463-37", "ovs_interfaceid": "2b0fc463-3743-41e4-9846-ee4dc53689f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 08:13:20 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Converting VIF {"id": "2b0fc463-3743-41e4-9846-ee4dc53689f4", "address": "fa:16:3e:f9:d6:30", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "vif_mac": "fa:16:3e:f9:d6:30"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0fc463-37", "ovs_interfaceid": "2b0fc463-3743-41e4-9846-ee4dc53689f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:13:20 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:d6:30,bridge_name='br-int',has_traffic_filtering=True,id=2b0fc463-3743-41e4-9846-ee4dc53689f4,network=Network(246d8f55-a1eb-4883-906c-69f15289caef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b0fc463-37') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:13:20 user nova-compute[74348]: DEBUG nova.objects.instance [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lazy-loading 'pci_devices' on Instance uuid 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:13:20 user nova-compute[74348]: DEBUG nova.objects.base [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Object Instance<5c3f6262-19cf-41dd-bc6c-bdb006eb58a0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:13:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] End _get_guest_xml xml=<domain type="kvm">
Nov 22 08:13:20 user nova-compute[74348]:   <uuid>5c3f6262-19cf-41dd-bc6c-bdb006eb58a0</uuid>
Nov 22 08:13:20 user nova-compute[74348]:   <name>instance-00000027</name>
Nov 22 08:13:20 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 08:13:20 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 08:13:20 user nova-compute[74348]:   <metadata>
Nov 22 08:13:20 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 08:13:20 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 08:13:20 user nova-compute[74348]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-408142113</nova:name>
Nov 22 08:13:20 user nova-compute[74348]:       <nova:creationTime>2023-11-22 08:13:20</nova:creationTime>
Nov 22 08:13:20 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 08:13:20 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 08:13:20 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 08:13:20 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 08:13:20 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 08:13:20 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 08:13:20 user nova-compute[74348]:       </nova:flavor>
Nov 22 08:13:20 user nova-compute[74348]:       <nova:owner>
Nov 22 08:13:20 user nova-compute[74348]:         <nova:user uuid="0b3c6587d0764b9fae5782792aec5d92">tempest-ServerRescueNegativeTestJSON-1773499839-project-member</nova:user>
Nov 22 08:13:20 user nova-compute[74348]:         <nova:project uuid="5d975b772fea4ed98b1b3ad284e51a65">tempest-ServerRescueNegativeTestJSON-1773499839</nova:project>
Nov 22 08:13:20 user nova-compute[74348]:       </nova:owner>
Nov 22 08:13:20 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 08:13:20 user nova-compute[74348]:       <nova:ports>
Nov 22 08:13:20 user nova-compute[74348]:         <nova:port uuid="2b0fc463-3743-41e4-9846-ee4dc53689f4">
Nov 22 08:13:20 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 22 08:13:20 user nova-compute[74348]:         </nova:port>
Nov 22 08:13:20 user nova-compute[74348]:       </nova:ports>
Nov 22 08:13:20 user nova-compute[74348]:     </nova:instance>
Nov 22 08:13:20 user nova-compute[74348]:   </metadata>
Nov 22 08:13:20 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 08:13:20 user nova-compute[74348]:     <system>
Nov 22 08:13:20 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 08:13:20 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 08:13:20 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 08:13:20 user nova-compute[74348]:       <entry name="serial">5c3f6262-19cf-41dd-bc6c-bdb006eb58a0</entry>
Nov 22 08:13:20 user nova-compute[74348]:       <entry name="uuid">5c3f6262-19cf-41dd-bc6c-bdb006eb58a0</entry>
Nov 22 08:13:20 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 08:13:20 user nova-compute[74348]:     </system>
Nov 22 08:13:20 user nova-compute[74348]:   </sysinfo>
Nov 22 08:13:20 user nova-compute[74348]:   <os>
Nov 22 08:13:20 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 08:13:20 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 08:13:20 user nova-compute[74348]:   </os>
Nov 22 08:13:20 user nova-compute[74348]:   <features>
Nov 22 08:13:20 user nova-compute[74348]:     <acpi/>
Nov 22 08:13:20 user nova-compute[74348]:     <apic/>
Nov 22 08:13:20 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 08:13:20 user nova-compute[74348]:   </features>
Nov 22 08:13:20 user nova-compute[74348]:   <clock offset="utc">
Nov 22 08:13:20 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 08:13:20 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 08:13:20 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 08:13:20 user nova-compute[74348]:   </clock>
Nov 22 08:13:20 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 08:13:20 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 08:13:20 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 08:13:20 user nova-compute[74348]:   </cpu>
Nov 22 08:13:20 user nova-compute[74348]:   <devices>
Nov 22 08:13:20 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 08:13:20 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 08:13:20 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0/disk.rescue"/>
Nov 22 08:13:20 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 08:13:20 user nova-compute[74348]:     </disk>
Nov 22 08:13:20 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 08:13:20 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 08:13:20 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0/disk"/>
Nov 22 08:13:20 user nova-compute[74348]:       <target dev="vdb" bus="virtio"/>
Nov 22 08:13:20 user nova-compute[74348]:     </disk>
Nov 22 08:13:20 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 08:13:20 user nova-compute[74348]:       <mac address="fa:16:3e:f9:d6:30"/>
Nov 22 08:13:20 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:13:20 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 08:13:20 user nova-compute[74348]:       <target dev="tap2b0fc463-37"/>
Nov 22 08:13:20 user nova-compute[74348]:     </interface>
Nov 22 08:13:20 user nova-compute[74348]:     <serial type="pty">
Nov 22 08:13:20 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0/console.log" append="off"/>
Nov 22 08:13:20 user nova-compute[74348]:     </serial>
Nov 22 08:13:20 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 08:13:20 user nova-compute[74348]:     <video>
Nov 22 08:13:20 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:13:20 user nova-compute[74348]:     </video>
Nov 22 08:13:20 user nova-compute[74348]:     <rng model="virtio">
Nov 22 08:13:20 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 08:13:20 user nova-compute[74348]:     </rng>
Nov 22 08:13:20 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 08:13:20 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 08:13:20 user nova-compute[74348]:       <stats period="10"/>
Nov 22 08:13:20 user nova-compute[74348]:     </memballoon>
Nov 22 08:13:20 user nova-compute[74348]:   </devices>
Nov 22 08:13:20 user nova-compute[74348]: </domain>
Nov 22 08:13:20 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 08:13:20 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Instance destroyed successfully.
Nov 22 08:13:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:13:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:13:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] No VIF found with MAC fa:16:3e:f9:d6:30, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:13:21 user nova-compute[74348]: DEBUG nova.compute.manager [req-ec9dafd0-082a-42b3-97ae-d8481ea90e26 req-7b08e37e-aa5f-4f95-8d38-e5193639e686 service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Received event network-vif-plugged-2b0fc463-3743-41e4-9846-ee4dc53689f4 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:13:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-ec9dafd0-082a-42b3-97ae-d8481ea90e26 req-7b08e37e-aa5f-4f95-8d38-e5193639e686 service nova] Acquiring lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:13:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-ec9dafd0-082a-42b3-97ae-d8481ea90e26 req-7b08e37e-aa5f-4f95-8d38-e5193639e686 service nova] Lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:13:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-ec9dafd0-082a-42b3-97ae-d8481ea90e26 req-7b08e37e-aa5f-4f95-8d38-e5193639e686 service nova] Lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:13:21 user nova-compute[74348]: DEBUG nova.compute.manager [req-ec9dafd0-082a-42b3-97ae-d8481ea90e26 req-7b08e37e-aa5f-4f95-8d38-e5193639e686 service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] No waiting events found dispatching network-vif-plugged-2b0fc463-3743-41e4-9846-ee4dc53689f4 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:13:21 user nova-compute[74348]: WARNING nova.compute.manager [req-ec9dafd0-082a-42b3-97ae-d8481ea90e26 req-7b08e37e-aa5f-4f95-8d38-e5193639e686 service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Received unexpected event network-vif-plugged-2b0fc463-3743-41e4-9846-ee4dc53689f4 for instance with vm_state active and task_state rescuing.
Nov 22 08:13:21 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:13:21 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:13:21 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:13:21 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:13:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:13:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:13:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:13:23 user nova-compute[74348]: DEBUG nova.compute.manager [req-b20e606a-7fe9-4a15-964f-62b3fe62d3b9 req-b77a8380-fba1-4bbb-9edd-880f31d0cc4a service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Received event network-vif-plugged-2b0fc463-3743-41e4-9846-ee4dc53689f4 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:13:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b20e606a-7fe9-4a15-964f-62b3fe62d3b9 req-b77a8380-fba1-4bbb-9edd-880f31d0cc4a service nova] Acquiring lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:13:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b20e606a-7fe9-4a15-964f-62b3fe62d3b9 req-b77a8380-fba1-4bbb-9edd-880f31d0cc4a service nova] Lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:13:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b20e606a-7fe9-4a15-964f-62b3fe62d3b9 req-b77a8380-fba1-4bbb-9edd-880f31d0cc4a service nova] Lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:13:23 user nova-compute[74348]: DEBUG nova.compute.manager [req-b20e606a-7fe9-4a15-964f-62b3fe62d3b9 req-b77a8380-fba1-4bbb-9edd-880f31d0cc4a service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] No waiting events found dispatching network-vif-plugged-2b0fc463-3743-41e4-9846-ee4dc53689f4 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:13:23 user nova-compute[74348]: WARNING nova.compute.manager [req-b20e606a-7fe9-4a15-964f-62b3fe62d3b9 req-b77a8380-fba1-4bbb-9edd-880f31d0cc4a service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Received unexpected event network-vif-plugged-2b0fc463-3743-41e4-9846-ee4dc53689f4 for instance with vm_state active and task_state rescuing.
Nov 22 08:13:23 user nova-compute[74348]: DEBUG nova.compute.manager [req-b20e606a-7fe9-4a15-964f-62b3fe62d3b9 req-b77a8380-fba1-4bbb-9edd-880f31d0cc4a service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Received event network-vif-plugged-2b0fc463-3743-41e4-9846-ee4dc53689f4 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:13:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b20e606a-7fe9-4a15-964f-62b3fe62d3b9 req-b77a8380-fba1-4bbb-9edd-880f31d0cc4a service nova] Acquiring lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:13:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b20e606a-7fe9-4a15-964f-62b3fe62d3b9 req-b77a8380-fba1-4bbb-9edd-880f31d0cc4a service nova] Lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:13:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b20e606a-7fe9-4a15-964f-62b3fe62d3b9 req-b77a8380-fba1-4bbb-9edd-880f31d0cc4a service nova] Lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:13:23 user nova-compute[74348]: DEBUG nova.compute.manager [req-b20e606a-7fe9-4a15-964f-62b3fe62d3b9 req-b77a8380-fba1-4bbb-9edd-880f31d0cc4a service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] No waiting events found dispatching network-vif-plugged-2b0fc463-3743-41e4-9846-ee4dc53689f4 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:13:23 user nova-compute[74348]: WARNING nova.compute.manager [req-b20e606a-7fe9-4a15-964f-62b3fe62d3b9 req-b77a8380-fba1-4bbb-9edd-880f31d0cc4a service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Received unexpected event network-vif-plugged-2b0fc463-3743-41e4-9846-ee4dc53689f4 for instance with vm_state active and task_state rescuing.
Nov 22 08:13:23 user nova-compute[74348]: DEBUG nova.compute.manager [None req-6677e7ca-6512-436a-947c-55f25c6f477f tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:13:24 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:13:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:13:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:13:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:13:37 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:13:38 user nova-compute[74348]: DEBUG nova.compute.manager [req-e61e57c5-80d8-42e3-ac30-80cb89f8c306 req-43408e66-5ba6-4489-9ac9-66e2f190f582 service nova] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Received event network-changed-71861e5a-e368-4c2f-b960-7ec13f513fec {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:13:38 user nova-compute[74348]: DEBUG nova.compute.manager [req-e61e57c5-80d8-42e3-ac30-80cb89f8c306 req-43408e66-5ba6-4489-9ac9-66e2f190f582 service nova] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Refreshing instance network info cache due to event network-changed-71861e5a-e368-4c2f-b960-7ec13f513fec. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:13:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e61e57c5-80d8-42e3-ac30-80cb89f8c306 req-43408e66-5ba6-4489-9ac9-66e2f190f582 service nova] Acquiring lock "refresh_cache-dfa85b90-0b1e-4984-b89d-315a3590ec93" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:13:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e61e57c5-80d8-42e3-ac30-80cb89f8c306 req-43408e66-5ba6-4489-9ac9-66e2f190f582 service nova] Acquired lock "refresh_cache-dfa85b90-0b1e-4984-b89d-315a3590ec93" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:13:38 user nova-compute[74348]: DEBUG nova.network.neutron [req-e61e57c5-80d8-42e3-ac30-80cb89f8c306 req-43408e66-5ba6-4489-9ac9-66e2f190f582 service nova] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Refreshing network info cache for port 71861e5a-e368-4c2f-b960-7ec13f513fec {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:13:38 user nova-compute[74348]: DEBUG nova.network.neutron [req-e61e57c5-80d8-42e3-ac30-80cb89f8c306 req-43408e66-5ba6-4489-9ac9-66e2f190f582 service nova] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Updated VIF entry in instance network info cache for port 71861e5a-e368-4c2f-b960-7ec13f513fec. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:13:38 user nova-compute[74348]: DEBUG nova.network.neutron [req-e61e57c5-80d8-42e3-ac30-80cb89f8c306 req-43408e66-5ba6-4489-9ac9-66e2f190f582 service nova] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Updating instance_info_cache with network_info: [{"id": "71861e5a-e368-4c2f-b960-7ec13f513fec", "address": "fa:16:3e:82:44:15", "network": {"id": "606a7c22-1285-47e8-bfa0-f09dbd7cb9ac", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-63336037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d1a2eb68ef4c0aa5ef081fe10877a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71861e5a-e3", "ovs_interfaceid": "71861e5a-e368-4c2f-b960-7ec13f513fec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:13:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e61e57c5-80d8-42e3-ac30-80cb89f8c306 req-43408e66-5ba6-4489-9ac9-66e2f190f582 service nova] Releasing lock "refresh_cache-dfa85b90-0b1e-4984-b89d-315a3590ec93" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:13:39 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:13:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquiring lock "dfa85b90-0b1e-4984-b89d-315a3590ec93" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:13:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "dfa85b90-0b1e-4984-b89d-315a3590ec93" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:13:41 user nova-compute[74348]: DEBUG nova.objects.instance [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lazy-loading 'flavor' on Instance uuid dfa85b90-0b1e-4984-b89d-315a3590ec93 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:13:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "dfa85b90-0b1e-4984-b89d-315a3590ec93" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:13:42 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquiring lock "dfa85b90-0b1e-4984-b89d-315a3590ec93" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:13:42 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "dfa85b90-0b1e-4984-b89d-315a3590ec93" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:13:42 user nova-compute[74348]: INFO nova.compute.manager [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Attaching volume 67c4510c-fcd7-434c-b974-5eff2da99d9d to /dev/vdb
Nov 22 08:13:42 user nova-compute[74348]: DEBUG os_brick.utils [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:13:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:42 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5803d0-62b8-496d-a98f-2f11f5f3c36f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:13:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:42 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[445b5198-f64c-49e6-99c0-ea4bec614b5b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:13:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:42 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0642c6f4-edc4-44f7-afd8-084a6837d443]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:13:42 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a569160-d7f8-4956-96ac-365a013e2d7e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:13:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:13:42 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 08:13:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:13:42 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 08:13:42 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[89465c9f-65ad-4113-bba7-8d11824979f8]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:13:42 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 08:13:42 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 08:13:42 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 08:13:42 user nova-compute[74348]: DEBUG os_brick.utils [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:13:42 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Updating existing volume attachment record: 295bc9b9-1b6e-44df-a401-4008bc19469c {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 08:13:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:13:43 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:13:44 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:13:44 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:13:44 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:13:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-b8f84c0b-fab5-4900-bf65-270c9c06baf8" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:13:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-b8f84c0b-fab5-4900-bf65-270c9c06baf8" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:13:44 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 08:13:45 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Updating instance_info_cache with network_info: [{"id": "72e5b044-9d3b-412d-9a20-408387fb6fe6", "address": "fa:16:3e:5d:93:c7", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e5b044-9d", "ovs_interfaceid": "72e5b044-9d3b-412d-9a20-408387fb6fe6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:13:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-b8f84c0b-fab5-4900-bf65-270c9c06baf8" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:13:45 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 08:13:45 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:13:45 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:13:45 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:13:46 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:13:46 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:13:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kFAmgSEj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:13:48 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:13:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:13:48 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:13:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:13:48 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 08:13:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5f79b0-fd20-4f72-ba56-1961ea131a6e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 08:13:48 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c9cbaf-e586-48c1-ae48-256c95afb7aa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d] added
Nov 22 08:13:48 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[236561a5-248c-46ce-9457-e0569790497e]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4e5d7e-14fb-4ffa-848c-7680d6d6d53a]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kFAmgSEj {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kFAmgSEj" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96dfbd0-a1b1-490f-9da0-1329ec78302d]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kFAmgSEj'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdd1dd4-c10a-4f3b-86f3-f740493d1366]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c7b2cb-360e-484d-8499-11685fb1d015]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:13:48 user nova-compute[74348]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)
Nov 22 08:13:48 user nova-compute[74348]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)
Nov 22 08:13:48 user nova-compute[74348]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 (non-flash)
Nov 22 08:13:48 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:13:48 user nova-compute[74348]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)
Nov 22 08:13:48 user nova-compute[74348]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)
Nov 22 08:13:48 user nova-compute[74348]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 (non-flash)
Nov 22 08:13:48 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3b65ce-c5bd-4b4a-90ba-917d5e963bbf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d, portal: 172.16.0.220,3260]
Nov 22 08:13:48 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d, portal: 172.16.0.220,3260] successful.
Nov 22 08:13:48 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[020a5f20-b88e-40cc-b868-0434cfb44ccd]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d0400e-d03c-47f5-b3ed-e74a771d8d61]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:13:48 user nova-compute[74348]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)
Nov 22 08:13:48 user nova-compute[74348]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)
Nov 22 08:13:48 user nova-compute[74348]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 (non-flash)
Nov 22 08:13:48 user nova-compute[74348]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d (non-flash)
Nov 22 08:13:48 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:13:48 user nova-compute[74348]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)
Nov 22 08:13:48 user nova-compute[74348]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)
Nov 22 08:13:48 user nova-compute[74348]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 (non-flash)
Nov 22 08:13:48 user nova-compute[74348]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d (non-flash)
Nov 22 08:13:48 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] HCTL ('37', '-', '-', 0) found on session 49 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca06054e-cc0c-4770-ac0b-dc552f70fa2c]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:13:48 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Searching for a device in session 49 and hctl ['37', '*', '*', 0] yield: None {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:13:49 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:13:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:13:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:13:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:13:49 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:13:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:13:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:49 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Searching for a device in session 49 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:13:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kFAmgSEj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 08:13:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:13:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23232656637343633', 'path': '/dev/sdf'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:13:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232656637343633', 'path': '/dev/sdf'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 08:13:49 user nova-compute[74348]: DEBUG nova.objects.instance [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lazy-loading 'flavor' on Instance uuid dfa85b90-0b1e-4984-b89d-315a3590ec93 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:13:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 08:13:49 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:13:49 user nova-compute[74348]:   <source dev="/dev/sdf"/>
Nov 22 08:13:49 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:13:49 user nova-compute[74348]:   <serial>67c4510c-fcd7-434c-b974-5eff2da99d9d</serial>
Nov 22 08:13:49 user nova-compute[74348]: </disk>
Nov 22 08:13:49 user nova-compute[74348]:  {{(pid=74348) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 08:13:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:50 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:13:50 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:13:50 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] No VIF found with MAC fa:16:3e:82:44:15, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:13:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:50 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:13:50 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:13:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:50 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b01bbbe0-420d-49b1-801b-b8b146a18f6d tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "dfa85b90-0b1e-4984-b89d-315a3590ec93" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.479s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:13:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0/disk.rescue --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0/disk.rescue --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0/disk.rescue --force-share --output=json" returned: 0 in 0.230s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:51 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0/disk (vdb) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:13:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfa85b90-0b1e-4984-b89d-315a3590ec93/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:13:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfa85b90-0b1e-4984-b89d-315a3590ec93/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfa85b90-0b1e-4984-b89d-315a3590ec93/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfa85b90-0b1e-4984-b89d-315a3590ec93/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:52 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:13:52 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:13:53 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:13:53 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:13:53 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=7915MB free_disk=24.65363311767578GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquiring lock "dfa85b90-0b1e-4984-b89d-315a3590ec93" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "dfa85b90-0b1e-4984-b89d-315a3590ec93" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG nova.objects.instance [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lazy-loading 'flavor' on Instance uuid dfa85b90-0b1e-4984-b89d-315a3590ec93 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "dfa85b90-0b1e-4984-b89d-315a3590ec93" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 765f8c47-c042-4430-8d35-07926ad693fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance b8f84c0b-fab5-4900-bf65-270c9c06baf8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 5006cff5-4b67-405d-b6b1-4c355f82d920 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 555f4246-d4b2-4f2f-b91c-dda8fe47264c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance ba74ca7d-2875-426c-a485-d908af865bae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance b95b6cae-1885-43e8-b589-ee89854100a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance b998bedf-ee29-48a1-a14b-449add115c39 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance dfa85b90-0b1e-4984-b89d-315a3590ec93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 54d11b82-543c-4166-bf31-5e4e94eb830f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Refreshing inventories for resource provider 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Updating ProviderTree inventory for provider 52690f6a-773f-4e8d-be85-d278b6522975 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Updating inventory in ProviderTree for provider 52690f6a-773f-4e8d-be85-d278b6522975 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Refreshing aggregate associations for resource provider 52690f6a-773f-4e8d-be85-d278b6522975, aggregates: None {{(pid=74348) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquiring lock "dfa85b90-0b1e-4984-b89d-315a3590ec93" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "dfa85b90-0b1e-4984-b89d-315a3590ec93" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:13:53 user nova-compute[74348]: INFO nova.compute.manager [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Attaching volume 89b845d5-94f9-45e0-93c4-d043ad9bf9f2 to /dev/vdc
Nov 22 08:13:53 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Refreshing trait associations for resource provider 52690f6a-773f-4e8d-be85-d278b6522975, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=74348) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG os_brick.utils [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[279d68a1-d597-4061-8112-ba03fc062241]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f54539d-29c7-4c8b-92a9-1c10febb07b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[524ca1bd-daa7-47b4-8138-3f3ff2e0e66f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e419093b-a378-4b60-ad3b-282463547739]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:13:53 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 08:13:53 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[521fb2e8-7f17-4791-909a-9d4cdea54d1e]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG os_brick.utils [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Updating existing volume attachment record: 84963fef-25ed-4ab1-a531-bf34d91cbf35 {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:13:53 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:13:54 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:13:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.851s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:13:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:13:55 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:13:55 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:13:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MkvLPQzp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:14:00 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:14:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:14:00 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:14:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:14:00 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 08:14:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2 -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce752b38-79f7-46b6-ab4a-0cf3944b01f7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 08:14:00 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[62046b81-0092-4d0c-8a5e-b2d62fd51e3c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2] added
Nov 22 08:14:00 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ba176c-ea17-483d-827e-b327ea3697ca]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a18573-b8aa-433f-ad65-36653d8cf669]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MkvLPQzp {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG nova.compute.manager [req-8e4491d8-d897-44c7-b1c7-674e3adfdf98 req-03d0b1c7-c824-435c-808f-d173eb6ae99e service nova] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Received event network-changed-db42bd08-8f0c-4e24-82c6-579bed0476bf {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG nova.compute.manager [req-8e4491d8-d897-44c7-b1c7-674e3adfdf98 req-03d0b1c7-c824-435c-808f-d173eb6ae99e service nova] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Refreshing instance network info cache due to event network-changed-db42bd08-8f0c-4e24-82c6-579bed0476bf. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-8e4491d8-d897-44c7-b1c7-674e3adfdf98 req-03d0b1c7-c824-435c-808f-d173eb6ae99e service nova] Acquiring lock "refresh_cache-5006cff5-4b67-405d-b6b1-4c355f82d920" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-8e4491d8-d897-44c7-b1c7-674e3adfdf98 req-03d0b1c7-c824-435c-808f-d173eb6ae99e service nova] Acquired lock "refresh_cache-5006cff5-4b67-405d-b6b1-4c355f82d920" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG nova.network.neutron [req-8e4491d8-d897-44c7-b1c7-674e3adfdf98 req-03d0b1c7-c824-435c-808f-d173eb6ae99e service nova] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Refreshing network info cache for port db42bd08-8f0c-4e24-82c6-579bed0476bf {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MkvLPQzp" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb72f954-5491-44e6-bf34-0cb63ae12089]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MkvLPQzp'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6f8ac7-dae5-4dba-9f11-6461535e2e59]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8466c2f1-60db-4ff3-a2b2-6bbac8f0a330]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:14:00 user nova-compute[74348]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)
Nov 22 08:14:00 user nova-compute[74348]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)
Nov 22 08:14:00 user nova-compute[74348]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 (non-flash)
Nov 22 08:14:00 user nova-compute[74348]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d (non-flash)
Nov 22 08:14:00 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:14:00 user nova-compute[74348]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)
Nov 22 08:14:00 user nova-compute[74348]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)
Nov 22 08:14:00 user nova-compute[74348]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 (non-flash)
Nov 22 08:14:00 user nova-compute[74348]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d (non-flash)
Nov 22 08:14:00 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2 -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2 -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2013bf-beff-4ace-9815-5518a74348f4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2, portal: 172.16.0.220,3260]
Nov 22 08:14:00 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2, portal: 172.16.0.220,3260] successful.
Nov 22 08:14:00 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d2a633-66fe-4dcc-b0c8-c12e2f4a2018]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe94bbe-c6e8-4572-8cc6-aec829641784]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:14:00 user nova-compute[74348]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)
Nov 22 08:14:00 user nova-compute[74348]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)
Nov 22 08:14:00 user nova-compute[74348]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 (non-flash)
Nov 22 08:14:00 user nova-compute[74348]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d (non-flash)
Nov 22 08:14:00 user nova-compute[74348]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2 (non-flash)
Nov 22 08:14:00 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:14:00 user nova-compute[74348]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)
Nov 22 08:14:00 user nova-compute[74348]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)
Nov 22 08:14:00 user nova-compute[74348]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 (non-flash)
Nov 22 08:14:00 user nova-compute[74348]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d (non-flash)
Nov 22 08:14:00 user nova-compute[74348]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2 (non-flash)
Nov 22 08:14:00 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.380s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] HCTL ('38', '-', '-', 0) found on session 50 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.027s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6746c515-ba0a-4de7-b871-f590cb1fc74a]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Searching for a device in session 50 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MkvLPQzp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74348) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG nova.network.neutron [req-8e4491d8-d897-44c7-b1c7-674e3adfdf98 req-03d0b1c7-c824-435c-808f-d173eb6ae99e service nova] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Updated VIF entry in instance network info cache for port db42bd08-8f0c-4e24-82c6-579bed0476bf. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG nova.network.neutron [req-8e4491d8-d897-44c7-b1c7-674e3adfdf98 req-03d0b1c7-c824-435c-808f-d173eb6ae99e service nova] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Updating instance_info_cache with network_info: [{"id": "db42bd08-8f0c-4e24-82c6-579bed0476bf", "address": "fa:16:3e:4e:f8:01", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb42bd08-8f", "ovs_interfaceid": "db42bd08-8f0c-4e24-82c6-579bed0476bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:14:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-8e4491d8-d897-44c7-b1c7-674e3adfdf98 req-03d0b1c7-c824-435c-808f-d173eb6ae99e service nova] Releasing lock "refresh_cache-5006cff5-4b67-405d-b6b1-4c355f82d920" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:14:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.430s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:14:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] <== connect_volume: return (1431ms) {'type': 'block', 'scsi_wwn': '23536663661313266', 'path': '/dev/sdg'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:14:01 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536663661313266', 'path': '/dev/sdg'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 08:14:01 user nova-compute[74348]: DEBUG nova.objects.instance [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lazy-loading 'flavor' on Instance uuid dfa85b90-0b1e-4984-b89d-315a3590ec93 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:14:01 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 08:14:01 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:14:01 user nova-compute[74348]:   <source dev="/dev/sdg"/>
Nov 22 08:14:01 user nova-compute[74348]:   <target dev="vdc" bus="virtio"/>
Nov 22 08:14:01 user nova-compute[74348]:   <serial>89b845d5-94f9-45e0-93c4-d043ad9bf9f2</serial>
Nov 22 08:14:01 user nova-compute[74348]: </disk>
Nov 22 08:14:01 user nova-compute[74348]:  {{(pid=74348) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 08:14:01 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:14:01 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:14:01 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:14:01 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] No VIF found with MAC fa:16:3e:82:44:15, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:14:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-303d0059-7af9-4826-9d4a-c1e285be18a8 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "dfa85b90-0b1e-4984-b89d-315a3590ec93" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.412s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:14:02 user nova-compute[74348]: DEBUG nova.compute.manager [req-3b5427e9-a0f3-4b31-98c6-3c1f57b8ed56 req-465c9ec3-09ea-4995-bc33-0f771f64f51f service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Received event network-changed-fe9fc32d-b2f0-4770-8473-de9e3a5816c9 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:14:02 user nova-compute[74348]: DEBUG nova.compute.manager [req-3b5427e9-a0f3-4b31-98c6-3c1f57b8ed56 req-465c9ec3-09ea-4995-bc33-0f771f64f51f service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Refreshing instance network info cache due to event network-changed-fe9fc32d-b2f0-4770-8473-de9e3a5816c9. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:14:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3b5427e9-a0f3-4b31-98c6-3c1f57b8ed56 req-465c9ec3-09ea-4995-bc33-0f771f64f51f service nova] Acquiring lock "refresh_cache-54d11b82-543c-4166-bf31-5e4e94eb830f" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:14:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3b5427e9-a0f3-4b31-98c6-3c1f57b8ed56 req-465c9ec3-09ea-4995-bc33-0f771f64f51f service nova] Acquired lock "refresh_cache-54d11b82-543c-4166-bf31-5e4e94eb830f" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:14:02 user nova-compute[74348]: DEBUG nova.network.neutron [req-3b5427e9-a0f3-4b31-98c6-3c1f57b8ed56 req-465c9ec3-09ea-4995-bc33-0f771f64f51f service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Refreshing network info cache for port fe9fc32d-b2f0-4770-8473-de9e3a5816c9 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:14:02 user nova-compute[74348]: DEBUG nova.compute.manager [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Stashing vm_state: active {{(pid=74348) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 22 08:14:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:14:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:14:02 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 08:14:02 user nova-compute[74348]: INFO nova.compute.claims [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Claim successful on node user
Nov 22 08:14:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:02 user nova-compute[74348]: INFO nova.compute.resource_tracker [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Updating resource usage from migration 0d383a24-8dff-4547-b41e-6cbd76f5ce1c
Nov 22 08:14:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7108c66c-9c02-4c9b-bd9c-0b6e21f5c87b tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquiring lock "dfa85b90-0b1e-4984-b89d-315a3590ec93" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:14:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7108c66c-9c02-4c9b-bd9c-0b6e21f5c87b tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "dfa85b90-0b1e-4984-b89d-315a3590ec93" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:14:02 user nova-compute[74348]: DEBUG nova.network.neutron [req-3b5427e9-a0f3-4b31-98c6-3c1f57b8ed56 req-465c9ec3-09ea-4995-bc33-0f771f64f51f service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Updated VIF entry in instance network info cache for port fe9fc32d-b2f0-4770-8473-de9e3a5816c9. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:14:02 user nova-compute[74348]: DEBUG nova.network.neutron [req-3b5427e9-a0f3-4b31-98c6-3c1f57b8ed56 req-465c9ec3-09ea-4995-bc33-0f771f64f51f service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Updating instance_info_cache with network_info: [{"id": "fe9fc32d-b2f0-4770-8473-de9e3a5816c9", "address": "fa:16:3e:b9:17:27", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9fc32d-b2", "ovs_interfaceid": "fe9fc32d-b2f0-4770-8473-de9e3a5816c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:14:02 user nova-compute[74348]: INFO nova.compute.manager [None req-7108c66c-9c02-4c9b-bd9c-0b6e21f5c87b tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Detaching volume 67c4510c-fcd7-434c-b974-5eff2da99d9d
Nov 22 08:14:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3b5427e9-a0f3-4b31-98c6-3c1f57b8ed56 req-465c9ec3-09ea-4995-bc33-0f771f64f51f service nova] Releasing lock "refresh_cache-54d11b82-543c-4166-bf31-5e4e94eb830f" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:14:02 user nova-compute[74348]: INFO nova.virt.block_device [None req-7108c66c-9c02-4c9b-bd9c-0b6e21f5c87b tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Attempting to driver detach volume 67c4510c-fcd7-434c-b974-5eff2da99d9d from mountpoint /dev/vdb
Nov 22 08:14:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-7108c66c-9c02-4c9b-bd9c-0b6e21f5c87b tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Attempting to detach device vdb from instance dfa85b90-0b1e-4984-b89d-315a3590ec93 from the persistent domain config. {{(pid=74348) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 08:14:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-7108c66c-9c02-4c9b-bd9c-0b6e21f5c87b tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:14:02 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:14:02 user nova-compute[74348]:   <source dev="/dev/sdf"/>
Nov 22 08:14:02 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:14:02 user nova-compute[74348]:   <serial>67c4510c-fcd7-434c-b974-5eff2da99d9d</serial>
Nov 22 08:14:02 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 08:14:02 user nova-compute[74348]: </disk>
Nov 22 08:14:02 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:14:02 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-7108c66c-9c02-4c9b-bd9c-0b6e21f5c87b tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Successfully detached device vdb from instance dfa85b90-0b1e-4984-b89d-315a3590ec93 from the persistent domain config.
Nov 22 08:14:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-7108c66c-9c02-4c9b-bd9c-0b6e21f5c87b tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dfa85b90-0b1e-4984-b89d-315a3590ec93 from the live domain config. {{(pid=74348) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 08:14:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-7108c66c-9c02-4c9b-bd9c-0b6e21f5c87b tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:14:02 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:14:02 user nova-compute[74348]:   <source dev="/dev/sdf"/>
Nov 22 08:14:02 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:14:02 user nova-compute[74348]:   <serial>67c4510c-fcd7-434c-b974-5eff2da99d9d</serial>
Nov 22 08:14:02 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 08:14:02 user nova-compute[74348]: </disk>
Nov 22 08:14:02 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:14:02 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:14:02 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:14:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.522s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:14:02 user nova-compute[74348]: INFO nova.compute.manager [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Migrating
Nov 22 08:14:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "refresh_cache-54d11b82-543c-4166-bf31-5e4e94eb830f" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:14:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquired lock "refresh_cache-54d11b82-543c-4166-bf31-5e4e94eb830f" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:14:02 user nova-compute[74348]: DEBUG nova.network.neutron [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:14:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-7108c66c-9c02-4c9b-bd9c-0b6e21f5c87b tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dfa85b90-0b1e-4984-b89d-315a3590ec93 {{(pid=74348) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 08:14:03 user nova-compute[74348]: DEBUG nova.network.neutron [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Updating instance_info_cache with network_info: [{"id": "fe9fc32d-b2f0-4770-8473-de9e3a5816c9", "address": "fa:16:3e:b9:17:27", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9fc32d-b2", "ovs_interfaceid": "fe9fc32d-b2f0-4770-8473-de9e3a5816c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:14:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Releasing lock "refresh_cache-54d11b82-543c-4166-bf31-5e4e94eb830f" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:14:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Starting migrate_disk_and_power_off {{(pid=74348) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 22 08:14:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:03 user nova-compute[74348]: DEBUG nova.compute.manager [req-5c9a6393-a150-4d1d-aaee-9e10d4d14e04 req-fb574327-7530-4452-b048-13a6976aa62f service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Received event network-vif-unplugged-fe9fc32d-b2f0-4770-8473-de9e3a5816c9 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:14:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-5c9a6393-a150-4d1d-aaee-9e10d4d14e04 req-fb574327-7530-4452-b048-13a6976aa62f service nova] Acquiring lock "54d11b82-543c-4166-bf31-5e4e94eb830f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:14:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-5c9a6393-a150-4d1d-aaee-9e10d4d14e04 req-fb574327-7530-4452-b048-13a6976aa62f service nova] Lock "54d11b82-543c-4166-bf31-5e4e94eb830f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:14:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-5c9a6393-a150-4d1d-aaee-9e10d4d14e04 req-fb574327-7530-4452-b048-13a6976aa62f service nova] Lock "54d11b82-543c-4166-bf31-5e4e94eb830f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:14:03 user nova-compute[74348]: DEBUG nova.compute.manager [req-5c9a6393-a150-4d1d-aaee-9e10d4d14e04 req-fb574327-7530-4452-b048-13a6976aa62f service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] No waiting events found dispatching network-vif-unplugged-fe9fc32d-b2f0-4770-8473-de9e3a5816c9 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:14:03 user nova-compute[74348]: WARNING nova.compute.manager [req-5c9a6393-a150-4d1d-aaee-9e10d4d14e04 req-fb574327-7530-4452-b048-13a6976aa62f service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Received unexpected event network-vif-unplugged-fe9fc32d-b2f0-4770-8473-de9e3a5816c9 for instance with vm_state active and task_state resize_migrating.
Nov 22 08:14:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:04 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Instance destroyed successfully.
Nov 22 08:14:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:12:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-68334599',display_name='tempest-ServerActionsTestOtherA-server-68334599',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-68334599',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOnwiyyOG0pLFwcj345c4IzhM/kyBtQaUAH7E3RkvN6illtA9ZAkzh5oMECX0856YNQ2Mjloaz2SuvdsQL10sz9Itf7PAs6pZTbAEN/oI0ibl2evR0cUOwfMcOEuxLp2g==',key_name='tempest-keypair-1143468972',keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:12:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d62fda81543f461288e324458620d07c',ramdisk_id='',reservation_id='r-5wioe4l0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-90817446',owner_user_name='tempest-ServerActionsTestOtherA-90817446-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:14:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43550ccf30be49aba6ed6de2caf9ae1e',uuid=54d11b82-543c-4166-bf31-5e4e94eb830f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe9fc32d-b2f0-4770-8473-de9e3a5816c9", "address": "fa:16:3e:b9:17:27", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-169967538-network", "vif_mac": "fa:16:3e:b9:17:27"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9fc32d-b2", "ovs_interfaceid": "fe9fc32d-b2f0-4770-8473-de9e3a5816c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Converting VIF {"id": "fe9fc32d-b2f0-4770-8473-de9e3a5816c9", "address": "fa:16:3e:b9:17:27", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-169967538-network", "vif_mac": "fa:16:3e:b9:17:27"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9fc32d-b2", "ovs_interfaceid": "fe9fc32d-b2f0-4770-8473-de9e3a5816c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:17:27,bridge_name='br-int',has_traffic_filtering=True,id=fe9fc32d-b2f0-4770-8473-de9e3a5816c9,network=Network(9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9fc32d-b2') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG os_vif [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:17:27,bridge_name='br-int',has_traffic_filtering=True,id=fe9fc32d-b2f0-4770-8473-de9e3a5816c9,network=Network(9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9fc32d-b2') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe9fc32d-b2, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=51d13f00-e059-421a-bf68-4dd639fd5676) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:04 user nova-compute[74348]: INFO os_vif [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:17:27,bridge_name='br-int',has_traffic_filtering=True,id=fe9fc32d-b2f0-4770-8473-de9e3a5816c9,network=Network(9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9fc32d-b2')
Nov 22 08:14:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RSKrQjYE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:14:04 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:14:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed106ca3-1afd-4702-a444-cbb29a3948fc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 08:14:04 user nova-compute[74348]: No targets found.
Nov 22 08:14:04 user nova-compute[74348]: iSNS:
Nov 22 08:14:04 user nova-compute[74348]: No targets found.
Nov 22 08:14:04 user nova-compute[74348]: STATIC:
Nov 22 08:14:04 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8
Nov 22 08:14:04 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:14:04 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:14:04 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290
Nov 22 08:14:04 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:14:04 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:14:04 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30
Nov 22 08:14:04 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:14:04 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:14:04 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2
Nov 22 08:14:04 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:14:04 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:14:04 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d
Nov 22 08:14:04 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:14:04 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:14:04 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336
Nov 22 08:14:04 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:14:04 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:14:04 user nova-compute[74348]: FIRMWARE:
Nov 22 08:14:04 user nova-compute[74348]: No targets found.
Nov 22 08:14:04 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 08:14:04 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 08:14:04 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a291b137-85da-4fb6-8902-76f89135ce20]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ddef4a-934a-46ff-acda-6ba9ff293370]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:14:04 user nova-compute[74348]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)
Nov 22 08:14:04 user nova-compute[74348]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)
Nov 22 08:14:04 user nova-compute[74348]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 (non-flash)
Nov 22 08:14:04 user nova-compute[74348]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d (non-flash)
Nov 22 08:14:04 user nova-compute[74348]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2 (non-flash)
Nov 22 08:14:04 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:14:04 user nova-compute[74348]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)
Nov 22 08:14:04 user nova-compute[74348]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)
Nov 22 08:14:04 user nova-compute[74348]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 (non-flash)
Nov 22 08:14:04 user nova-compute[74348]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d (non-flash)
Nov 22 08:14:04 user nova-compute[74348]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2 (non-flash)
Nov 22 08:14:04 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f22285ae4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290'): ({'sdd'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Removing single pathed devices sdd {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5941d5b7-3fff-4dc3-95cc-1cba507f64dd]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.030s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f951fe10-3e9a-4561-b528-113670c05c0c]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Flushing IO for device /dev/sdd {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca8d84f-b289-43b4-82bb-bbeb03d73188]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27c8e31-608e-4c41-aec6-c6d24257f3b4]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] SCSI volumes sdd have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3276e1a1-1d35-49f7-8ca1-8933587705b1]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d83ffc-792b-46f9-a2b9-9c8eab13ac75]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290, portal: 172.16.0.220,3260]
Nov 22 08:14:04 user nova-compute[74348]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290, portal: 172.16.0.220,3260] successful.
Nov 22 08:14:04 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b03364c-6344-45d1-8ca8-a72c06d11ea8]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] <== disconnect_volume: return (353ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:05 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:14:05 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Cleaning up deleted instances {{(pid=74348) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 22 08:14:05 user nova-compute[74348]: DEBUG nova.network.neutron [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Port fe9fc32d-b2f0-4770-8473-de9e3a5816c9 binding to destination host user is already ACTIVE {{(pid=74348) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 22 08:14:05 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] There are 0 instances to clean {{(pid=74348) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 22 08:14:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "54d11b82-543c-4166-bf31-5e4e94eb830f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:14:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "54d11b82-543c-4166-bf31-5e4e94eb830f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:14:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "54d11b82-543c-4166-bf31-5e4e94eb830f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:14:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "refresh_cache-54d11b82-543c-4166-bf31-5e4e94eb830f" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:14:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquired lock "refresh_cache-54d11b82-543c-4166-bf31-5e4e94eb830f" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:14:05 user nova-compute[74348]: DEBUG nova.network.neutron [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:14:05 user nova-compute[74348]: DEBUG nova.compute.manager [req-2841a995-d5cf-4cac-b58b-369353eff928 req-b165c5de-79d3-46a8-abbe-9f82167bfd4e service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Received event network-vif-plugged-fe9fc32d-b2f0-4770-8473-de9e3a5816c9 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:14:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2841a995-d5cf-4cac-b58b-369353eff928 req-b165c5de-79d3-46a8-abbe-9f82167bfd4e service nova] Acquiring lock "54d11b82-543c-4166-bf31-5e4e94eb830f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:14:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2841a995-d5cf-4cac-b58b-369353eff928 req-b165c5de-79d3-46a8-abbe-9f82167bfd4e service nova] Lock "54d11b82-543c-4166-bf31-5e4e94eb830f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:14:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2841a995-d5cf-4cac-b58b-369353eff928 req-b165c5de-79d3-46a8-abbe-9f82167bfd4e service nova] Lock "54d11b82-543c-4166-bf31-5e4e94eb830f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:14:05 user nova-compute[74348]: DEBUG nova.compute.manager [req-2841a995-d5cf-4cac-b58b-369353eff928 req-b165c5de-79d3-46a8-abbe-9f82167bfd4e service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] No waiting events found dispatching network-vif-plugged-fe9fc32d-b2f0-4770-8473-de9e3a5816c9 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:14:05 user nova-compute[74348]: WARNING nova.compute.manager [req-2841a995-d5cf-4cac-b58b-369353eff928 req-b165c5de-79d3-46a8-abbe-9f82167bfd4e service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Received unexpected event network-vif-plugged-fe9fc32d-b2f0-4770-8473-de9e3a5816c9 for instance with vm_state active and task_state resize_migrated.
Nov 22 08:14:05 user nova-compute[74348]: DEBUG nova.compute.manager [req-2841a995-d5cf-4cac-b58b-369353eff928 req-b165c5de-79d3-46a8-abbe-9f82167bfd4e service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Received event network-vif-plugged-fe9fc32d-b2f0-4770-8473-de9e3a5816c9 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:14:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2841a995-d5cf-4cac-b58b-369353eff928 req-b165c5de-79d3-46a8-abbe-9f82167bfd4e service nova] Acquiring lock "54d11b82-543c-4166-bf31-5e4e94eb830f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:14:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2841a995-d5cf-4cac-b58b-369353eff928 req-b165c5de-79d3-46a8-abbe-9f82167bfd4e service nova] Lock "54d11b82-543c-4166-bf31-5e4e94eb830f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:14:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2841a995-d5cf-4cac-b58b-369353eff928 req-b165c5de-79d3-46a8-abbe-9f82167bfd4e service nova] Lock "54d11b82-543c-4166-bf31-5e4e94eb830f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:14:05 user nova-compute[74348]: DEBUG nova.compute.manager [req-2841a995-d5cf-4cac-b58b-369353eff928 req-b165c5de-79d3-46a8-abbe-9f82167bfd4e service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] No waiting events found dispatching network-vif-plugged-fe9fc32d-b2f0-4770-8473-de9e3a5816c9 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:14:05 user nova-compute[74348]: WARNING nova.compute.manager [req-2841a995-d5cf-4cac-b58b-369353eff928 req-b165c5de-79d3-46a8-abbe-9f82167bfd4e service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Received unexpected event network-vif-plugged-fe9fc32d-b2f0-4770-8473-de9e3a5816c9 for instance with vm_state active and task_state resize_migrated.
Nov 22 08:14:05 user nova-compute[74348]: DEBUG nova.compute.manager [req-2841a995-d5cf-4cac-b58b-369353eff928 req-b165c5de-79d3-46a8-abbe-9f82167bfd4e service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Received event network-vif-plugged-fe9fc32d-b2f0-4770-8473-de9e3a5816c9 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:14:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2841a995-d5cf-4cac-b58b-369353eff928 req-b165c5de-79d3-46a8-abbe-9f82167bfd4e service nova] Acquiring lock "54d11b82-543c-4166-bf31-5e4e94eb830f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:14:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2841a995-d5cf-4cac-b58b-369353eff928 req-b165c5de-79d3-46a8-abbe-9f82167bfd4e service nova] Lock "54d11b82-543c-4166-bf31-5e4e94eb830f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:14:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2841a995-d5cf-4cac-b58b-369353eff928 req-b165c5de-79d3-46a8-abbe-9f82167bfd4e service nova] Lock "54d11b82-543c-4166-bf31-5e4e94eb830f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:14:05 user nova-compute[74348]: DEBUG nova.compute.manager [req-2841a995-d5cf-4cac-b58b-369353eff928 req-b165c5de-79d3-46a8-abbe-9f82167bfd4e service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] No waiting events found dispatching network-vif-plugged-fe9fc32d-b2f0-4770-8473-de9e3a5816c9 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:14:05 user nova-compute[74348]: WARNING nova.compute.manager [req-2841a995-d5cf-4cac-b58b-369353eff928 req-b165c5de-79d3-46a8-abbe-9f82167bfd4e service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Received unexpected event network-vif-plugged-fe9fc32d-b2f0-4770-8473-de9e3a5816c9 for instance with vm_state active and task_state resize_migrated.
Nov 22 08:14:05 user nova-compute[74348]: DEBUG nova.compute.manager [req-2841a995-d5cf-4cac-b58b-369353eff928 req-b165c5de-79d3-46a8-abbe-9f82167bfd4e service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Received event network-vif-unplugged-fe9fc32d-b2f0-4770-8473-de9e3a5816c9 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:14:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2841a995-d5cf-4cac-b58b-369353eff928 req-b165c5de-79d3-46a8-abbe-9f82167bfd4e service nova] Acquiring lock "54d11b82-543c-4166-bf31-5e4e94eb830f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:14:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2841a995-d5cf-4cac-b58b-369353eff928 req-b165c5de-79d3-46a8-abbe-9f82167bfd4e service nova] Lock "54d11b82-543c-4166-bf31-5e4e94eb830f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:14:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2841a995-d5cf-4cac-b58b-369353eff928 req-b165c5de-79d3-46a8-abbe-9f82167bfd4e service nova] Lock "54d11b82-543c-4166-bf31-5e4e94eb830f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:14:05 user nova-compute[74348]: DEBUG nova.compute.manager [req-2841a995-d5cf-4cac-b58b-369353eff928 req-b165c5de-79d3-46a8-abbe-9f82167bfd4e service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] No waiting events found dispatching network-vif-unplugged-fe9fc32d-b2f0-4770-8473-de9e3a5816c9 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:14:05 user nova-compute[74348]: WARNING nova.compute.manager [req-2841a995-d5cf-4cac-b58b-369353eff928 req-b165c5de-79d3-46a8-abbe-9f82167bfd4e service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Received unexpected event network-vif-unplugged-fe9fc32d-b2f0-4770-8473-de9e3a5816c9 for instance with vm_state active and task_state resize_migrated.
Nov 22 08:14:05 user nova-compute[74348]: DEBUG nova.compute.manager [req-2841a995-d5cf-4cac-b58b-369353eff928 req-b165c5de-79d3-46a8-abbe-9f82167bfd4e service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Received event network-vif-plugged-fe9fc32d-b2f0-4770-8473-de9e3a5816c9 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:14:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2841a995-d5cf-4cac-b58b-369353eff928 req-b165c5de-79d3-46a8-abbe-9f82167bfd4e service nova] Acquiring lock "54d11b82-543c-4166-bf31-5e4e94eb830f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:14:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2841a995-d5cf-4cac-b58b-369353eff928 req-b165c5de-79d3-46a8-abbe-9f82167bfd4e service nova] Lock "54d11b82-543c-4166-bf31-5e4e94eb830f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:14:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2841a995-d5cf-4cac-b58b-369353eff928 req-b165c5de-79d3-46a8-abbe-9f82167bfd4e service nova] Lock "54d11b82-543c-4166-bf31-5e4e94eb830f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:14:05 user nova-compute[74348]: DEBUG nova.compute.manager [req-2841a995-d5cf-4cac-b58b-369353eff928 req-b165c5de-79d3-46a8-abbe-9f82167bfd4e service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] No waiting events found dispatching network-vif-plugged-fe9fc32d-b2f0-4770-8473-de9e3a5816c9 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:14:05 user nova-compute[74348]: WARNING nova.compute.manager [req-2841a995-d5cf-4cac-b58b-369353eff928 req-b165c5de-79d3-46a8-abbe-9f82167bfd4e service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Received unexpected event network-vif-plugged-fe9fc32d-b2f0-4770-8473-de9e3a5816c9 for instance with vm_state active and task_state resize_migrated.
Nov 22 08:14:06 user nova-compute[74348]: DEBUG nova.network.neutron [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Updating instance_info_cache with network_info: [{"id": "fe9fc32d-b2f0-4770-8473-de9e3a5816c9", "address": "fa:16:3e:b9:17:27", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9fc32d-b2", "ovs_interfaceid": "fe9fc32d-b2f0-4770-8473-de9e3a5816c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:14:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Releasing lock "refresh_cache-54d11b82-543c-4166-bf31-5e4e94eb830f" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:14:06 user nova-compute[74348]: DEBUG os_brick.utils [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:14:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:06 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[50619055-cfde-4cff-962a-f061ca5e38fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:06 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[712d288e-0261-4abd-a03c-92acb86d1f84]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:06 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d787e8-8fa6-4e90-9801-64edda288c2b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:06 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecec6ecd-1df6-4311-a3f2-2beea8892be8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:14:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 08:14:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:14:06 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 08:14:06 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[55350004-04fe-448f-b138-23279fc21d68]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 08:14:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 08:14:06 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 08:14:06 user nova-compute[74348]: DEBUG os_brick.utils [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:14:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Starting finish_migration {{(pid=74348) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Instance directory exists: not creating {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 22 08:14:12 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Creating image(s)
Nov 22 08:14:12 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Did not create local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Ensure instance console log exists: /opt/stack/data/nova/instances/54d11b82-543c-4166-bf31-5e4e94eb830f/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Start _get_guest_xml network_info=[{"id": "fe9fc32d-b2f0-4770-8473-de9e3a5816c9", "address": "fa:16:3e:b9:17:27", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-169967538-network", "vif_mac": "fa:16:3e:b9:17:27"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9fc32d-b2", "ovs_interfaceid": "fe9fc32d-b2f0-4770-8473-de9e3a5816c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RSKrQjYE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '54d11b82-543c-4166-bf31-5e4e94eb830f', 'attached_at': '2023-11-22T08:14:13.000000', 'detached_at': '', 'volume_id': '060663bf-6a7e-4962-9df6-d7a401fcb290', 'serial': '060663bf-6a7e-4962-9df6-d7a401fcb290'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '8d639568-d006-4fc0-a982-61a7c84d2a9a', 'volume_type': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 08:14:12 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:14:12 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:14:12 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RSKrQjYE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:14:12 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:14:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:14:12 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:14:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:14:12 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 08:14:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b843170c-a302-4124-97aa-db72ceb2cafb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 08:14:12 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d88fa68-1588-47e6-b23c-cce9fe05acde]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290] added
Nov 22 08:14:12 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e36364d-c03b-4d7d-a63d-d6c5941c6300]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7358b9-a393-44eb-82d5-1ba74a0148c9]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RSKrQjYE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RSKrQjYE" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefafe08-5a76-46ba-a8c6-d0ea23f57b3b]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RSKrQjYE'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[800f43e0-e9a1-415c-b2e9-5f86517bf3aa]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:14:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:13 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:13 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4ece7d-6bf2-4ce4-b3ee-9eb4bad3a2b1]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:13 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:14:13 user nova-compute[74348]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)
Nov 22 08:14:13 user nova-compute[74348]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 (non-flash)
Nov 22 08:14:13 user nova-compute[74348]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d (non-flash)
Nov 22 08:14:13 user nova-compute[74348]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2 (non-flash)
Nov 22 08:14:13 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:14:13 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:14:13 user nova-compute[74348]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)
Nov 22 08:14:13 user nova-compute[74348]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 (non-flash)
Nov 22 08:14:13 user nova-compute[74348]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d (non-flash)
Nov 22 08:14:13 user nova-compute[74348]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2 (non-flash)
Nov 22 08:14:13 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:14:13 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:13 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:13 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3253cd72-e9fe-4830-886e-038e7934ad13]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:13 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290, portal: 172.16.0.220,3260]
Nov 22 08:14:13 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290, portal: 172.16.0.220,3260] successful.
Nov 22 08:14:13 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:14:13 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:13 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:13 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c468d664-8b58-4088-b26e-1a6e9dd2707b]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:13 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:14:13 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:13 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:13 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[986fc8f2-50a5-4d02-a0ec-8bfcff526afe]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:13 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:14:13 user nova-compute[74348]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)
Nov 22 08:14:13 user nova-compute[74348]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 (non-flash)
Nov 22 08:14:13 user nova-compute[74348]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d (non-flash)
Nov 22 08:14:13 user nova-compute[74348]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2 (non-flash)
Nov 22 08:14:13 user nova-compute[74348]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)
Nov 22 08:14:13 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:14:13 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:14:13 user nova-compute[74348]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)
Nov 22 08:14:13 user nova-compute[74348]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 (non-flash)
Nov 22 08:14:13 user nova-compute[74348]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d (non-flash)
Nov 22 08:14:13 user nova-compute[74348]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2 (non-flash)
Nov 22 08:14:13 user nova-compute[74348]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)
Nov 22 08:14:13 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:14:13 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:14:13 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 08:14:13 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] HCTL ('35', '-', '-', 0) found on session 51 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 08:14:13 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 08:14:13 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:13 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:13 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[59786c44-48a9-43b6-b309-b38e27763b1e]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:13 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: None {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:14:14 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:14:14 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RSKrQjYE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 08:14:14 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:14:14 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '26430353431373361', 'path': '/dev/sdd'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:14:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430353431373361', 'path': '/dev/sdd'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 08:14:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:12:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-68334599',display_name='tempest-ServerActionsTestOtherA-server-68334599',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-68334599',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOnwiyyOG0pLFwcj345c4IzhM/kyBtQaUAH7E3RkvN6illtA9ZAkzh5oMECX0856YNQ2Mjloaz2SuvdsQL10sz9Itf7PAs6pZTbAEN/oI0ibl2evR0cUOwfMcOEuxLp2g==',key_name='tempest-keypair-1143468972',keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:12:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d62fda81543f461288e324458620d07c',ramdisk_id='',reservation_id='r-5wioe4l0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-90817446',owner_user_name='tempest-ServerActionsTestOtherA-90817446-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:14:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43550ccf30be49aba6ed6de2caf9ae1e',uuid=54d11b82-543c-4166-bf31-5e4e94eb830f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe9fc32d-b2f0-4770-8473-de9e3a5816c9", "address": "fa:16:3e:b9:17:27", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-169967538-network", "vif_mac": "fa:16:3e:b9:17:27"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9fc32d-b2", "ovs_interfaceid": "fe9fc32d-b2f0-4770-8473-de9e3a5816c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 08:14:14 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Converting VIF {"id": "fe9fc32d-b2f0-4770-8473-de9e3a5816c9", "address": "fa:16:3e:b9:17:27", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-169967538-network", "vif_mac": "fa:16:3e:b9:17:27"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9fc32d-b2", "ovs_interfaceid": "fe9fc32d-b2f0-4770-8473-de9e3a5816c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:14:14 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:17:27,bridge_name='br-int',has_traffic_filtering=True,id=fe9fc32d-b2f0-4770-8473-de9e3a5816c9,network=Network(9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9fc32d-b2') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:14:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] End _get_guest_xml xml=<domain type="kvm">
Nov 22 08:14:14 user nova-compute[74348]:   <uuid>54d11b82-543c-4166-bf31-5e4e94eb830f</uuid>
Nov 22 08:14:14 user nova-compute[74348]:   <name>instance-00000029</name>
Nov 22 08:14:14 user nova-compute[74348]:   <memory>2097152</memory>
Nov 22 08:14:14 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 08:14:14 user nova-compute[74348]:   <metadata>
Nov 22 08:14:14 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 08:14:14 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 08:14:14 user nova-compute[74348]:       <nova:name>tempest-ServerActionsTestOtherA-server-68334599</nova:name>
Nov 22 08:14:14 user nova-compute[74348]:       <nova:creationTime>2023-11-22 08:14:12</nova:creationTime>
Nov 22 08:14:14 user nova-compute[74348]:       <nova:flavor name="m1.small">
Nov 22 08:14:14 user nova-compute[74348]:         <nova:memory>2048</nova:memory>
Nov 22 08:14:14 user nova-compute[74348]:         <nova:disk>20</nova:disk>
Nov 22 08:14:14 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 08:14:14 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 08:14:14 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 08:14:14 user nova-compute[74348]:       </nova:flavor>
Nov 22 08:14:14 user nova-compute[74348]:       <nova:owner>
Nov 22 08:14:14 user nova-compute[74348]:         <nova:user uuid="43550ccf30be49aba6ed6de2caf9ae1e">tempest-ServerActionsTestOtherA-90817446-project-member</nova:user>
Nov 22 08:14:14 user nova-compute[74348]:         <nova:project uuid="d62fda81543f461288e324458620d07c">tempest-ServerActionsTestOtherA-90817446</nova:project>
Nov 22 08:14:14 user nova-compute[74348]:       </nova:owner>
Nov 22 08:14:14 user nova-compute[74348]:       <nova:ports>
Nov 22 08:14:14 user nova-compute[74348]:         <nova:port uuid="fe9fc32d-b2f0-4770-8473-de9e3a5816c9">
Nov 22 08:14:14 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 22 08:14:14 user nova-compute[74348]:         </nova:port>
Nov 22 08:14:14 user nova-compute[74348]:       </nova:ports>
Nov 22 08:14:14 user nova-compute[74348]:     </nova:instance>
Nov 22 08:14:14 user nova-compute[74348]:   </metadata>
Nov 22 08:14:14 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 08:14:14 user nova-compute[74348]:     <system>
Nov 22 08:14:14 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 08:14:14 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 08:14:14 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 08:14:14 user nova-compute[74348]:       <entry name="serial">54d11b82-543c-4166-bf31-5e4e94eb830f</entry>
Nov 22 08:14:14 user nova-compute[74348]:       <entry name="uuid">54d11b82-543c-4166-bf31-5e4e94eb830f</entry>
Nov 22 08:14:14 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 08:14:14 user nova-compute[74348]:     </system>
Nov 22 08:14:14 user nova-compute[74348]:   </sysinfo>
Nov 22 08:14:14 user nova-compute[74348]:   <os>
Nov 22 08:14:14 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 08:14:14 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 08:14:14 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 08:14:14 user nova-compute[74348]:   </os>
Nov 22 08:14:14 user nova-compute[74348]:   <features>
Nov 22 08:14:14 user nova-compute[74348]:     <acpi/>
Nov 22 08:14:14 user nova-compute[74348]:     <apic/>
Nov 22 08:14:14 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 08:14:14 user nova-compute[74348]:   </features>
Nov 22 08:14:14 user nova-compute[74348]:   <clock offset="utc">
Nov 22 08:14:14 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 08:14:14 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 08:14:14 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 08:14:14 user nova-compute[74348]:   </clock>
Nov 22 08:14:14 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 08:14:14 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 08:14:14 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 08:14:14 user nova-compute[74348]:   </cpu>
Nov 22 08:14:14 user nova-compute[74348]:   <devices>
Nov 22 08:14:14 user nova-compute[74348]:     <disk type="block" device="disk">
Nov 22 08:14:14 user nova-compute[74348]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:14:14 user nova-compute[74348]:       <source dev="/dev/sdd"/>
Nov 22 08:14:14 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 08:14:14 user nova-compute[74348]:       <serial>060663bf-6a7e-4962-9df6-d7a401fcb290</serial>
Nov 22 08:14:14 user nova-compute[74348]:     </disk>
Nov 22 08:14:14 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 08:14:14 user nova-compute[74348]:       <mac address="fa:16:3e:b9:17:27"/>
Nov 22 08:14:14 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:14:14 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 08:14:14 user nova-compute[74348]:       <target dev="tapfe9fc32d-b2"/>
Nov 22 08:14:14 user nova-compute[74348]:     </interface>
Nov 22 08:14:14 user nova-compute[74348]:     <serial type="pty">
Nov 22 08:14:14 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/54d11b82-543c-4166-bf31-5e4e94eb830f/console.log" append="off"/>
Nov 22 08:14:14 user nova-compute[74348]:     </serial>
Nov 22 08:14:14 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 08:14:14 user nova-compute[74348]:     <video>
Nov 22 08:14:14 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:14:14 user nova-compute[74348]:     </video>
Nov 22 08:14:14 user nova-compute[74348]:     <rng model="virtio">
Nov 22 08:14:14 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 08:14:14 user nova-compute[74348]:     </rng>
Nov 22 08:14:14 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 08:14:14 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 08:14:14 user nova-compute[74348]:       <stats period="10"/>
Nov 22 08:14:14 user nova-compute[74348]:     </memballoon>
Nov 22 08:14:14 user nova-compute[74348]:   </devices>
Nov 22 08:14:14 user nova-compute[74348]: </domain>
Nov 22 08:14:14 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 08:14:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:12:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-68334599',display_name='tempest-ServerActionsTestOtherA-server-68334599',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-68334599',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOnwiyyOG0pLFwcj345c4IzhM/kyBtQaUAH7E3RkvN6illtA9ZAkzh5oMECX0856YNQ2Mjloaz2SuvdsQL10sz9Itf7PAs6pZTbAEN/oI0ibl2evR0cUOwfMcOEuxLp2g==',key_name='tempest-keypair-1143468972',keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:12:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d62fda81543f461288e324458620d07c',ramdisk_id='',reservation_id='r-5wioe4l0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-90817446',owner_user_name='tempest-ServerActionsTestOtherA-90817446-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:14:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43550ccf30be49aba6ed6de2caf9ae1e',uuid=54d11b82-543c-4166-bf31-5e4e94eb830f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe9fc32d-b2f0-4770-8473-de9e3a5816c9", "address": "fa:16:3e:b9:17:27", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-169967538-network", "vif_mac": "fa:16:3e:b9:17:27"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9fc32d-b2", "ovs_interfaceid": "fe9fc32d-b2f0-4770-8473-de9e3a5816c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 08:14:14 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Converting VIF {"id": "fe9fc32d-b2f0-4770-8473-de9e3a5816c9", "address": "fa:16:3e:b9:17:27", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-169967538-network", "vif_mac": "fa:16:3e:b9:17:27"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9fc32d-b2", "ovs_interfaceid": "fe9fc32d-b2f0-4770-8473-de9e3a5816c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:14:14 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:17:27,bridge_name='br-int',has_traffic_filtering=True,id=fe9fc32d-b2f0-4770-8473-de9e3a5816c9,network=Network(9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9fc32d-b2') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:14:14 user nova-compute[74348]: DEBUG os_vif [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:17:27,bridge_name='br-int',has_traffic_filtering=True,id=fe9fc32d-b2f0-4770-8473-de9e3a5816c9,network=Network(9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9fc32d-b2') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 08:14:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:14:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 08:14:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1a203ccd-4c17-51dc-9e6e-ccb4ba2cc280', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:14:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe9fc32d-b2, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:14:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe9fc32d-b2, col_values=(('qos', UUID('99b07539-cf09-4807-84e8-0f75b1abb7a1')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:14:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe9fc32d-b2, col_values=(('external_ids', {'iface-id': 'fe9fc32d-b2f0-4770-8473-de9e3a5816c9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:17:27', 'vm-uuid': '54d11b82-543c-4166-bf31-5e4e94eb830f'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:14:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:14:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:14 user nova-compute[74348]: INFO os_vif [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:17:27,bridge_name='br-int',has_traffic_filtering=True,id=fe9fc32d-b2f0-4770-8473-de9e3a5816c9,network=Network(9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9fc32d-b2')
Nov 22 08:14:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:14:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] No VIF found with MAC fa:16:3e:b9:17:27, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:14:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:15 user nova-compute[74348]: DEBUG nova.compute.manager [req-583f076f-0169-4306-b0e4-20947db68bd0 req-8375c401-bac8-430e-b5c1-996772c98d13 service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Received event network-vif-plugged-fe9fc32d-b2f0-4770-8473-de9e3a5816c9 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:14:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-583f076f-0169-4306-b0e4-20947db68bd0 req-8375c401-bac8-430e-b5c1-996772c98d13 service nova] Acquiring lock "54d11b82-543c-4166-bf31-5e4e94eb830f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:14:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-583f076f-0169-4306-b0e4-20947db68bd0 req-8375c401-bac8-430e-b5c1-996772c98d13 service nova] Lock "54d11b82-543c-4166-bf31-5e4e94eb830f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:14:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-583f076f-0169-4306-b0e4-20947db68bd0 req-8375c401-bac8-430e-b5c1-996772c98d13 service nova] Lock "54d11b82-543c-4166-bf31-5e4e94eb830f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:14:15 user nova-compute[74348]: DEBUG nova.compute.manager [req-583f076f-0169-4306-b0e4-20947db68bd0 req-8375c401-bac8-430e-b5c1-996772c98d13 service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] No waiting events found dispatching network-vif-plugged-fe9fc32d-b2f0-4770-8473-de9e3a5816c9 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:14:15 user nova-compute[74348]: WARNING nova.compute.manager [req-583f076f-0169-4306-b0e4-20947db68bd0 req-8375c401-bac8-430e-b5c1-996772c98d13 service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Received unexpected event network-vif-plugged-fe9fc32d-b2f0-4770-8473-de9e3a5816c9 for instance with vm_state active and task_state resize_finish.
Nov 22 08:14:17 user nova-compute[74348]: DEBUG nova.compute.manager [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 08:14:17 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Instance running successfully.
Nov 22 08:14:17 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Failed to set time: agent not configured {{(pid=74348) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 22 08:14:17 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-b0a3e59f-cfd3-4b33-81ec-e667286bad6c tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] finish_migration finished successfully. {{(pid=74348) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 22 08:14:17 user nova-compute[74348]: DEBUG nova.compute.manager [req-6c622d44-546c-4d64-91ed-23e8db93949f req-b9f7eb2a-8d9e-4bbd-af83-909fe36fc388 service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Received event network-vif-plugged-fe9fc32d-b2f0-4770-8473-de9e3a5816c9 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:14:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-6c622d44-546c-4d64-91ed-23e8db93949f req-b9f7eb2a-8d9e-4bbd-af83-909fe36fc388 service nova] Acquiring lock "54d11b82-543c-4166-bf31-5e4e94eb830f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:14:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-6c622d44-546c-4d64-91ed-23e8db93949f req-b9f7eb2a-8d9e-4bbd-af83-909fe36fc388 service nova] Lock "54d11b82-543c-4166-bf31-5e4e94eb830f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:14:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-6c622d44-546c-4d64-91ed-23e8db93949f req-b9f7eb2a-8d9e-4bbd-af83-909fe36fc388 service nova] Lock "54d11b82-543c-4166-bf31-5e4e94eb830f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:14:17 user nova-compute[74348]: DEBUG nova.compute.manager [req-6c622d44-546c-4d64-91ed-23e8db93949f req-b9f7eb2a-8d9e-4bbd-af83-909fe36fc388 service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] No waiting events found dispatching network-vif-plugged-fe9fc32d-b2f0-4770-8473-de9e3a5816c9 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:14:17 user nova-compute[74348]: WARNING nova.compute.manager [req-6c622d44-546c-4d64-91ed-23e8db93949f req-b9f7eb2a-8d9e-4bbd-af83-909fe36fc388 service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Received unexpected event network-vif-plugged-fe9fc32d-b2f0-4770-8473-de9e3a5816c9 for instance with vm_state resized and task_state None.
Nov 22 08:14:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:23 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-7108c66c-9c02-4c9b-bd9c-0b6e21f5c87b tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance dfa85b90-0b1e-4984-b89d-315a3590ec93 is timed out.
Nov 22 08:14:23 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-7108c66c-9c02-4c9b-bd9c-0b6e21f5c87b tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Successfully detached device vdb from instance dfa85b90-0b1e-4984-b89d-315a3590ec93 from the live domain config.
Nov 22 08:14:23 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7108c66c-9c02-4c9b-bd9c-0b6e21f5c87b tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7108c66c-9c02-4c9b-bd9c-0b6e21f5c87b tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kFAmgSEj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:14:23 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-7108c66c-9c02-4c9b-bd9c-0b6e21f5c87b tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:14:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-7108c66c-9c02-4c9b-bd9c-0b6e21f5c87b tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-7108c66c-9c02-4c9b-bd9c-0b6e21f5c87b tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[10905a0f-9267-407b-8278-8bef1dccb90f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7108c66c-9c02-4c9b-bd9c-0b6e21f5c87b tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 08:14:23 user nova-compute[74348]: No targets found.
Nov 22 08:14:23 user nova-compute[74348]: iSNS:
Nov 22 08:14:23 user nova-compute[74348]: No targets found.
Nov 22 08:14:23 user nova-compute[74348]: STATIC:
Nov 22 08:14:23 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8
Nov 22 08:14:23 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:14:23 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:14:23 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290
Nov 22 08:14:23 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:14:23 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:14:23 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30
Nov 22 08:14:23 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:14:23 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:14:23 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2
Nov 22 08:14:23 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:14:23 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:14:23 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d
Nov 22 08:14:23 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:14:23 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:14:23 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336
Nov 22 08:14:23 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:14:23 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:14:23 user nova-compute[74348]: FIRMWARE:
Nov 22 08:14:23 user nova-compute[74348]: No targets found.
Nov 22 08:14:23 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7108c66c-9c02-4c9b-bd9c-0b6e21f5c87b tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 08:14:23 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 08:14:23 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7108c66c-9c02-4c9b-bd9c-0b6e21f5c87b tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b4b022-c647-45ef-9585-d8bdecab86ba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1948fa6a-4c28-4248-a594-6da601362ce8]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7108c66c-9c02-4c9b-bd9c-0b6e21f5c87b tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:14:23 user nova-compute[74348]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)
Nov 22 08:14:23 user nova-compute[74348]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 (non-flash)
Nov 22 08:14:23 user nova-compute[74348]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d (non-flash)
Nov 22 08:14:23 user nova-compute[74348]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2 (non-flash)
Nov 22 08:14:23 user nova-compute[74348]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)
Nov 22 08:14:23 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7108c66c-9c02-4c9b-bd9c-0b6e21f5c87b tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:14:23 user nova-compute[74348]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)
Nov 22 08:14:23 user nova-compute[74348]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 (non-flash)
Nov 22 08:14:23 user nova-compute[74348]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d (non-flash)
Nov 22 08:14:23 user nova-compute[74348]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2 (non-flash)
Nov 22 08:14:23 user nova-compute[74348]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)
Nov 22 08:14:23 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7108c66c-9c02-4c9b-bd9c-0b6e21f5c87b tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f225510e680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d'): ({'sdf'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-7108c66c-9c02-4c9b-bd9c-0b6e21f5c87b tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Removing single pathed devices sdf {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49c1e6f-7f0b-476c-a5d3-e08793e034ec]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bf47ce-30e5-497e-9da3-14f968724653]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-7108c66c-9c02-4c9b-bd9c-0b6e21f5c87b tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Flushing IO for device /dev/sdf {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[08cacb35-e460-4c15-88b8-686ca1bedb94]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-7108c66c-9c02-4c9b-bd9c-0b6e21f5c87b tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75aa444-c8e6-4d9a-ae46-ac7d7159f8d3]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-7108c66c-9c02-4c9b-bd9c-0b6e21f5c87b tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-7108c66c-9c02-4c9b-bd9c-0b6e21f5c87b tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] SCSI volumes sdf have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7108c66c-9c02-4c9b-bd9c-0b6e21f5c87b tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[74dfafa4-4e64-48b8-b8f0-9067bc7b54cb]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7108c66c-9c02-4c9b-bd9c-0b6e21f5c87b tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e07a9c-7b70-4110-a65d-3e9c7f31f93c]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7108c66c-9c02-4c9b-bd9c-0b6e21f5c87b tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d, portal: 172.16.0.220,3260]
Nov 22 08:14:23 user nova-compute[74348]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d, portal: 172.16.0.220,3260] successful.
Nov 22 08:14:23 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67c4510c-fcd7-434c-b974-5eff2da99d9d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[816db1e0-3085-4bcf-9085-c2d9691338e2]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7108c66c-9c02-4c9b-bd9c-0b6e21f5c87b tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-7108c66c-9c02-4c9b-bd9c-0b6e21f5c87b tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7108c66c-9c02-4c9b-bd9c-0b6e21f5c87b tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] <== disconnect_volume: return (320ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:14:23 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7108c66c-9c02-4c9b-bd9c-0b6e21f5c87b tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 08:14:24 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:24 user nova-compute[74348]: DEBUG nova.objects.instance [None req-7108c66c-9c02-4c9b-bd9c-0b6e21f5c87b tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lazy-loading 'flavor' on Instance uuid dfa85b90-0b1e-4984-b89d-315a3590ec93 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:14:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7108c66c-9c02-4c9b-bd9c-0b6e21f5c87b tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "dfa85b90-0b1e-4984-b89d-315a3590ec93" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.683s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:14:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-aaef9e72-0c7d-47c6-af28-1a2194a71a74 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquiring lock "dfa85b90-0b1e-4984-b89d-315a3590ec93" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:14:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-aaef9e72-0c7d-47c6-af28-1a2194a71a74 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "dfa85b90-0b1e-4984-b89d-315a3590ec93" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:14:25 user nova-compute[74348]: INFO nova.compute.manager [None req-aaef9e72-0c7d-47c6-af28-1a2194a71a74 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Detaching volume 89b845d5-94f9-45e0-93c4-d043ad9bf9f2
Nov 22 08:14:25 user nova-compute[74348]: INFO nova.virt.block_device [None req-aaef9e72-0c7d-47c6-af28-1a2194a71a74 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Attempting to driver detach volume 89b845d5-94f9-45e0-93c4-d043ad9bf9f2 from mountpoint /dev/vdc
Nov 22 08:14:25 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-aaef9e72-0c7d-47c6-af28-1a2194a71a74 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Attempting to detach device vdc from instance dfa85b90-0b1e-4984-b89d-315a3590ec93 from the persistent domain config. {{(pid=74348) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 08:14:25 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-aaef9e72-0c7d-47c6-af28-1a2194a71a74 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:14:25 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:14:25 user nova-compute[74348]:   <source dev="/dev/sdg"/>
Nov 22 08:14:25 user nova-compute[74348]:   <target dev="vdc" bus="virtio"/>
Nov 22 08:14:25 user nova-compute[74348]:   <serial>89b845d5-94f9-45e0-93c4-d043ad9bf9f2</serial>
Nov 22 08:14:25 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 22 08:14:25 user nova-compute[74348]: </disk>
Nov 22 08:14:25 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:14:25 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-aaef9e72-0c7d-47c6-af28-1a2194a71a74 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Successfully detached device vdc from instance dfa85b90-0b1e-4984-b89d-315a3590ec93 from the persistent domain config.
Nov 22 08:14:25 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-aaef9e72-0c7d-47c6-af28-1a2194a71a74 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance dfa85b90-0b1e-4984-b89d-315a3590ec93 from the live domain config. {{(pid=74348) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 08:14:25 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-aaef9e72-0c7d-47c6-af28-1a2194a71a74 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:14:25 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:14:25 user nova-compute[74348]:   <source dev="/dev/sdg"/>
Nov 22 08:14:25 user nova-compute[74348]:   <target dev="vdc" bus="virtio"/>
Nov 22 08:14:25 user nova-compute[74348]:   <serial>89b845d5-94f9-45e0-93c4-d043ad9bf9f2</serial>
Nov 22 08:14:25 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 22 08:14:25 user nova-compute[74348]: </disk>
Nov 22 08:14:25 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:14:25 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-aaef9e72-0c7d-47c6-af28-1a2194a71a74 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance dfa85b90-0b1e-4984-b89d-315a3590ec93 {{(pid=74348) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 08:14:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:14:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:39 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:39 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "b998bedf-ee29-48a1-a14b-449add115c39" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:14:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "b998bedf-ee29-48a1-a14b-449add115c39" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:14:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "b998bedf-ee29-48a1-a14b-449add115c39-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:14:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "b998bedf-ee29-48a1-a14b-449add115c39-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:14:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "b998bedf-ee29-48a1-a14b-449add115c39-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:14:41 user nova-compute[74348]: INFO nova.compute.manager [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Terminating instance
Nov 22 08:14:41 user nova-compute[74348]: DEBUG nova.compute.manager [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 08:14:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:41 user nova-compute[74348]: DEBUG nova.compute.manager [req-120bf072-e852-4f89-9fad-8ca991651c37 req-4129fd78-7bef-47c3-8d2f-afcb4224f445 service nova] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Received event network-vif-unplugged-ee377706-a70f-4d29-96be-4d56daedb95a {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:14:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-120bf072-e852-4f89-9fad-8ca991651c37 req-4129fd78-7bef-47c3-8d2f-afcb4224f445 service nova] Acquiring lock "b998bedf-ee29-48a1-a14b-449add115c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:14:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-120bf072-e852-4f89-9fad-8ca991651c37 req-4129fd78-7bef-47c3-8d2f-afcb4224f445 service nova] Lock "b998bedf-ee29-48a1-a14b-449add115c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:14:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-120bf072-e852-4f89-9fad-8ca991651c37 req-4129fd78-7bef-47c3-8d2f-afcb4224f445 service nova] Lock "b998bedf-ee29-48a1-a14b-449add115c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:14:41 user nova-compute[74348]: DEBUG nova.compute.manager [req-120bf072-e852-4f89-9fad-8ca991651c37 req-4129fd78-7bef-47c3-8d2f-afcb4224f445 service nova] [instance: b998bedf-ee29-48a1-a14b-449add115c39] No waiting events found dispatching network-vif-unplugged-ee377706-a70f-4d29-96be-4d56daedb95a {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:14:41 user nova-compute[74348]: DEBUG nova.compute.manager [req-120bf072-e852-4f89-9fad-8ca991651c37 req-4129fd78-7bef-47c3-8d2f-afcb4224f445 service nova] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Received event network-vif-unplugged-ee377706-a70f-4d29-96be-4d56daedb95a for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 08:14:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:42 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Instance destroyed successfully.
Nov 22 08:14:42 user nova-compute[74348]: DEBUG nova.objects.instance [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lazy-loading 'resources' on Instance uuid b998bedf-ee29-48a1-a14b-449add115c39 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:09:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2080387933',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2080387933',id=38,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:11:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a31d898cdc69494a8825e8d93a0d04bc',ramdisk_id='',reservation_id='r-ra0klnf9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-502521972',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T08:12:56Z,user_data=None,user_id='1d5c8274eca14965b6cbfe22110f904d',uuid=b998bedf-ee29-48a1-a14b-449add115c39,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee377706-a70f-4d29-96be-4d56daedb95a", "address": "fa:16:3e:a1:2b:05", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee377706-a7", "ovs_interfaceid": "ee377706-a70f-4d29-96be-4d56daedb95a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Converting VIF {"id": "ee377706-a70f-4d29-96be-4d56daedb95a", "address": "fa:16:3e:a1:2b:05", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee377706-a7", "ovs_interfaceid": "ee377706-a70f-4d29-96be-4d56daedb95a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:2b:05,bridge_name='br-int',has_traffic_filtering=True,id=ee377706-a70f-4d29-96be-4d56daedb95a,network=Network(6fe60468-191c-4d84-8dce-55c056f88936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee377706-a7') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG os_vif [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:2b:05,bridge_name='br-int',has_traffic_filtering=True,id=ee377706-a70f-4d29-96be-4d56daedb95a,network=Network(6fe60468-191c-4d84-8dce-55c056f88936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee377706-a7') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee377706-a7, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e54383cc-96a1-4fc9-b426-63a295b51863) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:14:42 user nova-compute[74348]: INFO os_vif [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:2b:05,bridge_name='br-int',has_traffic_filtering=True,id=ee377706-a70f-4d29-96be-4d56daedb95a,network=Network(6fe60468-191c-4d84-8dce-55c056f88936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee377706-a7')
Nov 22 08:14:42 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LlaMmJwv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:14:42 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:14:42 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[489545ef-0a4e-4d1a-958e-e9443b64b117]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 08:14:42 user nova-compute[74348]: No targets found.
Nov 22 08:14:42 user nova-compute[74348]: iSNS:
Nov 22 08:14:42 user nova-compute[74348]: No targets found.
Nov 22 08:14:42 user nova-compute[74348]: STATIC:
Nov 22 08:14:42 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8
Nov 22 08:14:42 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:14:42 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:14:42 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290
Nov 22 08:14:42 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:14:42 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:14:42 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30
Nov 22 08:14:42 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:14:42 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:14:42 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2
Nov 22 08:14:42 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:14:42 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:14:42 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336
Nov 22 08:14:42 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:14:42 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:14:42 user nova-compute[74348]: FIRMWARE:
Nov 22 08:14:42 user nova-compute[74348]: No targets found.
Nov 22 08:14:42 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 08:14:42 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 08:14:42 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[923f43e4-1e50-4e2e-b1bb-6585446d0a54]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64264dc-ab0d-41c9-bac3-65c90fdc49fa]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:14:42 user nova-compute[74348]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)
Nov 22 08:14:42 user nova-compute[74348]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 (non-flash)
Nov 22 08:14:42 user nova-compute[74348]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2 (non-flash)
Nov 22 08:14:42 user nova-compute[74348]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)
Nov 22 08:14:42 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:14:42 user nova-compute[74348]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 (non-flash)
Nov 22 08:14:42 user nova-compute[74348]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 (non-flash)
Nov 22 08:14:42 user nova-compute[74348]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2 (non-flash)
Nov 22 08:14:42 user nova-compute[74348]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)
Nov 22 08:14:42 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2228280c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336'): ({'sdc'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Removing single pathed devices sdc {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b518cb-f686-4e18-8173-ae0c4d5784c9]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0759770b-ae17-49e7-a2c8-1db044475e1b]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Flushing IO for device /dev/sdc {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fdcab6-0d19-4121-a102-706ae154b5fe]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fc276b-3b8e-4be1-9694-a1aa6693a535]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] SCSI volumes sdc have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO923d52ee-eeb155516ab4ff89', '/dev/disk/by-id/scsi-26565623135353531', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_923d52ee') {{(pid=85159) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 22 08:14:42 user nova-compute[74348]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO923d52ee-eeb155516ab4ff89
Nov 22 08:14:42 user nova-compute[74348]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26565623135353531
Nov 22 08:14:42 user nova-compute[74348]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_923d52ee
Nov 22 08:14:42 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec18906-28db-4a2a-bb80-fa1d3019108d]: (4, None) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d7c356-63ad-4952-9773-0ec1a4b3b439]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b07ebe-ba64-4781-86e3-00f897829060]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336, portal: 172.16.0.220,3260]
Nov 22 08:14:42 user nova-compute[74348]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336, portal: 172.16.0.220,3260] successful.
Nov 22 08:14:42 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5b8e56f-87c3-4657-991f-ad58f3089336 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37dd790-ca1b-4839-8f34-244f9e89602e]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] <== disconnect_volume: return (320ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 08:14:42 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Deleting instance files /opt/stack/data/nova/instances/b998bedf-ee29-48a1-a14b-449add115c39_del
Nov 22 08:14:42 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Deletion of /opt/stack/data/nova/instances/b998bedf-ee29-48a1-a14b-449add115c39_del complete
Nov 22 08:14:42 user nova-compute[74348]: INFO nova.compute.manager [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 22 08:14:42 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 08:14:42 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: b998bedf-ee29-48a1-a14b-449add115c39] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 08:14:43 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:14:43 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Took 0.45 seconds to deallocate network for instance.
Nov 22 08:14:43 user nova-compute[74348]: DEBUG nova.compute.manager [req-80624664-82b3-469a-93c9-01224e716ca0 req-348fa8fb-9377-451a-a58e-d35ecd900331 service nova] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Received event network-vif-deleted-ee377706-a70f-4d29-96be-4d56daedb95a {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:14:43 user nova-compute[74348]: INFO nova.compute.manager [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Took 0.75 seconds to detach 1 volumes for instance.
Nov 22 08:14:43 user nova-compute[74348]: DEBUG nova.compute.manager [req-0b9af3e6-1a57-4e08-b7fb-faf825757e16 req-87e1c5f3-0c45-4fac-a8fb-aad65af52a26 service nova] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Received event network-vif-plugged-ee377706-a70f-4d29-96be-4d56daedb95a {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:14:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-0b9af3e6-1a57-4e08-b7fb-faf825757e16 req-87e1c5f3-0c45-4fac-a8fb-aad65af52a26 service nova] Acquiring lock "b998bedf-ee29-48a1-a14b-449add115c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:14:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-0b9af3e6-1a57-4e08-b7fb-faf825757e16 req-87e1c5f3-0c45-4fac-a8fb-aad65af52a26 service nova] Lock "b998bedf-ee29-48a1-a14b-449add115c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:14:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-0b9af3e6-1a57-4e08-b7fb-faf825757e16 req-87e1c5f3-0c45-4fac-a8fb-aad65af52a26 service nova] Lock "b998bedf-ee29-48a1-a14b-449add115c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:14:43 user nova-compute[74348]: DEBUG nova.compute.manager [req-0b9af3e6-1a57-4e08-b7fb-faf825757e16 req-87e1c5f3-0c45-4fac-a8fb-aad65af52a26 service nova] [instance: b998bedf-ee29-48a1-a14b-449add115c39] No waiting events found dispatching network-vif-plugged-ee377706-a70f-4d29-96be-4d56daedb95a {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:14:43 user nova-compute[74348]: WARNING nova.compute.manager [req-0b9af3e6-1a57-4e08-b7fb-faf825757e16 req-87e1c5f3-0c45-4fac-a8fb-aad65af52a26 service nova] [instance: b998bedf-ee29-48a1-a14b-449add115c39] Received unexpected event network-vif-plugged-ee377706-a70f-4d29-96be-4d56daedb95a for instance with vm_state active and task_state deleting.
Nov 22 08:14:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:14:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:14:44 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:14:44 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:14:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.322s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:14:44 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Deleted allocations for instance b998bedf-ee29-48a1-a14b-449add115c39
Nov 22 08:14:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9de95b75-4f1c-4188-88ee-66ebb08c7e15 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "b998bedf-ee29-48a1-a14b-449add115c39" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.865s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:14:44 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:14:44 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:14:44 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-5006cff5-4b67-405d-b6b1-4c355f82d920" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:14:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-5006cff5-4b67-405d-b6b1-4c355f82d920" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:14:44 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 08:14:45 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Updating instance_info_cache with network_info: [{"id": "db42bd08-8f0c-4e24-82c6-579bed0476bf", "address": "fa:16:3e:4e:f8:01", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb42bd08-8f", "ovs_interfaceid": "db42bd08-8f0c-4e24-82c6-579bed0476bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:14:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-5006cff5-4b67-405d-b6b1-4c355f82d920" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:14:45 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 08:14:45 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-aaef9e72-0c7d-47c6-af28-1a2194a71a74 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance dfa85b90-0b1e-4984-b89d-315a3590ec93 is timed out.
Nov 22 08:14:45 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-aaef9e72-0c7d-47c6-af28-1a2194a71a74 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Successfully detached device vdc from instance dfa85b90-0b1e-4984-b89d-315a3590ec93 from the live domain config.
Nov 22 08:14:45 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aaef9e72-0c7d-47c6-af28-1a2194a71a74 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 08:14:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaef9e72-0c7d-47c6-af28-1a2194a71a74 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MkvLPQzp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:14:45 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-aaef9e72-0c7d-47c6-af28-1a2194a71a74 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:14:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-aaef9e72-0c7d-47c6-af28-1a2194a71a74 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:14:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-aaef9e72-0c7d-47c6-af28-1a2194a71a74 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:14:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:45 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd0746b-56ae-4b30-ad94-b30f30e8a5e8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaef9e72-0c7d-47c6-af28-1a2194a71a74 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 08:14:45 user nova-compute[74348]: No targets found.
Nov 22 08:14:45 user nova-compute[74348]: iSNS:
Nov 22 08:14:45 user nova-compute[74348]: No targets found.
Nov 22 08:14:45 user nova-compute[74348]: STATIC:
Nov 22 08:14:45 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8
Nov 22 08:14:45 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:14:45 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:14:45 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290
Nov 22 08:14:45 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:14:45 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:14:45 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30
Nov 22 08:14:45 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:14:45 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:14:45 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2
Nov 22 08:14:45 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:14:45 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:14:45 user nova-compute[74348]: FIRMWARE:
Nov 22 08:14:45 user nova-compute[74348]: No targets found.
Nov 22 08:14:45 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:14:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaef9e72-0c7d-47c6-af28-1a2194a71a74 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 08:14:45 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 08:14:45 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 08:14:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaef9e72-0c7d-47c6-af28-1a2194a71a74 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 08:14:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:45 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88ec81d-f5c7-4df8-842b-8783ad4497cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:45 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cae164e-e33d-4bcf-ada5-ebebbfa06b17]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaef9e72-0c7d-47c6-af28-1a2194a71a74 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:14:45 user nova-compute[74348]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 (non-flash)
Nov 22 08:14:45 user nova-compute[74348]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2 (non-flash)
Nov 22 08:14:45 user nova-compute[74348]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)
Nov 22 08:14:45 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:14:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaef9e72-0c7d-47c6-af28-1a2194a71a74 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:14:45 user nova-compute[74348]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 (non-flash)
Nov 22 08:14:45 user nova-compute[74348]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2 (non-flash)
Nov 22 08:14:45 user nova-compute[74348]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)
Nov 22 08:14:45 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:14:45 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaef9e72-0c7d-47c6-af28-1a2194a71a74 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f224c5bdd80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2'): ({'sdg'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 08:14:45 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-aaef9e72-0c7d-47c6-af28-1a2194a71a74 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Removing single pathed devices sdg {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 08:14:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:45 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a2eb5e-8914-4955-a771-328cf7abc24a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:45 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3fc04a-5a2d-4973-bc2e-8210d6802172]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:45 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-aaef9e72-0c7d-47c6-af28-1a2194a71a74 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Flushing IO for device /dev/sdg {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 08:14:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:45 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1de60bb-e43e-40e3-95bb-307ac856e4d6]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:45 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-aaef9e72-0c7d-47c6-af28-1a2194a71a74 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 08:14:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.039s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:46 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e213c5a2-79a3-4dbf-a502-4f5d1cb405af]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:46 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-aaef9e72-0c7d-47c6-af28-1a2194a71a74 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 08:14:46 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-aaef9e72-0c7d-47c6-af28-1a2194a71a74 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] SCSI volumes sdg have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 08:14:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaef9e72-0c7d-47c6-af28-1a2194a71a74 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 08:14:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:46 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f7d7ab-9ee3-41f4-ac19-3ef94114caf4]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaef9e72-0c7d-47c6-af28-1a2194a71a74 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:14:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2 -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:46 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e7d32f-7fbc-439a-a7b3-bcc2e14fa8a9]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaef9e72-0c7d-47c6-af28-1a2194a71a74 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2, portal: 172.16.0.220,3260]
Nov 22 08:14:46 user nova-compute[74348]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2, portal: 172.16.0.220,3260] successful.
Nov 22 08:14:46 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:14:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2 -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b845d5-94f9-45e0-93c4-d043ad9bf9f2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:46 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1fa589-5c27-4b7e-a157-67ed321c467d]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:14:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaef9e72-0c7d-47c6-af28-1a2194a71a74 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:14:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-aaef9e72-0c7d-47c6-af28-1a2194a71a74 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:14:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaef9e72-0c7d-47c6-af28-1a2194a71a74 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] <== disconnect_volume: return (310ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:14:46 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aaef9e72-0c7d-47c6-af28-1a2194a71a74 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 08:14:46 user nova-compute[74348]: DEBUG nova.objects.instance [None req-aaef9e72-0c7d-47c6-af28-1a2194a71a74 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lazy-loading 'flavor' on Instance uuid dfa85b90-0b1e-4984-b89d-315a3590ec93 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:14:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-aaef9e72-0c7d-47c6-af28-1a2194a71a74 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "dfa85b90-0b1e-4984-b89d-315a3590ec93" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.676s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:14:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:47 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:14:47 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:14:47 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:14:47 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:14:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b5ee6f88-25a8-4eb6-8e9a-d9d7401a6904 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquiring lock "dfa85b90-0b1e-4984-b89d-315a3590ec93" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:14:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b5ee6f88-25a8-4eb6-8e9a-d9d7401a6904 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "dfa85b90-0b1e-4984-b89d-315a3590ec93" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:14:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b5ee6f88-25a8-4eb6-8e9a-d9d7401a6904 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquiring lock "dfa85b90-0b1e-4984-b89d-315a3590ec93-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:14:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b5ee6f88-25a8-4eb6-8e9a-d9d7401a6904 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "dfa85b90-0b1e-4984-b89d-315a3590ec93-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:14:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b5ee6f88-25a8-4eb6-8e9a-d9d7401a6904 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "dfa85b90-0b1e-4984-b89d-315a3590ec93-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:14:48 user nova-compute[74348]: INFO nova.compute.manager [None req-b5ee6f88-25a8-4eb6-8e9a-d9d7401a6904 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Terminating instance
Nov 22 08:14:48 user nova-compute[74348]: DEBUG nova.compute.manager [None req-b5ee6f88-25a8-4eb6-8e9a-d9d7401a6904 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 08:14:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:48 user nova-compute[74348]: DEBUG nova.compute.manager [req-409f6bc9-f5fc-417c-9118-ce26d11c93ad req-043ccfbd-7b4f-4b4d-a599-23ed58b65090 service nova] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Received event network-vif-unplugged-71861e5a-e368-4c2f-b960-7ec13f513fec {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:14:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-409f6bc9-f5fc-417c-9118-ce26d11c93ad req-043ccfbd-7b4f-4b4d-a599-23ed58b65090 service nova] Acquiring lock "dfa85b90-0b1e-4984-b89d-315a3590ec93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:14:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-409f6bc9-f5fc-417c-9118-ce26d11c93ad req-043ccfbd-7b4f-4b4d-a599-23ed58b65090 service nova] Lock "dfa85b90-0b1e-4984-b89d-315a3590ec93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:14:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-409f6bc9-f5fc-417c-9118-ce26d11c93ad req-043ccfbd-7b4f-4b4d-a599-23ed58b65090 service nova] Lock "dfa85b90-0b1e-4984-b89d-315a3590ec93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:14:48 user nova-compute[74348]: DEBUG nova.compute.manager [req-409f6bc9-f5fc-417c-9118-ce26d11c93ad req-043ccfbd-7b4f-4b4d-a599-23ed58b65090 service nova] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] No waiting events found dispatching network-vif-unplugged-71861e5a-e368-4c2f-b960-7ec13f513fec {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:14:48 user nova-compute[74348]: DEBUG nova.compute.manager [req-409f6bc9-f5fc-417c-9118-ce26d11c93ad req-043ccfbd-7b4f-4b4d-a599-23ed58b65090 service nova] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Received event network-vif-unplugged-71861e5a-e368-4c2f-b960-7ec13f513fec for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 08:14:48 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:14:48 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Instance destroyed successfully.
Nov 22 08:14:48 user nova-compute[74348]: DEBUG nova.objects.instance [None req-b5ee6f88-25a8-4eb6-8e9a-d9d7401a6904 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lazy-loading 'resources' on Instance uuid dfa85b90-0b1e-4984-b89d-315a3590ec93 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:14:48 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-b5ee6f88-25a8-4eb6-8e9a-d9d7401a6904 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:11:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1774797545',display_name='tempest-AttachVolumeTestJSON-server-1774797545',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1774797545',id=40,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTytNFrgh91MNlFVNxTrsW6WDKA0qttjwQd3oXWu6tzjsBiTLiRZq+JbSerC1vrEXEc7rf7co9vpI13vUvv6ktL52s5sDBn3ccI4O/F3GNejszbyW+2yuuVDnJR2Qr17w==',key_name='tempest-keypair-1139120022',keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:11:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2d1a2eb68ef4c0aa5ef081fe10877a9',ramdisk_id='',reservation_id='r-a3bpejvz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-608656879',owner_user_name='tempest-AttachVolumeTestJSON-608656879-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T08:11:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae8c7082420f4b85a9009ff82296d8cb',uuid=dfa85b90-0b1e-4984-b89d-315a3590ec93,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71861e5a-e368-4c2f-b960-7ec13f513fec", "address": "fa:16:3e:82:44:15", "network": {"id": "606a7c22-1285-47e8-bfa0-f09dbd7cb9ac", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-63336037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d1a2eb68ef4c0aa5ef081fe10877a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71861e5a-e3", "ovs_interfaceid": "71861e5a-e368-4c2f-b960-7ec13f513fec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:14:48 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-b5ee6f88-25a8-4eb6-8e9a-d9d7401a6904 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Converting VIF {"id": "71861e5a-e368-4c2f-b960-7ec13f513fec", "address": "fa:16:3e:82:44:15", "network": {"id": "606a7c22-1285-47e8-bfa0-f09dbd7cb9ac", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-63336037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d1a2eb68ef4c0aa5ef081fe10877a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71861e5a-e3", "ovs_interfaceid": "71861e5a-e368-4c2f-b960-7ec13f513fec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:14:48 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-b5ee6f88-25a8-4eb6-8e9a-d9d7401a6904 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:82:44:15,bridge_name='br-int',has_traffic_filtering=True,id=71861e5a-e368-4c2f-b960-7ec13f513fec,network=Network(606a7c22-1285-47e8-bfa0-f09dbd7cb9ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71861e5a-e3') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:14:48 user nova-compute[74348]: DEBUG os_vif [None req-b5ee6f88-25a8-4eb6-8e9a-d9d7401a6904 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:44:15,bridge_name='br-int',has_traffic_filtering=True,id=71861e5a-e368-4c2f-b960-7ec13f513fec,network=Network(606a7c22-1285-47e8-bfa0-f09dbd7cb9ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71861e5a-e3') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:14:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71861e5a-e3, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:14:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2856a0cc-527f-4997-a496-cdb9f5f11da2) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:14:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:14:48 user nova-compute[74348]: INFO os_vif [None req-b5ee6f88-25a8-4eb6-8e9a-d9d7401a6904 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:44:15,bridge_name='br-int',has_traffic_filtering=True,id=71861e5a-e368-4c2f-b960-7ec13f513fec,network=Network(606a7c22-1285-47e8-bfa0-f09dbd7cb9ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71861e5a-e3')
Nov 22 08:14:48 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-b5ee6f88-25a8-4eb6-8e9a-d9d7401a6904 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Deleting instance files /opt/stack/data/nova/instances/dfa85b90-0b1e-4984-b89d-315a3590ec93_del
Nov 22 08:14:48 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-b5ee6f88-25a8-4eb6-8e9a-d9d7401a6904 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Deletion of /opt/stack/data/nova/instances/dfa85b90-0b1e-4984-b89d-315a3590ec93_del complete
Nov 22 08:14:48 user nova-compute[74348]: INFO nova.compute.manager [None req-b5ee6f88-25a8-4eb6-8e9a-d9d7401a6904 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 22 08:14:48 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-b5ee6f88-25a8-4eb6-8e9a-d9d7401a6904 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 08:14:48 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 08:14:48 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 08:14:49 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:14:49 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:14:49 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Took 0.64 seconds to deallocate network for instance.
Nov 22 08:14:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b5ee6f88-25a8-4eb6-8e9a-d9d7401a6904 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:14:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b5ee6f88-25a8-4eb6-8e9a-d9d7401a6904 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:14:49 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-b5ee6f88-25a8-4eb6-8e9a-d9d7401a6904 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:14:49 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-b5ee6f88-25a8-4eb6-8e9a-d9d7401a6904 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:14:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b5ee6f88-25a8-4eb6-8e9a-d9d7401a6904 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.293s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:14:49 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-b5ee6f88-25a8-4eb6-8e9a-d9d7401a6904 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Deleted allocations for instance dfa85b90-0b1e-4984-b89d-315a3590ec93
Nov 22 08:14:50 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b5ee6f88-25a8-4eb6-8e9a-d9d7401a6904 tempest-AttachVolumeTestJSON-608656879 tempest-AttachVolumeTestJSON-608656879-project-member] Lock "dfa85b90-0b1e-4984-b89d-315a3590ec93" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.969s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:14:50 user nova-compute[74348]: DEBUG nova.compute.manager [req-b034b49e-f62d-4deb-aa47-4804bca1b8bc req-108ca78e-a15c-4e11-acc3-4004f6a78fd7 service nova] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Received event network-vif-plugged-71861e5a-e368-4c2f-b960-7ec13f513fec {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:14:50 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b034b49e-f62d-4deb-aa47-4804bca1b8bc req-108ca78e-a15c-4e11-acc3-4004f6a78fd7 service nova] Acquiring lock "dfa85b90-0b1e-4984-b89d-315a3590ec93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:14:50 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b034b49e-f62d-4deb-aa47-4804bca1b8bc req-108ca78e-a15c-4e11-acc3-4004f6a78fd7 service nova] Lock "dfa85b90-0b1e-4984-b89d-315a3590ec93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:14:50 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b034b49e-f62d-4deb-aa47-4804bca1b8bc req-108ca78e-a15c-4e11-acc3-4004f6a78fd7 service nova] Lock "dfa85b90-0b1e-4984-b89d-315a3590ec93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:14:50 user nova-compute[74348]: DEBUG nova.compute.manager [req-b034b49e-f62d-4deb-aa47-4804bca1b8bc req-108ca78e-a15c-4e11-acc3-4004f6a78fd7 service nova] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] No waiting events found dispatching network-vif-plugged-71861e5a-e368-4c2f-b960-7ec13f513fec {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:14:50 user nova-compute[74348]: WARNING nova.compute.manager [req-b034b49e-f62d-4deb-aa47-4804bca1b8bc req-108ca78e-a15c-4e11-acc3-4004f6a78fd7 service nova] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Received unexpected event network-vif-plugged-71861e5a-e368-4c2f-b960-7ec13f513fec for instance with vm_state deleted and task_state None.
Nov 22 08:14:50 user nova-compute[74348]: DEBUG nova.compute.manager [req-b034b49e-f62d-4deb-aa47-4804bca1b8bc req-108ca78e-a15c-4e11-acc3-4004f6a78fd7 service nova] [instance: dfa85b90-0b1e-4984-b89d-315a3590ec93] Received event network-vif-deleted-71861e5a-e368-4c2f-b960-7ec13f513fec {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:14:51 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:14:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:14:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:14:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:14:51 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:14:51 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:52 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:14:52 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:14:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0/disk.rescue --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0/disk.rescue --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:53 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0/disk (vdb) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:14:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:14:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:14:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:14:54 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:14:54 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:14:54 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=8180MB free_disk=24.67831039428711GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:14:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:14:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:14:54 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Applying migration context for instance 54d11b82-543c-4166-bf31-5e4e94eb830f as it has an incoming, in-progress migration 0d383a24-8dff-4547-b41e-6cbd76f5ce1c. Migration status is finished {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 22 08:14:54 user nova-compute[74348]: INFO nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Updating resource usage from migration 0d383a24-8dff-4547-b41e-6cbd76f5ce1c
Nov 22 08:14:54 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 765f8c47-c042-4430-8d35-07926ad693fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:14:54 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance b8f84c0b-fab5-4900-bf65-270c9c06baf8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:14:54 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 5006cff5-4b67-405d-b6b1-4c355f82d920 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:14:54 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 555f4246-d4b2-4f2f-b91c-dda8fe47264c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:14:54 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance ba74ca7d-2875-426c-a485-d908af865bae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:14:54 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance b95b6cae-1885-43e8-b589-ee89854100a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:14:54 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:14:54 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Migration 0d383a24-8dff-4547-b41e-6cbd76f5ce1c is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 22 08:14:54 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 54d11b82-543c-4166-bf31-5e4e94eb830f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:14:54 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:14:54 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:14:55 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:14:55 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:14:55 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:14:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.410s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:14:56 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:14:56 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:14:56 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:14:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:15:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:15:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:15:09 user nova-compute[74348]: INFO nova.compute.manager [None req-593bdf20-edb2-4e01-b6af-dc09ac1df4cd tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Unrescuing
Nov 22 08:15:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-593bdf20-edb2-4e01-b6af-dc09ac1df4cd tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquiring lock "refresh_cache-5c3f6262-19cf-41dd-bc6c-bdb006eb58a0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:15:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-593bdf20-edb2-4e01-b6af-dc09ac1df4cd tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquired lock "refresh_cache-5c3f6262-19cf-41dd-bc6c-bdb006eb58a0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:15:09 user nova-compute[74348]: DEBUG nova.network.neutron [None req-593bdf20-edb2-4e01-b6af-dc09ac1df4cd tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:15:09 user nova-compute[74348]: DEBUG nova.network.neutron [None req-593bdf20-edb2-4e01-b6af-dc09ac1df4cd tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Updating instance_info_cache with network_info: [{"id": "2b0fc463-3743-41e4-9846-ee4dc53689f4", "address": "fa:16:3e:f9:d6:30", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0fc463-37", "ovs_interfaceid": "2b0fc463-3743-41e4-9846-ee4dc53689f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:15:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-593bdf20-edb2-4e01-b6af-dc09ac1df4cd tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Releasing lock "refresh_cache-5c3f6262-19cf-41dd-bc6c-bdb006eb58a0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:15:09 user nova-compute[74348]: DEBUG nova.objects.instance [None req-593bdf20-edb2-4e01-b6af-dc09ac1df4cd tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lazy-loading 'flavor' on Instance uuid 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:15:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:15:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:15:10 user nova-compute[74348]: DEBUG nova.compute.manager [req-fbaeeed5-06c0-4dac-ba54-141d6ffdc4b0 req-beba5003-6382-4ad8-99ce-69c3243a960e service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Received event network-vif-unplugged-2b0fc463-3743-41e4-9846-ee4dc53689f4 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:15:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-fbaeeed5-06c0-4dac-ba54-141d6ffdc4b0 req-beba5003-6382-4ad8-99ce-69c3243a960e service nova] Acquiring lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:15:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-fbaeeed5-06c0-4dac-ba54-141d6ffdc4b0 req-beba5003-6382-4ad8-99ce-69c3243a960e service nova] Lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:15:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-fbaeeed5-06c0-4dac-ba54-141d6ffdc4b0 req-beba5003-6382-4ad8-99ce-69c3243a960e service nova] Lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:15:10 user nova-compute[74348]: DEBUG nova.compute.manager [req-fbaeeed5-06c0-4dac-ba54-141d6ffdc4b0 req-beba5003-6382-4ad8-99ce-69c3243a960e service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] No waiting events found dispatching network-vif-unplugged-2b0fc463-3743-41e4-9846-ee4dc53689f4 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:15:10 user nova-compute[74348]: WARNING nova.compute.manager [req-fbaeeed5-06c0-4dac-ba54-141d6ffdc4b0 req-beba5003-6382-4ad8-99ce-69c3243a960e service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Received unexpected event network-vif-unplugged-2b0fc463-3743-41e4-9846-ee4dc53689f4 for instance with vm_state rescued and task_state unrescuing.
Nov 22 08:15:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:15:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:15:10 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Instance destroyed successfully.
Nov 22 08:15:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:15:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:15:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:15:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:15:12 user nova-compute[74348]: DEBUG nova.compute.manager [req-d9c71f86-7ea7-4dab-9f42-d88ceb85f642 req-54126202-80b2-44ae-ae92-9095bca0255a service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Received event network-vif-plugged-2b0fc463-3743-41e4-9846-ee4dc53689f4 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:15:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d9c71f86-7ea7-4dab-9f42-d88ceb85f642 req-54126202-80b2-44ae-ae92-9095bca0255a service nova] Acquiring lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:15:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d9c71f86-7ea7-4dab-9f42-d88ceb85f642 req-54126202-80b2-44ae-ae92-9095bca0255a service nova] Lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:15:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d9c71f86-7ea7-4dab-9f42-d88ceb85f642 req-54126202-80b2-44ae-ae92-9095bca0255a service nova] Lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:15:12 user nova-compute[74348]: DEBUG nova.compute.manager [req-d9c71f86-7ea7-4dab-9f42-d88ceb85f642 req-54126202-80b2-44ae-ae92-9095bca0255a service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] No waiting events found dispatching network-vif-plugged-2b0fc463-3743-41e4-9846-ee4dc53689f4 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:15:12 user nova-compute[74348]: WARNING nova.compute.manager [req-d9c71f86-7ea7-4dab-9f42-d88ceb85f642 req-54126202-80b2-44ae-ae92-9095bca0255a service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Received unexpected event network-vif-plugged-2b0fc463-3743-41e4-9846-ee4dc53689f4 for instance with vm_state rescued and task_state unrescuing.
Nov 22 08:15:12 user nova-compute[74348]: DEBUG nova.compute.manager [req-d9c71f86-7ea7-4dab-9f42-d88ceb85f642 req-54126202-80b2-44ae-ae92-9095bca0255a service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Received event network-vif-plugged-2b0fc463-3743-41e4-9846-ee4dc53689f4 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:15:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d9c71f86-7ea7-4dab-9f42-d88ceb85f642 req-54126202-80b2-44ae-ae92-9095bca0255a service nova] Acquiring lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:15:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d9c71f86-7ea7-4dab-9f42-d88ceb85f642 req-54126202-80b2-44ae-ae92-9095bca0255a service nova] Lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:15:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d9c71f86-7ea7-4dab-9f42-d88ceb85f642 req-54126202-80b2-44ae-ae92-9095bca0255a service nova] Lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:15:12 user nova-compute[74348]: DEBUG nova.compute.manager [req-d9c71f86-7ea7-4dab-9f42-d88ceb85f642 req-54126202-80b2-44ae-ae92-9095bca0255a service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] No waiting events found dispatching network-vif-plugged-2b0fc463-3743-41e4-9846-ee4dc53689f4 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:15:12 user nova-compute[74348]: WARNING nova.compute.manager [req-d9c71f86-7ea7-4dab-9f42-d88ceb85f642 req-54126202-80b2-44ae-ae92-9095bca0255a service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Received unexpected event network-vif-plugged-2b0fc463-3743-41e4-9846-ee4dc53689f4 for instance with vm_state rescued and task_state unrescuing.
Nov 22 08:15:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:15:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:15:14 user nova-compute[74348]: DEBUG nova.compute.manager [None req-593bdf20-edb2-4e01-b6af-dc09ac1df4cd tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:15:14 user nova-compute[74348]: DEBUG nova.compute.manager [req-47aba2d3-d5e3-4048-981c-82e1baa4476b req-058316e1-7113-4877-8d4e-3beb5182e16e service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Received event network-vif-plugged-2b0fc463-3743-41e4-9846-ee4dc53689f4 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:15:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-47aba2d3-d5e3-4048-981c-82e1baa4476b req-058316e1-7113-4877-8d4e-3beb5182e16e service nova] Acquiring lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:15:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-47aba2d3-d5e3-4048-981c-82e1baa4476b req-058316e1-7113-4877-8d4e-3beb5182e16e service nova] Lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:15:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-47aba2d3-d5e3-4048-981c-82e1baa4476b req-058316e1-7113-4877-8d4e-3beb5182e16e service nova] Lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:15:14 user nova-compute[74348]: DEBUG nova.compute.manager [req-47aba2d3-d5e3-4048-981c-82e1baa4476b req-058316e1-7113-4877-8d4e-3beb5182e16e service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] No waiting events found dispatching network-vif-plugged-2b0fc463-3743-41e4-9846-ee4dc53689f4 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:15:14 user nova-compute[74348]: WARNING nova.compute.manager [req-47aba2d3-d5e3-4048-981c-82e1baa4476b req-058316e1-7113-4877-8d4e-3beb5182e16e service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Received unexpected event network-vif-plugged-2b0fc463-3743-41e4-9846-ee4dc53689f4 for instance with vm_state active and task_state None.
Nov 22 08:15:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:15:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:15:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:15:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:15:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:15:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1384b35e-3f19-474e-b942-687a5da50a2b tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "b95b6cae-1885-43e8-b589-ee89854100a3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:15:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1384b35e-3f19-474e-b942-687a5da50a2b tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "b95b6cae-1885-43e8-b589-ee89854100a3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:15:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1384b35e-3f19-474e-b942-687a5da50a2b tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "b95b6cae-1885-43e8-b589-ee89854100a3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:15:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1384b35e-3f19-474e-b942-687a5da50a2b tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "b95b6cae-1885-43e8-b589-ee89854100a3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:15:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1384b35e-3f19-474e-b942-687a5da50a2b tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "b95b6cae-1885-43e8-b589-ee89854100a3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:15:32 user nova-compute[74348]: INFO nova.compute.manager [None req-1384b35e-3f19-474e-b942-687a5da50a2b tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Terminating instance
Nov 22 08:15:32 user nova-compute[74348]: DEBUG nova.compute.manager [None req-1384b35e-3f19-474e-b942-687a5da50a2b tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 08:15:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:15:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:15:32 user nova-compute[74348]: DEBUG nova.compute.manager [req-fad60ad1-1516-4b38-8367-6ddb1ab3bb9c req-ef8da251-0a3d-499e-90c1-463d4aca2ce2 service nova] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Received event network-vif-unplugged-b6962c71-a062-4eac-a40d-7e3df83cc086 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:15:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-fad60ad1-1516-4b38-8367-6ddb1ab3bb9c req-ef8da251-0a3d-499e-90c1-463d4aca2ce2 service nova] Acquiring lock "b95b6cae-1885-43e8-b589-ee89854100a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:15:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-fad60ad1-1516-4b38-8367-6ddb1ab3bb9c req-ef8da251-0a3d-499e-90c1-463d4aca2ce2 service nova] Lock "b95b6cae-1885-43e8-b589-ee89854100a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:15:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-fad60ad1-1516-4b38-8367-6ddb1ab3bb9c req-ef8da251-0a3d-499e-90c1-463d4aca2ce2 service nova] Lock "b95b6cae-1885-43e8-b589-ee89854100a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:15:32 user nova-compute[74348]: DEBUG nova.compute.manager [req-fad60ad1-1516-4b38-8367-6ddb1ab3bb9c req-ef8da251-0a3d-499e-90c1-463d4aca2ce2 service nova] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] No waiting events found dispatching network-vif-unplugged-b6962c71-a062-4eac-a40d-7e3df83cc086 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:15:32 user nova-compute[74348]: DEBUG nova.compute.manager [req-fad60ad1-1516-4b38-8367-6ddb1ab3bb9c req-ef8da251-0a3d-499e-90c1-463d4aca2ce2 service nova] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Received event network-vif-unplugged-b6962c71-a062-4eac-a40d-7e3df83cc086 for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 08:15:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:15:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:15:32 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Instance destroyed successfully.
Nov 22 08:15:32 user nova-compute[74348]: DEBUG nova.objects.instance [None req-1384b35e-3f19-474e-b942-687a5da50a2b tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lazy-loading 'resources' on Instance uuid b95b6cae-1885-43e8-b589-ee89854100a3 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:15:32 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-1384b35e-3f19-474e-b942-687a5da50a2b tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:06:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1672365080',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1672365080',id=36,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:06:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a31d898cdc69494a8825e8d93a0d04bc',ramdisk_id='',reservation_id='r-ja4dvge7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-502521972',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T08:08:06Z,user_data=None,user_id='1d5c8274eca14965b6cbfe22110f904d',uuid=b95b6cae-1885-43e8-b589-ee89854100a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6962c71-a062-4eac-a40d-7e3df83cc086", "address": "fa:16:3e:e1:4b:c3", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6962c71-a0", "ovs_interfaceid": "b6962c71-a062-4eac-a40d-7e3df83cc086", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:15:32 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-1384b35e-3f19-474e-b942-687a5da50a2b tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Converting VIF {"id": "b6962c71-a062-4eac-a40d-7e3df83cc086", "address": "fa:16:3e:e1:4b:c3", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6962c71-a0", "ovs_interfaceid": "b6962c71-a062-4eac-a40d-7e3df83cc086", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:15:32 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-1384b35e-3f19-474e-b942-687a5da50a2b tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:4b:c3,bridge_name='br-int',has_traffic_filtering=True,id=b6962c71-a062-4eac-a40d-7e3df83cc086,network=Network(6fe60468-191c-4d84-8dce-55c056f88936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6962c71-a0') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:15:32 user nova-compute[74348]: DEBUG os_vif [None req-1384b35e-3f19-474e-b942-687a5da50a2b tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:4b:c3,bridge_name='br-int',has_traffic_filtering=True,id=b6962c71-a062-4eac-a40d-7e3df83cc086,network=Network(6fe60468-191c-4d84-8dce-55c056f88936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6962c71-a0') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:15:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:15:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb6962c71-a0, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:15:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:15:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:15:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:15:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=277f9308-5fa1-4349-8061-27d9b1e8f3a1) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:15:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:15:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:15:32 user nova-compute[74348]: INFO os_vif [None req-1384b35e-3f19-474e-b942-687a5da50a2b tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:4b:c3,bridge_name='br-int',has_traffic_filtering=True,id=b6962c71-a062-4eac-a40d-7e3df83cc086,network=Network(6fe60468-191c-4d84-8dce-55c056f88936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6962c71-a0')
Nov 22 08:15:32 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-1384b35e-3f19-474e-b942-687a5da50a2b tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Deleting instance files /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3_del
Nov 22 08:15:32 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-1384b35e-3f19-474e-b942-687a5da50a2b tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Deletion of /opt/stack/data/nova/instances/b95b6cae-1885-43e8-b589-ee89854100a3_del complete
Nov 22 08:15:33 user nova-compute[74348]: INFO nova.compute.manager [None req-1384b35e-3f19-474e-b942-687a5da50a2b tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 22 08:15:33 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-1384b35e-3f19-474e-b942-687a5da50a2b tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 08:15:33 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 08:15:33 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 08:15:33 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:15:33 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Took 0.53 seconds to deallocate network for instance.
Nov 22 08:15:33 user nova-compute[74348]: DEBUG nova.compute.manager [req-dbfb4335-572b-40aa-8965-ef23fc6221fb req-993d09cb-c5c2-4955-978b-24bb2ce2aa79 service nova] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Received event network-vif-deleted-b6962c71-a062-4eac-a40d-7e3df83cc086 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:15:33 user nova-compute[74348]: INFO nova.compute.manager [req-dbfb4335-572b-40aa-8965-ef23fc6221fb req-993d09cb-c5c2-4955-978b-24bb2ce2aa79 service nova] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Neutron deleted interface b6962c71-a062-4eac-a40d-7e3df83cc086; detaching it from the instance and deleting it from the info cache
Nov 22 08:15:33 user nova-compute[74348]: DEBUG nova.network.neutron [req-dbfb4335-572b-40aa-8965-ef23fc6221fb req-993d09cb-c5c2-4955-978b-24bb2ce2aa79 service nova] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:15:33 user nova-compute[74348]: DEBUG nova.compute.manager [req-dbfb4335-572b-40aa-8965-ef23fc6221fb req-993d09cb-c5c2-4955-978b-24bb2ce2aa79 service nova] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Detach interface failed, port_id=b6962c71-a062-4eac-a40d-7e3df83cc086, reason: Instance b95b6cae-1885-43e8-b589-ee89854100a3 could not be found. {{(pid=74348) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 08:15:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1384b35e-3f19-474e-b942-687a5da50a2b tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:15:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1384b35e-3f19-474e-b942-687a5da50a2b tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:15:33 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-1384b35e-3f19-474e-b942-687a5da50a2b tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:15:33 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-1384b35e-3f19-474e-b942-687a5da50a2b tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:15:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1384b35e-3f19-474e-b942-687a5da50a2b tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:15:33 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-1384b35e-3f19-474e-b942-687a5da50a2b tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Deleted allocations for instance b95b6cae-1885-43e8-b589-ee89854100a3
Nov 22 08:15:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1384b35e-3f19-474e-b942-687a5da50a2b tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "b95b6cae-1885-43e8-b589-ee89854100a3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.861s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:15:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:15:34 user nova-compute[74348]: DEBUG nova.compute.manager [req-c65a2ebc-a524-4ac6-927a-166aca922067 req-14fdb4b9-2492-4007-afe5-98e072ee7057 service nova] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Received event network-vif-plugged-b6962c71-a062-4eac-a40d-7e3df83cc086 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:15:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c65a2ebc-a524-4ac6-927a-166aca922067 req-14fdb4b9-2492-4007-afe5-98e072ee7057 service nova] Acquiring lock "b95b6cae-1885-43e8-b589-ee89854100a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:15:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c65a2ebc-a524-4ac6-927a-166aca922067 req-14fdb4b9-2492-4007-afe5-98e072ee7057 service nova] Lock "b95b6cae-1885-43e8-b589-ee89854100a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:15:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-c65a2ebc-a524-4ac6-927a-166aca922067 req-14fdb4b9-2492-4007-afe5-98e072ee7057 service nova] Lock "b95b6cae-1885-43e8-b589-ee89854100a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:15:34 user nova-compute[74348]: DEBUG nova.compute.manager [req-c65a2ebc-a524-4ac6-927a-166aca922067 req-14fdb4b9-2492-4007-afe5-98e072ee7057 service nova] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] No waiting events found dispatching network-vif-plugged-b6962c71-a062-4eac-a40d-7e3df83cc086 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:15:34 user nova-compute[74348]: WARNING nova.compute.manager [req-c65a2ebc-a524-4ac6-927a-166aca922067 req-14fdb4b9-2492-4007-afe5-98e072ee7057 service nova] [instance: b95b6cae-1885-43e8-b589-ee89854100a3] Received unexpected event network-vif-plugged-b6962c71-a062-4eac-a40d-7e3df83cc086 for instance with vm_state deleted and task_state None.
Nov 22 08:15:37 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:15:39 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:15:39 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:15:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:15:44 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:15:44 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:15:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-555f4246-d4b2-4f2f-b91c-dda8fe47264c" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:15:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-555f4246-d4b2-4f2f-b91c-dda8fe47264c" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:15:44 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 08:15:44 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:15:45 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Updating instance_info_cache with network_info: [{"id": "8e4fc0fe-f03b-4816-8a6a-c20a8eba5296", "address": "fa:16:3e:01:d5:cd", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4fc0fe-f0", "ovs_interfaceid": "8e4fc0fe-f03b-4816-8a6a-c20a8eba5296", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:15:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-555f4246-d4b2-4f2f-b91c-dda8fe47264c" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:15:45 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 08:15:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:15:48 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:15:48 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:15:48 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:15:49 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:15:49 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:15:50 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:15:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b0224174-3dd9-4046-9ebf-cd4c653c48fb tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "54d11b82-543c-4166-bf31-5e4e94eb830f" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:15:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b0224174-3dd9-4046-9ebf-cd4c653c48fb tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "54d11b82-543c-4166-bf31-5e4e94eb830f" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:15:51 user nova-compute[74348]: DEBUG nova.compute.manager [None req-b0224174-3dd9-4046-9ebf-cd4c653c48fb tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Going to confirm migration 2 {{(pid=74348) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 22 08:15:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b0224174-3dd9-4046-9ebf-cd4c653c48fb tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "refresh_cache-54d11b82-543c-4166-bf31-5e4e94eb830f" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:15:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b0224174-3dd9-4046-9ebf-cd4c653c48fb tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquired lock "refresh_cache-54d11b82-543c-4166-bf31-5e4e94eb830f" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:15:51 user nova-compute[74348]: DEBUG nova.network.neutron [None req-b0224174-3dd9-4046-9ebf-cd4c653c48fb tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:15:51 user nova-compute[74348]: DEBUG nova.objects.instance [None req-b0224174-3dd9-4046-9ebf-cd4c653c48fb tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lazy-loading 'info_cache' on Instance uuid 54d11b82-543c-4166-bf31-5e4e94eb830f {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:15:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:15:52 user nova-compute[74348]: DEBUG nova.network.neutron [None req-b0224174-3dd9-4046-9ebf-cd4c653c48fb tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Updating instance_info_cache with network_info: [{"id": "fe9fc32d-b2f0-4770-8473-de9e3a5816c9", "address": "fa:16:3e:b9:17:27", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9fc32d-b2", "ovs_interfaceid": "fe9fc32d-b2f0-4770-8473-de9e3a5816c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:15:52 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b0224174-3dd9-4046-9ebf-cd4c653c48fb tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Releasing lock "refresh_cache-54d11b82-543c-4166-bf31-5e4e94eb830f" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:15:52 user nova-compute[74348]: DEBUG nova.objects.instance [None req-b0224174-3dd9-4046-9ebf-cd4c653c48fb tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lazy-loading 'migration_context' on Instance uuid 54d11b82-543c-4166-bf31-5e4e94eb830f {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:15:52 user nova-compute[74348]: DEBUG nova.objects.base [None req-b0224174-3dd9-4046-9ebf-cd4c653c48fb tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Object Instance<54d11b82-543c-4166-bf31-5e4e94eb830f> lazy-loaded attributes: info_cache,migration_context {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:15:52 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b0224174-3dd9-4046-9ebf-cd4c653c48fb tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:15:52 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b0224174-3dd9-4046-9ebf-cd4c653c48fb tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:15:52 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:15:52 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:15:52 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:15:52 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-b0224174-3dd9-4046-9ebf-cd4c653c48fb tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:15:52 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-b0224174-3dd9-4046-9ebf-cd4c653c48fb tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:15:52 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b0224174-3dd9-4046-9ebf-cd4c653c48fb tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.312s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:15:52 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.200s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:15:52 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:15:52 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:15:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:15:52 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-b0224174-3dd9-4046-9ebf-cd4c653c48fb tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Deleted allocation for migration 0d383a24-8dff-4547-b41e-6cbd76f5ce1c
Nov 22 08:15:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:15:52 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b0224174-3dd9-4046-9ebf-cd4c653c48fb tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "54d11b82-543c-4166-bf31-5e4e94eb830f" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.328s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:15:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:15:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:15:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:15:53 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:15:53 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:15:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:15:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:15:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:15:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:15:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:15:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:15:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:15:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:15:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:15:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:15:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:15:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:15:54 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:15:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:15:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:15:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:15:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:15:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:15:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:15:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:15:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:15:55 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:15:55 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:15:55 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=8276MB free_disk=24.801624298095703GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:15:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:15:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:15:55 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 765f8c47-c042-4430-8d35-07926ad693fe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:15:55 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance b8f84c0b-fab5-4900-bf65-270c9c06baf8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:15:55 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 5006cff5-4b67-405d-b6b1-4c355f82d920 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:15:55 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 555f4246-d4b2-4f2f-b91c-dda8fe47264c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:15:55 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance ba74ca7d-2875-426c-a485-d908af865bae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:15:55 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:15:55 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 54d11b82-543c-4166-bf31-5e4e94eb830f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:15:55 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:15:55 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:15:55 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:15:55 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:15:55 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:15:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.356s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:15:57 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:15:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:16:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:16:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:16:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:16:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:16:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:16:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:16:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:16:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:16:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:16:22 user nova-compute[74348]: INFO nova.compute.manager [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Terminating instance
Nov 22 08:16:22 user nova-compute[74348]: DEBUG nova.compute.manager [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 08:16:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:16:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG nova.compute.manager [req-b14c9144-6217-4898-abdf-c6e71ccd862c req-1c7e856a-b1e6-4cf9-9dab-2bf15b79b0b2 service nova] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Received event network-vif-unplugged-72e5b044-9d3b-412d-9a20-408387fb6fe6 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b14c9144-6217-4898-abdf-c6e71ccd862c req-1c7e856a-b1e6-4cf9-9dab-2bf15b79b0b2 service nova] Acquiring lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b14c9144-6217-4898-abdf-c6e71ccd862c req-1c7e856a-b1e6-4cf9-9dab-2bf15b79b0b2 service nova] Lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b14c9144-6217-4898-abdf-c6e71ccd862c req-1c7e856a-b1e6-4cf9-9dab-2bf15b79b0b2 service nova] Lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG nova.compute.manager [req-b14c9144-6217-4898-abdf-c6e71ccd862c req-1c7e856a-b1e6-4cf9-9dab-2bf15b79b0b2 service nova] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] No waiting events found dispatching network-vif-unplugged-72e5b044-9d3b-412d-9a20-408387fb6fe6 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG nova.compute.manager [req-b14c9144-6217-4898-abdf-c6e71ccd862c req-1c7e856a-b1e6-4cf9-9dab-2bf15b79b0b2 service nova] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Received event network-vif-unplugged-72e5b044-9d3b-412d-9a20-408387fb6fe6 for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:16:23 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Instance destroyed successfully.
Nov 22 08:16:23 user nova-compute[74348]: DEBUG nova.objects.instance [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lazy-loading 'resources' on Instance uuid b8f84c0b-fab5-4900-bf65-270c9c06baf8 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:00:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1945716787',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1945716787',id=24,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:02:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a31d898cdc69494a8825e8d93a0d04bc',ramdisk_id='',reservation_id='r-9nke1bun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-502521972',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T08:04:21Z,user_data=None,user_id='1d5c8274eca14965b6cbfe22110f904d',uuid=b8f84c0b-fab5-4900-bf65-270c9c06baf8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72e5b044-9d3b-412d-9a20-408387fb6fe6", "address": "fa:16:3e:5d:93:c7", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e5b044-9d", "ovs_interfaceid": "72e5b044-9d3b-412d-9a20-408387fb6fe6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Converting VIF {"id": "72e5b044-9d3b-412d-9a20-408387fb6fe6", "address": "fa:16:3e:5d:93:c7", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e5b044-9d", "ovs_interfaceid": "72e5b044-9d3b-412d-9a20-408387fb6fe6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:93:c7,bridge_name='br-int',has_traffic_filtering=True,id=72e5b044-9d3b-412d-9a20-408387fb6fe6,network=Network(6fe60468-191c-4d84-8dce-55c056f88936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72e5b044-9d') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG os_vif [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:93:c7,bridge_name='br-int',has_traffic_filtering=True,id=72e5b044-9d3b-412d-9a20-408387fb6fe6,network=Network(6fe60468-191c-4d84-8dce-55c056f88936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72e5b044-9d') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72e5b044-9d, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a04ce15b-9bb2-4f03-8a41-53f4f43881b4) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:16:23 user nova-compute[74348]: INFO os_vif [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:93:c7,bridge_name='br-int',has_traffic_filtering=True,id=72e5b044-9d3b-412d-9a20-408387fb6fe6,network=Network(6fe60468-191c-4d84-8dce-55c056f88936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72e5b044-9d')
Nov 22 08:16:23 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nVWumQGy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:16:23 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:16:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d35fc09-7ee3-4a69-8aa9-ac095b24738f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 08:16:23 user nova-compute[74348]: No targets found.
Nov 22 08:16:23 user nova-compute[74348]: iSNS:
Nov 22 08:16:23 user nova-compute[74348]: No targets found.
Nov 22 08:16:23 user nova-compute[74348]: STATIC:
Nov 22 08:16:23 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8
Nov 22 08:16:23 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:16:23 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:16:23 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290
Nov 22 08:16:23 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:16:23 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:16:23 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30
Nov 22 08:16:23 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:16:23 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:16:23 user nova-compute[74348]: FIRMWARE:
Nov 22 08:16:23 user nova-compute[74348]: No targets found.
Nov 22 08:16:23 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 08:16:23 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 08:16:23 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a66ff35-2b41-4b01-922f-cef1d9ae04c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5cdec04-7874-469a-bb1e-f090e20b65f7]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:16:23 user nova-compute[74348]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 (non-flash)
Nov 22 08:16:23 user nova-compute[74348]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)
Nov 22 08:16:23 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 (non-flash)
Nov 22 08:16:23 user nova-compute[74348]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 (non-flash)
Nov 22 08:16:23 user nova-compute[74348]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)
Nov 22 08:16:23 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2228280040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8'): ({'sdb'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Removing single pathed devices sdb {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.033s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7251293d-037c-414c-bec5-ded661c4a4ac]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8139616c-e9e2-4e37-a49b-6c256dc2e063]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Flushing IO for device /dev/sdb {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e261eea-c378-41b2-a1b8-eb3e1eaca009]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7aafe0-bdd6-415c-a05c-88c081864f21]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] SCSI volumes sdb have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d08cfd-5513-48ed-b3f3-2af0cf25d074]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:16:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:16:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:16:24 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d729f6-4bb4-41ea-a5d2-9c90e475d240]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:16:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8, portal: 172.16.0.220,3260]
Nov 22 08:16:24 user nova-compute[74348]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8, portal: 172.16.0.220,3260] successful.
Nov 22 08:16:24 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:16:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:16:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75590810-f559-484b-947e-9e6f1397e7f8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:16:24 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c122d8-b7e1-40d5-b920-295a183748fc]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:16:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:16:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:16:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] <== disconnect_volume: return (344ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:16:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 08:16:24 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Deleting instance files /opt/stack/data/nova/instances/b8f84c0b-fab5-4900-bf65-270c9c06baf8_del
Nov 22 08:16:24 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Deletion of /opt/stack/data/nova/instances/b8f84c0b-fab5-4900-bf65-270c9c06baf8_del complete
Nov 22 08:16:24 user nova-compute[74348]: INFO nova.compute.manager [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Took 1.39 seconds to destroy the instance on the hypervisor.
Nov 22 08:16:24 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 08:16:24 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 08:16:24 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 08:16:24 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:16:24 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Took 0.48 seconds to deallocate network for instance.
Nov 22 08:16:25 user nova-compute[74348]: DEBUG nova.compute.manager [req-aed35dbc-64a4-49ce-9e4f-bf0862a53829 req-7b18c41b-39a6-4d08-992f-3f6b5a09e87e service nova] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Received event network-vif-plugged-72e5b044-9d3b-412d-9a20-408387fb6fe6 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:16:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-aed35dbc-64a4-49ce-9e4f-bf0862a53829 req-7b18c41b-39a6-4d08-992f-3f6b5a09e87e service nova] Acquiring lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:16:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-aed35dbc-64a4-49ce-9e4f-bf0862a53829 req-7b18c41b-39a6-4d08-992f-3f6b5a09e87e service nova] Lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:16:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-aed35dbc-64a4-49ce-9e4f-bf0862a53829 req-7b18c41b-39a6-4d08-992f-3f6b5a09e87e service nova] Lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:16:25 user nova-compute[74348]: DEBUG nova.compute.manager [req-aed35dbc-64a4-49ce-9e4f-bf0862a53829 req-7b18c41b-39a6-4d08-992f-3f6b5a09e87e service nova] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] No waiting events found dispatching network-vif-plugged-72e5b044-9d3b-412d-9a20-408387fb6fe6 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:16:25 user nova-compute[74348]: WARNING nova.compute.manager [req-aed35dbc-64a4-49ce-9e4f-bf0862a53829 req-7b18c41b-39a6-4d08-992f-3f6b5a09e87e service nova] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Received unexpected event network-vif-plugged-72e5b044-9d3b-412d-9a20-408387fb6fe6 for instance with vm_state active and task_state deleting.
Nov 22 08:16:25 user nova-compute[74348]: DEBUG nova.compute.manager [req-aed35dbc-64a4-49ce-9e4f-bf0862a53829 req-7b18c41b-39a6-4d08-992f-3f6b5a09e87e service nova] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Received event network-vif-deleted-72e5b044-9d3b-412d-9a20-408387fb6fe6 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:16:25 user nova-compute[74348]: INFO nova.compute.manager [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: b8f84c0b-fab5-4900-bf65-270c9c06baf8] Took 0.76 seconds to detach 1 volumes for instance.
Nov 22 08:16:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:16:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:16:25 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:16:25 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:16:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.247s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:16:25 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Deleted allocations for instance b8f84c0b-fab5-4900-bf65-270c9c06baf8
Nov 22 08:16:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-fdb2f0e6-b9b2-4082-8586-5be6fb2c3e2d tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "b8f84c0b-fab5-4900-bf65-270c9c06baf8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.073s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:16:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:16:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:16:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:16:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:16:44 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:16:44 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:16:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-ba74ca7d-2875-426c-a485-d908af865bae" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:16:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-ba74ca7d-2875-426c-a485-d908af865bae" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:16:44 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 08:16:44 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Updating instance_info_cache with network_info: [{"id": "674629a8-f3d5-41f1-a3d8-fbd957b97ad9", "address": "fa:16:3e:46:7e:d8", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap674629a8-f3", "ovs_interfaceid": "674629a8-f3d5-41f1-a3d8-fbd957b97ad9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:16:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-ba74ca7d-2875-426c-a485-d908af865bae" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:16:45 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 08:16:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:16:49 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:16:49 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:16:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:16:50 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:16:50 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:16:50 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:16:52 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:16:53 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:16:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:16:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:16:54 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:16:54 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:16:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:16:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:16:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:16:54 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:16:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:16:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:16:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:16:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:16:55 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:16:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:16:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:16:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:16:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:16:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:16:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:16:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:16:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:16:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:16:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:16:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:16:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:16:56 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:16:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:16:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:16:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:16:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:16:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:16:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:16:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:16:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:16:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:16:57 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:16:57 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:16:57 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=8412MB free_disk=24.790813446044922GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:16:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:16:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:16:57 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 765f8c47-c042-4430-8d35-07926ad693fe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:16:57 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 5006cff5-4b67-405d-b6b1-4c355f82d920 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:16:57 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 555f4246-d4b2-4f2f-b91c-dda8fe47264c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:16:57 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance ba74ca7d-2875-426c-a485-d908af865bae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:16:57 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:16:57 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 54d11b82-543c-4166-bf31-5e4e94eb830f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:16:57 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:16:57 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:16:57 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:16:57 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:16:57 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:16:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.318s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:16:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:16:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:16:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:01 user nova-compute[74348]: DEBUG nova.compute.manager [req-a49dcc89-5ab3-4747-8615-fe253777e6ba req-a31027e7-ffd3-4ea2-92cc-8553ab9e66da service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Received event network-changed-2b0fc463-3743-41e4-9846-ee4dc53689f4 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:17:01 user nova-compute[74348]: DEBUG nova.compute.manager [req-a49dcc89-5ab3-4747-8615-fe253777e6ba req-a31027e7-ffd3-4ea2-92cc-8553ab9e66da service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Refreshing instance network info cache due to event network-changed-2b0fc463-3743-41e4-9846-ee4dc53689f4. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:17:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a49dcc89-5ab3-4747-8615-fe253777e6ba req-a31027e7-ffd3-4ea2-92cc-8553ab9e66da service nova] Acquiring lock "refresh_cache-5c3f6262-19cf-41dd-bc6c-bdb006eb58a0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:17:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a49dcc89-5ab3-4747-8615-fe253777e6ba req-a31027e7-ffd3-4ea2-92cc-8553ab9e66da service nova] Acquired lock "refresh_cache-5c3f6262-19cf-41dd-bc6c-bdb006eb58a0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:17:01 user nova-compute[74348]: DEBUG nova.network.neutron [req-a49dcc89-5ab3-4747-8615-fe253777e6ba req-a31027e7-ffd3-4ea2-92cc-8553ab9e66da service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Refreshing network info cache for port 2b0fc463-3743-41e4-9846-ee4dc53689f4 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:17:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-af14b72f-8d67-4eee-aeff-61a19352eba6 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquiring lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:17:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-af14b72f-8d67-4eee-aeff-61a19352eba6 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:17:01 user nova-compute[74348]: INFO nova.compute.manager [None req-af14b72f-8d67-4eee-aeff-61a19352eba6 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Detaching volume 6eb1715a-579b-43af-96ad-d629a5706c30
Nov 22 08:17:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:01 user nova-compute[74348]: INFO nova.virt.block_device [None req-af14b72f-8d67-4eee-aeff-61a19352eba6 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Attempting to driver detach volume 6eb1715a-579b-43af-96ad-d629a5706c30 from mountpoint /dev/vdb
Nov 22 08:17:01 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-af14b72f-8d67-4eee-aeff-61a19352eba6 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Attempting to detach device vdb from instance 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0 from the persistent domain config. {{(pid=74348) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 08:17:01 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-af14b72f-8d67-4eee-aeff-61a19352eba6 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:17:01 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:17:01 user nova-compute[74348]:   <source dev="/dev/sde"/>
Nov 22 08:17:01 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:17:01 user nova-compute[74348]:   <serial>6eb1715a-579b-43af-96ad-d629a5706c30</serial>
Nov 22 08:17:01 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 08:17:01 user nova-compute[74348]: </disk>
Nov 22 08:17:01 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:17:01 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-af14b72f-8d67-4eee-aeff-61a19352eba6 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Successfully detached device vdb from instance 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0 from the persistent domain config.
Nov 22 08:17:01 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-af14b72f-8d67-4eee-aeff-61a19352eba6 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0 from the live domain config. {{(pid=74348) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 08:17:01 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-af14b72f-8d67-4eee-aeff-61a19352eba6 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:17:01 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:17:01 user nova-compute[74348]:   <source dev="/dev/sde"/>
Nov 22 08:17:01 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:17:01 user nova-compute[74348]:   <serial>6eb1715a-579b-43af-96ad-d629a5706c30</serial>
Nov 22 08:17:01 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 08:17:01 user nova-compute[74348]: </disk>
Nov 22 08:17:01 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:17:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-af14b72f-8d67-4eee-aeff-61a19352eba6 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0 {{(pid=74348) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 08:17:02 user nova-compute[74348]: DEBUG nova.network.neutron [req-a49dcc89-5ab3-4747-8615-fe253777e6ba req-a31027e7-ffd3-4ea2-92cc-8553ab9e66da service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Updated VIF entry in instance network info cache for port 2b0fc463-3743-41e4-9846-ee4dc53689f4. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:17:02 user nova-compute[74348]: DEBUG nova.network.neutron [req-a49dcc89-5ab3-4747-8615-fe253777e6ba req-a31027e7-ffd3-4ea2-92cc-8553ab9e66da service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Updating instance_info_cache with network_info: [{"id": "2b0fc463-3743-41e4-9846-ee4dc53689f4", "address": "fa:16:3e:f9:d6:30", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0fc463-37", "ovs_interfaceid": "2b0fc463-3743-41e4-9846-ee4dc53689f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:17:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a49dcc89-5ab3-4747-8615-fe253777e6ba req-a31027e7-ffd3-4ea2-92cc-8553ab9e66da service nova] Releasing lock "refresh_cache-5c3f6262-19cf-41dd-bc6c-bdb006eb58a0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:17:02 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:17:03 user nova-compute[74348]: DEBUG nova.compute.manager [req-2cbfb5dc-fa95-4c1c-b831-4d561ca35988 req-1e05ccc6-c433-40d5-96f6-a00ad99224af service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Received event network-changed-2b0fc463-3743-41e4-9846-ee4dc53689f4 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:17:03 user nova-compute[74348]: DEBUG nova.compute.manager [req-2cbfb5dc-fa95-4c1c-b831-4d561ca35988 req-1e05ccc6-c433-40d5-96f6-a00ad99224af service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Refreshing instance network info cache due to event network-changed-2b0fc463-3743-41e4-9846-ee4dc53689f4. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:17:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2cbfb5dc-fa95-4c1c-b831-4d561ca35988 req-1e05ccc6-c433-40d5-96f6-a00ad99224af service nova] Acquiring lock "refresh_cache-5c3f6262-19cf-41dd-bc6c-bdb006eb58a0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:17:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2cbfb5dc-fa95-4c1c-b831-4d561ca35988 req-1e05ccc6-c433-40d5-96f6-a00ad99224af service nova] Acquired lock "refresh_cache-5c3f6262-19cf-41dd-bc6c-bdb006eb58a0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:17:03 user nova-compute[74348]: DEBUG nova.network.neutron [req-2cbfb5dc-fa95-4c1c-b831-4d561ca35988 req-1e05ccc6-c433-40d5-96f6-a00ad99224af service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Refreshing network info cache for port 2b0fc463-3743-41e4-9846-ee4dc53689f4 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:17:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:03 user nova-compute[74348]: DEBUG nova.network.neutron [req-2cbfb5dc-fa95-4c1c-b831-4d561ca35988 req-1e05ccc6-c433-40d5-96f6-a00ad99224af service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Updated VIF entry in instance network info cache for port 2b0fc463-3743-41e4-9846-ee4dc53689f4. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:17:03 user nova-compute[74348]: DEBUG nova.network.neutron [req-2cbfb5dc-fa95-4c1c-b831-4d561ca35988 req-1e05ccc6-c433-40d5-96f6-a00ad99224af service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Updating instance_info_cache with network_info: [{"id": "2b0fc463-3743-41e4-9846-ee4dc53689f4", "address": "fa:16:3e:f9:d6:30", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0fc463-37", "ovs_interfaceid": "2b0fc463-3743-41e4-9846-ee4dc53689f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:17:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2cbfb5dc-fa95-4c1c-b831-4d561ca35988 req-1e05ccc6-c433-40d5-96f6-a00ad99224af service nova] Releasing lock "refresh_cache-5c3f6262-19cf-41dd-bc6c-bdb006eb58a0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:17:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Acquiring lock "895bf22e-1097-46ac-9ef3-a856dcd02349" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:17:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Lock "895bf22e-1097-46ac-9ef3-a856dcd02349" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:17:09 user nova-compute[74348]: DEBUG nova.compute.manager [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 08:17:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:17:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:17:10 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 08:17:10 user nova-compute[74348]: INFO nova.compute.claims [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Claim successful on node user
Nov 22 08:17:10 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:17:10 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:17:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.332s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:17:10 user nova-compute[74348]: DEBUG nova.compute.manager [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 08:17:10 user nova-compute[74348]: DEBUG nova.compute.manager [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 08:17:10 user nova-compute[74348]: DEBUG nova.network.neutron [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 08:17:10 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 08:17:10 user nova-compute[74348]: DEBUG nova.compute.manager [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 08:17:10 user nova-compute[74348]: DEBUG nova.policy [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '57494625c8a644ac9958aa3629d4aa62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec444609c0e43f1ad0fbeefbbb7dbb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 08:17:10 user nova-compute[74348]: INFO nova.virt.block_device [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Booting with volume d00769d0-fad3-4be1-ba4a-cb7615c344de at /dev/vda
Nov 22 08:17:10 user nova-compute[74348]: DEBUG os_brick.utils [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:17:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:17:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:17:10 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b68e87-8c9b-4626-9323-99f73c7e7bda]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:17:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:17:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:17:10 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb011a9e-68d9-4534-9d59-6c0800558586]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:17:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:17:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:17:10 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[90584f33-1586-44bb-b309-56dfc4f62f5e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:17:10 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd469b8f-0b94-49eb-840d-9d2f6a99afc1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:17:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:17:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:17:10 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 08:17:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:17:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:17:10 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 08:17:10 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[829d3e22-9a61-4d83-9010-16892d454ee8]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:17:10 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 08:17:10 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 08:17:10 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 08:17:10 user nova-compute[74348]: DEBUG os_brick.utils [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:17:10 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Updating existing volume attachment record: 8ddb4c79-4d12-41b4-8f9e-efab35d0c461 {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 08:17:11 user nova-compute[74348]: DEBUG nova.network.neutron [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Successfully created port: cec31312-56a9-45d2-a9ff-26a135b50547 {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 08:17:11 user nova-compute[74348]: DEBUG nova.network.neutron [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Successfully updated port: cec31312-56a9-45d2-a9ff-26a135b50547 {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 08:17:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Acquiring lock "refresh_cache-895bf22e-1097-46ac-9ef3-a856dcd02349" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:17:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Acquired lock "refresh_cache-895bf22e-1097-46ac-9ef3-a856dcd02349" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:17:11 user nova-compute[74348]: DEBUG nova.network.neutron [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:17:11 user nova-compute[74348]: DEBUG nova.compute.manager [req-ab648833-1c9c-47c6-9223-6a5f080c3fb2 req-5a5874ad-2a58-4a45-9a1a-e8c22d7c3df7 service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Received event network-changed-cec31312-56a9-45d2-a9ff-26a135b50547 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:17:11 user nova-compute[74348]: DEBUG nova.compute.manager [req-ab648833-1c9c-47c6-9223-6a5f080c3fb2 req-5a5874ad-2a58-4a45-9a1a-e8c22d7c3df7 service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Refreshing instance network info cache due to event network-changed-cec31312-56a9-45d2-a9ff-26a135b50547. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:17:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-ab648833-1c9c-47c6-9223-6a5f080c3fb2 req-5a5874ad-2a58-4a45-9a1a-e8c22d7c3df7 service nova] Acquiring lock "refresh_cache-895bf22e-1097-46ac-9ef3-a856dcd02349" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:17:12 user nova-compute[74348]: DEBUG nova.network.neutron [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 08:17:12 user nova-compute[74348]: DEBUG nova.network.neutron [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Updating instance_info_cache with network_info: [{"id": "cec31312-56a9-45d2-a9ff-26a135b50547", "address": "fa:16:3e:db:29:7a", "network": {"id": "54c3b38d-bf3a-445f-b63a-1ba2abfa50f9", "bridge": "br-int", "label": "tempest-TestShelveInstance-976927611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fec444609c0e43f1ad0fbeefbbb7dbb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec31312-56", "ovs_interfaceid": "cec31312-56a9-45d2-a9ff-26a135b50547", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:17:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Releasing lock "refresh_cache-895bf22e-1097-46ac-9ef3-a856dcd02349" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:17:12 user nova-compute[74348]: DEBUG nova.compute.manager [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Instance network_info: |[{"id": "cec31312-56a9-45d2-a9ff-26a135b50547", "address": "fa:16:3e:db:29:7a", "network": {"id": "54c3b38d-bf3a-445f-b63a-1ba2abfa50f9", "bridge": "br-int", "label": "tempest-TestShelveInstance-976927611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fec444609c0e43f1ad0fbeefbbb7dbb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec31312-56", "ovs_interfaceid": "cec31312-56a9-45d2-a9ff-26a135b50547", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 08:17:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-ab648833-1c9c-47c6-9223-6a5f080c3fb2 req-5a5874ad-2a58-4a45-9a1a-e8c22d7c3df7 service nova] Acquired lock "refresh_cache-895bf22e-1097-46ac-9ef3-a856dcd02349" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:17:12 user nova-compute[74348]: DEBUG nova.network.neutron [req-ab648833-1c9c-47c6-9223-6a5f080c3fb2 req-5a5874ad-2a58-4a45-9a1a-e8c22d7c3df7 service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Refreshing network info cache for port cec31312-56a9-45d2-a9ff-26a135b50547 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:17:12 user nova-compute[74348]: DEBUG nova.network.neutron [req-ab648833-1c9c-47c6-9223-6a5f080c3fb2 req-5a5874ad-2a58-4a45-9a1a-e8c22d7c3df7 service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Updated VIF entry in instance network info cache for port cec31312-56a9-45d2-a9ff-26a135b50547. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:17:12 user nova-compute[74348]: DEBUG nova.network.neutron [req-ab648833-1c9c-47c6-9223-6a5f080c3fb2 req-5a5874ad-2a58-4a45-9a1a-e8c22d7c3df7 service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Updating instance_info_cache with network_info: [{"id": "cec31312-56a9-45d2-a9ff-26a135b50547", "address": "fa:16:3e:db:29:7a", "network": {"id": "54c3b38d-bf3a-445f-b63a-1ba2abfa50f9", "bridge": "br-int", "label": "tempest-TestShelveInstance-976927611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fec444609c0e43f1ad0fbeefbbb7dbb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec31312-56", "ovs_interfaceid": "cec31312-56a9-45d2-a9ff-26a135b50547", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:17:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-ab648833-1c9c-47c6-9223-6a5f080c3fb2 req-5a5874ad-2a58-4a45-9a1a-e8c22d7c3df7 service nova] Releasing lock "refresh_cache-895bf22e-1097-46ac-9ef3-a856dcd02349" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:17:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e5b36f6a-7eb5-4f3d-9ea2-490f9ee6e701 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "765f8c47-c042-4430-8d35-07926ad693fe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:17:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e5b36f6a-7eb5-4f3d-9ea2-490f9ee6e701 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "765f8c47-c042-4430-8d35-07926ad693fe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:17:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e5b36f6a-7eb5-4f3d-9ea2-490f9ee6e701 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "765f8c47-c042-4430-8d35-07926ad693fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:17:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e5b36f6a-7eb5-4f3d-9ea2-490f9ee6e701 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "765f8c47-c042-4430-8d35-07926ad693fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:17:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e5b36f6a-7eb5-4f3d-9ea2-490f9ee6e701 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "765f8c47-c042-4430-8d35-07926ad693fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:17:13 user nova-compute[74348]: INFO nova.compute.manager [None req-e5b36f6a-7eb5-4f3d-9ea2-490f9ee6e701 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Terminating instance
Nov 22 08:17:13 user nova-compute[74348]: DEBUG nova.compute.manager [None req-e5b36f6a-7eb5-4f3d-9ea2-490f9ee6e701 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 08:17:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:13 user nova-compute[74348]: DEBUG nova.compute.manager [req-f8e6c6af-6a3c-4d23-b0fa-0bbb99296992 req-0ec6cd48-3abe-4f0d-99e6-be62fe06f838 service nova] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Received event network-vif-unplugged-3ee3f6b1-b929-404a-b3bb-6ece1c2d1052 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:17:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f8e6c6af-6a3c-4d23-b0fa-0bbb99296992 req-0ec6cd48-3abe-4f0d-99e6-be62fe06f838 service nova] Acquiring lock "765f8c47-c042-4430-8d35-07926ad693fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:17:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f8e6c6af-6a3c-4d23-b0fa-0bbb99296992 req-0ec6cd48-3abe-4f0d-99e6-be62fe06f838 service nova] Lock "765f8c47-c042-4430-8d35-07926ad693fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:17:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f8e6c6af-6a3c-4d23-b0fa-0bbb99296992 req-0ec6cd48-3abe-4f0d-99e6-be62fe06f838 service nova] Lock "765f8c47-c042-4430-8d35-07926ad693fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:17:13 user nova-compute[74348]: DEBUG nova.compute.manager [req-f8e6c6af-6a3c-4d23-b0fa-0bbb99296992 req-0ec6cd48-3abe-4f0d-99e6-be62fe06f838 service nova] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] No waiting events found dispatching network-vif-unplugged-3ee3f6b1-b929-404a-b3bb-6ece1c2d1052 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:17:13 user nova-compute[74348]: DEBUG nova.compute.manager [req-f8e6c6af-6a3c-4d23-b0fa-0bbb99296992 req-0ec6cd48-3abe-4f0d-99e6-be62fe06f838 service nova] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Received event network-vif-unplugged-3ee3f6b1-b929-404a-b3bb-6ece1c2d1052 for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 08:17:14 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Instance destroyed successfully.
Nov 22 08:17:14 user nova-compute[74348]: DEBUG nova.objects.instance [None req-e5b36f6a-7eb5-4f3d-9ea2-490f9ee6e701 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lazy-loading 'resources' on Instance uuid 765f8c47-c042-4430-8d35-07926ad693fe {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:17:14 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-e5b36f6a-7eb5-4f3d-9ea2-490f9ee6e701 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T07:57:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1927344265',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1927344265',id=16,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T07:57:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a31d898cdc69494a8825e8d93a0d04bc',ramdisk_id='',reservation_id='r-3xazfxkp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-502521972',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T07:59:31Z,user_data=None,user_id='1d5c8274eca14965b6cbfe22110f904d',uuid=765f8c47-c042-4430-8d35-07926ad693fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ee3f6b1-b929-404a-b3bb-6ece1c2d1052", "address": "fa:16:3e:60:74:68", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee3f6b1-b9", "ovs_interfaceid": "3ee3f6b1-b929-404a-b3bb-6ece1c2d1052", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:17:14 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-e5b36f6a-7eb5-4f3d-9ea2-490f9ee6e701 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Converting VIF {"id": "3ee3f6b1-b929-404a-b3bb-6ece1c2d1052", "address": "fa:16:3e:60:74:68", "network": {"id": "6fe60468-191c-4d84-8dce-55c056f88936", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-60246529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a31d898cdc69494a8825e8d93a0d04bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee3f6b1-b9", "ovs_interfaceid": "3ee3f6b1-b929-404a-b3bb-6ece1c2d1052", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:17:14 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-e5b36f6a-7eb5-4f3d-9ea2-490f9ee6e701 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:74:68,bridge_name='br-int',has_traffic_filtering=True,id=3ee3f6b1-b929-404a-b3bb-6ece1c2d1052,network=Network(6fe60468-191c-4d84-8dce-55c056f88936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ee3f6b1-b9') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:17:14 user nova-compute[74348]: DEBUG os_vif [None req-e5b36f6a-7eb5-4f3d-9ea2-490f9ee6e701 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:74:68,bridge_name='br-int',has_traffic_filtering=True,id=3ee3f6b1-b929-404a-b3bb-6ece1c2d1052,network=Network(6fe60468-191c-4d84-8dce-55c056f88936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ee3f6b1-b9') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:17:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ee3f6b1-b9, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:17:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:17:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5a26f008-e3ed-4437-995a-bd9e2a6208fd) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:17:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:17:14 user nova-compute[74348]: INFO os_vif [None req-e5b36f6a-7eb5-4f3d-9ea2-490f9ee6e701 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:74:68,bridge_name='br-int',has_traffic_filtering=True,id=3ee3f6b1-b929-404a-b3bb-6ece1c2d1052,network=Network(6fe60468-191c-4d84-8dce-55c056f88936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ee3f6b1-b9')
Nov 22 08:17:14 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-e5b36f6a-7eb5-4f3d-9ea2-490f9ee6e701 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Deleting instance files /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe_del
Nov 22 08:17:14 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-e5b36f6a-7eb5-4f3d-9ea2-490f9ee6e701 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Deletion of /opt/stack/data/nova/instances/765f8c47-c042-4430-8d35-07926ad693fe_del complete
Nov 22 08:17:14 user nova-compute[74348]: INFO nova.compute.manager [None req-e5b36f6a-7eb5-4f3d-9ea2-490f9ee6e701 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 22 08:17:14 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-e5b36f6a-7eb5-4f3d-9ea2-490f9ee6e701 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 08:17:14 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 08:17:14 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 08:17:14 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:17:14 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Took 0.43 seconds to deallocate network for instance.
Nov 22 08:17:14 user nova-compute[74348]: DEBUG nova.compute.manager [req-087e9ae8-788c-45bc-9aa4-86fc4645311d req-1bb3eea0-7121-47b2-8084-379e8f040ea1 service nova] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Received event network-vif-deleted-3ee3f6b1-b929-404a-b3bb-6ece1c2d1052 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:17:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e5b36f6a-7eb5-4f3d-9ea2-490f9ee6e701 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:17:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e5b36f6a-7eb5-4f3d-9ea2-490f9ee6e701 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:17:15 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-e5b36f6a-7eb5-4f3d-9ea2-490f9ee6e701 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:17:15 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-e5b36f6a-7eb5-4f3d-9ea2-490f9ee6e701 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:17:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e5b36f6a-7eb5-4f3d-9ea2-490f9ee6e701 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.275s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:17:15 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-e5b36f6a-7eb5-4f3d-9ea2-490f9ee6e701 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Deleted allocations for instance 765f8c47-c042-4430-8d35-07926ad693fe
Nov 22 08:17:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e5b36f6a-7eb5-4f3d-9ea2-490f9ee6e701 tempest-ServerBootFromVolumeStableRescueTest-502521972 tempest-ServerBootFromVolumeStableRescueTest-502521972-project-member] Lock "765f8c47-c042-4430-8d35-07926ad693fe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.778s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:17:16 user nova-compute[74348]: DEBUG nova.compute.manager [req-dcb43f59-529f-4c91-92e9-c6c2ab093097 req-9cec47a9-f8ff-41d6-a9a9-d7c1239194bd service nova] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Received event network-vif-plugged-3ee3f6b1-b929-404a-b3bb-6ece1c2d1052 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:17:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-dcb43f59-529f-4c91-92e9-c6c2ab093097 req-9cec47a9-f8ff-41d6-a9a9-d7c1239194bd service nova] Acquiring lock "765f8c47-c042-4430-8d35-07926ad693fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:17:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-dcb43f59-529f-4c91-92e9-c6c2ab093097 req-9cec47a9-f8ff-41d6-a9a9-d7c1239194bd service nova] Lock "765f8c47-c042-4430-8d35-07926ad693fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:17:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-dcb43f59-529f-4c91-92e9-c6c2ab093097 req-9cec47a9-f8ff-41d6-a9a9-d7c1239194bd service nova] Lock "765f8c47-c042-4430-8d35-07926ad693fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:17:16 user nova-compute[74348]: DEBUG nova.compute.manager [req-dcb43f59-529f-4c91-92e9-c6c2ab093097 req-9cec47a9-f8ff-41d6-a9a9-d7c1239194bd service nova] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] No waiting events found dispatching network-vif-plugged-3ee3f6b1-b929-404a-b3bb-6ece1c2d1052 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:17:16 user nova-compute[74348]: WARNING nova.compute.manager [req-dcb43f59-529f-4c91-92e9-c6c2ab093097 req-9cec47a9-f8ff-41d6-a9a9-d7c1239194bd service nova] [instance: 765f8c47-c042-4430-8d35-07926ad693fe] Received unexpected event network-vif-plugged-3ee3f6b1-b929-404a-b3bb-6ece1c2d1052 for instance with vm_state deleted and task_state None.
Nov 22 08:17:17 user nova-compute[74348]: DEBUG nova.compute.manager [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 08:17:17 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Creating image(s)
Nov 22 08:17:17 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Did not create local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Ensure instance console log exists: /opt/stack/data/nova/instances/895bf22e-1097-46ac-9ef3-a856dcd02349/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Start _get_guest_xml network_info=[{"id": "cec31312-56a9-45d2-a9ff-26a135b50547", "address": "fa:16:3e:db:29:7a", "network": {"id": "54c3b38d-bf3a-445f-b63a-1ba2abfa50f9", "bridge": "br-int", "label": "tempest-TestShelveInstance-976927611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fec444609c0e43f1ad0fbeefbbb7dbb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec31312-56", "ovs_interfaceid": "cec31312-56a9-45d2-a9ff-26a135b50547", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uXyEDwnI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '895bf22e-1097-46ac-9ef3-a856dcd02349', 'attached_at': '', 'detached_at': '', 'volume_id': 'd00769d0-fad3-4be1-ba4a-cb7615c344de', 'serial': 'd00769d0-fad3-4be1-ba4a-cb7615c344de'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '8ddb4c79-4d12-41b4-8f9e-efab35d0c461', 'volume_type': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 08:17:17 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:17:17 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:17:17 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uXyEDwnI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:17:17 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:17:17 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:17:17 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:17:17 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:17:17 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 08:17:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d17780-1741-4e73-ad96-12b461683fa4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 08:17:17 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb730fc2-ec76-4e87-9464-13a0b3a760e3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de] added
Nov 22 08:17:17 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8be2b6-ff86-491b-9c43-d81b2320862b]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d536ccf7-07f6-4a1e-87d0-e7eea9bd1f1f]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uXyEDwnI {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uXyEDwnI" returned: 0 in 0.026s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1bff50-5597-41e1-bede-9f7ad2f39a64]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uXyEDwnI'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebab975c-b259-4e56-9bec-766503633f26]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee265ee-8293-41b8-86d3-2588a72d707c]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 (non-flash)
Nov 22 08:17:17 user nova-compute[74348]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)
Nov 22 08:17:17 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 (non-flash)
Nov 22 08:17:17 user nova-compute[74348]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)
Nov 22 08:17:17 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e16d725-f613-47f5-8a11-7935a0078fc0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de, portal: 172.16.0.220,3260]
Nov 22 08:17:17 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de, portal: 172.16.0.220,3260] successful.
Nov 22 08:17:17 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[09cb45b5-ad20-453b-a97b-f45026732a45]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5275e8b-65d2-40e3-ad27-98e17448c0fb]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 (non-flash)
Nov 22 08:17:17 user nova-compute[74348]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)
Nov 22 08:17:17 user nova-compute[74348]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de (non-flash)
Nov 22 08:17:17 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 (non-flash)
Nov 22 08:17:17 user nova-compute[74348]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)
Nov 22 08:17:17 user nova-compute[74348]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de (non-flash)
Nov 22 08:17:17 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.029s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9edb48e9-3ee1-43e6-ba62-849a952b0245]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:17:17 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: None {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:17:18 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:17:18 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uXyEDwnI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 08:17:18 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:17:18 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23933613337363261', 'path': '/dev/sdb'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:17:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933613337363261', 'path': '/dev/sdb'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 08:17:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1023749067',display_name='tempest-TestShelveInstance-server-1023749067',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1023749067',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQebmH//Rl+dhu9Au8fBShXkal/oh0e6f5bQcxoS9pvLz6J1nQsCObUIl2aEFzc1wk+4Cn+eg9z+dEtpapl5Xv45FLNHf1+5LcxX2U0tOBMa4V6J0s5p8OW5pIkN3FRoQ==',key_name='tempest-TestShelveInstance-1832119496',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fec444609c0e43f1ad0fbeefbbb7dbb9',ramdisk_id='',reservation_id='r-sz0m0m2k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1568035397',owner_user_name='tempest-TestShelveInstance-1568035397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:17:10Z,user_data=None,user_id='57494625c8a644ac9958aa3629d4aa62',uuid=895bf22e-1097-46ac-9ef3-a856dcd02349,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cec31312-56a9-45d2-a9ff-26a135b50547", "address": "fa:16:3e:db:29:7a", "network": {"id": "54c3b38d-bf3a-445f-b63a-1ba2abfa50f9", "bridge": "br-int", "label": "tempest-TestShelveInstance-976927611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fec444609c0e43f1ad0fbeefbbb7dbb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec31312-56", "ovs_interfaceid": "cec31312-56a9-45d2-a9ff-26a135b50547", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 08:17:18 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Converting VIF {"id": "cec31312-56a9-45d2-a9ff-26a135b50547", "address": "fa:16:3e:db:29:7a", "network": {"id": "54c3b38d-bf3a-445f-b63a-1ba2abfa50f9", "bridge": "br-int", "label": "tempest-TestShelveInstance-976927611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fec444609c0e43f1ad0fbeefbbb7dbb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec31312-56", "ovs_interfaceid": "cec31312-56a9-45d2-a9ff-26a135b50547", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:17:18 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:29:7a,bridge_name='br-int',has_traffic_filtering=True,id=cec31312-56a9-45d2-a9ff-26a135b50547,network=Network(54c3b38d-bf3a-445f-b63a-1ba2abfa50f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcec31312-56') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:17:18 user nova-compute[74348]: DEBUG nova.objects.instance [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Lazy-loading 'pci_devices' on Instance uuid 895bf22e-1097-46ac-9ef3-a856dcd02349 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:17:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] End _get_guest_xml xml=<domain type="kvm">
Nov 22 08:17:18 user nova-compute[74348]:   <uuid>895bf22e-1097-46ac-9ef3-a856dcd02349</uuid>
Nov 22 08:17:18 user nova-compute[74348]:   <name>instance-0000002a</name>
Nov 22 08:17:18 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 08:17:18 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 08:17:18 user nova-compute[74348]:   <metadata>
Nov 22 08:17:18 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 08:17:18 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 08:17:18 user nova-compute[74348]:       <nova:name>tempest-TestShelveInstance-server-1023749067</nova:name>
Nov 22 08:17:18 user nova-compute[74348]:       <nova:creationTime>2023-11-22 08:17:17</nova:creationTime>
Nov 22 08:17:18 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 08:17:18 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 08:17:18 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 08:17:18 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 08:17:18 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 08:17:18 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 08:17:18 user nova-compute[74348]:       </nova:flavor>
Nov 22 08:17:18 user nova-compute[74348]:       <nova:owner>
Nov 22 08:17:18 user nova-compute[74348]:         <nova:user uuid="57494625c8a644ac9958aa3629d4aa62">tempest-TestShelveInstance-1568035397-project-member</nova:user>
Nov 22 08:17:18 user nova-compute[74348]:         <nova:project uuid="fec444609c0e43f1ad0fbeefbbb7dbb9">tempest-TestShelveInstance-1568035397</nova:project>
Nov 22 08:17:18 user nova-compute[74348]:       </nova:owner>
Nov 22 08:17:18 user nova-compute[74348]:       <nova:ports>
Nov 22 08:17:18 user nova-compute[74348]:         <nova:port uuid="cec31312-56a9-45d2-a9ff-26a135b50547">
Nov 22 08:17:18 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 22 08:17:18 user nova-compute[74348]:         </nova:port>
Nov 22 08:17:18 user nova-compute[74348]:       </nova:ports>
Nov 22 08:17:18 user nova-compute[74348]:     </nova:instance>
Nov 22 08:17:18 user nova-compute[74348]:   </metadata>
Nov 22 08:17:18 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 08:17:18 user nova-compute[74348]:     <system>
Nov 22 08:17:18 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 08:17:18 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 08:17:18 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 08:17:18 user nova-compute[74348]:       <entry name="serial">895bf22e-1097-46ac-9ef3-a856dcd02349</entry>
Nov 22 08:17:18 user nova-compute[74348]:       <entry name="uuid">895bf22e-1097-46ac-9ef3-a856dcd02349</entry>
Nov 22 08:17:18 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 08:17:18 user nova-compute[74348]:     </system>
Nov 22 08:17:18 user nova-compute[74348]:   </sysinfo>
Nov 22 08:17:18 user nova-compute[74348]:   <os>
Nov 22 08:17:18 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 08:17:18 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 08:17:18 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 08:17:18 user nova-compute[74348]:   </os>
Nov 22 08:17:18 user nova-compute[74348]:   <features>
Nov 22 08:17:18 user nova-compute[74348]:     <acpi/>
Nov 22 08:17:18 user nova-compute[74348]:     <apic/>
Nov 22 08:17:18 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 08:17:18 user nova-compute[74348]:   </features>
Nov 22 08:17:18 user nova-compute[74348]:   <clock offset="utc">
Nov 22 08:17:18 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 08:17:18 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 08:17:18 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 08:17:18 user nova-compute[74348]:   </clock>
Nov 22 08:17:18 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 08:17:18 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 08:17:18 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 08:17:18 user nova-compute[74348]:   </cpu>
Nov 22 08:17:18 user nova-compute[74348]:   <devices>
Nov 22 08:17:18 user nova-compute[74348]:     <disk type="block" device="disk">
Nov 22 08:17:18 user nova-compute[74348]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:17:18 user nova-compute[74348]:       <source dev="/dev/sdb"/>
Nov 22 08:17:18 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 08:17:18 user nova-compute[74348]:       <serial>d00769d0-fad3-4be1-ba4a-cb7615c344de</serial>
Nov 22 08:17:18 user nova-compute[74348]:     </disk>
Nov 22 08:17:18 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 08:17:18 user nova-compute[74348]:       <mac address="fa:16:3e:db:29:7a"/>
Nov 22 08:17:18 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:17:18 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 08:17:18 user nova-compute[74348]:       <target dev="tapcec31312-56"/>
Nov 22 08:17:18 user nova-compute[74348]:     </interface>
Nov 22 08:17:18 user nova-compute[74348]:     <serial type="pty">
Nov 22 08:17:18 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/895bf22e-1097-46ac-9ef3-a856dcd02349/console.log" append="off"/>
Nov 22 08:17:18 user nova-compute[74348]:     </serial>
Nov 22 08:17:18 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 08:17:18 user nova-compute[74348]:     <video>
Nov 22 08:17:18 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:17:18 user nova-compute[74348]:     </video>
Nov 22 08:17:18 user nova-compute[74348]:     <rng model="virtio">
Nov 22 08:17:18 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 08:17:18 user nova-compute[74348]:     </rng>
Nov 22 08:17:18 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 08:17:18 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 08:17:18 user nova-compute[74348]:       <stats period="10"/>
Nov 22 08:17:18 user nova-compute[74348]:     </memballoon>
Nov 22 08:17:18 user nova-compute[74348]:   </devices>
Nov 22 08:17:18 user nova-compute[74348]: </domain>
Nov 22 08:17:18 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 08:17:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1023749067',display_name='tempest-TestShelveInstance-server-1023749067',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1023749067',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQebmH//Rl+dhu9Au8fBShXkal/oh0e6f5bQcxoS9pvLz6J1nQsCObUIl2aEFzc1wk+4Cn+eg9z+dEtpapl5Xv45FLNHf1+5LcxX2U0tOBMa4V6J0s5p8OW5pIkN3FRoQ==',key_name='tempest-TestShelveInstance-1832119496',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fec444609c0e43f1ad0fbeefbbb7dbb9',ramdisk_id='',reservation_id='r-sz0m0m2k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1568035397',owner_user_name='tempest-TestShelveInstance-1568035397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:17:10Z,user_data=None,user_id='57494625c8a644ac9958aa3629d4aa62',uuid=895bf22e-1097-46ac-9ef3-a856dcd02349,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cec31312-56a9-45d2-a9ff-26a135b50547", "address": "fa:16:3e:db:29:7a", "network": {"id": "54c3b38d-bf3a-445f-b63a-1ba2abfa50f9", "bridge": "br-int", "label": "tempest-TestShelveInstance-976927611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fec444609c0e43f1ad0fbeefbbb7dbb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec31312-56", "ovs_interfaceid": "cec31312-56a9-45d2-a9ff-26a135b50547", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 08:17:18 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Converting VIF {"id": "cec31312-56a9-45d2-a9ff-26a135b50547", "address": "fa:16:3e:db:29:7a", "network": {"id": "54c3b38d-bf3a-445f-b63a-1ba2abfa50f9", "bridge": "br-int", "label": "tempest-TestShelveInstance-976927611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fec444609c0e43f1ad0fbeefbbb7dbb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec31312-56", "ovs_interfaceid": "cec31312-56a9-45d2-a9ff-26a135b50547", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:17:18 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:29:7a,bridge_name='br-int',has_traffic_filtering=True,id=cec31312-56a9-45d2-a9ff-26a135b50547,network=Network(54c3b38d-bf3a-445f-b63a-1ba2abfa50f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcec31312-56') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:17:18 user nova-compute[74348]: DEBUG os_vif [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:29:7a,bridge_name='br-int',has_traffic_filtering=True,id=cec31312-56a9-45d2-a9ff-26a135b50547,network=Network(54c3b38d-bf3a-445f-b63a-1ba2abfa50f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcec31312-56') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 08:17:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:17:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 08:17:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e18c43b6-1289-56f9-a2a3-8c531ae13bef', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:17:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:17:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcec31312-56, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:17:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcec31312-56, col_values=(('qos', UUID('9eedb61d-b6f1-4c0e-95bc-0d0f4b8056f3')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:17:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcec31312-56, col_values=(('external_ids', {'iface-id': 'cec31312-56a9-45d2-a9ff-26a135b50547', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:29:7a', 'vm-uuid': '895bf22e-1097-46ac-9ef3-a856dcd02349'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:17:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:17:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:18 user nova-compute[74348]: INFO os_vif [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:29:7a,bridge_name='br-int',has_traffic_filtering=True,id=cec31312-56a9-45d2-a9ff-26a135b50547,network=Network(54c3b38d-bf3a-445f-b63a-1ba2abfa50f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcec31312-56')
Nov 22 08:17:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:17:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] No VIF found with MAC fa:16:3e:db:29:7a, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:17:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:20 user nova-compute[74348]: DEBUG nova.compute.manager [req-58c3a278-0adf-4def-9720-168ae986e7ff req-39c25fcb-1772-4ede-ab9f-a170e4343763 service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Received event network-vif-plugged-cec31312-56a9-45d2-a9ff-26a135b50547 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:17:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-58c3a278-0adf-4def-9720-168ae986e7ff req-39c25fcb-1772-4ede-ab9f-a170e4343763 service nova] Acquiring lock "895bf22e-1097-46ac-9ef3-a856dcd02349-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:17:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-58c3a278-0adf-4def-9720-168ae986e7ff req-39c25fcb-1772-4ede-ab9f-a170e4343763 service nova] Lock "895bf22e-1097-46ac-9ef3-a856dcd02349-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:17:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-58c3a278-0adf-4def-9720-168ae986e7ff req-39c25fcb-1772-4ede-ab9f-a170e4343763 service nova] Lock "895bf22e-1097-46ac-9ef3-a856dcd02349-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:17:20 user nova-compute[74348]: DEBUG nova.compute.manager [req-58c3a278-0adf-4def-9720-168ae986e7ff req-39c25fcb-1772-4ede-ab9f-a170e4343763 service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] No waiting events found dispatching network-vif-plugged-cec31312-56a9-45d2-a9ff-26a135b50547 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:17:20 user nova-compute[74348]: WARNING nova.compute.manager [req-58c3a278-0adf-4def-9720-168ae986e7ff req-39c25fcb-1772-4ede-ab9f-a170e4343763 service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Received unexpected event network-vif-plugged-cec31312-56a9-45d2-a9ff-26a135b50547 for instance with vm_state building and task_state spawning.
Nov 22 08:17:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG nova.compute.manager [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 08:17:22 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Instance spawned successfully.
Nov 22 08:17:22 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG nova.compute.manager [req-b2a40be2-c198-48e5-9d6e-f335156adb24 req-4f294297-76d9-4f13-8565-8171f1c55ddd service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Received event network-vif-plugged-cec31312-56a9-45d2-a9ff-26a135b50547 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b2a40be2-c198-48e5-9d6e-f335156adb24 req-4f294297-76d9-4f13-8565-8171f1c55ddd service nova] Acquiring lock "895bf22e-1097-46ac-9ef3-a856dcd02349-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b2a40be2-c198-48e5-9d6e-f335156adb24 req-4f294297-76d9-4f13-8565-8171f1c55ddd service nova] Lock "895bf22e-1097-46ac-9ef3-a856dcd02349-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b2a40be2-c198-48e5-9d6e-f335156adb24 req-4f294297-76d9-4f13-8565-8171f1c55ddd service nova] Lock "895bf22e-1097-46ac-9ef3-a856dcd02349-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG nova.compute.manager [req-b2a40be2-c198-48e5-9d6e-f335156adb24 req-4f294297-76d9-4f13-8565-8171f1c55ddd service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] No waiting events found dispatching network-vif-plugged-cec31312-56a9-45d2-a9ff-26a135b50547 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:17:22 user nova-compute[74348]: WARNING nova.compute.manager [req-b2a40be2-c198-48e5-9d6e-f335156adb24 req-4f294297-76d9-4f13-8565-8171f1c55ddd service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Received unexpected event network-vif-plugged-cec31312-56a9-45d2-a9ff-26a135b50547 for instance with vm_state building and task_state spawning.
Nov 22 08:17:22 user nova-compute[74348]: INFO nova.compute.manager [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Took 4.99 seconds to spawn the instance on the hypervisor.
Nov 22 08:17:22 user nova-compute[74348]: DEBUG nova.compute.manager [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:17:22 user nova-compute[74348]: INFO nova.compute.manager [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Took 12.23 seconds to build instance.
Nov 22 08:17:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-052ef485-8357-4bdd-888c-1101f352109f tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Lock "895bf22e-1097-46ac-9ef3-a856dcd02349" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.324s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:17:22 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-af14b72f-8d67-4eee-aeff-61a19352eba6 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0 is timed out.
Nov 22 08:17:22 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-af14b72f-8d67-4eee-aeff-61a19352eba6 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Successfully detached device vdb from instance 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0 from the live domain config.
Nov 22 08:17:22 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af14b72f-8d67-4eee-aeff-61a19352eba6 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-af14b72f-8d67-4eee-aeff-61a19352eba6 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hwgVSAlC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:17:22 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-af14b72f-8d67-4eee-aeff-61a19352eba6 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:17:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-af14b72f-8d67-4eee-aeff-61a19352eba6 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-af14b72f-8d67-4eee-aeff-61a19352eba6 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[839630ae-2b2d-4cc8-a95f-6e514dde7a4e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-af14b72f-8d67-4eee-aeff-61a19352eba6 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 08:17:22 user nova-compute[74348]: No targets found.
Nov 22 08:17:22 user nova-compute[74348]: iSNS:
Nov 22 08:17:22 user nova-compute[74348]: No targets found.
Nov 22 08:17:22 user nova-compute[74348]: STATIC:
Nov 22 08:17:22 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de
Nov 22 08:17:22 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:17:22 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:17:22 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290
Nov 22 08:17:22 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:17:22 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:17:22 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30
Nov 22 08:17:22 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:17:22 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:17:22 user nova-compute[74348]: FIRMWARE:
Nov 22 08:17:22 user nova-compute[74348]: No targets found.
Nov 22 08:17:22 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-af14b72f-8d67-4eee-aeff-61a19352eba6 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 08:17:22 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 08:17:22 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-af14b72f-8d67-4eee-aeff-61a19352eba6 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.036s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d61a506-318f-4ae6-937c-b3689b748158]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e6eb1f-32d7-4560-aaf4-797e38e418f9]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-af14b72f-8d67-4eee-aeff-61a19352eba6 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 (non-flash)
Nov 22 08:17:22 user nova-compute[74348]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)
Nov 22 08:17:22 user nova-compute[74348]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de (non-flash)
Nov 22 08:17:22 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-af14b72f-8d67-4eee-aeff-61a19352eba6 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 (non-flash)
Nov 22 08:17:22 user nova-compute[74348]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)
Nov 22 08:17:22 user nova-compute[74348]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de (non-flash)
Nov 22 08:17:22 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-af14b72f-8d67-4eee-aeff-61a19352eba6 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f22550c05e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30'): ({'sde'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-af14b72f-8d67-4eee-aeff-61a19352eba6 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Removing single pathed devices sde {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea49666-12d3-4aaa-937d-adf14f752f20]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f148bcd-4738-40fd-a1e9-1da168123ddd]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-af14b72f-8d67-4eee-aeff-61a19352eba6 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Flushing IO for device /dev/sde {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[043efedc-6f0e-4dae-88d6-8a71c8722aca]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-af14b72f-8d67-4eee-aeff-61a19352eba6 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.087s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b37096a-c6d8-4113-9821-2a5208c6fddd]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-af14b72f-8d67-4eee-aeff-61a19352eba6 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-af14b72f-8d67-4eee-aeff-61a19352eba6 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] SCSI volumes sde have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-af14b72f-8d67-4eee-aeff-61a19352eba6 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2079c1eb-b0da-4594-9629-f1dde58442c3]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-af14b72f-8d67-4eee-aeff-61a19352eba6 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8caddd07-d0aa-48d1-a49b-5b29bb8bd6de]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-af14b72f-8d67-4eee-aeff-61a19352eba6 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30, portal: 172.16.0.220,3260]
Nov 22 08:17:22 user nova-compute[74348]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30, portal: 172.16.0.220,3260] successful.
Nov 22 08:17:22 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eb1715a-579b-43af-96ad-d629a5706c30 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b63f1c3-9be7-4beb-b4c8-b1b1e982e6a5]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-af14b72f-8d67-4eee-aeff-61a19352eba6 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-af14b72f-8d67-4eee-aeff-61a19352eba6 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-af14b72f-8d67-4eee-aeff-61a19352eba6 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] <== disconnect_volume: return (370ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:17:22 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af14b72f-8d67-4eee-aeff-61a19352eba6 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 08:17:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:23 user nova-compute[74348]: DEBUG nova.objects.instance [None req-af14b72f-8d67-4eee-aeff-61a19352eba6 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lazy-loading 'flavor' on Instance uuid 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:17:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-af14b72f-8d67-4eee-aeff-61a19352eba6 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.831s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:17:24 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:39 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:42 user nova-compute[74348]: INFO nova.compute.manager [None req-9e33f746-0c2c-4ece-bd85-88ef59e37805 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Get console output
Nov 22 08:17:43 user nova-compute[74348]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 22 08:17:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:44 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:46 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:17:46 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:17:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-5c3f6262-19cf-41dd-bc6c-bdb006eb58a0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:17:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-5c3f6262-19cf-41dd-bc6c-bdb006eb58a0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:17:46 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 08:17:47 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Updating instance_info_cache with network_info: [{"id": "2b0fc463-3743-41e4-9846-ee4dc53689f4", "address": "fa:16:3e:f9:d6:30", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0fc463-37", "ovs_interfaceid": "2b0fc463-3743-41e4-9846-ee4dc53689f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:17:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-5c3f6262-19cf-41dd-bc6c-bdb006eb58a0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:17:47 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 08:17:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:49 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:17:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:50 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:17:50 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:17:50 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:17:51 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:17:52 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-fb116271-4586-4e9c-8d0c-eab948be2ca3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquiring lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:17:52 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-fb116271-4586-4e9c-8d0c-eab948be2ca3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:17:52 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-fb116271-4586-4e9c-8d0c-eab948be2ca3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquiring lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:17:52 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-fb116271-4586-4e9c-8d0c-eab948be2ca3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:17:52 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-fb116271-4586-4e9c-8d0c-eab948be2ca3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:17:52 user nova-compute[74348]: INFO nova.compute.manager [None req-fb116271-4586-4e9c-8d0c-eab948be2ca3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Terminating instance
Nov 22 08:17:52 user nova-compute[74348]: DEBUG nova.compute.manager [None req-fb116271-4586-4e9c-8d0c-eab948be2ca3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 08:17:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:52 user nova-compute[74348]: DEBUG nova.compute.manager [req-79b87be9-116b-4bea-9155-c8cb32e69bc3 req-eba2a356-2265-4389-907c-8e4614034e84 service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Received event network-vif-unplugged-2b0fc463-3743-41e4-9846-ee4dc53689f4 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:17:52 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-79b87be9-116b-4bea-9155-c8cb32e69bc3 req-eba2a356-2265-4389-907c-8e4614034e84 service nova] Acquiring lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:17:52 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-79b87be9-116b-4bea-9155-c8cb32e69bc3 req-eba2a356-2265-4389-907c-8e4614034e84 service nova] Lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:17:52 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-79b87be9-116b-4bea-9155-c8cb32e69bc3 req-eba2a356-2265-4389-907c-8e4614034e84 service nova] Lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:17:52 user nova-compute[74348]: DEBUG nova.compute.manager [req-79b87be9-116b-4bea-9155-c8cb32e69bc3 req-eba2a356-2265-4389-907c-8e4614034e84 service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] No waiting events found dispatching network-vif-unplugged-2b0fc463-3743-41e4-9846-ee4dc53689f4 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:17:52 user nova-compute[74348]: DEBUG nova.compute.manager [req-79b87be9-116b-4bea-9155-c8cb32e69bc3 req-eba2a356-2265-4389-907c-8e4614034e84 service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Received event network-vif-unplugged-2b0fc463-3743-41e4-9846-ee4dc53689f4 for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 08:17:52 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Instance destroyed successfully.
Nov 22 08:17:52 user nova-compute[74348]: DEBUG nova.objects.instance [None req-fb116271-4586-4e9c-8d0c-eab948be2ca3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lazy-loading 'resources' on Instance uuid 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:17:52 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-fb116271-4586-4e9c-8d0c-eab948be2ca3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:11:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-408142113',display_name='tempest-ServerRescueNegativeTestJSON-server-408142113',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-408142113',id=39,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTdFy9xJMY+tkSnPoKIcYDCTRFY7lXZyCDzt1jEfugDen4Y9Eg9lFwO8VHH6D0hbVNRZWrLT0z8c4BxzMBaNJFSTjxYBMTbpIsDK8ziRltd2xcFzudVT5cjnyNXosH5qQ==',key_name='tempest-keypair-1362649951',keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:13:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d975b772fea4ed98b1b3ad284e51a65',ramdisk_id='',reservation_id='r-g0d4c2q4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1773499839',owner_user_name='tempest-ServerRescueNegativeTestJSON-1773499839-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T08:15:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b3c6587d0764b9fae5782792aec5d92',uuid=5c3f6262-19cf-41dd-bc6c-bdb006eb58a0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b0fc463-3743-41e4-9846-ee4dc53689f4", "address": "fa:16:3e:f9:d6:30", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0fc463-37", "ovs_interfaceid": "2b0fc463-3743-41e4-9846-ee4dc53689f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:17:52 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-fb116271-4586-4e9c-8d0c-eab948be2ca3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Converting VIF {"id": "2b0fc463-3743-41e4-9846-ee4dc53689f4", "address": "fa:16:3e:f9:d6:30", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0fc463-37", "ovs_interfaceid": "2b0fc463-3743-41e4-9846-ee4dc53689f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:17:52 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-fb116271-4586-4e9c-8d0c-eab948be2ca3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:d6:30,bridge_name='br-int',has_traffic_filtering=True,id=2b0fc463-3743-41e4-9846-ee4dc53689f4,network=Network(246d8f55-a1eb-4883-906c-69f15289caef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b0fc463-37') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:17:52 user nova-compute[74348]: DEBUG os_vif [None req-fb116271-4586-4e9c-8d0c-eab948be2ca3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:d6:30,bridge_name='br-int',has_traffic_filtering=True,id=2b0fc463-3743-41e4-9846-ee4dc53689f4,network=Network(246d8f55-a1eb-4883-906c-69f15289caef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b0fc463-37') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:17:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b0fc463-37, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:17:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:17:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b43a6de6-de5c-4ec1-bc8b-71f099d7fe0d) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:17:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:52 user nova-compute[74348]: INFO os_vif [None req-fb116271-4586-4e9c-8d0c-eab948be2ca3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:d6:30,bridge_name='br-int',has_traffic_filtering=True,id=2b0fc463-3743-41e4-9846-ee4dc53689f4,network=Network(246d8f55-a1eb-4883-906c-69f15289caef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b0fc463-37')
Nov 22 08:17:52 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-fb116271-4586-4e9c-8d0c-eab948be2ca3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Deleting instance files /opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0_del
Nov 22 08:17:52 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-fb116271-4586-4e9c-8d0c-eab948be2ca3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Deletion of /opt/stack/data/nova/instances/5c3f6262-19cf-41dd-bc6c-bdb006eb58a0_del complete
Nov 22 08:17:53 user nova-compute[74348]: INFO nova.compute.manager [None req-fb116271-4586-4e9c-8d0c-eab948be2ca3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Took 0.83 seconds to destroy the instance on the hypervisor.
Nov 22 08:17:53 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-fb116271-4586-4e9c-8d0c-eab948be2ca3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 08:17:53 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 08:17:53 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 08:17:53 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:17:53 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Took 0.61 seconds to deallocate network for instance.
Nov 22 08:17:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-fb116271-4586-4e9c-8d0c-eab948be2ca3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:17:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-fb116271-4586-4e9c-8d0c-eab948be2ca3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:17:53 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-fb116271-4586-4e9c-8d0c-eab948be2ca3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:17:53 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-fb116271-4586-4e9c-8d0c-eab948be2ca3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:17:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-fb116271-4586-4e9c-8d0c-eab948be2ca3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.247s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:17:53 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-fb116271-4586-4e9c-8d0c-eab948be2ca3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Deleted allocations for instance 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0
Nov 22 08:17:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-fb116271-4586-4e9c-8d0c-eab948be2ca3 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.867s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:17:54 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:17:54 user nova-compute[74348]: DEBUG nova.compute.manager [req-ec14863e-be5e-47c7-b911-b8ae0a2d1ba0 req-9ddca71d-aa7b-445a-a40c-dc308e46c527 service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Received event network-vif-plugged-2b0fc463-3743-41e4-9846-ee4dc53689f4 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:17:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-ec14863e-be5e-47c7-b911-b8ae0a2d1ba0 req-9ddca71d-aa7b-445a-a40c-dc308e46c527 service nova] Acquiring lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:17:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-ec14863e-be5e-47c7-b911-b8ae0a2d1ba0 req-9ddca71d-aa7b-445a-a40c-dc308e46c527 service nova] Lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:17:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-ec14863e-be5e-47c7-b911-b8ae0a2d1ba0 req-9ddca71d-aa7b-445a-a40c-dc308e46c527 service nova] Lock "5c3f6262-19cf-41dd-bc6c-bdb006eb58a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:17:54 user nova-compute[74348]: DEBUG nova.compute.manager [req-ec14863e-be5e-47c7-b911-b8ae0a2d1ba0 req-9ddca71d-aa7b-445a-a40c-dc308e46c527 service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] No waiting events found dispatching network-vif-plugged-2b0fc463-3743-41e4-9846-ee4dc53689f4 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:17:54 user nova-compute[74348]: WARNING nova.compute.manager [req-ec14863e-be5e-47c7-b911-b8ae0a2d1ba0 req-9ddca71d-aa7b-445a-a40c-dc308e46c527 service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Received unexpected event network-vif-plugged-2b0fc463-3743-41e4-9846-ee4dc53689f4 for instance with vm_state deleted and task_state None.
Nov 22 08:17:54 user nova-compute[74348]: DEBUG nova.compute.manager [req-ec14863e-be5e-47c7-b911-b8ae0a2d1ba0 req-9ddca71d-aa7b-445a-a40c-dc308e46c527 service nova] [instance: 5c3f6262-19cf-41dd-bc6c-bdb006eb58a0] Received event network-vif-deleted-2b0fc463-3743-41e4-9846-ee4dc53689f4 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:17:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:55 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:17:56 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:17:56 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:17:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:17:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:17:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:17:56 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:17:56 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:17:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:17:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:17:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:17:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:17:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:17:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:17:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:17:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:17:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:17:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:17:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:17:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:17:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:17:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:17:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:17:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:17:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:17:58 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:17:58 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:17:58 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:17:58 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=8424MB free_disk=24.94115447998047GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:17:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:17:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:17:58 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 5006cff5-4b67-405d-b6b1-4c355f82d920 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:17:58 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 555f4246-d4b2-4f2f-b91c-dda8fe47264c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:17:58 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance ba74ca7d-2875-426c-a485-d908af865bae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:17:58 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 54d11b82-543c-4166-bf31-5e4e94eb830f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:17:58 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 895bf22e-1097-46ac-9ef3-a856dcd02349 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:17:58 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:17:58 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:17:58 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:17:58 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:17:58 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:17:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.308s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:18:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:18:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:18:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:18:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:18:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:18:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:18:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:18:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:18:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:18:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:18:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:18:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:18:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:18:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:18:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:18:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:18:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:18:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:18:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:18:37 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:18:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:18:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:18:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:18:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:18:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:18:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:18:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "54d11b82-543c-4166-bf31-5e4e94eb830f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:18:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "54d11b82-543c-4166-bf31-5e4e94eb830f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:18:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "54d11b82-543c-4166-bf31-5e4e94eb830f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:18:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "54d11b82-543c-4166-bf31-5e4e94eb830f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:18:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "54d11b82-543c-4166-bf31-5e4e94eb830f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:18:43 user nova-compute[74348]: INFO nova.compute.manager [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Terminating instance
Nov 22 08:18:43 user nova-compute[74348]: DEBUG nova.compute.manager [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 08:18:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:18:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:18:43 user nova-compute[74348]: DEBUG nova.compute.manager [req-63862f4f-dac8-49b0-bfd0-d3b8dc898c2f req-1bebb25f-c855-40bd-868a-fbb04ddddb9c service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Received event network-vif-unplugged-fe9fc32d-b2f0-4770-8473-de9e3a5816c9 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:18:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-63862f4f-dac8-49b0-bfd0-d3b8dc898c2f req-1bebb25f-c855-40bd-868a-fbb04ddddb9c service nova] Acquiring lock "54d11b82-543c-4166-bf31-5e4e94eb830f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:18:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-63862f4f-dac8-49b0-bfd0-d3b8dc898c2f req-1bebb25f-c855-40bd-868a-fbb04ddddb9c service nova] Lock "54d11b82-543c-4166-bf31-5e4e94eb830f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:18:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-63862f4f-dac8-49b0-bfd0-d3b8dc898c2f req-1bebb25f-c855-40bd-868a-fbb04ddddb9c service nova] Lock "54d11b82-543c-4166-bf31-5e4e94eb830f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:18:43 user nova-compute[74348]: DEBUG nova.compute.manager [req-63862f4f-dac8-49b0-bfd0-d3b8dc898c2f req-1bebb25f-c855-40bd-868a-fbb04ddddb9c service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] No waiting events found dispatching network-vif-unplugged-fe9fc32d-b2f0-4770-8473-de9e3a5816c9 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:18:43 user nova-compute[74348]: DEBUG nova.compute.manager [req-63862f4f-dac8-49b0-bfd0-d3b8dc898c2f req-1bebb25f-c855-40bd-868a-fbb04ddddb9c service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Received event network-vif-unplugged-fe9fc32d-b2f0-4770-8473-de9e3a5816c9 for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 08:18:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:18:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:18:44 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Instance destroyed successfully.
Nov 22 08:18:44 user nova-compute[74348]: DEBUG nova.objects.instance [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lazy-loading 'resources' on Instance uuid 54d11b82-543c-4166-bf31-5e4e94eb830f {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:12:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-68334599',display_name='tempest-ServerActionsTestOtherA-server-68334599',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-68334599',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOnwiyyOG0pLFwcj345c4IzhM/kyBtQaUAH7E3RkvN6illtA9ZAkzh5oMECX0856YNQ2Mjloaz2SuvdsQL10sz9Itf7PAs6pZTbAEN/oI0ibl2evR0cUOwfMcOEuxLp2g==',key_name='tempest-keypair-1143468972',keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:14:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d62fda81543f461288e324458620d07c',ramdisk_id='',reservation_id='r-5wioe4l0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-90817446',owner_user_name='tempest-ServerActionsTestOtherA-90817446-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T08:15:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43550ccf30be49aba6ed6de2caf9ae1e',uuid=54d11b82-543c-4166-bf31-5e4e94eb830f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe9fc32d-b2f0-4770-8473-de9e3a5816c9", "address": "fa:16:3e:b9:17:27", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9fc32d-b2", "ovs_interfaceid": "fe9fc32d-b2f0-4770-8473-de9e3a5816c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Converting VIF {"id": "fe9fc32d-b2f0-4770-8473-de9e3a5816c9", "address": "fa:16:3e:b9:17:27", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9fc32d-b2", "ovs_interfaceid": "fe9fc32d-b2f0-4770-8473-de9e3a5816c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:17:27,bridge_name='br-int',has_traffic_filtering=True,id=fe9fc32d-b2f0-4770-8473-de9e3a5816c9,network=Network(9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9fc32d-b2') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG os_vif [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:17:27,bridge_name='br-int',has_traffic_filtering=True,id=fe9fc32d-b2f0-4770-8473-de9e3a5816c9,network=Network(9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9fc32d-b2') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe9fc32d-b2, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=99b07539-cf09-4807-84e8-0f75b1abb7a1) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:18:44 user nova-compute[74348]: INFO os_vif [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:17:27,bridge_name='br-int',has_traffic_filtering=True,id=fe9fc32d-b2f0-4770-8473-de9e3a5816c9,network=Network(9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9fc32d-b2')
Nov 22 08:18:44 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RSKrQjYE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:18:44 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:18:44 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0082bae0-0aeb-440c-84c4-a438ec3b37c2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 08:18:44 user nova-compute[74348]: No targets found.
Nov 22 08:18:44 user nova-compute[74348]: iSNS:
Nov 22 08:18:44 user nova-compute[74348]: No targets found.
Nov 22 08:18:44 user nova-compute[74348]: STATIC:
Nov 22 08:18:44 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de
Nov 22 08:18:44 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:18:44 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:18:44 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290
Nov 22 08:18:44 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:18:44 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:18:44 user nova-compute[74348]: FIRMWARE:
Nov 22 08:18:44 user nova-compute[74348]: No targets found.
Nov 22 08:18:44 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 08:18:44 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 08:18:44 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad78eb3f-29ba-41b4-ba23-aaaf0e0a1144]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e309ab-dd89-4600-acf6-d10ac6b6e549]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)
Nov 22 08:18:44 user nova-compute[74348]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de (non-flash)
Nov 22 08:18:44 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 (non-flash)
Nov 22 08:18:44 user nova-compute[74348]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de (non-flash)
Nov 22 08:18:44 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f224c240940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290'): ({'sdd'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Removing single pathed devices sdd {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc98982-42cb-4a7c-a45d-56ad97af8442]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[580a90d0-5a8e-4fbf-a07d-ed87e5815f55]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Flushing IO for device /dev/sdd {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[08903384-354b-45f2-82f8-4e834260e363]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.032s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[52947810-e3b8-4cab-8e33-4a57ddfcf432]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] SCSI volumes sdd have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_a3482ea4', '/dev/disk/by-id/scsi-26430353431373361', '/dev/disk/by-id/scsi-1SCST_BIOa3482ea4-d054173a517c454e') {{(pid=85159) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee3a7b3-30ef-40fe-9c1b-2b0c92346b76]: (4, None) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e599d1b-012c-47dd-99d4-d772ffa8b89f]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb74bd8-d7b0-465d-a1e4-c7ae02aad4a2]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290, portal: 172.16.0.220,3260]
Nov 22 08:18:44 user nova-compute[74348]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290, portal: 172.16.0.220,3260] successful.
Nov 22 08:18:44 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:060663bf-6a7e-4962-9df6-d7a401fcb290 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b098396-16b4-48b1-b5ab-08c38284660d]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] <== disconnect_volume: return (319ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 08:18:44 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Deleting instance files /opt/stack/data/nova/instances/54d11b82-543c-4166-bf31-5e4e94eb830f_del
Nov 22 08:18:44 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Deletion of /opt/stack/data/nova/instances/54d11b82-543c-4166-bf31-5e4e94eb830f_del complete
Nov 22 08:18:44 user nova-compute[74348]: INFO nova.compute.manager [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 22 08:18:44 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 08:18:44 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 08:18:45 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:18:45 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Took 1.07 seconds to deallocate network for instance.
Nov 22 08:18:45 user nova-compute[74348]: DEBUG nova.compute.manager [req-a4485fce-a10e-45ec-84b3-a898d40e48dd req-f38f8089-0316-494a-b057-0f7548a02aeb service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Received event network-vif-plugged-fe9fc32d-b2f0-4770-8473-de9e3a5816c9 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:18:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a4485fce-a10e-45ec-84b3-a898d40e48dd req-f38f8089-0316-494a-b057-0f7548a02aeb service nova] Acquiring lock "54d11b82-543c-4166-bf31-5e4e94eb830f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:18:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a4485fce-a10e-45ec-84b3-a898d40e48dd req-f38f8089-0316-494a-b057-0f7548a02aeb service nova] Lock "54d11b82-543c-4166-bf31-5e4e94eb830f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:18:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a4485fce-a10e-45ec-84b3-a898d40e48dd req-f38f8089-0316-494a-b057-0f7548a02aeb service nova] Lock "54d11b82-543c-4166-bf31-5e4e94eb830f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:18:45 user nova-compute[74348]: DEBUG nova.compute.manager [req-a4485fce-a10e-45ec-84b3-a898d40e48dd req-f38f8089-0316-494a-b057-0f7548a02aeb service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] No waiting events found dispatching network-vif-plugged-fe9fc32d-b2f0-4770-8473-de9e3a5816c9 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:18:45 user nova-compute[74348]: WARNING nova.compute.manager [req-a4485fce-a10e-45ec-84b3-a898d40e48dd req-f38f8089-0316-494a-b057-0f7548a02aeb service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Received unexpected event network-vif-plugged-fe9fc32d-b2f0-4770-8473-de9e3a5816c9 for instance with vm_state active and task_state deleting.
Nov 22 08:18:45 user nova-compute[74348]: DEBUG nova.compute.manager [req-96f36f5c-2a81-4626-88ad-52b9a190ec08 req-55bcfc7d-1ad3-4337-80b0-b53cd2b88099 service nova] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Received event network-vif-deleted-fe9fc32d-b2f0-4770-8473-de9e3a5816c9 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:18:46 user nova-compute[74348]: INFO nova.compute.manager [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Took 0.77 seconds to detach 1 volumes for instance.
Nov 22 08:18:46 user nova-compute[74348]: DEBUG nova.compute.manager [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 54d11b82-543c-4166-bf31-5e4e94eb830f] Deleting volume: 060663bf-6a7e-4962-9df6-d7a401fcb290 {{(pid=74348) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 22 08:18:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:18:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:18:47 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:18:47 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:18:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.232s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:18:47 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Deleted allocations for instance 54d11b82-543c-4166-bf31-5e4e94eb830f
Nov 22 08:18:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f507e780-6e16-41be-a891-64be2fe5a7d0 tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "54d11b82-543c-4166-bf31-5e4e94eb830f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.614s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:18:48 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:18:48 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:18:48 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Didn't find any instances for network info cache update. {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 08:18:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:18:50 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:18:50 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:18:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8004f153-ffc1-40c1-afb0-90fabb201c33 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquiring lock "ba74ca7d-2875-426c-a485-d908af865bae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:18:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8004f153-ffc1-40c1-afb0-90fabb201c33 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "ba74ca7d-2875-426c-a485-d908af865bae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:18:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8004f153-ffc1-40c1-afb0-90fabb201c33 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquiring lock "ba74ca7d-2875-426c-a485-d908af865bae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:18:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8004f153-ffc1-40c1-afb0-90fabb201c33 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "ba74ca7d-2875-426c-a485-d908af865bae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:18:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8004f153-ffc1-40c1-afb0-90fabb201c33 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "ba74ca7d-2875-426c-a485-d908af865bae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:18:51 user nova-compute[74348]: INFO nova.compute.manager [None req-8004f153-ffc1-40c1-afb0-90fabb201c33 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Terminating instance
Nov 22 08:18:51 user nova-compute[74348]: DEBUG nova.compute.manager [None req-8004f153-ffc1-40c1-afb0-90fabb201c33 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 08:18:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:18:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:18:52 user nova-compute[74348]: DEBUG nova.compute.manager [req-f45ec196-910a-4c23-9346-e724ac91e3c6 req-b1535165-0164-449d-8979-104cbcfbfdf4 service nova] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Received event network-vif-unplugged-674629a8-f3d5-41f1-a3d8-fbd957b97ad9 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:18:52 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f45ec196-910a-4c23-9346-e724ac91e3c6 req-b1535165-0164-449d-8979-104cbcfbfdf4 service nova] Acquiring lock "ba74ca7d-2875-426c-a485-d908af865bae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:18:52 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f45ec196-910a-4c23-9346-e724ac91e3c6 req-b1535165-0164-449d-8979-104cbcfbfdf4 service nova] Lock "ba74ca7d-2875-426c-a485-d908af865bae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:18:52 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f45ec196-910a-4c23-9346-e724ac91e3c6 req-b1535165-0164-449d-8979-104cbcfbfdf4 service nova] Lock "ba74ca7d-2875-426c-a485-d908af865bae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:18:52 user nova-compute[74348]: DEBUG nova.compute.manager [req-f45ec196-910a-4c23-9346-e724ac91e3c6 req-b1535165-0164-449d-8979-104cbcfbfdf4 service nova] [instance: ba74ca7d-2875-426c-a485-d908af865bae] No waiting events found dispatching network-vif-unplugged-674629a8-f3d5-41f1-a3d8-fbd957b97ad9 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:18:52 user nova-compute[74348]: DEBUG nova.compute.manager [req-f45ec196-910a-4c23-9346-e724ac91e3c6 req-b1535165-0164-449d-8979-104cbcfbfdf4 service nova] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Received event network-vif-unplugged-674629a8-f3d5-41f1-a3d8-fbd957b97ad9 for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 08:18:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:18:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:18:52 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:18:52 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:18:52 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Instance destroyed successfully.
Nov 22 08:18:52 user nova-compute[74348]: DEBUG nova.objects.instance [None req-8004f153-ffc1-40c1-afb0-90fabb201c33 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lazy-loading 'resources' on Instance uuid ba74ca7d-2875-426c-a485-d908af865bae {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:18:52 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-8004f153-ffc1-40c1-afb0-90fabb201c33 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:02:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1470868857',display_name='tempest-ServerRescueNegativeTestJSON-server-1470868857',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1470868857',id=29,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:04:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d975b772fea4ed98b1b3ad284e51a65',ramdisk_id='',reservation_id='r-wa0y0kht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1773499839',owner_user_name='tempest-ServerRescueNegativeTestJSON-1773499839-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T08:04:41Z,user_data=None,user_id='0b3c6587d0764b9fae5782792aec5d92',uuid=ba74ca7d-2875-426c-a485-d908af865bae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "674629a8-f3d5-41f1-a3d8-fbd957b97ad9", "address": "fa:16:3e:46:7e:d8", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap674629a8-f3", "ovs_interfaceid": "674629a8-f3d5-41f1-a3d8-fbd957b97ad9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:18:52 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-8004f153-ffc1-40c1-afb0-90fabb201c33 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Converting VIF {"id": "674629a8-f3d5-41f1-a3d8-fbd957b97ad9", "address": "fa:16:3e:46:7e:d8", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap674629a8-f3", "ovs_interfaceid": "674629a8-f3d5-41f1-a3d8-fbd957b97ad9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:18:52 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-8004f153-ffc1-40c1-afb0-90fabb201c33 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:7e:d8,bridge_name='br-int',has_traffic_filtering=True,id=674629a8-f3d5-41f1-a3d8-fbd957b97ad9,network=Network(246d8f55-a1eb-4883-906c-69f15289caef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap674629a8-f3') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:18:52 user nova-compute[74348]: DEBUG os_vif [None req-8004f153-ffc1-40c1-afb0-90fabb201c33 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:7e:d8,bridge_name='br-int',has_traffic_filtering=True,id=674629a8-f3d5-41f1-a3d8-fbd957b97ad9,network=Network(246d8f55-a1eb-4883-906c-69f15289caef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap674629a8-f3') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:18:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:18:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap674629a8-f3, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:18:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:18:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:18:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:18:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aa292653-a249-44ee-8377-3b6b07247f66) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:18:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:18:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:18:52 user nova-compute[74348]: INFO os_vif [None req-8004f153-ffc1-40c1-afb0-90fabb201c33 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:7e:d8,bridge_name='br-int',has_traffic_filtering=True,id=674629a8-f3d5-41f1-a3d8-fbd957b97ad9,network=Network(246d8f55-a1eb-4883-906c-69f15289caef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap674629a8-f3')
Nov 22 08:18:52 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-8004f153-ffc1-40c1-afb0-90fabb201c33 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Deleting instance files /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae_del
Nov 22 08:18:52 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-8004f153-ffc1-40c1-afb0-90fabb201c33 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Deletion of /opt/stack/data/nova/instances/ba74ca7d-2875-426c-a485-d908af865bae_del complete
Nov 22 08:18:52 user nova-compute[74348]: INFO nova.compute.manager [None req-8004f153-ffc1-40c1-afb0-90fabb201c33 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 22 08:18:52 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-8004f153-ffc1-40c1-afb0-90fabb201c33 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 08:18:52 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 08:18:52 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: ba74ca7d-2875-426c-a485-d908af865bae] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 08:18:53 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:18:53 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Took 0.41 seconds to deallocate network for instance.
Nov 22 08:18:53 user nova-compute[74348]: DEBUG nova.compute.manager [req-7441239b-7edc-4281-8dbc-99a6a1377644 req-7d6d42fc-91f2-4656-a36e-d98e68afa714 service nova] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Received event network-vif-deleted-674629a8-f3d5-41f1-a3d8-fbd957b97ad9 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:18:53 user nova-compute[74348]: INFO nova.compute.manager [req-7441239b-7edc-4281-8dbc-99a6a1377644 req-7d6d42fc-91f2-4656-a36e-d98e68afa714 service nova] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Neutron deleted interface 674629a8-f3d5-41f1-a3d8-fbd957b97ad9; detaching it from the instance and deleting it from the info cache
Nov 22 08:18:53 user nova-compute[74348]: DEBUG nova.network.neutron [req-7441239b-7edc-4281-8dbc-99a6a1377644 req-7d6d42fc-91f2-4656-a36e-d98e68afa714 service nova] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:18:53 user nova-compute[74348]: DEBUG nova.compute.manager [req-7441239b-7edc-4281-8dbc-99a6a1377644 req-7d6d42fc-91f2-4656-a36e-d98e68afa714 service nova] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Detach interface failed, port_id=674629a8-f3d5-41f1-a3d8-fbd957b97ad9, reason: Instance ba74ca7d-2875-426c-a485-d908af865bae could not be found. {{(pid=74348) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 08:18:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8004f153-ffc1-40c1-afb0-90fabb201c33 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:18:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8004f153-ffc1-40c1-afb0-90fabb201c33 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:18:53 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:18:53 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-8004f153-ffc1-40c1-afb0-90fabb201c33 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:18:53 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-8004f153-ffc1-40c1-afb0-90fabb201c33 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:18:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8004f153-ffc1-40c1-afb0-90fabb201c33 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.513s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:18:53 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-8004f153-ffc1-40c1-afb0-90fabb201c33 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Deleted allocations for instance ba74ca7d-2875-426c-a485-d908af865bae
Nov 22 08:18:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8004f153-ffc1-40c1-afb0-90fabb201c33 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "ba74ca7d-2875-426c-a485-d908af865bae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.009s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:18:54 user nova-compute[74348]: DEBUG nova.compute.manager [req-429fc969-14b2-4fb3-8204-aa6c475f1dde req-1bf1f7a0-bdc3-4ebd-a5a8-3dcbb1bf6851 service nova] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Received event network-vif-plugged-674629a8-f3d5-41f1-a3d8-fbd957b97ad9 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:18:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-429fc969-14b2-4fb3-8204-aa6c475f1dde req-1bf1f7a0-bdc3-4ebd-a5a8-3dcbb1bf6851 service nova] Acquiring lock "ba74ca7d-2875-426c-a485-d908af865bae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:18:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-429fc969-14b2-4fb3-8204-aa6c475f1dde req-1bf1f7a0-bdc3-4ebd-a5a8-3dcbb1bf6851 service nova] Lock "ba74ca7d-2875-426c-a485-d908af865bae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:18:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-429fc969-14b2-4fb3-8204-aa6c475f1dde req-1bf1f7a0-bdc3-4ebd-a5a8-3dcbb1bf6851 service nova] Lock "ba74ca7d-2875-426c-a485-d908af865bae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:18:54 user nova-compute[74348]: DEBUG nova.compute.manager [req-429fc969-14b2-4fb3-8204-aa6c475f1dde req-1bf1f7a0-bdc3-4ebd-a5a8-3dcbb1bf6851 service nova] [instance: ba74ca7d-2875-426c-a485-d908af865bae] No waiting events found dispatching network-vif-plugged-674629a8-f3d5-41f1-a3d8-fbd957b97ad9 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:18:54 user nova-compute[74348]: WARNING nova.compute.manager [req-429fc969-14b2-4fb3-8204-aa6c475f1dde req-1bf1f7a0-bdc3-4ebd-a5a8-3dcbb1bf6851 service nova] [instance: ba74ca7d-2875-426c-a485-d908af865bae] Received unexpected event network-vif-plugged-674629a8-f3d5-41f1-a3d8-fbd957b97ad9 for instance with vm_state deleted and task_state None.
Nov 22 08:18:56 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:18:56 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:18:56 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:18:56 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:18:57 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:18:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:18:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:18:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:18:57 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:18:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:18:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:18:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:18:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:18:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:18:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:18:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:18:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:18:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:18:58 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:18:58 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:18:58 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:18:58 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=8746MB free_disk=24.95034408569336GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:18:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:18:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:18:58 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 5006cff5-4b67-405d-b6b1-4c355f82d920 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:18:58 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 555f4246-d4b2-4f2f-b91c-dda8fe47264c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:18:58 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 895bf22e-1097-46ac-9ef3-a856dcd02349 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:18:58 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:18:58 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:18:58 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Refreshing inventories for resource provider 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 22 08:18:58 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Updating ProviderTree inventory for provider 52690f6a-773f-4e8d-be85-d278b6522975 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 22 08:18:58 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Updating inventory in ProviderTree for provider 52690f6a-773f-4e8d-be85-d278b6522975 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 22 08:18:58 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Refreshing aggregate associations for resource provider 52690f6a-773f-4e8d-be85-d278b6522975, aggregates: None {{(pid=74348) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 22 08:18:59 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Refreshing trait associations for resource provider 52690f6a-773f-4e8d-be85-d278b6522975, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=74348) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 22 08:18:59 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:18:59 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:18:59 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:18:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.406s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:19:01 user nova-compute[74348]: DEBUG nova.compute.manager [req-6455c36a-b69d-4745-86ab-1751f91d1035 req-ec754e4c-50c6-4584-a865-1ac2ba285951 service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Received event network-changed-cec31312-56a9-45d2-a9ff-26a135b50547 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:19:01 user nova-compute[74348]: DEBUG nova.compute.manager [req-6455c36a-b69d-4745-86ab-1751f91d1035 req-ec754e4c-50c6-4584-a865-1ac2ba285951 service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Refreshing instance network info cache due to event network-changed-cec31312-56a9-45d2-a9ff-26a135b50547. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:19:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-6455c36a-b69d-4745-86ab-1751f91d1035 req-ec754e4c-50c6-4584-a865-1ac2ba285951 service nova] Acquiring lock "refresh_cache-895bf22e-1097-46ac-9ef3-a856dcd02349" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:19:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-6455c36a-b69d-4745-86ab-1751f91d1035 req-ec754e4c-50c6-4584-a865-1ac2ba285951 service nova] Acquired lock "refresh_cache-895bf22e-1097-46ac-9ef3-a856dcd02349" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:19:01 user nova-compute[74348]: DEBUG nova.network.neutron [req-6455c36a-b69d-4745-86ab-1751f91d1035 req-ec754e4c-50c6-4584-a865-1ac2ba285951 service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Refreshing network info cache for port cec31312-56a9-45d2-a9ff-26a135b50547 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:19:02 user nova-compute[74348]: DEBUG nova.network.neutron [req-6455c36a-b69d-4745-86ab-1751f91d1035 req-ec754e4c-50c6-4584-a865-1ac2ba285951 service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Updated VIF entry in instance network info cache for port cec31312-56a9-45d2-a9ff-26a135b50547. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:19:02 user nova-compute[74348]: DEBUG nova.network.neutron [req-6455c36a-b69d-4745-86ab-1751f91d1035 req-ec754e4c-50c6-4584-a865-1ac2ba285951 service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Updating instance_info_cache with network_info: [{"id": "cec31312-56a9-45d2-a9ff-26a135b50547", "address": "fa:16:3e:db:29:7a", "network": {"id": "54c3b38d-bf3a-445f-b63a-1ba2abfa50f9", "bridge": "br-int", "label": "tempest-TestShelveInstance-976927611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fec444609c0e43f1ad0fbeefbbb7dbb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec31312-56", "ovs_interfaceid": "cec31312-56a9-45d2-a9ff-26a135b50547", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:19:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-6455c36a-b69d-4745-86ab-1751f91d1035 req-ec754e4c-50c6-4584-a865-1ac2ba285951 service nova] Releasing lock "refresh_cache-895bf22e-1097-46ac-9ef3-a856dcd02349" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:19:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Acquiring lock "895bf22e-1097-46ac-9ef3-a856dcd02349" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:19:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Lock "895bf22e-1097-46ac-9ef3-a856dcd02349" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:19:02 user nova-compute[74348]: INFO nova.compute.manager [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Shelve offloading
Nov 22 08:19:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:19:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:19:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:19:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:19:02 user nova-compute[74348]: DEBUG nova.compute.manager [req-df22444a-51ed-4f5f-b957-1b74cafdd025 req-fbee808d-f4ac-4117-b450-6c606413fd36 service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Received event network-vif-unplugged-cec31312-56a9-45d2-a9ff-26a135b50547 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:19:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-df22444a-51ed-4f5f-b957-1b74cafdd025 req-fbee808d-f4ac-4117-b450-6c606413fd36 service nova] Acquiring lock "895bf22e-1097-46ac-9ef3-a856dcd02349-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:19:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-df22444a-51ed-4f5f-b957-1b74cafdd025 req-fbee808d-f4ac-4117-b450-6c606413fd36 service nova] Lock "895bf22e-1097-46ac-9ef3-a856dcd02349-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:19:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-df22444a-51ed-4f5f-b957-1b74cafdd025 req-fbee808d-f4ac-4117-b450-6c606413fd36 service nova] Lock "895bf22e-1097-46ac-9ef3-a856dcd02349-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:19:02 user nova-compute[74348]: DEBUG nova.compute.manager [req-df22444a-51ed-4f5f-b957-1b74cafdd025 req-fbee808d-f4ac-4117-b450-6c606413fd36 service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] No waiting events found dispatching network-vif-unplugged-cec31312-56a9-45d2-a9ff-26a135b50547 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:19:02 user nova-compute[74348]: WARNING nova.compute.manager [req-df22444a-51ed-4f5f-b957-1b74cafdd025 req-fbee808d-f4ac-4117-b450-6c606413fd36 service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Received unexpected event network-vif-unplugged-cec31312-56a9-45d2-a9ff-26a135b50547 for instance with vm_state active and task_state shelving.
Nov 22 08:19:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:19:03 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Instance destroyed successfully.
Nov 22 08:19:03 user nova-compute[74348]: DEBUG nova.compute.manager [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:19:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Acquiring lock "refresh_cache-895bf22e-1097-46ac-9ef3-a856dcd02349" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:19:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Acquired lock "refresh_cache-895bf22e-1097-46ac-9ef3-a856dcd02349" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:19:03 user nova-compute[74348]: DEBUG nova.network.neutron [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:19:03 user nova-compute[74348]: DEBUG nova.network.neutron [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Updating instance_info_cache with network_info: [{"id": "cec31312-56a9-45d2-a9ff-26a135b50547", "address": "fa:16:3e:db:29:7a", "network": {"id": "54c3b38d-bf3a-445f-b63a-1ba2abfa50f9", "bridge": "br-int", "label": "tempest-TestShelveInstance-976927611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fec444609c0e43f1ad0fbeefbbb7dbb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec31312-56", "ovs_interfaceid": "cec31312-56a9-45d2-a9ff-26a135b50547", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:19:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Releasing lock "refresh_cache-895bf22e-1097-46ac-9ef3-a856dcd02349" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:19:04 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Instance destroyed successfully.
Nov 22 08:19:04 user nova-compute[74348]: DEBUG nova.objects.instance [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Lazy-loading 'resources' on Instance uuid 895bf22e-1097-46ac-9ef3-a856dcd02349 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1023749067',display_name='tempest-TestShelveInstance-server-1023749067',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1023749067',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQebmH//Rl+dhu9Au8fBShXkal/oh0e6f5bQcxoS9pvLz6J1nQsCObUIl2aEFzc1wk+4Cn+eg9z+dEtpapl5Xv45FLNHf1+5LcxX2U0tOBMa4V6J0s5p8OW5pIkN3FRoQ==',key_name='tempest-TestShelveInstance-1832119496',keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:17:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fec444609c0e43f1ad0fbeefbbb7dbb9',ramdisk_id='',reservation_id='r-sz0m0m2k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1568035397',owner_user_name='tempest-TestShelveInstance-1568035397-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T08:17:22Z,user_data=None,user_id='57494625c8a644ac9958aa3629d4aa62',uuid=895bf22e-1097-46ac-9ef3-a856dcd02349,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cec31312-56a9-45d2-a9ff-26a135b50547", "address": "fa:16:3e:db:29:7a", "network": {"id": "54c3b38d-bf3a-445f-b63a-1ba2abfa50f9", "bridge": "br-int", "label": "tempest-TestShelveInstance-976927611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fec444609c0e43f1ad0fbeefbbb7dbb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec31312-56", "ovs_interfaceid": "cec31312-56a9-45d2-a9ff-26a135b50547", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Converting VIF {"id": "cec31312-56a9-45d2-a9ff-26a135b50547", "address": "fa:16:3e:db:29:7a", "network": {"id": "54c3b38d-bf3a-445f-b63a-1ba2abfa50f9", "bridge": "br-int", "label": "tempest-TestShelveInstance-976927611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fec444609c0e43f1ad0fbeefbbb7dbb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec31312-56", "ovs_interfaceid": "cec31312-56a9-45d2-a9ff-26a135b50547", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:29:7a,bridge_name='br-int',has_traffic_filtering=True,id=cec31312-56a9-45d2-a9ff-26a135b50547,network=Network(54c3b38d-bf3a-445f-b63a-1ba2abfa50f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcec31312-56') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG os_vif [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:29:7a,bridge_name='br-int',has_traffic_filtering=True,id=cec31312-56a9-45d2-a9ff-26a135b50547,network=Network(54c3b38d-bf3a-445f-b63a-1ba2abfa50f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcec31312-56') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcec31312-56, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9eedb61d-b6f1-4c0e-95bc-0d0f4b8056f3) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG nova.compute.manager [req-379e4a25-acb2-4ab6-b9f9-f80e4afa817d req-61b60b39-1ccb-4d27-ae8e-1830be70ea5b service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Received event network-changed-cec31312-56a9-45d2-a9ff-26a135b50547 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG nova.compute.manager [req-379e4a25-acb2-4ab6-b9f9-f80e4afa817d req-61b60b39-1ccb-4d27-ae8e-1830be70ea5b service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Refreshing instance network info cache due to event network-changed-cec31312-56a9-45d2-a9ff-26a135b50547. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-379e4a25-acb2-4ab6-b9f9-f80e4afa817d req-61b60b39-1ccb-4d27-ae8e-1830be70ea5b service nova] Acquiring lock "refresh_cache-895bf22e-1097-46ac-9ef3-a856dcd02349" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-379e4a25-acb2-4ab6-b9f9-f80e4afa817d req-61b60b39-1ccb-4d27-ae8e-1830be70ea5b service nova] Acquired lock "refresh_cache-895bf22e-1097-46ac-9ef3-a856dcd02349" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG nova.network.neutron [req-379e4a25-acb2-4ab6-b9f9-f80e4afa817d req-61b60b39-1ccb-4d27-ae8e-1830be70ea5b service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Refreshing network info cache for port cec31312-56a9-45d2-a9ff-26a135b50547 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:19:04 user nova-compute[74348]: INFO os_vif [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:29:7a,bridge_name='br-int',has_traffic_filtering=True,id=cec31312-56a9-45d2-a9ff-26a135b50547,network=Network(54c3b38d-bf3a-445f-b63a-1ba2abfa50f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcec31312-56')
Nov 22 08:19:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uXyEDwnI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:19:04 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:19:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee227f76-9d9c-4bd3-b514-b72340cf46c2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 08:19:04 user nova-compute[74348]: No targets found.
Nov 22 08:19:04 user nova-compute[74348]: iSNS:
Nov 22 08:19:04 user nova-compute[74348]: No targets found.
Nov 22 08:19:04 user nova-compute[74348]: STATIC:
Nov 22 08:19:04 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de
Nov 22 08:19:04 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:19:04 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:19:04 user nova-compute[74348]: FIRMWARE:
Nov 22 08:19:04 user nova-compute[74348]: No targets found.
Nov 22 08:19:04 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 08:19:04 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 08:19:04 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1661480-a7b2-470a-ae58-ecf84d5f3094]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e404da2-f8d8-424a-b0e6-4f4e4334b734]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de (non-flash)
Nov 22 08:19:04 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de (non-flash)
Nov 22 08:19:04 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f22281575b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de'): ({'sdb'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Removing single pathed devices sdb {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe68cec-a22d-46f5-964c-d13424c5652e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cdc51cd-31cd-4246-9d11-be5e8edf98f1]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Flushing IO for device /dev/sdb {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a89823-9173-497c-b3c2-44725b7f1f58]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b753113-8cd9-47f1-84c5-db0790e8d3e8]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] SCSI volumes sdb have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a326b3c-9674-4315-be9b-e07a754efd13]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b106a21-84b4-423b-95f4-81ecc7da99d1]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de, portal: 172.16.0.220,3260]
Nov 22 08:19:04 user nova-compute[74348]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de, portal: 172.16.0.220,3260] successful.
Nov 22 08:19:04 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26a83a3-9aea-4ab9-a8cc-3a8cd4816cd4]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] <== disconnect_volume: return (298ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 08:19:04 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Deleting instance files /opt/stack/data/nova/instances/895bf22e-1097-46ac-9ef3-a856dcd02349_del
Nov 22 08:19:04 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Deletion of /opt/stack/data/nova/instances/895bf22e-1097-46ac-9ef3-a856dcd02349_del complete
Nov 22 08:19:04 user nova-compute[74348]: DEBUG nova.network.neutron [req-379e4a25-acb2-4ab6-b9f9-f80e4afa817d req-61b60b39-1ccb-4d27-ae8e-1830be70ea5b service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Updated VIF entry in instance network info cache for port cec31312-56a9-45d2-a9ff-26a135b50547. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG nova.network.neutron [req-379e4a25-acb2-4ab6-b9f9-f80e4afa817d req-61b60b39-1ccb-4d27-ae8e-1830be70ea5b service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Updating instance_info_cache with network_info: [{"id": "cec31312-56a9-45d2-a9ff-26a135b50547", "address": "fa:16:3e:db:29:7a", "network": {"id": "54c3b38d-bf3a-445f-b63a-1ba2abfa50f9", "bridge": null, "label": "tempest-TestShelveInstance-976927611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fec444609c0e43f1ad0fbeefbbb7dbb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapcec31312-56", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-379e4a25-acb2-4ab6-b9f9-f80e4afa817d req-61b60b39-1ccb-4d27-ae8e-1830be70ea5b service nova] Releasing lock "refresh_cache-895bf22e-1097-46ac-9ef3-a856dcd02349" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG nova.compute.manager [req-479108da-2be7-4e07-9446-352dbb325f1c req-4034c7c5-7983-4fc3-a702-762188f7dd9b service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Received event network-vif-plugged-cec31312-56a9-45d2-a9ff-26a135b50547 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-479108da-2be7-4e07-9446-352dbb325f1c req-4034c7c5-7983-4fc3-a702-762188f7dd9b service nova] Acquiring lock "895bf22e-1097-46ac-9ef3-a856dcd02349-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-479108da-2be7-4e07-9446-352dbb325f1c req-4034c7c5-7983-4fc3-a702-762188f7dd9b service nova] Lock "895bf22e-1097-46ac-9ef3-a856dcd02349-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-479108da-2be7-4e07-9446-352dbb325f1c req-4034c7c5-7983-4fc3-a702-762188f7dd9b service nova] Lock "895bf22e-1097-46ac-9ef3-a856dcd02349-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:19:04 user nova-compute[74348]: DEBUG nova.compute.manager [req-479108da-2be7-4e07-9446-352dbb325f1c req-4034c7c5-7983-4fc3-a702-762188f7dd9b service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] No waiting events found dispatching network-vif-plugged-cec31312-56a9-45d2-a9ff-26a135b50547 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:19:04 user nova-compute[74348]: WARNING nova.compute.manager [req-479108da-2be7-4e07-9446-352dbb325f1c req-4034c7c5-7983-4fc3-a702-762188f7dd9b service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Received unexpected event network-vif-plugged-cec31312-56a9-45d2-a9ff-26a135b50547 for instance with vm_state active and task_state shelving.
Nov 22 08:19:05 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:19:05 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:19:05 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Cleaning up deleted instances {{(pid=74348) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 22 08:19:05 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] There are 0 instances to clean {{(pid=74348) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 22 08:19:05 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Deleted allocations for instance 895bf22e-1097-46ac-9ef3-a856dcd02349
Nov 22 08:19:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:19:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:19:05 user nova-compute[74348]: DEBUG nova.objects.instance [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Lazy-loading 'numa_topology' on Instance uuid 895bf22e-1097-46ac-9ef3-a856dcd02349 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:19:05 user nova-compute[74348]: DEBUG nova.objects.base [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Object Instance<895bf22e-1097-46ac-9ef3-a856dcd02349> lazy-loaded attributes: resources,numa_topology {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:19:05 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:19:05 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:19:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.142s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:19:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7fc2753a-7c1c-434a-9d54-0b7c15471ed6 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Lock "895bf22e-1097-46ac-9ef3-a856dcd02349" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.440s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:19:08 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:19:08 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74348) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 22 08:19:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:19:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:19:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:19:16 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:19:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:19:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:19:24 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:19:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:19:33 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._sync_power_states {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:19:33 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Triggering sync for uuid 5006cff5-4b67-405d-b6b1-4c355f82d920 {{(pid=74348) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 08:19:33 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Triggering sync for uuid 555f4246-d4b2-4f2f-b91c-dda8fe47264c {{(pid=74348) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 08:19:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "5006cff5-4b67-405d-b6b1-4c355f82d920" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:19:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "5006cff5-4b67-405d-b6b1-4c355f82d920" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:19:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:19:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:19:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "5006cff5-4b67-405d-b6b1-4c355f82d920" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:19:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:19:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:19:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:19:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-126f2936-f30b-4760-974f-19c7d01c356f tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "5006cff5-4b67-405d-b6b1-4c355f82d920" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:19:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-126f2936-f30b-4760-974f-19c7d01c356f tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "5006cff5-4b67-405d-b6b1-4c355f82d920" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:19:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-126f2936-f30b-4760-974f-19c7d01c356f tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "5006cff5-4b67-405d-b6b1-4c355f82d920-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:19:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-126f2936-f30b-4760-974f-19c7d01c356f tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "5006cff5-4b67-405d-b6b1-4c355f82d920-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:19:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-126f2936-f30b-4760-974f-19c7d01c356f tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "5006cff5-4b67-405d-b6b1-4c355f82d920-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:19:37 user nova-compute[74348]: INFO nova.compute.manager [None req-126f2936-f30b-4760-974f-19c7d01c356f tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Terminating instance
Nov 22 08:19:37 user nova-compute[74348]: DEBUG nova.compute.manager [None req-126f2936-f30b-4760-974f-19c7d01c356f tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 08:19:37 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:19:37 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:19:37 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:19:37 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:19:37 user nova-compute[74348]: DEBUG nova.compute.manager [req-704abc0a-5176-4d4a-8a83-b1d06ec59c78 req-68e1fbd0-89e5-451d-9cca-025dc97afd6f service nova] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Received event network-vif-unplugged-db42bd08-8f0c-4e24-82c6-579bed0476bf {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:19:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-704abc0a-5176-4d4a-8a83-b1d06ec59c78 req-68e1fbd0-89e5-451d-9cca-025dc97afd6f service nova] Acquiring lock "5006cff5-4b67-405d-b6b1-4c355f82d920-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:19:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-704abc0a-5176-4d4a-8a83-b1d06ec59c78 req-68e1fbd0-89e5-451d-9cca-025dc97afd6f service nova] Lock "5006cff5-4b67-405d-b6b1-4c355f82d920-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:19:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-704abc0a-5176-4d4a-8a83-b1d06ec59c78 req-68e1fbd0-89e5-451d-9cca-025dc97afd6f service nova] Lock "5006cff5-4b67-405d-b6b1-4c355f82d920-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:19:37 user nova-compute[74348]: DEBUG nova.compute.manager [req-704abc0a-5176-4d4a-8a83-b1d06ec59c78 req-68e1fbd0-89e5-451d-9cca-025dc97afd6f service nova] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] No waiting events found dispatching network-vif-unplugged-db42bd08-8f0c-4e24-82c6-579bed0476bf {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:19:37 user nova-compute[74348]: DEBUG nova.compute.manager [req-704abc0a-5176-4d4a-8a83-b1d06ec59c78 req-68e1fbd0-89e5-451d-9cca-025dc97afd6f service nova] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Received event network-vif-unplugged-db42bd08-8f0c-4e24-82c6-579bed0476bf for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 08:19:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:19:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:19:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:19:38 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Instance destroyed successfully.
Nov 22 08:19:38 user nova-compute[74348]: DEBUG nova.objects.instance [None req-126f2936-f30b-4760-974f-19c7d01c356f tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lazy-loading 'resources' on Instance uuid 5006cff5-4b67-405d-b6b1-4c355f82d920 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:19:38 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-126f2936-f30b-4760-974f-19c7d01c356f tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:01:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1936742078',display_name='tempest-ServerActionsTestOtherA-server-1936742078',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1936742078',id=26,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOnwiyyOG0pLFwcj345c4IzhM/kyBtQaUAH7E3RkvN6illtA9ZAkzh5oMECX0856YNQ2Mjloaz2SuvdsQL10sz9Itf7PAs6pZTbAEN/oI0ibl2evR0cUOwfMcOEuxLp2g==',key_name='tempest-keypair-1143468972',keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:01:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d62fda81543f461288e324458620d07c',ramdisk_id='',reservation_id='r-o4samxtn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-90817446',owner_user_name='tempest-ServerActionsTestOtherA-90817446-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T08:01:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43550ccf30be49aba6ed6de2caf9ae1e',uuid=5006cff5-4b67-405d-b6b1-4c355f82d920,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db42bd08-8f0c-4e24-82c6-579bed0476bf", "address": "fa:16:3e:4e:f8:01", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb42bd08-8f", "ovs_interfaceid": "db42bd08-8f0c-4e24-82c6-579bed0476bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:19:38 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-126f2936-f30b-4760-974f-19c7d01c356f tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Converting VIF {"id": "db42bd08-8f0c-4e24-82c6-579bed0476bf", "address": "fa:16:3e:4e:f8:01", "network": {"id": "9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-169967538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62fda81543f461288e324458620d07c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb42bd08-8f", "ovs_interfaceid": "db42bd08-8f0c-4e24-82c6-579bed0476bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:19:38 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-126f2936-f30b-4760-974f-19c7d01c356f tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:f8:01,bridge_name='br-int',has_traffic_filtering=True,id=db42bd08-8f0c-4e24-82c6-579bed0476bf,network=Network(9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb42bd08-8f') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:19:38 user nova-compute[74348]: DEBUG os_vif [None req-126f2936-f30b-4760-974f-19c7d01c356f tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:f8:01,bridge_name='br-int',has_traffic_filtering=True,id=db42bd08-8f0c-4e24-82c6-579bed0476bf,network=Network(9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb42bd08-8f') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:19:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:19:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb42bd08-8f, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:19:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:19:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:19:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f1c13b6f-9e67-4d9e-be07-89ae10640526) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:19:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:19:38 user nova-compute[74348]: INFO os_vif [None req-126f2936-f30b-4760-974f-19c7d01c356f tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:f8:01,bridge_name='br-int',has_traffic_filtering=True,id=db42bd08-8f0c-4e24-82c6-579bed0476bf,network=Network(9d2d2b07-d8ff-4c04-b778-cc7e1e1b74ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb42bd08-8f')
Nov 22 08:19:38 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-126f2936-f30b-4760-974f-19c7d01c356f tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Deleting instance files /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920_del
Nov 22 08:19:38 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-126f2936-f30b-4760-974f-19c7d01c356f tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Deletion of /opt/stack/data/nova/instances/5006cff5-4b67-405d-b6b1-4c355f82d920_del complete
Nov 22 08:19:38 user nova-compute[74348]: INFO nova.compute.manager [None req-126f2936-f30b-4760-974f-19c7d01c356f tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 22 08:19:38 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-126f2936-f30b-4760-974f-19c7d01c356f tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 08:19:38 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 08:19:38 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 08:19:38 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:19:38 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Took 0.40 seconds to deallocate network for instance.
Nov 22 08:19:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-126f2936-f30b-4760-974f-19c7d01c356f tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:19:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-126f2936-f30b-4760-974f-19c7d01c356f tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:19:39 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-126f2936-f30b-4760-974f-19c7d01c356f tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:19:39 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-126f2936-f30b-4760-974f-19c7d01c356f tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:19:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-126f2936-f30b-4760-974f-19c7d01c356f tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.141s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:19:39 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-126f2936-f30b-4760-974f-19c7d01c356f tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Deleted allocations for instance 5006cff5-4b67-405d-b6b1-4c355f82d920
Nov 22 08:19:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-126f2936-f30b-4760-974f-19c7d01c356f tempest-ServerActionsTestOtherA-90817446 tempest-ServerActionsTestOtherA-90817446-project-member] Lock "5006cff5-4b67-405d-b6b1-4c355f82d920" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.614s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:19:40 user nova-compute[74348]: DEBUG nova.compute.manager [req-5b34ccbb-4a58-4c87-9644-91ed02425d56 req-390324c3-e072-46f2-a77a-172c4b9730d9 service nova] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Received event network-vif-plugged-db42bd08-8f0c-4e24-82c6-579bed0476bf {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:19:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-5b34ccbb-4a58-4c87-9644-91ed02425d56 req-390324c3-e072-46f2-a77a-172c4b9730d9 service nova] Acquiring lock "5006cff5-4b67-405d-b6b1-4c355f82d920-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:19:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-5b34ccbb-4a58-4c87-9644-91ed02425d56 req-390324c3-e072-46f2-a77a-172c4b9730d9 service nova] Lock "5006cff5-4b67-405d-b6b1-4c355f82d920-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:19:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-5b34ccbb-4a58-4c87-9644-91ed02425d56 req-390324c3-e072-46f2-a77a-172c4b9730d9 service nova] Lock "5006cff5-4b67-405d-b6b1-4c355f82d920-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:19:40 user nova-compute[74348]: DEBUG nova.compute.manager [req-5b34ccbb-4a58-4c87-9644-91ed02425d56 req-390324c3-e072-46f2-a77a-172c4b9730d9 service nova] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] No waiting events found dispatching network-vif-plugged-db42bd08-8f0c-4e24-82c6-579bed0476bf {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:19:40 user nova-compute[74348]: WARNING nova.compute.manager [req-5b34ccbb-4a58-4c87-9644-91ed02425d56 req-390324c3-e072-46f2-a77a-172c4b9730d9 service nova] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Received unexpected event network-vif-plugged-db42bd08-8f0c-4e24-82c6-579bed0476bf for instance with vm_state deleted and task_state None.
Nov 22 08:19:40 user nova-compute[74348]: DEBUG nova.compute.manager [req-5b34ccbb-4a58-4c87-9644-91ed02425d56 req-390324c3-e072-46f2-a77a-172c4b9730d9 service nova] [instance: 5006cff5-4b67-405d-b6b1-4c355f82d920] Received event network-vif-deleted-db42bd08-8f0c-4e24-82c6-579bed0476bf {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:19:42 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-cd7c5b13-b003-4772-8985-fbace4547a14 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquiring lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:19:42 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-cd7c5b13-b003-4772-8985-fbace4547a14 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:19:42 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-cd7c5b13-b003-4772-8985-fbace4547a14 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquiring lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:19:42 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-cd7c5b13-b003-4772-8985-fbace4547a14 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:19:42 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-cd7c5b13-b003-4772-8985-fbace4547a14 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:19:42 user nova-compute[74348]: INFO nova.compute.manager [None req-cd7c5b13-b003-4772-8985-fbace4547a14 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Terminating instance
Nov 22 08:19:42 user nova-compute[74348]: DEBUG nova.compute.manager [None req-cd7c5b13-b003-4772-8985-fbace4547a14 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 08:19:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:19:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:19:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:19:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:19:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:19:43 user nova-compute[74348]: DEBUG nova.compute.manager [req-44f330e5-1215-4b2b-bcc8-e15fb5579aa7 req-de06abaa-ab61-45cc-967a-719ffbdb670b service nova] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Received event network-vif-unplugged-8e4fc0fe-f03b-4816-8a6a-c20a8eba5296 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:19:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-44f330e5-1215-4b2b-bcc8-e15fb5579aa7 req-de06abaa-ab61-45cc-967a-719ffbdb670b service nova] Acquiring lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:19:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-44f330e5-1215-4b2b-bcc8-e15fb5579aa7 req-de06abaa-ab61-45cc-967a-719ffbdb670b service nova] Lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:19:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-44f330e5-1215-4b2b-bcc8-e15fb5579aa7 req-de06abaa-ab61-45cc-967a-719ffbdb670b service nova] Lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:19:43 user nova-compute[74348]: DEBUG nova.compute.manager [req-44f330e5-1215-4b2b-bcc8-e15fb5579aa7 req-de06abaa-ab61-45cc-967a-719ffbdb670b service nova] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] No waiting events found dispatching network-vif-unplugged-8e4fc0fe-f03b-4816-8a6a-c20a8eba5296 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:19:43 user nova-compute[74348]: DEBUG nova.compute.manager [req-44f330e5-1215-4b2b-bcc8-e15fb5579aa7 req-de06abaa-ab61-45cc-967a-719ffbdb670b service nova] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Received event network-vif-unplugged-8e4fc0fe-f03b-4816-8a6a-c20a8eba5296 for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 08:19:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:19:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:19:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:19:43 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Instance destroyed successfully.
Nov 22 08:19:43 user nova-compute[74348]: DEBUG nova.objects.instance [None req-cd7c5b13-b003-4772-8985-fbace4547a14 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lazy-loading 'resources' on Instance uuid 555f4246-d4b2-4f2f-b91c-dda8fe47264c {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:19:43 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-cd7c5b13-b003-4772-8985-fbace4547a14 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:02:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-305514770',display_name='tempest-ServerRescueNegativeTestJSON-server-305514770',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-305514770',id=28,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:07:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d975b772fea4ed98b1b3ad284e51a65',ramdisk_id='',reservation_id='r-rd38z59i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1773499839',owner_user_name='tempest-ServerRescueNegativeTestJSON-1773499839-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T08:09:24Z,user_data=None,user_id='0b3c6587d0764b9fae5782792aec5d92',uuid=555f4246-d4b2-4f2f-b91c-dda8fe47264c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e4fc0fe-f03b-4816-8a6a-c20a8eba5296", "address": "fa:16:3e:01:d5:cd", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4fc0fe-f0", "ovs_interfaceid": "8e4fc0fe-f03b-4816-8a6a-c20a8eba5296", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:19:43 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-cd7c5b13-b003-4772-8985-fbace4547a14 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Converting VIF {"id": "8e4fc0fe-f03b-4816-8a6a-c20a8eba5296", "address": "fa:16:3e:01:d5:cd", "network": {"id": "246d8f55-a1eb-4883-906c-69f15289caef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-801710710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d975b772fea4ed98b1b3ad284e51a65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4fc0fe-f0", "ovs_interfaceid": "8e4fc0fe-f03b-4816-8a6a-c20a8eba5296", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:19:43 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-cd7c5b13-b003-4772-8985-fbace4547a14 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:d5:cd,bridge_name='br-int',has_traffic_filtering=True,id=8e4fc0fe-f03b-4816-8a6a-c20a8eba5296,network=Network(246d8f55-a1eb-4883-906c-69f15289caef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e4fc0fe-f0') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:19:43 user nova-compute[74348]: DEBUG os_vif [None req-cd7c5b13-b003-4772-8985-fbace4547a14 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:d5:cd,bridge_name='br-int',has_traffic_filtering=True,id=8e4fc0fe-f03b-4816-8a6a-c20a8eba5296,network=Network(246d8f55-a1eb-4883-906c-69f15289caef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e4fc0fe-f0') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:19:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:19:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e4fc0fe-f0, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:19:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:19:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:19:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:19:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ce4cb421-1ef3-4280-8ace-23eac44f6e97) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:19:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:19:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:19:43 user nova-compute[74348]: INFO os_vif [None req-cd7c5b13-b003-4772-8985-fbace4547a14 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:d5:cd,bridge_name='br-int',has_traffic_filtering=True,id=8e4fc0fe-f03b-4816-8a6a-c20a8eba5296,network=Network(246d8f55-a1eb-4883-906c-69f15289caef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e4fc0fe-f0')
Nov 22 08:19:43 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-cd7c5b13-b003-4772-8985-fbace4547a14 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Deleting instance files /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c_del
Nov 22 08:19:43 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-cd7c5b13-b003-4772-8985-fbace4547a14 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Deletion of /opt/stack/data/nova/instances/555f4246-d4b2-4f2f-b91c-dda8fe47264c_del complete
Nov 22 08:19:43 user nova-compute[74348]: INFO nova.compute.manager [None req-cd7c5b13-b003-4772-8985-fbace4547a14 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 22 08:19:43 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-cd7c5b13-b003-4772-8985-fbace4547a14 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 08:19:43 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 08:19:43 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 08:19:44 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:19:44 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Took 0.37 seconds to deallocate network for instance.
Nov 22 08:19:44 user nova-compute[74348]: DEBUG nova.compute.manager [req-6d627a1c-a8eb-43e3-89cc-f890c0f867b5 req-91381a2c-0519-4c88-a397-ce318b15970a service nova] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Received event network-vif-deleted-8e4fc0fe-f03b-4816-8a6a-c20a8eba5296 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:19:44 user nova-compute[74348]: INFO nova.compute.manager [req-6d627a1c-a8eb-43e3-89cc-f890c0f867b5 req-91381a2c-0519-4c88-a397-ce318b15970a service nova] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Neutron deleted interface 8e4fc0fe-f03b-4816-8a6a-c20a8eba5296; detaching it from the instance and deleting it from the info cache
Nov 22 08:19:44 user nova-compute[74348]: DEBUG nova.network.neutron [req-6d627a1c-a8eb-43e3-89cc-f890c0f867b5 req-91381a2c-0519-4c88-a397-ce318b15970a service nova] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:19:44 user nova-compute[74348]: DEBUG nova.compute.manager [req-6d627a1c-a8eb-43e3-89cc-f890c0f867b5 req-91381a2c-0519-4c88-a397-ce318b15970a service nova] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Detach interface failed, port_id=8e4fc0fe-f03b-4816-8a6a-c20a8eba5296, reason: Instance 555f4246-d4b2-4f2f-b91c-dda8fe47264c could not be found. {{(pid=74348) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 08:19:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-cd7c5b13-b003-4772-8985-fbace4547a14 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:19:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-cd7c5b13-b003-4772-8985-fbace4547a14 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:19:44 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-cd7c5b13-b003-4772-8985-fbace4547a14 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:19:44 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-cd7c5b13-b003-4772-8985-fbace4547a14 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:19:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-cd7c5b13-b003-4772-8985-fbace4547a14 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.142s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:19:44 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-cd7c5b13-b003-4772-8985-fbace4547a14 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Deleted allocations for instance 555f4246-d4b2-4f2f-b91c-dda8fe47264c
Nov 22 08:19:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-cd7c5b13-b003-4772-8985-fbace4547a14 tempest-ServerRescueNegativeTestJSON-1773499839 tempest-ServerRescueNegativeTestJSON-1773499839-project-member] Lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.538s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:19:45 user nova-compute[74348]: DEBUG nova.compute.manager [req-3c3132bf-107f-453c-b2f8-2ffe76f3042f req-e4578a9b-0224-4bd7-8ecc-a84780782492 service nova] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Received event network-vif-plugged-8e4fc0fe-f03b-4816-8a6a-c20a8eba5296 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:19:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3c3132bf-107f-453c-b2f8-2ffe76f3042f req-e4578a9b-0224-4bd7-8ecc-a84780782492 service nova] Acquiring lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:19:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3c3132bf-107f-453c-b2f8-2ffe76f3042f req-e4578a9b-0224-4bd7-8ecc-a84780782492 service nova] Lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:19:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3c3132bf-107f-453c-b2f8-2ffe76f3042f req-e4578a9b-0224-4bd7-8ecc-a84780782492 service nova] Lock "555f4246-d4b2-4f2f-b91c-dda8fe47264c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:19:45 user nova-compute[74348]: DEBUG nova.compute.manager [req-3c3132bf-107f-453c-b2f8-2ffe76f3042f req-e4578a9b-0224-4bd7-8ecc-a84780782492 service nova] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] No waiting events found dispatching network-vif-plugged-8e4fc0fe-f03b-4816-8a6a-c20a8eba5296 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:19:45 user nova-compute[74348]: WARNING nova.compute.manager [req-3c3132bf-107f-453c-b2f8-2ffe76f3042f req-e4578a9b-0224-4bd7-8ecc-a84780782492 service nova] [instance: 555f4246-d4b2-4f2f-b91c-dda8fe47264c] Received unexpected event network-vif-plugged-8e4fc0fe-f03b-4816-8a6a-c20a8eba5296 for instance with vm_state deleted and task_state None.
Nov 22 08:19:48 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:19:48 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:19:48 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Rebuilding the list of instances to heal {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 08:19:48 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Didn't find any instances for network info cache update. {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 08:19:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:19:51 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:19:51 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:19:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:19:54 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:19:54 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:19:55 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:19:56 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:19:56 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:19:56 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:19:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:19:59 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:19:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:19:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:19:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:19:59 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:20:00 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:20:00 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:20:00 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=9102MB free_disk=25.005229949951172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:20:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:20:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:20:00 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:20:00 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:20:00 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:20:00 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:20:00 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:20:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:20:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:20:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:20:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:20:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:20:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:20:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:20:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:20:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:20:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:20:36 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:20:36 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:20:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:20:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:20:39 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:20:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:20:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:20:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:20:44 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:20:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Acquiring lock "11c5dfc5-e414-4676-bc1e-06a85fcfd7c2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:20:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Lock "11c5dfc5-e414-4676-bc1e-06a85fcfd7c2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:20:45 user nova-compute[74348]: DEBUG nova.compute.manager [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 08:20:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:20:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:20:45 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 08:20:45 user nova-compute[74348]: INFO nova.compute.claims [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Claim successful on node user
Nov 22 08:20:45 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:20:45 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:20:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.198s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:20:45 user nova-compute[74348]: DEBUG nova.compute.manager [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 08:20:45 user nova-compute[74348]: DEBUG nova.compute.manager [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 08:20:45 user nova-compute[74348]: DEBUG nova.network.neutron [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 08:20:45 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 08:20:45 user nova-compute[74348]: DEBUG nova.compute.manager [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 08:20:45 user nova-compute[74348]: DEBUG nova.policy [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '53eb92cbaf064fe6b36824f24401b874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab03f00a19408e80660a5c4de957f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 08:20:45 user nova-compute[74348]: DEBUG nova.compute.manager [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 08:20:45 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 08:20:45 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Creating image(s)
Nov 22 08:20:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Acquiring lock "/opt/stack/data/nova/instances/11c5dfc5-e414-4676-bc1e-06a85fcfd7c2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:20:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Lock "/opt/stack/data/nova/instances/11c5dfc5-e414-4676-bc1e-06a85fcfd7c2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:20:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Lock "/opt/stack/data/nova/instances/11c5dfc5-e414-4676-bc1e-06a85fcfd7c2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:20:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:20:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.170s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:20:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Acquiring lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:20:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:20:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:20:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.182s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:20:45 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/11c5dfc5-e414-4676-bc1e-06a85fcfd7c2/disk 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:20:45 user nova-compute[74348]: DEBUG nova.network.neutron [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Successfully created port: 81234fa3-f64a-43dd-a217-74df297018a1 {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/11c5dfc5-e414-4676-bc1e-06a85fcfd7c2/disk 1073741824" returned: 0 in 0.055s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.173s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Checking if we can resize image /opt/stack/data/nova/instances/11c5dfc5-e414-4676-bc1e-06a85fcfd7c2/disk. size=1073741824 {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c5dfc5-e414-4676-bc1e-06a85fcfd7c2/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c5dfc5-e414-4676-bc1e-06a85fcfd7c2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Cannot resize image /opt/stack/data/nova/instances/11c5dfc5-e414-4676-bc1e-06a85fcfd7c2/disk to a smaller size. {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Ensure instance console log exists: /opt/stack/data/nova/instances/11c5dfc5-e414-4676-bc1e-06a85fcfd7c2/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG nova.network.neutron [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Successfully updated port: 81234fa3-f64a-43dd-a217-74df297018a1 {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Acquiring lock "refresh_cache-11c5dfc5-e414-4676-bc1e-06a85fcfd7c2" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Acquired lock "refresh_cache-11c5dfc5-e414-4676-bc1e-06a85fcfd7c2" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG nova.network.neutron [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG nova.compute.manager [req-10340135-256d-462f-af52-ef5a9fdbfaec req-325be44d-8175-44e7-adb7-bed9094229e8 service nova] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Received event network-changed-81234fa3-f64a-43dd-a217-74df297018a1 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG nova.compute.manager [req-10340135-256d-462f-af52-ef5a9fdbfaec req-325be44d-8175-44e7-adb7-bed9094229e8 service nova] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Refreshing instance network info cache due to event network-changed-81234fa3-f64a-43dd-a217-74df297018a1. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-10340135-256d-462f-af52-ef5a9fdbfaec req-325be44d-8175-44e7-adb7-bed9094229e8 service nova] Acquiring lock "refresh_cache-11c5dfc5-e414-4676-bc1e-06a85fcfd7c2" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG nova.network.neutron [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG nova.network.neutron [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Updating instance_info_cache with network_info: [{"id": "81234fa3-f64a-43dd-a217-74df297018a1", "address": "fa:16:3e:f2:89:77", "network": {"id": "0c8e2736-63a5-4818-9b41-11fb918863ac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-354472038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ab03f00a19408e80660a5c4de957f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81234fa3-f6", "ovs_interfaceid": "81234fa3-f64a-43dd-a217-74df297018a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Releasing lock "refresh_cache-11c5dfc5-e414-4676-bc1e-06a85fcfd7c2" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG nova.compute.manager [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Instance network_info: |[{"id": "81234fa3-f64a-43dd-a217-74df297018a1", "address": "fa:16:3e:f2:89:77", "network": {"id": "0c8e2736-63a5-4818-9b41-11fb918863ac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-354472038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ab03f00a19408e80660a5c4de957f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81234fa3-f6", "ovs_interfaceid": "81234fa3-f64a-43dd-a217-74df297018a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-10340135-256d-462f-af52-ef5a9fdbfaec req-325be44d-8175-44e7-adb7-bed9094229e8 service nova] Acquired lock "refresh_cache-11c5dfc5-e414-4676-bc1e-06a85fcfd7c2" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG nova.network.neutron [req-10340135-256d-462f-af52-ef5a9fdbfaec req-325be44d-8175-44e7-adb7-bed9094229e8 service nova] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Refreshing network info cache for port 81234fa3-f64a-43dd-a217-74df297018a1 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Start _get_guest_xml network_info=[{"id": "81234fa3-f64a-43dd-a217-74df297018a1", "address": "fa:16:3e:f2:89:77", "network": {"id": "0c8e2736-63a5-4818-9b41-11fb918863ac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-354472038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ab03f00a19408e80660a5c4de957f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81234fa3-f6", "ovs_interfaceid": "81234fa3-f64a-43dd-a217-74df297018a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 08:20:46 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:20:46 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:20:46 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:20:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1565976574',display_name='tempest-VolumesActionsTest-instance-1565976574',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1565976574',id=43,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96ab03f00a19408e80660a5c4de957f7',ramdisk_id='',reservation_id='r-f8b08fp5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-395866833',owner_user_name='tempest-VolumesActionsTest-395866833-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:20:45Z,user_data=None,user_id='53eb92cbaf064fe6b36824f24401b874',uuid=11c5dfc5-e414-4676-bc1e-06a85fcfd7c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81234fa3-f64a-43dd-a217-74df297018a1", "address": "fa:16:3e:f2:89:77", "network": {"id": "0c8e2736-63a5-4818-9b41-11fb918863ac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-354472038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ab03f00a19408e80660a5c4de957f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81234fa3-f6", "ovs_interfaceid": "81234fa3-f64a-43dd-a217-74df297018a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Converting VIF {"id": "81234fa3-f64a-43dd-a217-74df297018a1", "address": "fa:16:3e:f2:89:77", "network": {"id": "0c8e2736-63a5-4818-9b41-11fb918863ac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-354472038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ab03f00a19408e80660a5c4de957f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81234fa3-f6", "ovs_interfaceid": "81234fa3-f64a-43dd-a217-74df297018a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:89:77,bridge_name='br-int',has_traffic_filtering=True,id=81234fa3-f64a-43dd-a217-74df297018a1,network=Network(0c8e2736-63a5-4818-9b41-11fb918863ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81234fa3-f6') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG nova.objects.instance [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Lazy-loading 'pci_devices' on Instance uuid 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] End _get_guest_xml xml=<domain type="kvm">
Nov 22 08:20:46 user nova-compute[74348]:   <uuid>11c5dfc5-e414-4676-bc1e-06a85fcfd7c2</uuid>
Nov 22 08:20:46 user nova-compute[74348]:   <name>instance-0000002b</name>
Nov 22 08:20:46 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 08:20:46 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 08:20:46 user nova-compute[74348]:   <metadata>
Nov 22 08:20:46 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 08:20:46 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 08:20:46 user nova-compute[74348]:       <nova:name>tempest-VolumesActionsTest-instance-1565976574</nova:name>
Nov 22 08:20:46 user nova-compute[74348]:       <nova:creationTime>2023-11-22 08:20:46</nova:creationTime>
Nov 22 08:20:46 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 08:20:46 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 08:20:46 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 08:20:46 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 08:20:46 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 08:20:46 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 08:20:46 user nova-compute[74348]:       </nova:flavor>
Nov 22 08:20:46 user nova-compute[74348]:       <nova:owner>
Nov 22 08:20:46 user nova-compute[74348]:         <nova:user uuid="53eb92cbaf064fe6b36824f24401b874">tempest-VolumesActionsTest-395866833-project-member</nova:user>
Nov 22 08:20:46 user nova-compute[74348]:         <nova:project uuid="96ab03f00a19408e80660a5c4de957f7">tempest-VolumesActionsTest-395866833</nova:project>
Nov 22 08:20:46 user nova-compute[74348]:       </nova:owner>
Nov 22 08:20:46 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 08:20:46 user nova-compute[74348]:       <nova:ports>
Nov 22 08:20:46 user nova-compute[74348]:         <nova:port uuid="81234fa3-f64a-43dd-a217-74df297018a1">
Nov 22 08:20:46 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 22 08:20:46 user nova-compute[74348]:         </nova:port>
Nov 22 08:20:46 user nova-compute[74348]:       </nova:ports>
Nov 22 08:20:46 user nova-compute[74348]:     </nova:instance>
Nov 22 08:20:46 user nova-compute[74348]:   </metadata>
Nov 22 08:20:46 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 08:20:46 user nova-compute[74348]:     <system>
Nov 22 08:20:46 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 08:20:46 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 08:20:46 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 08:20:46 user nova-compute[74348]:       <entry name="serial">11c5dfc5-e414-4676-bc1e-06a85fcfd7c2</entry>
Nov 22 08:20:46 user nova-compute[74348]:       <entry name="uuid">11c5dfc5-e414-4676-bc1e-06a85fcfd7c2</entry>
Nov 22 08:20:46 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 08:20:46 user nova-compute[74348]:     </system>
Nov 22 08:20:46 user nova-compute[74348]:   </sysinfo>
Nov 22 08:20:46 user nova-compute[74348]:   <os>
Nov 22 08:20:46 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 08:20:46 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 08:20:46 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 08:20:46 user nova-compute[74348]:   </os>
Nov 22 08:20:46 user nova-compute[74348]:   <features>
Nov 22 08:20:46 user nova-compute[74348]:     <acpi/>
Nov 22 08:20:46 user nova-compute[74348]:     <apic/>
Nov 22 08:20:46 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 08:20:46 user nova-compute[74348]:   </features>
Nov 22 08:20:46 user nova-compute[74348]:   <clock offset="utc">
Nov 22 08:20:46 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 08:20:46 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 08:20:46 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 08:20:46 user nova-compute[74348]:   </clock>
Nov 22 08:20:46 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 08:20:46 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 08:20:46 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 08:20:46 user nova-compute[74348]:   </cpu>
Nov 22 08:20:46 user nova-compute[74348]:   <devices>
Nov 22 08:20:46 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 08:20:46 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 08:20:46 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/11c5dfc5-e414-4676-bc1e-06a85fcfd7c2/disk"/>
Nov 22 08:20:46 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 08:20:46 user nova-compute[74348]:     </disk>
Nov 22 08:20:46 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 08:20:46 user nova-compute[74348]:       <mac address="fa:16:3e:f2:89:77"/>
Nov 22 08:20:46 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:20:46 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 08:20:46 user nova-compute[74348]:       <target dev="tap81234fa3-f6"/>
Nov 22 08:20:46 user nova-compute[74348]:     </interface>
Nov 22 08:20:46 user nova-compute[74348]:     <serial type="pty">
Nov 22 08:20:46 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/11c5dfc5-e414-4676-bc1e-06a85fcfd7c2/console.log" append="off"/>
Nov 22 08:20:46 user nova-compute[74348]:     </serial>
Nov 22 08:20:46 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 08:20:46 user nova-compute[74348]:     <video>
Nov 22 08:20:46 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:20:46 user nova-compute[74348]:     </video>
Nov 22 08:20:46 user nova-compute[74348]:     <rng model="virtio">
Nov 22 08:20:46 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 08:20:46 user nova-compute[74348]:     </rng>
Nov 22 08:20:46 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 08:20:46 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 08:20:46 user nova-compute[74348]:       <stats period="10"/>
Nov 22 08:20:46 user nova-compute[74348]:     </memballoon>
Nov 22 08:20:46 user nova-compute[74348]:   </devices>
Nov 22 08:20:46 user nova-compute[74348]: </domain>
Nov 22 08:20:46 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:20:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1565976574',display_name='tempest-VolumesActionsTest-instance-1565976574',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1565976574',id=43,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96ab03f00a19408e80660a5c4de957f7',ramdisk_id='',reservation_id='r-f8b08fp5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-395866833',owner_user_name='tempest-VolumesActionsTest-395866833-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:20:45Z,user_data=None,user_id='53eb92cbaf064fe6b36824f24401b874',uuid=11c5dfc5-e414-4676-bc1e-06a85fcfd7c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81234fa3-f64a-43dd-a217-74df297018a1", "address": "fa:16:3e:f2:89:77", "network": {"id": "0c8e2736-63a5-4818-9b41-11fb918863ac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-354472038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ab03f00a19408e80660a5c4de957f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81234fa3-f6", "ovs_interfaceid": "81234fa3-f64a-43dd-a217-74df297018a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Converting VIF {"id": "81234fa3-f64a-43dd-a217-74df297018a1", "address": "fa:16:3e:f2:89:77", "network": {"id": "0c8e2736-63a5-4818-9b41-11fb918863ac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-354472038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ab03f00a19408e80660a5c4de957f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81234fa3-f6", "ovs_interfaceid": "81234fa3-f64a-43dd-a217-74df297018a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:89:77,bridge_name='br-int',has_traffic_filtering=True,id=81234fa3-f64a-43dd-a217-74df297018a1,network=Network(0c8e2736-63a5-4818-9b41-11fb918863ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81234fa3-f6') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG os_vif [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:89:77,bridge_name='br-int',has_traffic_filtering=True,id=81234fa3-f64a-43dd-a217-74df297018a1,network=Network(0c8e2736-63a5-4818-9b41-11fb918863ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81234fa3-f6') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:20:46 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 08:20:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:20:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac08879c-c127-5b06-9656-c7adf20f28a7', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:20:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:20:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:20:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:20:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81234fa3-f6, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:20:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap81234fa3-f6, col_values=(('qos', UUID('a689e9f8-8666-43c3-a9fa-724a17968b71')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:20:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap81234fa3-f6, col_values=(('external_ids', {'iface-id': '81234fa3-f64a-43dd-a217-74df297018a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:89:77', 'vm-uuid': '11c5dfc5-e414-4676-bc1e-06a85fcfd7c2'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:20:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:20:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:20:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:20:47 user nova-compute[74348]: INFO os_vif [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:89:77,bridge_name='br-int',has_traffic_filtering=True,id=81234fa3-f64a-43dd-a217-74df297018a1,network=Network(0c8e2736-63a5-4818-9b41-11fb918863ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81234fa3-f6')
Nov 22 08:20:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:20:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] No VIF found with MAC fa:16:3e:f2:89:77, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:20:47 user nova-compute[74348]: DEBUG nova.network.neutron [req-10340135-256d-462f-af52-ef5a9fdbfaec req-325be44d-8175-44e7-adb7-bed9094229e8 service nova] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Updated VIF entry in instance network info cache for port 81234fa3-f64a-43dd-a217-74df297018a1. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:20:47 user nova-compute[74348]: DEBUG nova.network.neutron [req-10340135-256d-462f-af52-ef5a9fdbfaec req-325be44d-8175-44e7-adb7-bed9094229e8 service nova] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Updating instance_info_cache with network_info: [{"id": "81234fa3-f64a-43dd-a217-74df297018a1", "address": "fa:16:3e:f2:89:77", "network": {"id": "0c8e2736-63a5-4818-9b41-11fb918863ac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-354472038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ab03f00a19408e80660a5c4de957f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81234fa3-f6", "ovs_interfaceid": "81234fa3-f64a-43dd-a217-74df297018a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:20:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-10340135-256d-462f-af52-ef5a9fdbfaec req-325be44d-8175-44e7-adb7-bed9094229e8 service nova] Releasing lock "refresh_cache-11c5dfc5-e414-4676-bc1e-06a85fcfd7c2" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:20:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:20:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:20:48 user nova-compute[74348]: DEBUG nova.compute.manager [req-101d53ce-3504-4e8d-8cf5-a607a263e199 req-f5dc14d8-6158-4570-a194-8876932438de service nova] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Received event network-vif-plugged-81234fa3-f64a-43dd-a217-74df297018a1 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:20:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-101d53ce-3504-4e8d-8cf5-a607a263e199 req-f5dc14d8-6158-4570-a194-8876932438de service nova] Acquiring lock "11c5dfc5-e414-4676-bc1e-06a85fcfd7c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:20:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-101d53ce-3504-4e8d-8cf5-a607a263e199 req-f5dc14d8-6158-4570-a194-8876932438de service nova] Lock "11c5dfc5-e414-4676-bc1e-06a85fcfd7c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:20:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-101d53ce-3504-4e8d-8cf5-a607a263e199 req-f5dc14d8-6158-4570-a194-8876932438de service nova] Lock "11c5dfc5-e414-4676-bc1e-06a85fcfd7c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:20:48 user nova-compute[74348]: DEBUG nova.compute.manager [req-101d53ce-3504-4e8d-8cf5-a607a263e199 req-f5dc14d8-6158-4570-a194-8876932438de service nova] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] No waiting events found dispatching network-vif-plugged-81234fa3-f64a-43dd-a217-74df297018a1 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:20:48 user nova-compute[74348]: WARNING nova.compute.manager [req-101d53ce-3504-4e8d-8cf5-a607a263e199 req-f5dc14d8-6158-4570-a194-8876932438de service nova] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Received unexpected event network-vif-plugged-81234fa3-f64a-43dd-a217-74df297018a1 for instance with vm_state building and task_state spawning.
Nov 22 08:20:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:20:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:20:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:20:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:20:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:20:50 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:20:50 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:20:50 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Rebuilding the list of instances to heal {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 08:20:50 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Skipping network cache update for instance because it is Building. {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 22 08:20:50 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Didn't find any instances for network info cache update. {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 08:20:50 user nova-compute[74348]: DEBUG nova.compute.manager [req-37d060f2-62e8-47e7-9929-566ceb087001 req-076ac355-2d31-406b-b6b5-03fb5e406229 service nova] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Received event network-vif-plugged-81234fa3-f64a-43dd-a217-74df297018a1 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:20:50 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-37d060f2-62e8-47e7-9929-566ceb087001 req-076ac355-2d31-406b-b6b5-03fb5e406229 service nova] Acquiring lock "11c5dfc5-e414-4676-bc1e-06a85fcfd7c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:20:50 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-37d060f2-62e8-47e7-9929-566ceb087001 req-076ac355-2d31-406b-b6b5-03fb5e406229 service nova] Lock "11c5dfc5-e414-4676-bc1e-06a85fcfd7c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:20:50 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-37d060f2-62e8-47e7-9929-566ceb087001 req-076ac355-2d31-406b-b6b5-03fb5e406229 service nova] Lock "11c5dfc5-e414-4676-bc1e-06a85fcfd7c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:20:50 user nova-compute[74348]: DEBUG nova.compute.manager [req-37d060f2-62e8-47e7-9929-566ceb087001 req-076ac355-2d31-406b-b6b5-03fb5e406229 service nova] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] No waiting events found dispatching network-vif-plugged-81234fa3-f64a-43dd-a217-74df297018a1 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:20:50 user nova-compute[74348]: WARNING nova.compute.manager [req-37d060f2-62e8-47e7-9929-566ceb087001 req-076ac355-2d31-406b-b6b5-03fb5e406229 service nova] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Received unexpected event network-vif-plugged-81234fa3-f64a-43dd-a217-74df297018a1 for instance with vm_state building and task_state spawning.
Nov 22 08:20:50 user nova-compute[74348]: DEBUG nova.compute.manager [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 08:20:50 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 08:20:50 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Instance spawned successfully.
Nov 22 08:20:50 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 08:20:50 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:20:50 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:20:50 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:20:50 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:20:50 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:20:50 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:20:50 user nova-compute[74348]: INFO nova.compute.manager [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Took 5.17 seconds to spawn the instance on the hypervisor.
Nov 22 08:20:50 user nova-compute[74348]: DEBUG nova.compute.manager [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:20:50 user nova-compute[74348]: INFO nova.compute.manager [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Took 5.76 seconds to build instance.
Nov 22 08:20:50 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-30c198ef-f4d7-4767-a35f-1deff6a1e4c7 tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Lock "11c5dfc5-e414-4676-bc1e-06a85fcfd7c2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.855s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:20:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:20:53 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:20:53 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:20:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Acquiring lock "895bf22e-1097-46ac-9ef3-a856dcd02349" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:20:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Lock "895bf22e-1097-46ac-9ef3-a856dcd02349" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:20:54 user nova-compute[74348]: INFO nova.compute.manager [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Unshelving
Nov 22 08:20:54 user nova-compute[74348]: INFO nova.virt.block_device [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Booting with volume d00769d0-fad3-4be1-ba4a-cb7615c344de at /dev/vda
Nov 22 08:20:54 user nova-compute[74348]: DEBUG os_brick.utils [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:20:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:20:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:20:54 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f26acb7-c514-4e4e-9d4f-8b2820546607]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:20:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:20:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:20:54 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9e157d-ab6c-4627-bf38-607c3ae31d91]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:20:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:20:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:20:54 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f17d161-2929-4303-bbd9-f6590b0030ad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:20:54 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f0ae74-dbe3-4e7c-bd39-5e29ddefb53d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:20:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:20:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:20:54 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 08:20:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:20:54 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:20:54 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 08:20:54 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a075055c-7fec-4348-8fff-e91902d99f5f]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:20:54 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 08:20:54 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 08:20:54 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 08:20:54 user nova-compute[74348]: DEBUG os_brick.utils [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:20:54 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Updating existing volume attachment record: 765a6a75-f425-406e-b97d-c8ca7be9826b {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 08:20:54 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:20:54 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:20:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:20:56 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:20:56 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:20:56 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:20:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:20:58 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:20:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:00 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:21:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:21:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:21:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:21:00 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:21:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:21:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:21:00 user nova-compute[74348]: DEBUG nova.objects.instance [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Lazy-loading 'pci_requests' on Instance uuid 895bf22e-1097-46ac-9ef3-a856dcd02349 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:21:00 user nova-compute[74348]: DEBUG nova.objects.instance [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Lazy-loading 'numa_topology' on Instance uuid 895bf22e-1097-46ac-9ef3-a856dcd02349 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:21:00 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 08:21:00 user nova-compute[74348]: INFO nova.compute.claims [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Claim successful on node user
Nov 22 08:21:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c5dfc5-e414-4676-bc1e-06a85fcfd7c2/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:21:00 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:21:00 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:21:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.416s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:21:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c5dfc5-e414-4676-bc1e-06a85fcfd7c2/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:21:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c5dfc5-e414-4676-bc1e-06a85fcfd7c2/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:21:01 user nova-compute[74348]: INFO nova.network.neutron [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Updating port cec31312-56a9-45d2-a9ff-26a135b50547 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 22 08:21:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c5dfc5-e414-4676-bc1e-06a85fcfd7c2/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:21:01 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:21:01 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:21:01 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=8935MB free_disk=24.993667602539062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:21:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:21:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:21:01 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:21:01 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (52690f6a-773f-4e8d-be85-d278b6522975): {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 22 08:21:01 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:21:01 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:21:01 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:21:01 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:21:01 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:21:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.237s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:21:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Acquiring lock "refresh_cache-895bf22e-1097-46ac-9ef3-a856dcd02349" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:21:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Acquired lock "refresh_cache-895bf22e-1097-46ac-9ef3-a856dcd02349" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:21:01 user nova-compute[74348]: DEBUG nova.network.neutron [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG nova.compute.manager [req-13109c80-8417-4cc7-b6ce-203469bcb649 req-31d4a8a9-1034-4e53-839e-ffd01fb32078 service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Received event network-changed-cec31312-56a9-45d2-a9ff-26a135b50547 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG nova.compute.manager [req-13109c80-8417-4cc7-b6ce-203469bcb649 req-31d4a8a9-1034-4e53-839e-ffd01fb32078 service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Refreshing instance network info cache due to event network-changed-cec31312-56a9-45d2-a9ff-26a135b50547. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-13109c80-8417-4cc7-b6ce-203469bcb649 req-31d4a8a9-1034-4e53-839e-ffd01fb32078 service nova] Acquiring lock "refresh_cache-895bf22e-1097-46ac-9ef3-a856dcd02349" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG nova.network.neutron [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Updating instance_info_cache with network_info: [{"id": "cec31312-56a9-45d2-a9ff-26a135b50547", "address": "fa:16:3e:db:29:7a", "network": {"id": "54c3b38d-bf3a-445f-b63a-1ba2abfa50f9", "bridge": "br-int", "label": "tempest-TestShelveInstance-976927611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fec444609c0e43f1ad0fbeefbbb7dbb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec31312-56", "ovs_interfaceid": "cec31312-56a9-45d2-a9ff-26a135b50547", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Releasing lock "refresh_cache-895bf22e-1097-46ac-9ef3-a856dcd02349" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 08:21:02 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Creating image(s)
Nov 22 08:21:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Did not create local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Ensure instance console log exists: /opt/stack/data/nova/instances/895bf22e-1097-46ac-9ef3-a856dcd02349/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Start _get_guest_xml network_info=[{"id": "cec31312-56a9-45d2-a9ff-26a135b50547", "address": "fa:16:3e:db:29:7a", "network": {"id": "54c3b38d-bf3a-445f-b63a-1ba2abfa50f9", "bridge": "br-int", "label": "tempest-TestShelveInstance-976927611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fec444609c0e43f1ad0fbeefbbb7dbb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec31312-56", "ovs_interfaceid": "cec31312-56a9-45d2-a9ff-26a135b50547", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uXyEDwnI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '895bf22e-1097-46ac-9ef3-a856dcd02349', 'attached_at': '', 'detached_at': '', 'volume_id': 'd00769d0-fad3-4be1-ba4a-cb7615c344de', 'serial': 'd00769d0-fad3-4be1-ba4a-cb7615c344de'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '765a6a75-f425-406e-b97d-c8ca7be9826b', 'volume_type': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-13109c80-8417-4cc7-b6ce-203469bcb649 req-31d4a8a9-1034-4e53-839e-ffd01fb32078 service nova] Acquired lock "refresh_cache-895bf22e-1097-46ac-9ef3-a856dcd02349" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG nova.network.neutron [req-13109c80-8417-4cc7-b6ce-203469bcb649 req-31d4a8a9-1034-4e53-839e-ffd01fb32078 service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Refreshing network info cache for port cec31312-56a9-45d2-a9ff-26a135b50547 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:21:02 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:21:02 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:21:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG nova.objects.instance [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Lazy-loading 'vcpu_model' on Instance uuid 895bf22e-1097-46ac-9ef3-a856dcd02349 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG nova.objects.base [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Object Instance<895bf22e-1097-46ac-9ef3-a856dcd02349> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uXyEDwnI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:21:02 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:21:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:21:02 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:21:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:21:02 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 08:21:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6554b0d-c858-4aa5-807a-6546cc27f8a1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 08:21:02 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[402d0e89-a36c-494c-9af6-9060bf45052c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de] added
Nov 22 08:21:02 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87d2fb6-5b31-4cce-ac60-22b9927f53df]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb342398-c4ed-46b6-9cc9-26250b375604]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uXyEDwnI {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uXyEDwnI" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c208b44-bec1-469e-8ea4-7541882609d4]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uXyEDwnI'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2579a8-daca-4487-a1fa-59a501a3de13]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd35ac1-1f7c-4209-b147-0d36622191e7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 22 08:21:02 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 22 08:21:02 user nova-compute[74348]:  {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:21:02 user nova-compute[74348]: WARNING os_brick.initiator.connectors.iscsi [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 22 08:21:02 user nova-compute[74348]: 
Nov 22 08:21:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f892ce-9a44-4208-ba66-f3b67e2900bf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de, portal: 172.16.0.220,3260]
Nov 22 08:21:02 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de, portal: 172.16.0.220,3260] successful.
Nov 22 08:21:02 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1051a3d-08ea-41b1-ab5b-6ec3c8ca340b]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c97746-6f41-4fc7-a69a-9715b51de850]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de (non-flash)
Nov 22 08:21:02 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de (non-flash)
Nov 22 08:21:02 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e1f111-4410-4e76-a3d1-0a718ac8dd3e]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uXyEDwnI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG nova.network.neutron [req-13109c80-8417-4cc7-b6ce-203469bcb649 req-31d4a8a9-1034-4e53-839e-ffd01fb32078 service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Updated VIF entry in instance network info cache for port cec31312-56a9-45d2-a9ff-26a135b50547. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG nova.network.neutron [req-13109c80-8417-4cc7-b6ce-203469bcb649 req-31d4a8a9-1034-4e53-839e-ffd01fb32078 service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Updating instance_info_cache with network_info: [{"id": "cec31312-56a9-45d2-a9ff-26a135b50547", "address": "fa:16:3e:db:29:7a", "network": {"id": "54c3b38d-bf3a-445f-b63a-1ba2abfa50f9", "bridge": "br-int", "label": "tempest-TestShelveInstance-976927611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fec444609c0e43f1ad0fbeefbbb7dbb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec31312-56", "ovs_interfaceid": "cec31312-56a9-45d2-a9ff-26a135b50547", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:21:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-13109c80-8417-4cc7-b6ce-203469bcb649 req-31d4a8a9-1034-4e53-839e-ffd01fb32078 service nova] Releasing lock "refresh_cache-895bf22e-1097-46ac-9ef3-a856dcd02349" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:21:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:21:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23933613337363261', 'path': '/dev/sdb'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:21:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933613337363261', 'path': '/dev/sdb'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 08:21:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-22T08:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1023749067',display_name='tempest-TestShelveInstance-server-1023749067',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1023749067',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1832119496',keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:17:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='fec444609c0e43f1ad0fbeefbbb7dbb9',ramdisk_id='',reservation_id='r-sz0m0m2k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1568035397',owner_user_name='tempest-TestShelveInstance-1568035397-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T08:20:54Z,user_data=None,user_id='57494625c8a644ac9958aa3629d4aa62',uuid=895bf22e-1097-46ac-9ef3-a856dcd02349,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "cec31312-56a9-45d2-a9ff-26a135b50547", "address": "fa:16:3e:db:29:7a", "network": {"id": "54c3b38d-bf3a-445f-b63a-1ba2abfa50f9", "bridge": "br-int", "label": "tempest-TestShelveInstance-976927611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fec444609c0e43f1ad0fbeefbbb7dbb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec31312-56", "ovs_interfaceid": "cec31312-56a9-45d2-a9ff-26a135b50547", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 08:21:03 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Converting VIF {"id": "cec31312-56a9-45d2-a9ff-26a135b50547", "address": "fa:16:3e:db:29:7a", "network": {"id": "54c3b38d-bf3a-445f-b63a-1ba2abfa50f9", "bridge": "br-int", "label": "tempest-TestShelveInstance-976927611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fec444609c0e43f1ad0fbeefbbb7dbb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec31312-56", "ovs_interfaceid": "cec31312-56a9-45d2-a9ff-26a135b50547", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:21:03 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:29:7a,bridge_name='br-int',has_traffic_filtering=True,id=cec31312-56a9-45d2-a9ff-26a135b50547,network=Network(54c3b38d-bf3a-445f-b63a-1ba2abfa50f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcec31312-56') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:21:03 user nova-compute[74348]: DEBUG nova.objects.instance [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Lazy-loading 'pci_devices' on Instance uuid 895bf22e-1097-46ac-9ef3-a856dcd02349 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:21:03 user nova-compute[74348]: DEBUG nova.objects.base [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Object Instance<895bf22e-1097-46ac-9ef3-a856dcd02349> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74348) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 08:21:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] End _get_guest_xml xml=<domain type="kvm">
Nov 22 08:21:03 user nova-compute[74348]:   <uuid>895bf22e-1097-46ac-9ef3-a856dcd02349</uuid>
Nov 22 08:21:03 user nova-compute[74348]:   <name>instance-0000002a</name>
Nov 22 08:21:03 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 08:21:03 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 08:21:03 user nova-compute[74348]:   <metadata>
Nov 22 08:21:03 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 08:21:03 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 08:21:03 user nova-compute[74348]:       <nova:name>tempest-TestShelveInstance-server-1023749067</nova:name>
Nov 22 08:21:03 user nova-compute[74348]:       <nova:creationTime>2023-11-22 08:21:02</nova:creationTime>
Nov 22 08:21:03 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 08:21:03 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 08:21:03 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 08:21:03 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 08:21:03 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 08:21:03 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 08:21:03 user nova-compute[74348]:       </nova:flavor>
Nov 22 08:21:03 user nova-compute[74348]:       <nova:owner>
Nov 22 08:21:03 user nova-compute[74348]:         <nova:user uuid="57494625c8a644ac9958aa3629d4aa62">tempest-TestShelveInstance-1568035397-project-member</nova:user>
Nov 22 08:21:03 user nova-compute[74348]:         <nova:project uuid="fec444609c0e43f1ad0fbeefbbb7dbb9">tempest-TestShelveInstance-1568035397</nova:project>
Nov 22 08:21:03 user nova-compute[74348]:       </nova:owner>
Nov 22 08:21:03 user nova-compute[74348]:       <nova:ports>
Nov 22 08:21:03 user nova-compute[74348]:         <nova:port uuid="cec31312-56a9-45d2-a9ff-26a135b50547">
Nov 22 08:21:03 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 22 08:21:03 user nova-compute[74348]:         </nova:port>
Nov 22 08:21:03 user nova-compute[74348]:       </nova:ports>
Nov 22 08:21:03 user nova-compute[74348]:     </nova:instance>
Nov 22 08:21:03 user nova-compute[74348]:   </metadata>
Nov 22 08:21:03 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 08:21:03 user nova-compute[74348]:     <system>
Nov 22 08:21:03 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 08:21:03 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 08:21:03 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 08:21:03 user nova-compute[74348]:       <entry name="serial">895bf22e-1097-46ac-9ef3-a856dcd02349</entry>
Nov 22 08:21:03 user nova-compute[74348]:       <entry name="uuid">895bf22e-1097-46ac-9ef3-a856dcd02349</entry>
Nov 22 08:21:03 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 08:21:03 user nova-compute[74348]:     </system>
Nov 22 08:21:03 user nova-compute[74348]:   </sysinfo>
Nov 22 08:21:03 user nova-compute[74348]:   <os>
Nov 22 08:21:03 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 08:21:03 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 08:21:03 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 08:21:03 user nova-compute[74348]:   </os>
Nov 22 08:21:03 user nova-compute[74348]:   <features>
Nov 22 08:21:03 user nova-compute[74348]:     <acpi/>
Nov 22 08:21:03 user nova-compute[74348]:     <apic/>
Nov 22 08:21:03 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 08:21:03 user nova-compute[74348]:   </features>
Nov 22 08:21:03 user nova-compute[74348]:   <clock offset="utc">
Nov 22 08:21:03 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 08:21:03 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 08:21:03 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 08:21:03 user nova-compute[74348]:   </clock>
Nov 22 08:21:03 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 08:21:03 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 08:21:03 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 08:21:03 user nova-compute[74348]:   </cpu>
Nov 22 08:21:03 user nova-compute[74348]:   <devices>
Nov 22 08:21:03 user nova-compute[74348]:     <disk type="block" device="disk">
Nov 22 08:21:03 user nova-compute[74348]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:21:03 user nova-compute[74348]:       <source dev="/dev/sdb"/>
Nov 22 08:21:03 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 08:21:03 user nova-compute[74348]:       <serial>d00769d0-fad3-4be1-ba4a-cb7615c344de</serial>
Nov 22 08:21:03 user nova-compute[74348]:     </disk>
Nov 22 08:21:03 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 08:21:03 user nova-compute[74348]:       <mac address="fa:16:3e:db:29:7a"/>
Nov 22 08:21:03 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:21:03 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 08:21:03 user nova-compute[74348]:       <target dev="tapcec31312-56"/>
Nov 22 08:21:03 user nova-compute[74348]:     </interface>
Nov 22 08:21:03 user nova-compute[74348]:     <serial type="pty">
Nov 22 08:21:03 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/895bf22e-1097-46ac-9ef3-a856dcd02349/console.log" append="off"/>
Nov 22 08:21:03 user nova-compute[74348]:     </serial>
Nov 22 08:21:03 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 08:21:03 user nova-compute[74348]:     <video>
Nov 22 08:21:03 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:21:03 user nova-compute[74348]:     </video>
Nov 22 08:21:03 user nova-compute[74348]:     <rng model="virtio">
Nov 22 08:21:03 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 08:21:03 user nova-compute[74348]:     </rng>
Nov 22 08:21:03 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 08:21:03 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 08:21:03 user nova-compute[74348]:       <stats period="10"/>
Nov 22 08:21:03 user nova-compute[74348]:     </memballoon>
Nov 22 08:21:03 user nova-compute[74348]:   </devices>
Nov 22 08:21:03 user nova-compute[74348]: </domain>
Nov 22 08:21:03 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 08:21:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-22T08:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1023749067',display_name='tempest-TestShelveInstance-server-1023749067',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1023749067',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1832119496',keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:17:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='fec444609c0e43f1ad0fbeefbbb7dbb9',ramdisk_id='',reservation_id='r-sz0m0m2k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1568035397',owner_user_name='tempest-TestShelveInstance-1568035397-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T08:20:54Z,user_data=None,user_id='57494625c8a644ac9958aa3629d4aa62',uuid=895bf22e-1097-46ac-9ef3-a856dcd02349,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "cec31312-56a9-45d2-a9ff-26a135b50547", "address": "fa:16:3e:db:29:7a", "network": {"id": "54c3b38d-bf3a-445f-b63a-1ba2abfa50f9", "bridge": "br-int", "label": "tempest-TestShelveInstance-976927611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fec444609c0e43f1ad0fbeefbbb7dbb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec31312-56", "ovs_interfaceid": "cec31312-56a9-45d2-a9ff-26a135b50547", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 08:21:03 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Converting VIF {"id": "cec31312-56a9-45d2-a9ff-26a135b50547", "address": "fa:16:3e:db:29:7a", "network": {"id": "54c3b38d-bf3a-445f-b63a-1ba2abfa50f9", "bridge": "br-int", "label": "tempest-TestShelveInstance-976927611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fec444609c0e43f1ad0fbeefbbb7dbb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec31312-56", "ovs_interfaceid": "cec31312-56a9-45d2-a9ff-26a135b50547", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:21:03 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:29:7a,bridge_name='br-int',has_traffic_filtering=True,id=cec31312-56a9-45d2-a9ff-26a135b50547,network=Network(54c3b38d-bf3a-445f-b63a-1ba2abfa50f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcec31312-56') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:21:03 user nova-compute[74348]: DEBUG os_vif [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:29:7a,bridge_name='br-int',has_traffic_filtering=True,id=cec31312-56a9-45d2-a9ff-26a135b50547,network=Network(54c3b38d-bf3a-445f-b63a-1ba2abfa50f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcec31312-56') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 08:21:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:21:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 08:21:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e18c43b6-1289-56f9-a2a3-8c531ae13bef', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:21:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:21:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcec31312-56, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:21:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcec31312-56, col_values=(('qos', UUID('d28660a4-51ac-4799-af67-cf674fa0e983')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:21:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcec31312-56, col_values=(('external_ids', {'iface-id': 'cec31312-56a9-45d2-a9ff-26a135b50547', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:29:7a', 'vm-uuid': '895bf22e-1097-46ac-9ef3-a856dcd02349'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:21:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:21:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:03 user nova-compute[74348]: INFO os_vif [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:29:7a,bridge_name='br-int',has_traffic_filtering=True,id=cec31312-56a9-45d2-a9ff-26a135b50547,network=Network(54c3b38d-bf3a-445f-b63a-1ba2abfa50f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcec31312-56')
Nov 22 08:21:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:21:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] No VIF found with MAC fa:16:3e:db:29:7a, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:21:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:05 user nova-compute[74348]: DEBUG nova.compute.manager [req-e6b80532-9ca8-4ac2-a413-c6019a6d45d0 req-4d2088e4-4ad3-4db5-a839-c780e0e5c728 service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Received event network-vif-plugged-cec31312-56a9-45d2-a9ff-26a135b50547 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:21:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e6b80532-9ca8-4ac2-a413-c6019a6d45d0 req-4d2088e4-4ad3-4db5-a839-c780e0e5c728 service nova] Acquiring lock "895bf22e-1097-46ac-9ef3-a856dcd02349-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:21:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e6b80532-9ca8-4ac2-a413-c6019a6d45d0 req-4d2088e4-4ad3-4db5-a839-c780e0e5c728 service nova] Lock "895bf22e-1097-46ac-9ef3-a856dcd02349-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:21:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e6b80532-9ca8-4ac2-a413-c6019a6d45d0 req-4d2088e4-4ad3-4db5-a839-c780e0e5c728 service nova] Lock "895bf22e-1097-46ac-9ef3-a856dcd02349-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:21:05 user nova-compute[74348]: DEBUG nova.compute.manager [req-e6b80532-9ca8-4ac2-a413-c6019a6d45d0 req-4d2088e4-4ad3-4db5-a839-c780e0e5c728 service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] No waiting events found dispatching network-vif-plugged-cec31312-56a9-45d2-a9ff-26a135b50547 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:21:05 user nova-compute[74348]: WARNING nova.compute.manager [req-e6b80532-9ca8-4ac2-a413-c6019a6d45d0 req-4d2088e4-4ad3-4db5-a839-c780e0e5c728 service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Received unexpected event network-vif-plugged-cec31312-56a9-45d2-a9ff-26a135b50547 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 22 08:21:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:07 user nova-compute[74348]: DEBUG nova.compute.manager [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 08:21:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 08:21:07 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Instance spawned successfully.
Nov 22 08:21:07 user nova-compute[74348]: DEBUG nova.compute.manager [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:21:07 user nova-compute[74348]: DEBUG nova.compute.manager [req-f6c0a1cd-a716-4ded-a8b8-86a3dd848773 req-bb84d262-a106-485c-ba58-1fc31d1fbeaa service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Received event network-vif-plugged-cec31312-56a9-45d2-a9ff-26a135b50547 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:21:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f6c0a1cd-a716-4ded-a8b8-86a3dd848773 req-bb84d262-a106-485c-ba58-1fc31d1fbeaa service nova] Acquiring lock "895bf22e-1097-46ac-9ef3-a856dcd02349-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:21:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f6c0a1cd-a716-4ded-a8b8-86a3dd848773 req-bb84d262-a106-485c-ba58-1fc31d1fbeaa service nova] Lock "895bf22e-1097-46ac-9ef3-a856dcd02349-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:21:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f6c0a1cd-a716-4ded-a8b8-86a3dd848773 req-bb84d262-a106-485c-ba58-1fc31d1fbeaa service nova] Lock "895bf22e-1097-46ac-9ef3-a856dcd02349-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:21:07 user nova-compute[74348]: DEBUG nova.compute.manager [req-f6c0a1cd-a716-4ded-a8b8-86a3dd848773 req-bb84d262-a106-485c-ba58-1fc31d1fbeaa service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] No waiting events found dispatching network-vif-plugged-cec31312-56a9-45d2-a9ff-26a135b50547 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:21:07 user nova-compute[74348]: WARNING nova.compute.manager [req-f6c0a1cd-a716-4ded-a8b8-86a3dd848773 req-bb84d262-a106-485c-ba58-1fc31d1fbeaa service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Received unexpected event network-vif-plugged-cec31312-56a9-45d2-a9ff-26a135b50547 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 22 08:21:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3d01c474-b58f-40f6-893e-827f255c818d tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Lock "895bf22e-1097-46ac-9ef3-a856dcd02349" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.490s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:21:07 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:21:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Acquiring lock "4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:21:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lock "4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:21:24 user nova-compute[74348]: DEBUG nova.compute.manager [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 08:21:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:21:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:21:24 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 08:21:24 user nova-compute[74348]: INFO nova.compute.claims [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Claim successful on node user
Nov 22 08:21:24 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:21:24 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:21:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.239s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:21:24 user nova-compute[74348]: DEBUG nova.compute.manager [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 08:21:24 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:24 user nova-compute[74348]: DEBUG nova.compute.manager [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 08:21:24 user nova-compute[74348]: DEBUG nova.network.neutron [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 08:21:24 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 08:21:24 user nova-compute[74348]: DEBUG nova.compute.manager [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 08:21:24 user nova-compute[74348]: DEBUG nova.policy [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '078c813dade14ab5b9ad1e2f7fa02d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b1c567f5f44bc69012abed3fa2fed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 08:21:24 user nova-compute[74348]: DEBUG nova.compute.manager [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 08:21:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 08:21:24 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Creating image(s)
Nov 22 08:21:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Acquiring lock "/opt/stack/data/nova/instances/4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:21:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lock "/opt/stack/data/nova/instances/4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:21:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lock "/opt/stack/data/nova/instances/4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:21:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:21:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.172s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:21:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Acquiring lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:21:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:21:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:21:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.174s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:21:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723/disk 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:21:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723/disk 1073741824" returned: 0 in 0.058s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:21:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:21:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:21:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.179s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:21:25 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723/disk. size=1073741824 {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 08:21:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:21:25 user nova-compute[74348]: DEBUG nova.network.neutron [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Successfully created port: 7cc1a5d8-94a4-488d-9e21-67bd6037de7f {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 08:21:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:21:25 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Cannot resize image /opt/stack/data/nova/instances/4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723/disk to a smaller size. {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 08:21:25 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 08:21:25 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Ensure instance console log exists: /opt/stack/data/nova/instances/4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 08:21:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:21:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:21:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG nova.network.neutron [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Successfully updated port: 7cc1a5d8-94a4-488d-9e21-67bd6037de7f {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Acquiring lock "refresh_cache-4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Acquired lock "refresh_cache-4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG nova.network.neutron [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG nova.compute.manager [req-44f738c7-f341-4164-8246-989123ca6dd9 req-ab6b4d07-6001-491f-8753-ada28753a693 service nova] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Received event network-changed-7cc1a5d8-94a4-488d-9e21-67bd6037de7f {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG nova.compute.manager [req-44f738c7-f341-4164-8246-989123ca6dd9 req-ab6b4d07-6001-491f-8753-ada28753a693 service nova] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Refreshing instance network info cache due to event network-changed-7cc1a5d8-94a4-488d-9e21-67bd6037de7f. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-44f738c7-f341-4164-8246-989123ca6dd9 req-ab6b4d07-6001-491f-8753-ada28753a693 service nova] Acquiring lock "refresh_cache-4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG nova.network.neutron [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG nova.network.neutron [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Updating instance_info_cache with network_info: [{"id": "7cc1a5d8-94a4-488d-9e21-67bd6037de7f", "address": "fa:16:3e:e6:3a:57", "network": {"id": "d9c6413a-e220-4028-9f88-536d89a316a8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1645865569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66b1c567f5f44bc69012abed3fa2fed7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc1a5d8-94", "ovs_interfaceid": "7cc1a5d8-94a4-488d-9e21-67bd6037de7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Releasing lock "refresh_cache-4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG nova.compute.manager [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Instance network_info: |[{"id": "7cc1a5d8-94a4-488d-9e21-67bd6037de7f", "address": "fa:16:3e:e6:3a:57", "network": {"id": "d9c6413a-e220-4028-9f88-536d89a316a8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1645865569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66b1c567f5f44bc69012abed3fa2fed7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc1a5d8-94", "ovs_interfaceid": "7cc1a5d8-94a4-488d-9e21-67bd6037de7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-44f738c7-f341-4164-8246-989123ca6dd9 req-ab6b4d07-6001-491f-8753-ada28753a693 service nova] Acquired lock "refresh_cache-4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG nova.network.neutron [req-44f738c7-f341-4164-8246-989123ca6dd9 req-ab6b4d07-6001-491f-8753-ada28753a693 service nova] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Refreshing network info cache for port 7cc1a5d8-94a4-488d-9e21-67bd6037de7f {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Start _get_guest_xml network_info=[{"id": "7cc1a5d8-94a4-488d-9e21-67bd6037de7f", "address": "fa:16:3e:e6:3a:57", "network": {"id": "d9c6413a-e220-4028-9f88-536d89a316a8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1645865569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66b1c567f5f44bc69012abed3fa2fed7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc1a5d8-94", "ovs_interfaceid": "7cc1a5d8-94a4-488d-9e21-67bd6037de7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 08:21:26 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:21:26 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:21:26 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:21:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-978729776',display_name='tempest-TestServerVolumeAttachmentScenario-server-978729776',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-978729776',id=44,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYUGQB4vRXX5DkLw14hSn8vU2Is8kzEso+0vODv3bsSkpqbzmdULqxpRzdnotLNV5SJ86y4SDRvFcNzezPcV419teVrBfc+MAClFb8K7moG/xDnDryK6nrzzAa0+R03Uw==',key_name='tempest-keypair-789713225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66b1c567f5f44bc69012abed3fa2fed7',ramdisk_id='',reservation_id='r-pkyzxsc9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-318747544',owner_user_name='tempest-TestServerVolumeAttachmentScenario-318747544-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:21:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='078c813dade14ab5b9ad1e2f7fa02d65',uuid=4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cc1a5d8-94a4-488d-9e21-67bd6037de7f", "address": "fa:16:3e:e6:3a:57", "network": {"id": "d9c6413a-e220-4028-9f88-536d89a316a8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1645865569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66b1c567f5f44bc69012abed3fa2fed7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc1a5d8-94", "ovs_interfaceid": "7cc1a5d8-94a4-488d-9e21-67bd6037de7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Converting VIF {"id": "7cc1a5d8-94a4-488d-9e21-67bd6037de7f", "address": "fa:16:3e:e6:3a:57", "network": {"id": "d9c6413a-e220-4028-9f88-536d89a316a8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1645865569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66b1c567f5f44bc69012abed3fa2fed7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc1a5d8-94", "ovs_interfaceid": "7cc1a5d8-94a4-488d-9e21-67bd6037de7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:3a:57,bridge_name='br-int',has_traffic_filtering=True,id=7cc1a5d8-94a4-488d-9e21-67bd6037de7f,network=Network(d9c6413a-e220-4028-9f88-536d89a316a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc1a5d8-94') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG nova.objects.instance [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lazy-loading 'pci_devices' on Instance uuid 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] End _get_guest_xml xml=<domain type="kvm">
Nov 22 08:21:26 user nova-compute[74348]:   <uuid>4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723</uuid>
Nov 22 08:21:26 user nova-compute[74348]:   <name>instance-0000002c</name>
Nov 22 08:21:26 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 08:21:26 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 08:21:26 user nova-compute[74348]:   <metadata>
Nov 22 08:21:26 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 08:21:26 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 08:21:26 user nova-compute[74348]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-978729776</nova:name>
Nov 22 08:21:26 user nova-compute[74348]:       <nova:creationTime>2023-11-22 08:21:26</nova:creationTime>
Nov 22 08:21:26 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 08:21:26 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 08:21:26 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 08:21:26 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 08:21:26 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 08:21:26 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 08:21:26 user nova-compute[74348]:       </nova:flavor>
Nov 22 08:21:26 user nova-compute[74348]:       <nova:owner>
Nov 22 08:21:26 user nova-compute[74348]:         <nova:user uuid="078c813dade14ab5b9ad1e2f7fa02d65">tempest-TestServerVolumeAttachmentScenario-318747544-project-member</nova:user>
Nov 22 08:21:26 user nova-compute[74348]:         <nova:project uuid="66b1c567f5f44bc69012abed3fa2fed7">tempest-TestServerVolumeAttachmentScenario-318747544</nova:project>
Nov 22 08:21:26 user nova-compute[74348]:       </nova:owner>
Nov 22 08:21:26 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 08:21:26 user nova-compute[74348]:       <nova:ports>
Nov 22 08:21:26 user nova-compute[74348]:         <nova:port uuid="7cc1a5d8-94a4-488d-9e21-67bd6037de7f">
Nov 22 08:21:26 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 22 08:21:26 user nova-compute[74348]:         </nova:port>
Nov 22 08:21:26 user nova-compute[74348]:       </nova:ports>
Nov 22 08:21:26 user nova-compute[74348]:     </nova:instance>
Nov 22 08:21:26 user nova-compute[74348]:   </metadata>
Nov 22 08:21:26 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 08:21:26 user nova-compute[74348]:     <system>
Nov 22 08:21:26 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 08:21:26 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 08:21:26 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 08:21:26 user nova-compute[74348]:       <entry name="serial">4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723</entry>
Nov 22 08:21:26 user nova-compute[74348]:       <entry name="uuid">4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723</entry>
Nov 22 08:21:26 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 08:21:26 user nova-compute[74348]:     </system>
Nov 22 08:21:26 user nova-compute[74348]:   </sysinfo>
Nov 22 08:21:26 user nova-compute[74348]:   <os>
Nov 22 08:21:26 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 08:21:26 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 08:21:26 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 08:21:26 user nova-compute[74348]:   </os>
Nov 22 08:21:26 user nova-compute[74348]:   <features>
Nov 22 08:21:26 user nova-compute[74348]:     <acpi/>
Nov 22 08:21:26 user nova-compute[74348]:     <apic/>
Nov 22 08:21:26 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 08:21:26 user nova-compute[74348]:   </features>
Nov 22 08:21:26 user nova-compute[74348]:   <clock offset="utc">
Nov 22 08:21:26 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 08:21:26 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 08:21:26 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 08:21:26 user nova-compute[74348]:   </clock>
Nov 22 08:21:26 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 08:21:26 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 08:21:26 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 08:21:26 user nova-compute[74348]:   </cpu>
Nov 22 08:21:26 user nova-compute[74348]:   <devices>
Nov 22 08:21:26 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 08:21:26 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 08:21:26 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723/disk"/>
Nov 22 08:21:26 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 08:21:26 user nova-compute[74348]:     </disk>
Nov 22 08:21:26 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 08:21:26 user nova-compute[74348]:       <mac address="fa:16:3e:e6:3a:57"/>
Nov 22 08:21:26 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:21:26 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 08:21:26 user nova-compute[74348]:       <target dev="tap7cc1a5d8-94"/>
Nov 22 08:21:26 user nova-compute[74348]:     </interface>
Nov 22 08:21:26 user nova-compute[74348]:     <serial type="pty">
Nov 22 08:21:26 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723/console.log" append="off"/>
Nov 22 08:21:26 user nova-compute[74348]:     </serial>
Nov 22 08:21:26 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 08:21:26 user nova-compute[74348]:     <video>
Nov 22 08:21:26 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:21:26 user nova-compute[74348]:     </video>
Nov 22 08:21:26 user nova-compute[74348]:     <rng model="virtio">
Nov 22 08:21:26 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 08:21:26 user nova-compute[74348]:     </rng>
Nov 22 08:21:26 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 08:21:26 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 08:21:26 user nova-compute[74348]:       <stats period="10"/>
Nov 22 08:21:26 user nova-compute[74348]:     </memballoon>
Nov 22 08:21:26 user nova-compute[74348]:   </devices>
Nov 22 08:21:26 user nova-compute[74348]: </domain>
Nov 22 08:21:26 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:21:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-978729776',display_name='tempest-TestServerVolumeAttachmentScenario-server-978729776',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-978729776',id=44,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYUGQB4vRXX5DkLw14hSn8vU2Is8kzEso+0vODv3bsSkpqbzmdULqxpRzdnotLNV5SJ86y4SDRvFcNzezPcV419teVrBfc+MAClFb8K7moG/xDnDryK6nrzzAa0+R03Uw==',key_name='tempest-keypair-789713225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66b1c567f5f44bc69012abed3fa2fed7',ramdisk_id='',reservation_id='r-pkyzxsc9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-318747544',owner_user_name='tempest-TestServerVolumeAttachmentScenario-318747544-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:21:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='078c813dade14ab5b9ad1e2f7fa02d65',uuid=4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cc1a5d8-94a4-488d-9e21-67bd6037de7f", "address": "fa:16:3e:e6:3a:57", "network": {"id": "d9c6413a-e220-4028-9f88-536d89a316a8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1645865569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66b1c567f5f44bc69012abed3fa2fed7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc1a5d8-94", "ovs_interfaceid": "7cc1a5d8-94a4-488d-9e21-67bd6037de7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Converting VIF {"id": "7cc1a5d8-94a4-488d-9e21-67bd6037de7f", "address": "fa:16:3e:e6:3a:57", "network": {"id": "d9c6413a-e220-4028-9f88-536d89a316a8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1645865569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66b1c567f5f44bc69012abed3fa2fed7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc1a5d8-94", "ovs_interfaceid": "7cc1a5d8-94a4-488d-9e21-67bd6037de7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:3a:57,bridge_name='br-int',has_traffic_filtering=True,id=7cc1a5d8-94a4-488d-9e21-67bd6037de7f,network=Network(d9c6413a-e220-4028-9f88-536d89a316a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc1a5d8-94') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG os_vif [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:3a:57,bridge_name='br-int',has_traffic_filtering=True,id=7cc1a5d8-94a4-488d-9e21-67bd6037de7f,network=Network(d9c6413a-e220-4028-9f88-536d89a316a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc1a5d8-94') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f5e4831a-61ba-5ae7-b212-9f39e5166d36', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7cc1a5d8-94, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7cc1a5d8-94, col_values=(('qos', UUID('ae201233-a0c6-4805-96be-12df17761533')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7cc1a5d8-94, col_values=(('external_ids', {'iface-id': '7cc1a5d8-94a4-488d-9e21-67bd6037de7f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:3a:57', 'vm-uuid': '4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:26 user nova-compute[74348]: INFO os_vif [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:3a:57,bridge_name='br-int',has_traffic_filtering=True,id=7cc1a5d8-94a4-488d-9e21-67bd6037de7f,network=Network(d9c6413a-e220-4028-9f88-536d89a316a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc1a5d8-94')
Nov 22 08:21:26 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] No VIF found with MAC fa:16:3e:e6:3a:57, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG nova.network.neutron [req-44f738c7-f341-4164-8246-989123ca6dd9 req-ab6b4d07-6001-491f-8753-ada28753a693 service nova] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Updated VIF entry in instance network info cache for port 7cc1a5d8-94a4-488d-9e21-67bd6037de7f. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG nova.network.neutron [req-44f738c7-f341-4164-8246-989123ca6dd9 req-ab6b4d07-6001-491f-8753-ada28753a693 service nova] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Updating instance_info_cache with network_info: [{"id": "7cc1a5d8-94a4-488d-9e21-67bd6037de7f", "address": "fa:16:3e:e6:3a:57", "network": {"id": "d9c6413a-e220-4028-9f88-536d89a316a8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1645865569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66b1c567f5f44bc69012abed3fa2fed7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc1a5d8-94", "ovs_interfaceid": "7cc1a5d8-94a4-488d-9e21-67bd6037de7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:21:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-44f738c7-f341-4164-8246-989123ca6dd9 req-ab6b4d07-6001-491f-8753-ada28753a693 service nova] Releasing lock "refresh_cache-4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:21:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:28 user nova-compute[74348]: DEBUG nova.compute.manager [req-f4ce7a7c-59f7-43bd-94e0-ea43a13dcff0 req-e2181908-92b8-4495-aed8-12e67f21ad70 service nova] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Received event network-vif-plugged-7cc1a5d8-94a4-488d-9e21-67bd6037de7f {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:21:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f4ce7a7c-59f7-43bd-94e0-ea43a13dcff0 req-e2181908-92b8-4495-aed8-12e67f21ad70 service nova] Acquiring lock "4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:21:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f4ce7a7c-59f7-43bd-94e0-ea43a13dcff0 req-e2181908-92b8-4495-aed8-12e67f21ad70 service nova] Lock "4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:21:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f4ce7a7c-59f7-43bd-94e0-ea43a13dcff0 req-e2181908-92b8-4495-aed8-12e67f21ad70 service nova] Lock "4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:21:28 user nova-compute[74348]: DEBUG nova.compute.manager [req-f4ce7a7c-59f7-43bd-94e0-ea43a13dcff0 req-e2181908-92b8-4495-aed8-12e67f21ad70 service nova] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] No waiting events found dispatching network-vif-plugged-7cc1a5d8-94a4-488d-9e21-67bd6037de7f {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:21:28 user nova-compute[74348]: WARNING nova.compute.manager [req-f4ce7a7c-59f7-43bd-94e0-ea43a13dcff0 req-e2181908-92b8-4495-aed8-12e67f21ad70 service nova] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Received unexpected event network-vif-plugged-7cc1a5d8-94a4-488d-9e21-67bd6037de7f for instance with vm_state building and task_state spawning.
Nov 22 08:21:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:30 user nova-compute[74348]: DEBUG nova.compute.manager [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 08:21:30 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 08:21:30 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Instance spawned successfully.
Nov 22 08:21:30 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 08:21:30 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:21:30 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:21:30 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:21:30 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:21:30 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:21:30 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:21:30 user nova-compute[74348]: INFO nova.compute.manager [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Took 5.26 seconds to spawn the instance on the hypervisor.
Nov 22 08:21:30 user nova-compute[74348]: DEBUG nova.compute.manager [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:21:30 user nova-compute[74348]: INFO nova.compute.manager [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Took 5.81 seconds to build instance.
Nov 22 08:21:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-8298e7d5-61fe-4933-abed-0b5329682dd9 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lock "4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.965s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:21:30 user nova-compute[74348]: DEBUG nova.compute.manager [req-7670bc7d-1176-4a84-bca5-b7f6798673eb req-04528c02-ce6d-4003-ab03-178a49ba248a service nova] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Received event network-vif-plugged-7cc1a5d8-94a4-488d-9e21-67bd6037de7f {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:21:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-7670bc7d-1176-4a84-bca5-b7f6798673eb req-04528c02-ce6d-4003-ab03-178a49ba248a service nova] Acquiring lock "4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:21:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-7670bc7d-1176-4a84-bca5-b7f6798673eb req-04528c02-ce6d-4003-ab03-178a49ba248a service nova] Lock "4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:21:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-7670bc7d-1176-4a84-bca5-b7f6798673eb req-04528c02-ce6d-4003-ab03-178a49ba248a service nova] Lock "4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:21:30 user nova-compute[74348]: DEBUG nova.compute.manager [req-7670bc7d-1176-4a84-bca5-b7f6798673eb req-04528c02-ce6d-4003-ab03-178a49ba248a service nova] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] No waiting events found dispatching network-vif-plugged-7cc1a5d8-94a4-488d-9e21-67bd6037de7f {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:21:30 user nova-compute[74348]: WARNING nova.compute.manager [req-7670bc7d-1176-4a84-bca5-b7f6798673eb req-04528c02-ce6d-4003-ab03-178a49ba248a service nova] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Received unexpected event network-vif-plugged-7cc1a5d8-94a4-488d-9e21-67bd6037de7f for instance with vm_state active and task_state None.
Nov 22 08:21:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:36 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:44 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:46 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:49 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:21:49 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:21:49 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Rebuilding the list of instances to heal {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 08:21:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-895bf22e-1097-46ac-9ef3-a856dcd02349" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:21:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-895bf22e-1097-46ac-9ef3-a856dcd02349" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:21:49 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 08:21:49 user nova-compute[74348]: DEBUG nova.objects.instance [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lazy-loading 'info_cache' on Instance uuid 895bf22e-1097-46ac-9ef3-a856dcd02349 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:21:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:50 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Updating instance_info_cache with network_info: [{"id": "cec31312-56a9-45d2-a9ff-26a135b50547", "address": "fa:16:3e:db:29:7a", "network": {"id": "54c3b38d-bf3a-445f-b63a-1ba2abfa50f9", "bridge": "br-int", "label": "tempest-TestShelveInstance-976927611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fec444609c0e43f1ad0fbeefbbb7dbb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec31312-56", "ovs_interfaceid": "cec31312-56a9-45d2-a9ff-26a135b50547", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:21:50 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-895bf22e-1097-46ac-9ef3-a856dcd02349" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:21:50 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 08:21:51 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:54 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:21:54 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:21:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:55 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:21:55 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:21:56 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:21:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:21:57 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:21:58 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:21:59 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:21:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:22:00 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:22:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:22:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:22:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:22:00 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:22:00 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:22:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c5dfc5-e414-4676-bc1e-06a85fcfd7c2/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:22:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c5dfc5-e414-4676-bc1e-06a85fcfd7c2/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:22:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c5dfc5-e414-4676-bc1e-06a85fcfd7c2/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:22:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c5dfc5-e414-4676-bc1e-06a85fcfd7c2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:22:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:22:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:22:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:22:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:22:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:22:01 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:22:01 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:22:01 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=8660MB free_disk=24.926319122314453GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:22:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:22:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:22:01 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:22:01 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 895bf22e-1097-46ac-9ef3-a856dcd02349 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:22:01 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:22:01 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:22:01 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:22:02 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:22:02 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:22:02 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:22:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.255s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:22:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:22:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:22:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:22:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:22:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:22:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:22:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:22:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:22:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:22:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:22:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:22:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:22:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:22:21 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:22:21 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:22:21 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:22:21 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:22:21 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:22:21 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:22:26 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:22:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:22:36 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:22:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7d026e98-b91a-45b0-a29a-d3fb2e87d7eb tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Acquiring lock "11c5dfc5-e414-4676-bc1e-06a85fcfd7c2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:22:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7d026e98-b91a-45b0-a29a-d3fb2e87d7eb tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Lock "11c5dfc5-e414-4676-bc1e-06a85fcfd7c2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:22:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7d026e98-b91a-45b0-a29a-d3fb2e87d7eb tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Acquiring lock "11c5dfc5-e414-4676-bc1e-06a85fcfd7c2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:22:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7d026e98-b91a-45b0-a29a-d3fb2e87d7eb tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Lock "11c5dfc5-e414-4676-bc1e-06a85fcfd7c2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:22:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7d026e98-b91a-45b0-a29a-d3fb2e87d7eb tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Lock "11c5dfc5-e414-4676-bc1e-06a85fcfd7c2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:22:41 user nova-compute[74348]: INFO nova.compute.manager [None req-7d026e98-b91a-45b0-a29a-d3fb2e87d7eb tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Terminating instance
Nov 22 08:22:41 user nova-compute[74348]: DEBUG nova.compute.manager [None req-7d026e98-b91a-45b0-a29a-d3fb2e87d7eb tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 08:22:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:22:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:22:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:22:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:22:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:22:42 user nova-compute[74348]: DEBUG nova.compute.manager [req-910bba72-36f9-4beb-8d16-84f2aa1233a1 req-221d4e4e-c66b-4e82-a7ba-e07ea5828743 service nova] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Received event network-vif-unplugged-81234fa3-f64a-43dd-a217-74df297018a1 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:22:42 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-910bba72-36f9-4beb-8d16-84f2aa1233a1 req-221d4e4e-c66b-4e82-a7ba-e07ea5828743 service nova] Acquiring lock "11c5dfc5-e414-4676-bc1e-06a85fcfd7c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:22:42 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-910bba72-36f9-4beb-8d16-84f2aa1233a1 req-221d4e4e-c66b-4e82-a7ba-e07ea5828743 service nova] Lock "11c5dfc5-e414-4676-bc1e-06a85fcfd7c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:22:42 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-910bba72-36f9-4beb-8d16-84f2aa1233a1 req-221d4e4e-c66b-4e82-a7ba-e07ea5828743 service nova] Lock "11c5dfc5-e414-4676-bc1e-06a85fcfd7c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:22:42 user nova-compute[74348]: DEBUG nova.compute.manager [req-910bba72-36f9-4beb-8d16-84f2aa1233a1 req-221d4e4e-c66b-4e82-a7ba-e07ea5828743 service nova] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] No waiting events found dispatching network-vif-unplugged-81234fa3-f64a-43dd-a217-74df297018a1 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:22:42 user nova-compute[74348]: DEBUG nova.compute.manager [req-910bba72-36f9-4beb-8d16-84f2aa1233a1 req-221d4e4e-c66b-4e82-a7ba-e07ea5828743 service nova] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Received event network-vif-unplugged-81234fa3-f64a-43dd-a217-74df297018a1 for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 08:22:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:22:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:22:42 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Instance destroyed successfully.
Nov 22 08:22:42 user nova-compute[74348]: DEBUG nova.objects.instance [None req-7d026e98-b91a-45b0-a29a-d3fb2e87d7eb tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Lazy-loading 'resources' on Instance uuid 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:22:42 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-7d026e98-b91a-45b0-a29a-d3fb2e87d7eb tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:20:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1565976574',display_name='tempest-VolumesActionsTest-instance-1565976574',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1565976574',id=43,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:20:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96ab03f00a19408e80660a5c4de957f7',ramdisk_id='',reservation_id='r-f8b08fp5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-395866833',owner_user_name='tempest-VolumesActionsTest-395866833-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T08:20:51Z,user_data=None,user_id='53eb92cbaf064fe6b36824f24401b874',uuid=11c5dfc5-e414-4676-bc1e-06a85fcfd7c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81234fa3-f64a-43dd-a217-74df297018a1", "address": "fa:16:3e:f2:89:77", "network": {"id": "0c8e2736-63a5-4818-9b41-11fb918863ac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-354472038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ab03f00a19408e80660a5c4de957f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81234fa3-f6", "ovs_interfaceid": "81234fa3-f64a-43dd-a217-74df297018a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:22:42 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-7d026e98-b91a-45b0-a29a-d3fb2e87d7eb tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Converting VIF {"id": "81234fa3-f64a-43dd-a217-74df297018a1", "address": "fa:16:3e:f2:89:77", "network": {"id": "0c8e2736-63a5-4818-9b41-11fb918863ac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-354472038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ab03f00a19408e80660a5c4de957f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81234fa3-f6", "ovs_interfaceid": "81234fa3-f64a-43dd-a217-74df297018a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:22:42 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-7d026e98-b91a-45b0-a29a-d3fb2e87d7eb tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:89:77,bridge_name='br-int',has_traffic_filtering=True,id=81234fa3-f64a-43dd-a217-74df297018a1,network=Network(0c8e2736-63a5-4818-9b41-11fb918863ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81234fa3-f6') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:22:42 user nova-compute[74348]: DEBUG os_vif [None req-7d026e98-b91a-45b0-a29a-d3fb2e87d7eb tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:89:77,bridge_name='br-int',has_traffic_filtering=True,id=81234fa3-f64a-43dd-a217-74df297018a1,network=Network(0c8e2736-63a5-4818-9b41-11fb918863ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81234fa3-f6') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:22:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:22:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81234fa3-f6, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:22:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:22:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:22:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:22:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a689e9f8-8666-43c3-a9fa-724a17968b71) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:22:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:22:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:22:42 user nova-compute[74348]: INFO os_vif [None req-7d026e98-b91a-45b0-a29a-d3fb2e87d7eb tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:89:77,bridge_name='br-int',has_traffic_filtering=True,id=81234fa3-f64a-43dd-a217-74df297018a1,network=Network(0c8e2736-63a5-4818-9b41-11fb918863ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81234fa3-f6')
Nov 22 08:22:42 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-7d026e98-b91a-45b0-a29a-d3fb2e87d7eb tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Deleting instance files /opt/stack/data/nova/instances/11c5dfc5-e414-4676-bc1e-06a85fcfd7c2_del
Nov 22 08:22:42 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-7d026e98-b91a-45b0-a29a-d3fb2e87d7eb tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Deletion of /opt/stack/data/nova/instances/11c5dfc5-e414-4676-bc1e-06a85fcfd7c2_del complete
Nov 22 08:22:42 user nova-compute[74348]: INFO nova.compute.manager [None req-7d026e98-b91a-45b0-a29a-d3fb2e87d7eb tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 22 08:22:42 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-7d026e98-b91a-45b0-a29a-d3fb2e87d7eb tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 08:22:42 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 08:22:42 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 08:22:43 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:22:43 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Took 0.40 seconds to deallocate network for instance.
Nov 22 08:22:43 user nova-compute[74348]: DEBUG nova.compute.manager [req-9a6f56c4-3e70-4fec-950f-70369851f036 req-3ece7a8e-c1a6-484a-8850-7322046b69f1 service nova] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Received event network-vif-deleted-81234fa3-f64a-43dd-a217-74df297018a1 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:22:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7d026e98-b91a-45b0-a29a-d3fb2e87d7eb tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:22:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7d026e98-b91a-45b0-a29a-d3fb2e87d7eb tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:22:43 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-7d026e98-b91a-45b0-a29a-d3fb2e87d7eb tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:22:43 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-7d026e98-b91a-45b0-a29a-d3fb2e87d7eb tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:22:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7d026e98-b91a-45b0-a29a-d3fb2e87d7eb tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.170s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:22:43 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-7d026e98-b91a-45b0-a29a-d3fb2e87d7eb tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Deleted allocations for instance 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2
Nov 22 08:22:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-7d026e98-b91a-45b0-a29a-d3fb2e87d7eb tempest-VolumesActionsTest-395866833 tempest-VolumesActionsTest-395866833-project-member] Lock "11c5dfc5-e414-4676-bc1e-06a85fcfd7c2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.632s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:22:44 user nova-compute[74348]: DEBUG nova.compute.manager [req-d59c3450-de22-4807-ba51-b1749d2f2464 req-205a6de2-d722-420d-b473-cabd4ec72b1b service nova] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Received event network-vif-plugged-81234fa3-f64a-43dd-a217-74df297018a1 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:22:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d59c3450-de22-4807-ba51-b1749d2f2464 req-205a6de2-d722-420d-b473-cabd4ec72b1b service nova] Acquiring lock "11c5dfc5-e414-4676-bc1e-06a85fcfd7c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:22:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d59c3450-de22-4807-ba51-b1749d2f2464 req-205a6de2-d722-420d-b473-cabd4ec72b1b service nova] Lock "11c5dfc5-e414-4676-bc1e-06a85fcfd7c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:22:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d59c3450-de22-4807-ba51-b1749d2f2464 req-205a6de2-d722-420d-b473-cabd4ec72b1b service nova] Lock "11c5dfc5-e414-4676-bc1e-06a85fcfd7c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:22:44 user nova-compute[74348]: DEBUG nova.compute.manager [req-d59c3450-de22-4807-ba51-b1749d2f2464 req-205a6de2-d722-420d-b473-cabd4ec72b1b service nova] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] No waiting events found dispatching network-vif-plugged-81234fa3-f64a-43dd-a217-74df297018a1 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:22:44 user nova-compute[74348]: WARNING nova.compute.manager [req-d59c3450-de22-4807-ba51-b1749d2f2464 req-205a6de2-d722-420d-b473-cabd4ec72b1b service nova] [instance: 11c5dfc5-e414-4676-bc1e-06a85fcfd7c2] Received unexpected event network-vif-plugged-81234fa3-f64a-43dd-a217-74df297018a1 for instance with vm_state deleted and task_state None.
Nov 22 08:22:44 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:22:45 user nova-compute[74348]: DEBUG nova.compute.manager [req-0a1360b1-2e46-4656-943e-ee9383b8e190 req-a07c0ce1-ec5f-4341-856a-60ca14e45b4d service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Received event network-changed-cec31312-56a9-45d2-a9ff-26a135b50547 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:22:45 user nova-compute[74348]: DEBUG nova.compute.manager [req-0a1360b1-2e46-4656-943e-ee9383b8e190 req-a07c0ce1-ec5f-4341-856a-60ca14e45b4d service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Refreshing instance network info cache due to event network-changed-cec31312-56a9-45d2-a9ff-26a135b50547. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:22:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-0a1360b1-2e46-4656-943e-ee9383b8e190 req-a07c0ce1-ec5f-4341-856a-60ca14e45b4d service nova] Acquiring lock "refresh_cache-895bf22e-1097-46ac-9ef3-a856dcd02349" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:22:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-0a1360b1-2e46-4656-943e-ee9383b8e190 req-a07c0ce1-ec5f-4341-856a-60ca14e45b4d service nova] Acquired lock "refresh_cache-895bf22e-1097-46ac-9ef3-a856dcd02349" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:22:45 user nova-compute[74348]: DEBUG nova.network.neutron [req-0a1360b1-2e46-4656-943e-ee9383b8e190 req-a07c0ce1-ec5f-4341-856a-60ca14e45b4d service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Refreshing network info cache for port cec31312-56a9-45d2-a9ff-26a135b50547 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:22:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Acquiring lock "895bf22e-1097-46ac-9ef3-a856dcd02349" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:22:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Lock "895bf22e-1097-46ac-9ef3-a856dcd02349" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:22:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Acquiring lock "895bf22e-1097-46ac-9ef3-a856dcd02349-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:22:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Lock "895bf22e-1097-46ac-9ef3-a856dcd02349-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:22:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Lock "895bf22e-1097-46ac-9ef3-a856dcd02349-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:22:45 user nova-compute[74348]: INFO nova.compute.manager [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Terminating instance
Nov 22 08:22:45 user nova-compute[74348]: DEBUG nova.compute.manager [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 08:22:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:22:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:22:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:22:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:22:45 user nova-compute[74348]: DEBUG nova.network.neutron [req-0a1360b1-2e46-4656-943e-ee9383b8e190 req-a07c0ce1-ec5f-4341-856a-60ca14e45b4d service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Updated VIF entry in instance network info cache for port cec31312-56a9-45d2-a9ff-26a135b50547. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:22:45 user nova-compute[74348]: DEBUG nova.network.neutron [req-0a1360b1-2e46-4656-943e-ee9383b8e190 req-a07c0ce1-ec5f-4341-856a-60ca14e45b4d service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Updating instance_info_cache with network_info: [{"id": "cec31312-56a9-45d2-a9ff-26a135b50547", "address": "fa:16:3e:db:29:7a", "network": {"id": "54c3b38d-bf3a-445f-b63a-1ba2abfa50f9", "bridge": "br-int", "label": "tempest-TestShelveInstance-976927611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fec444609c0e43f1ad0fbeefbbb7dbb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec31312-56", "ovs_interfaceid": "cec31312-56a9-45d2-a9ff-26a135b50547", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:22:45 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-0a1360b1-2e46-4656-943e-ee9383b8e190 req-a07c0ce1-ec5f-4341-856a-60ca14e45b4d service nova] Releasing lock "refresh_cache-895bf22e-1097-46ac-9ef3-a856dcd02349" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:22:46 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Instance destroyed successfully.
Nov 22 08:22:46 user nova-compute[74348]: DEBUG nova.objects.instance [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Lazy-loading 'resources' on Instance uuid 895bf22e-1097-46ac-9ef3-a856dcd02349 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-22T08:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1023749067',display_name='tempest-TestShelveInstance-server-1023749067',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1023749067',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQebmH//Rl+dhu9Au8fBShXkal/oh0e6f5bQcxoS9pvLz6J1nQsCObUIl2aEFzc1wk+4Cn+eg9z+dEtpapl5Xv45FLNHf1+5LcxX2U0tOBMa4V6J0s5p8OW5pIkN3FRoQ==',key_name='tempest-TestShelveInstance-1832119496',keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:21:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fec444609c0e43f1ad0fbeefbbb7dbb9',ramdisk_id='',reservation_id='r-sz0m0m2k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1568035397',owner_user_name='tempest-TestShelveInstance-1568035397-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T08:21:08Z,user_data=None,user_id='57494625c8a644ac9958aa3629d4aa62',uuid=895bf22e-1097-46ac-9ef3-a856dcd02349,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cec31312-56a9-45d2-a9ff-26a135b50547", "address": "fa:16:3e:db:29:7a", "network": {"id": "54c3b38d-bf3a-445f-b63a-1ba2abfa50f9", "bridge": "br-int", "label": "tempest-TestShelveInstance-976927611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fec444609c0e43f1ad0fbeefbbb7dbb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec31312-56", "ovs_interfaceid": "cec31312-56a9-45d2-a9ff-26a135b50547", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Converting VIF {"id": "cec31312-56a9-45d2-a9ff-26a135b50547", "address": "fa:16:3e:db:29:7a", "network": {"id": "54c3b38d-bf3a-445f-b63a-1ba2abfa50f9", "bridge": "br-int", "label": "tempest-TestShelveInstance-976927611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fec444609c0e43f1ad0fbeefbbb7dbb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec31312-56", "ovs_interfaceid": "cec31312-56a9-45d2-a9ff-26a135b50547", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:29:7a,bridge_name='br-int',has_traffic_filtering=True,id=cec31312-56a9-45d2-a9ff-26a135b50547,network=Network(54c3b38d-bf3a-445f-b63a-1ba2abfa50f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcec31312-56') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG os_vif [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:29:7a,bridge_name='br-int',has_traffic_filtering=True,id=cec31312-56a9-45d2-a9ff-26a135b50547,network=Network(54c3b38d-bf3a-445f-b63a-1ba2abfa50f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcec31312-56') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcec31312-56, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d28660a4-51ac-4799-af67-cf674fa0e983) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:22:46 user nova-compute[74348]: INFO os_vif [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:29:7a,bridge_name='br-int',has_traffic_filtering=True,id=cec31312-56a9-45d2-a9ff-26a135b50547,network=Network(54c3b38d-bf3a-445f-b63a-1ba2abfa50f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcec31312-56')
Nov 22 08:22:46 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uXyEDwnI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:22:46 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:22:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[319e282e-d0ff-4b4c-bea3-9fcb2a849ac8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 08:22:46 user nova-compute[74348]: No targets found.
Nov 22 08:22:46 user nova-compute[74348]: iSNS:
Nov 22 08:22:46 user nova-compute[74348]: No targets found.
Nov 22 08:22:46 user nova-compute[74348]: STATIC:
Nov 22 08:22:46 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de
Nov 22 08:22:46 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:22:46 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:22:46 user nova-compute[74348]: FIRMWARE:
Nov 22 08:22:46 user nova-compute[74348]: No targets found.
Nov 22 08:22:46 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 08:22:46 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 08:22:46 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6d9114-6a5c-4af7-8347-3c41cb448e24]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3c865d-8088-4cf0-90c1-39a6eec559c5]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de (non-flash)
Nov 22 08:22:46 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de (non-flash)
Nov 22 08:22:46 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2228369630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de'): ({'sdb'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Removing single pathed devices sdb {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fefd8d-8227-4e01-984e-713f767762c7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG nova.compute.manager [req-f6f2de9b-3d95-4f48-836e-81b3d9c6fa42 req-07976535-705e-46e9-b7ba-e831b49fb926 service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Received event network-vif-unplugged-cec31312-56a9-45d2-a9ff-26a135b50547 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f6f2de9b-3d95-4f48-836e-81b3d9c6fa42 req-07976535-705e-46e9-b7ba-e831b49fb926 service nova] Acquiring lock "895bf22e-1097-46ac-9ef3-a856dcd02349-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f6f2de9b-3d95-4f48-836e-81b3d9c6fa42 req-07976535-705e-46e9-b7ba-e831b49fb926 service nova] Lock "895bf22e-1097-46ac-9ef3-a856dcd02349-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f6f2de9b-3d95-4f48-836e-81b3d9c6fa42 req-07976535-705e-46e9-b7ba-e831b49fb926 service nova] Lock "895bf22e-1097-46ac-9ef3-a856dcd02349-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG nova.compute.manager [req-f6f2de9b-3d95-4f48-836e-81b3d9c6fa42 req-07976535-705e-46e9-b7ba-e831b49fb926 service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] No waiting events found dispatching network-vif-unplugged-cec31312-56a9-45d2-a9ff-26a135b50547 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG nova.compute.manager [req-f6f2de9b-3d95-4f48-836e-81b3d9c6fa42 req-07976535-705e-46e9-b7ba-e831b49fb926 service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Received event network-vif-unplugged-cec31312-56a9-45d2-a9ff-26a135b50547 for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG nova.compute.manager [req-f6f2de9b-3d95-4f48-836e-81b3d9c6fa42 req-07976535-705e-46e9-b7ba-e831b49fb926 service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Received event network-vif-plugged-cec31312-56a9-45d2-a9ff-26a135b50547 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f6f2de9b-3d95-4f48-836e-81b3d9c6fa42 req-07976535-705e-46e9-b7ba-e831b49fb926 service nova] Acquiring lock "895bf22e-1097-46ac-9ef3-a856dcd02349-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f6f2de9b-3d95-4f48-836e-81b3d9c6fa42 req-07976535-705e-46e9-b7ba-e831b49fb926 service nova] Lock "895bf22e-1097-46ac-9ef3-a856dcd02349-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f6f2de9b-3d95-4f48-836e-81b3d9c6fa42 req-07976535-705e-46e9-b7ba-e831b49fb926 service nova] Lock "895bf22e-1097-46ac-9ef3-a856dcd02349-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG nova.compute.manager [req-f6f2de9b-3d95-4f48-836e-81b3d9c6fa42 req-07976535-705e-46e9-b7ba-e831b49fb926 service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] No waiting events found dispatching network-vif-plugged-cec31312-56a9-45d2-a9ff-26a135b50547 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:22:46 user nova-compute[74348]: WARNING nova.compute.manager [req-f6f2de9b-3d95-4f48-836e-81b3d9c6fa42 req-07976535-705e-46e9-b7ba-e831b49fb926 service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Received unexpected event network-vif-plugged-cec31312-56a9-45d2-a9ff-26a135b50547 for instance with vm_state active and task_state deleting.
Nov 22 08:22:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9f783e-7625-46c3-8269-444dcf1852ca]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Flushing IO for device /dev/sdb {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98a42e0-7bf9-4d84-b086-eae25ed1ff34]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[836a76df-e4c1-46fc-9ac3-c12c9f36aacc]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] SCSI volumes sdb have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6383c6-2a9a-4a14-a1a0-e7877c76460e]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de -p 172.16.0.220:3260 --logout" returned: 0 in 0.040s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[89954f97-7b67-42b1-a07b-7c202d5662b3]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de, portal: 172.16.0.220,3260]
Nov 22 08:22:46 user nova-compute[74348]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de, portal: 172.16.0.220,3260] successful.
Nov 22 08:22:46 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d00769d0-fad3-4be1-ba4a-cb7615c344de -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c440e4a-9c11-4dc6-bd72-a9a382fe6dfb]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.262s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] <== disconnect_volume: return (264ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 08:22:46 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Deleting instance files /opt/stack/data/nova/instances/895bf22e-1097-46ac-9ef3-a856dcd02349_del
Nov 22 08:22:46 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Deletion of /opt/stack/data/nova/instances/895bf22e-1097-46ac-9ef3-a856dcd02349_del complete
Nov 22 08:22:46 user nova-compute[74348]: INFO nova.compute.manager [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 22 08:22:46 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:22:46 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Took 0.45 seconds to deallocate network for instance.
Nov 22 08:22:46 user nova-compute[74348]: DEBUG nova.compute.manager [req-1e46b205-cbb9-492f-ae08-b335c09b327f req-51690852-bdf1-43e9-857f-966f9a38d232 service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Received event network-vif-deleted-cec31312-56a9-45d2-a9ff-26a135b50547 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:22:46 user nova-compute[74348]: INFO nova.compute.manager [req-1e46b205-cbb9-492f-ae08-b335c09b327f req-51690852-bdf1-43e9-857f-966f9a38d232 service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Neutron deleted interface cec31312-56a9-45d2-a9ff-26a135b50547; detaching it from the instance and deleting it from the info cache
Nov 22 08:22:46 user nova-compute[74348]: DEBUG nova.network.neutron [req-1e46b205-cbb9-492f-ae08-b335c09b327f req-51690852-bdf1-43e9-857f-966f9a38d232 service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:22:46 user nova-compute[74348]: DEBUG nova.compute.manager [req-1e46b205-cbb9-492f-ae08-b335c09b327f req-51690852-bdf1-43e9-857f-966f9a38d232 service nova] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Detach interface failed, port_id=cec31312-56a9-45d2-a9ff-26a135b50547, reason: Instance 895bf22e-1097-46ac-9ef3-a856dcd02349 could not be found. {{(pid=74348) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 08:22:47 user nova-compute[74348]: INFO nova.compute.manager [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Took 0.71 seconds to detach 1 volumes for instance.
Nov 22 08:22:47 user nova-compute[74348]: DEBUG nova.compute.manager [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] [instance: 895bf22e-1097-46ac-9ef3-a856dcd02349] Deleting volume: d00769d0-fad3-4be1-ba4a-cb7615c344de {{(pid=74348) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 22 08:22:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:22:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:22:47 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:22:47 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:22:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.132s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:22:47 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Deleted allocations for instance 895bf22e-1097-46ac-9ef3-a856dcd02349
Nov 22 08:22:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-71c2de27-d7d6-4c54-8382-522ef2e15ac5 tempest-TestShelveInstance-1568035397 tempest-TestShelveInstance-1568035397-project-member] Lock "895bf22e-1097-46ac-9ef3-a856dcd02349" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.660s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:22:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:22:51 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:22:52 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:22:52 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:22:52 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:22:52 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:22:52 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 08:22:52 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Updating instance_info_cache with network_info: [{"id": "7cc1a5d8-94a4-488d-9e21-67bd6037de7f", "address": "fa:16:3e:e6:3a:57", "network": {"id": "d9c6413a-e220-4028-9f88-536d89a316a8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1645865569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66b1c567f5f44bc69012abed3fa2fed7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc1a5d8-94", "ovs_interfaceid": "7cc1a5d8-94a4-488d-9e21-67bd6037de7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:22:52 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:22:52 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 08:22:54 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:22:54 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:22:55 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:22:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:22:56 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:22:57 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:22:58 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:23:00 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:23:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:23:01 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:23:01 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:23:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:23:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:23:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:23:01 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:23:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:23:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:23:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:23:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:23:02 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:23:02 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:23:02 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=8912MB free_disk=24.952972412109375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:23:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:23:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:23:02 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:23:02 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:23:02 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:23:02 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:23:02 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:23:02 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:23:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:23:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:23:07 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:23:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:23:15 user nova-compute[74348]: DEBUG nova.compute.manager [req-f6127464-e4cf-49a8-89b0-99f183dc3929 req-fbb53225-2a9e-4b92-a174-25ee7d9227fe service nova] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Received event network-changed-7cc1a5d8-94a4-488d-9e21-67bd6037de7f {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:23:15 user nova-compute[74348]: DEBUG nova.compute.manager [req-f6127464-e4cf-49a8-89b0-99f183dc3929 req-fbb53225-2a9e-4b92-a174-25ee7d9227fe service nova] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Refreshing instance network info cache due to event network-changed-7cc1a5d8-94a4-488d-9e21-67bd6037de7f. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:23:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f6127464-e4cf-49a8-89b0-99f183dc3929 req-fbb53225-2a9e-4b92-a174-25ee7d9227fe service nova] Acquiring lock "refresh_cache-4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:23:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f6127464-e4cf-49a8-89b0-99f183dc3929 req-fbb53225-2a9e-4b92-a174-25ee7d9227fe service nova] Acquired lock "refresh_cache-4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:23:15 user nova-compute[74348]: DEBUG nova.network.neutron [req-f6127464-e4cf-49a8-89b0-99f183dc3929 req-fbb53225-2a9e-4b92-a174-25ee7d9227fe service nova] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Refreshing network info cache for port 7cc1a5d8-94a4-488d-9e21-67bd6037de7f {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:23:15 user nova-compute[74348]: DEBUG nova.network.neutron [req-f6127464-e4cf-49a8-89b0-99f183dc3929 req-fbb53225-2a9e-4b92-a174-25ee7d9227fe service nova] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Updated VIF entry in instance network info cache for port 7cc1a5d8-94a4-488d-9e21-67bd6037de7f. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:23:15 user nova-compute[74348]: DEBUG nova.network.neutron [req-f6127464-e4cf-49a8-89b0-99f183dc3929 req-fbb53225-2a9e-4b92-a174-25ee7d9227fe service nova] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Updating instance_info_cache with network_info: [{"id": "7cc1a5d8-94a4-488d-9e21-67bd6037de7f", "address": "fa:16:3e:e6:3a:57", "network": {"id": "d9c6413a-e220-4028-9f88-536d89a316a8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1645865569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66b1c567f5f44bc69012abed3fa2fed7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc1a5d8-94", "ovs_interfaceid": "7cc1a5d8-94a4-488d-9e21-67bd6037de7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:23:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f6127464-e4cf-49a8-89b0-99f183dc3929 req-fbb53225-2a9e-4b92-a174-25ee7d9227fe service nova] Releasing lock "refresh_cache-4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:23:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:23:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Acquiring lock "4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:23:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lock "4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:23:16 user nova-compute[74348]: DEBUG nova.objects.instance [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lazy-loading 'flavor' on Instance uuid 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:23:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lock "4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.104s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:23:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Acquiring lock "4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:23:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lock "4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:23:16 user nova-compute[74348]: INFO nova.compute.manager [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Attaching volume 06374015-b411-4c70-ac68-92bf57f5f68a to /dev/vdb
Nov 22 08:23:16 user nova-compute[74348]: DEBUG os_brick.utils [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:23:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:23:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:23:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd57ce3-5bfe-4e3c-9e89-3c0d018522ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:23:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:23:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:23:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d21888-6be4-4007-9ef6-eb407e4910bd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:23:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:23:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:23:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff3a982-fd35-445c-bb7e-67a016660edc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:23:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7b047a-4b6f-433f-91f4-b31f9d56475b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:23:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:23:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:23:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 08:23:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:23:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:23:16 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 08:23:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[11489157-6ef6-4257-b8b7-72e7312fa156]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:23:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 08:23:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 08:23:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 08:23:16 user nova-compute[74348]: DEBUG os_brick.utils [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:23:16 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Updating existing volume attachment record: 525fba0c-4e0c-4aba-8b96-93b48876bf46 {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 08:23:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:23:21 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sWGDoLzn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:23:24 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:23:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:23:24 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:23:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:23:24 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 08:23:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd77793-317b-436a-849a-c1d034cc5ee6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 08:23:24 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2943b4-f403-477b-af5d-c3caca50969b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a] added
Nov 22 08:23:24 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab28d5dd-2fb7-4d5f-8b84-fd9674c3683b]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[df163cf5-2253-4fe8-9b67-f25d4d283462]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sWGDoLzn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sWGDoLzn" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bcb8ace-3b9c-4477-8272-7583b72b09e4]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sWGDoLzn'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1d4e86-2364-49e0-a107-343cca4088e0]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df89645-7639-4e80-9a07-6c5a0564dfcd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 22 08:23:24 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 22 08:23:24 user nova-compute[74348]:  {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:23:24 user nova-compute[74348]: WARNING os_brick.initiator.connectors.iscsi [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 22 08:23:24 user nova-compute[74348]: 
Nov 22 08:23:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f8c330-0535-4357-954f-75fe1201df88]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a, portal: 172.16.0.220,3260]
Nov 22 08:23:24 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a, portal: 172.16.0.220,3260] successful.
Nov 22 08:23:24 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a2f143-8ef4-4c6d-81d6-f064b1b56033]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c99b45-b86c-465a-9a3c-eb7006ebe290]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a (non-flash)
Nov 22 08:23:24 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a (non-flash)
Nov 22 08:23:24 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78207b3-268b-4b92-aec8-781a409a3090]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: None {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:23:24 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:23:25 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:23:25 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sWGDoLzn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 08:23:25 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:23:25 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23163376138396366', 'path': '/dev/sdb'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:23:25 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163376138396366', 'path': '/dev/sdb'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 08:23:25 user nova-compute[74348]: DEBUG nova.objects.instance [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lazy-loading 'flavor' on Instance uuid 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:23:25 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 08:23:25 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:23:25 user nova-compute[74348]:   <source dev="/dev/sdb"/>
Nov 22 08:23:25 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:23:25 user nova-compute[74348]:   <serial>06374015-b411-4c70-ac68-92bf57f5f68a</serial>
Nov 22 08:23:25 user nova-compute[74348]: </disk>
Nov 22 08:23:25 user nova-compute[74348]:  {{(pid=74348) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 08:23:25 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:23:25 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:23:25 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] No VIF found with MAC fa:16:3e:e6:3a:57, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:23:26 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:23:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-85504640-6fca-42ae-98bd-ab2a40d2b9de tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lock "4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.702s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:23:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Acquiring lock "4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:23:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lock "4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:23:29 user nova-compute[74348]: DEBUG nova.objects.instance [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lazy-loading 'flavor' on Instance uuid 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:23:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lock "4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:23:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Acquiring lock "4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:23:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lock "4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:23:29 user nova-compute[74348]: INFO nova.compute.manager [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Attaching volume 44050743-c211-491e-ab5f-940d76240348 to /dev/vdc
Nov 22 08:23:29 user nova-compute[74348]: DEBUG os_brick.utils [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:23:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:23:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:23:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[022a2171-be61-4539-a3a2-aaf2b51dc599]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:23:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:23:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:23:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1eb13d-d2bb-42a3-8085-2e7032ab72aa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:23:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:23:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:23:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[325f0353-9580-469a-a646-ccab184b86f0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:23:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6440312e-bb07-4491-ba3b-4146bd6b6daa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:23:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:23:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:23:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 08:23:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:23:29 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:23:29 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 08:23:29 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0656f330-70bf-4be4-8031-b3d12f728f50]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:23:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 08:23:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 08:23:29 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 08:23:29 user nova-compute[74348]: DEBUG os_brick.utils [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:23:29 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Updating existing volume attachment record: de5fa040-a475-41a7-8c60-ab35f3d7998e {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 08:23:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:23:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvpLHyIc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:23:35 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:23:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:23:35 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:23:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:23:35 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 08:23:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348 -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[40329eb7-9e72-4db0-9414-a067ee6a50d2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 08:23:35 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348 -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1948a6-8581-4f06-862b-d5ca3c94134c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348] added
Nov 22 08:23:35 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70f4d50-549f-4f82-a63d-d8facf6441b9]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce3d23e-85de-47c1-a8fe-ae75c5f8dae2]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tvpLHyIc {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tvpLHyIc" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[726fc459-c071-42bd-80ac-cf75d57496c0]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tvpLHyIc'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[efff2092-d2ab-49d3-a562-79fc728665f9]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[55836404-c774-43fa-b960-05dede956e03]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a (non-flash)
Nov 22 08:23:35 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a (non-flash)
Nov 22 08:23:35 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348 -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0179c8ed-34d6-475b-927d-ab8a8cc7bcf5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348, portal: 172.16.0.220,3260]
Nov 22 08:23:35 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348, portal: 172.16.0.220,3260] successful.
Nov 22 08:23:35 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[95085231-8f58-48df-b878-cc13d3e4346c]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[04073fcd-c0e1-413e-a76a-98bfb4ee5d30]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a (non-flash)
Nov 22 08:23:35 user nova-compute[74348]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348 (non-flash)
Nov 22 08:23:35 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a (non-flash)
Nov 22 08:23:35 user nova-compute[74348]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348 (non-flash)
Nov 22 08:23:35 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9726b4c9-8c89-467c-9702-da7c0b8beffe]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:23:35 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: None {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:23:36 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:23:36 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:23:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvpLHyIc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 08:23:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:23:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '26265303136636534', 'path': '/dev/sdc'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:23:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265303136636534', 'path': '/dev/sdc'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 08:23:36 user nova-compute[74348]: DEBUG nova.objects.instance [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lazy-loading 'flavor' on Instance uuid 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:23:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 08:23:36 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:23:36 user nova-compute[74348]:   <source dev="/dev/sdc"/>
Nov 22 08:23:36 user nova-compute[74348]:   <target dev="vdc" bus="virtio"/>
Nov 22 08:23:36 user nova-compute[74348]:   <serial>44050743-c211-491e-ab5f-940d76240348</serial>
Nov 22 08:23:36 user nova-compute[74348]: </disk>
Nov 22 08:23:36 user nova-compute[74348]:  {{(pid=74348) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 08:23:37 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:23:37 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:23:37 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:23:37 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] No VIF found with MAC fa:16:3e:e6:3a:57, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:23:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-3e066998-e30b-4490-bedd-73b6add59e5c tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lock "4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.911s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:23:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:23:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-27ce48b0-f3bc-4e27-b318-40cd9e301be3 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Acquiring lock "4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:23:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-27ce48b0-f3bc-4e27-b318-40cd9e301be3 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lock "4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:23:38 user nova-compute[74348]: INFO nova.compute.manager [None req-27ce48b0-f3bc-4e27-b318-40cd9e301be3 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Detaching volume 44050743-c211-491e-ab5f-940d76240348
Nov 22 08:23:38 user nova-compute[74348]: INFO nova.virt.block_device [None req-27ce48b0-f3bc-4e27-b318-40cd9e301be3 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Attempting to driver detach volume 44050743-c211-491e-ab5f-940d76240348 from mountpoint /dev/vdc
Nov 22 08:23:38 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-27ce48b0-f3bc-4e27-b318-40cd9e301be3 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Attempting to detach device vdc from instance 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723 from the persistent domain config. {{(pid=74348) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 08:23:38 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-27ce48b0-f3bc-4e27-b318-40cd9e301be3 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:23:38 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:23:38 user nova-compute[74348]:   <source dev="/dev/sdc"/>
Nov 22 08:23:38 user nova-compute[74348]:   <target dev="vdc" bus="virtio"/>
Nov 22 08:23:38 user nova-compute[74348]:   <serial>44050743-c211-491e-ab5f-940d76240348</serial>
Nov 22 08:23:38 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 22 08:23:38 user nova-compute[74348]: </disk>
Nov 22 08:23:38 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:23:38 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-27ce48b0-f3bc-4e27-b318-40cd9e301be3 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Successfully detached device vdc from instance 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723 from the persistent domain config.
Nov 22 08:23:38 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-27ce48b0-f3bc-4e27-b318-40cd9e301be3 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723 from the live domain config. {{(pid=74348) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 08:23:38 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-27ce48b0-f3bc-4e27-b318-40cd9e301be3 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:23:38 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:23:38 user nova-compute[74348]:   <source dev="/dev/sdc"/>
Nov 22 08:23:38 user nova-compute[74348]:   <target dev="vdc" bus="virtio"/>
Nov 22 08:23:38 user nova-compute[74348]:   <serial>44050743-c211-491e-ab5f-940d76240348</serial>
Nov 22 08:23:38 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 22 08:23:38 user nova-compute[74348]: </disk>
Nov 22 08:23:38 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:23:39 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-27ce48b0-f3bc-4e27-b318-40cd9e301be3 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723 {{(pid=74348) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 08:23:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:23:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:23:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:23:46 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:23:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:23:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:23:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:23:50 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:23:50 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:23:50 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Rebuilding the list of instances to heal {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 08:23:50 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:23:50 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:23:50 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 08:23:50 user nova-compute[74348]: DEBUG nova.objects.instance [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lazy-loading 'info_cache' on Instance uuid 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:23:51 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Updating instance_info_cache with network_info: [{"id": "7cc1a5d8-94a4-488d-9e21-67bd6037de7f", "address": "fa:16:3e:e6:3a:57", "network": {"id": "d9c6413a-e220-4028-9f88-536d89a316a8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1645865569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66b1c567f5f44bc69012abed3fa2fed7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc1a5d8-94", "ovs_interfaceid": "7cc1a5d8-94a4-488d-9e21-67bd6037de7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:23:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:23:51 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 08:23:51 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:23:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:23:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:23:55 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:23:55 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:23:55 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:23:55 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:23:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:23:56 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:23:58 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:23:58 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:23:59 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-27ce48b0-f3bc-4e27-b318-40cd9e301be3 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723 is timed out.
Nov 22 08:23:59 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-27ce48b0-f3bc-4e27-b318-40cd9e301be3 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Successfully detached device vdc from instance 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723 from the live domain config.
Nov 22 08:23:59 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27ce48b0-f3bc-4e27-b318-40cd9e301be3 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ce48b0-f3bc-4e27-b318-40cd9e301be3 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvpLHyIc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:23:59 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-27ce48b0-f3bc-4e27-b318-40cd9e301be3 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:23:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-27ce48b0-f3bc-4e27-b318-40cd9e301be3 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-27ce48b0-f3bc-4e27-b318-40cd9e301be3 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f66414b-07b7-436b-90dc-56d9ab266e71]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ce48b0-f3bc-4e27-b318-40cd9e301be3 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 08:23:59 user nova-compute[74348]: No targets found.
Nov 22 08:23:59 user nova-compute[74348]: iSNS:
Nov 22 08:23:59 user nova-compute[74348]: No targets found.
Nov 22 08:23:59 user nova-compute[74348]: STATIC:
Nov 22 08:23:59 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a
Nov 22 08:23:59 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:23:59 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:23:59 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348
Nov 22 08:23:59 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:23:59 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:23:59 user nova-compute[74348]: FIRMWARE:
Nov 22 08:23:59 user nova-compute[74348]: No targets found.
Nov 22 08:23:59 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ce48b0-f3bc-4e27-b318-40cd9e301be3 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 08:23:59 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 08:23:59 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ce48b0-f3bc-4e27-b318-40cd9e301be3 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa23644-0dcc-49b1-9000-c9f95351391a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8daf4fff-8116-428a-87e8-b3dd566eb459]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ce48b0-f3bc-4e27-b318-40cd9e301be3 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a (non-flash)
Nov 22 08:23:59 user nova-compute[74348]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348 (non-flash)
Nov 22 08:23:59 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ce48b0-f3bc-4e27-b318-40cd9e301be3 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a (non-flash)
Nov 22 08:23:59 user nova-compute[74348]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348 (non-flash)
Nov 22 08:23:59 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ce48b0-f3bc-4e27-b318-40cd9e301be3 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f222852f370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348'): ({'sdc'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-27ce48b0-f3bc-4e27-b318-40cd9e301be3 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Removing single pathed devices sdc {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[21038c5f-a3a3-40fa-af3c-afb2f30514f1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[44035ef5-2052-47a8-b415-80ed0e9d6b8a]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-27ce48b0-f3bc-4e27-b318-40cd9e301be3 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Flushing IO for device /dev/sdc {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[22fd0e8b-297f-4ae1-87c0-6c1da82d3c9b]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-27ce48b0-f3bc-4e27-b318-40cd9e301be3 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee10e7ef-a49b-4549-aba6-550746217b9d]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-27ce48b0-f3bc-4e27-b318-40cd9e301be3 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-27ce48b0-f3bc-4e27-b318-40cd9e301be3 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] SCSI volumes sdc have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ce48b0-f3bc-4e27-b318-40cd9e301be3 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bc56eb-3fa5-4963-a557-86425e2502de]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ce48b0-f3bc-4e27-b318-40cd9e301be3 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348 -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Acquiring lock "e689f22e-9d71-40ed-a22e-1ded548b4f17" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "e689f22e-9d71-40ed-a22e-1ded548b4f17" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b83acee-0353-4c04-b954-c4160489e6fe]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ce48b0-f3bc-4e27-b318-40cd9e301be3 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348, portal: 172.16.0.220,3260]
Nov 22 08:23:59 user nova-compute[74348]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348, portal: 172.16.0.220,3260] successful.
Nov 22 08:23:59 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348 -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG nova.compute.manager [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44050743-c211-491e-ab5f-940d76240348 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ae3e89-4c65-48ab-8220-ddff09da00d3]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ce48b0-f3bc-4e27-b318-40cd9e301be3 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-27ce48b0-f3bc-4e27-b318-40cd9e301be3 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ce48b0-f3bc-4e27-b318-40cd9e301be3 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] <== disconnect_volume: return (304ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27ce48b0-f3bc-4e27-b318-40cd9e301be3 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 08:23:59 user nova-compute[74348]: INFO nova.compute.claims [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Claim successful on node user
Nov 22 08:23:59 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Refreshing inventories for resource provider 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Updating ProviderTree inventory for provider 52690f6a-773f-4e8d-be85-d278b6522975 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Updating inventory in ProviderTree for provider 52690f6a-773f-4e8d-be85-d278b6522975 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Refreshing aggregate associations for resource provider 52690f6a-773f-4e8d-be85-d278b6522975, aggregates: None {{(pid=74348) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Refreshing trait associations for resource provider 52690f6a-773f-4e8d-be85-d278b6522975, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=74348) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.376s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:23:59 user nova-compute[74348]: DEBUG nova.compute.manager [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 08:24:00 user nova-compute[74348]: DEBUG nova.compute.manager [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 08:24:00 user nova-compute[74348]: DEBUG nova.network.neutron [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 08:24:00 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 08:24:00 user nova-compute[74348]: DEBUG nova.compute.manager [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 08:24:00 user nova-compute[74348]: DEBUG nova.objects.instance [None req-27ce48b0-f3bc-4e27-b318-40cd9e301be3 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lazy-loading 'flavor' on Instance uuid 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:24:00 user nova-compute[74348]: DEBUG nova.compute.manager [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 08:24:00 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 08:24:00 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Creating image(s)
Nov 22 08:24:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Acquiring lock "/opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:24:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "/opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:24:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "/opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:24:00 user nova-compute[74348]: DEBUG nova.policy [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73f355ba09f346a3bbeec09de69630de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04273ca629b04809bb095bdfce87b461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 08:24:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:24:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-27ce48b0-f3bc-4e27-b318-40cd9e301be3 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lock "4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.842s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:24:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.240s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:24:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Acquiring lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:24:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:24:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:24:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.202s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:24:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17/disk 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:24:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17/disk 1073741824" returned: 0 in 0.087s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:24:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.298s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:24:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:24:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.245s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:24:01 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17/disk. size=1073741824 {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 08:24:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:24:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:24:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:24:01 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Cannot resize image /opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17/disk to a smaller size. {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 08:24:01 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 08:24:01 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Ensure instance console log exists: /opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 08:24:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:24:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:24:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:24:01 user nova-compute[74348]: DEBUG nova.network.neutron [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Successfully created port: 47ad4e60-7966-44ea-b188-b78fe76158f4 {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 08:24:01 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG nova.network.neutron [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Successfully updated port: 47ad4e60-7966-44ea-b188-b78fe76158f4 {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Acquiring lock "refresh_cache-e689f22e-9d71-40ed-a22e-1ded548b4f17" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Acquired lock "refresh_cache-e689f22e-9d71-40ed-a22e-1ded548b4f17" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG nova.network.neutron [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG nova.compute.manager [req-14381365-7e33-4f94-aa0d-6aa282bff40b req-f427eeba-dc25-40b9-9628-2982e5ba5b83 service nova] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Received event network-changed-47ad4e60-7966-44ea-b188-b78fe76158f4 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG nova.compute.manager [req-14381365-7e33-4f94-aa0d-6aa282bff40b req-f427eeba-dc25-40b9-9628-2982e5ba5b83 service nova] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Refreshing instance network info cache due to event network-changed-47ad4e60-7966-44ea-b188-b78fe76158f4. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-14381365-7e33-4f94-aa0d-6aa282bff40b req-f427eeba-dc25-40b9-9628-2982e5ba5b83 service nova] Acquiring lock "refresh_cache-e689f22e-9d71-40ed-a22e-1ded548b4f17" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG nova.network.neutron [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG nova.network.neutron [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Updating instance_info_cache with network_info: [{"id": "47ad4e60-7966-44ea-b188-b78fe76158f4", "address": "fa:16:3e:e8:2d:c5", "network": {"id": "0f3f2141-ab52-4769-afb8-9fc69aba88c5", "bridge": "br-int", "label": "tempest-TestStampPattern-455105330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04273ca629b04809bb095bdfce87b461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ad4e60-79", "ovs_interfaceid": "47ad4e60-7966-44ea-b188-b78fe76158f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Releasing lock "refresh_cache-e689f22e-9d71-40ed-a22e-1ded548b4f17" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG nova.compute.manager [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Instance network_info: |[{"id": "47ad4e60-7966-44ea-b188-b78fe76158f4", "address": "fa:16:3e:e8:2d:c5", "network": {"id": "0f3f2141-ab52-4769-afb8-9fc69aba88c5", "bridge": "br-int", "label": "tempest-TestStampPattern-455105330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04273ca629b04809bb095bdfce87b461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ad4e60-79", "ovs_interfaceid": "47ad4e60-7966-44ea-b188-b78fe76158f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-14381365-7e33-4f94-aa0d-6aa282bff40b req-f427eeba-dc25-40b9-9628-2982e5ba5b83 service nova] Acquired lock "refresh_cache-e689f22e-9d71-40ed-a22e-1ded548b4f17" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG nova.network.neutron [req-14381365-7e33-4f94-aa0d-6aa282bff40b req-f427eeba-dc25-40b9-9628-2982e5ba5b83 service nova] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Refreshing network info cache for port 47ad4e60-7966-44ea-b188-b78fe76158f4 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Start _get_guest_xml network_info=[{"id": "47ad4e60-7966-44ea-b188-b78fe76158f4", "address": "fa:16:3e:e8:2d:c5", "network": {"id": "0f3f2141-ab52-4769-afb8-9fc69aba88c5", "bridge": "br-int", "label": "tempest-TestStampPattern-455105330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04273ca629b04809bb095bdfce87b461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ad4e60-79", "ovs_interfaceid": "47ad4e60-7966-44ea-b188-b78fe76158f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 08:24:02 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:24:02 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:24:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:23:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1954896474',display_name='tempest-TestStampPattern-server-1954896474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1954896474',id=45,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlUnFKyNzS1mXvj2RBw5DmkD3+qjXoM5C122ESkjwExv4XOw6jmefFB7MRuLNKPdpMIrw4H12Bhnzb8PXfADXBPw55Gh+zMggP8MIeh0a5Ad23x1r79I+bH41DLq7nsnA==',key_name='tempest-TestStampPattern-1253083494',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04273ca629b04809bb095bdfce87b461',ramdisk_id='',reservation_id='r-uswl3mpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1355704184',owner_user_name='tempest-TestStampPattern-1355704184-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:24:00Z,user_data=None,user_id='73f355ba09f346a3bbeec09de69630de',uuid=e689f22e-9d71-40ed-a22e-1ded548b4f17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47ad4e60-7966-44ea-b188-b78fe76158f4", "address": "fa:16:3e:e8:2d:c5", "network": {"id": "0f3f2141-ab52-4769-afb8-9fc69aba88c5", "bridge": "br-int", "label": "tempest-TestStampPattern-455105330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04273ca629b04809bb095bdfce87b461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ad4e60-79", "ovs_interfaceid": "47ad4e60-7966-44ea-b188-b78fe76158f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Converting VIF {"id": "47ad4e60-7966-44ea-b188-b78fe76158f4", "address": "fa:16:3e:e8:2d:c5", "network": {"id": "0f3f2141-ab52-4769-afb8-9fc69aba88c5", "bridge": "br-int", "label": "tempest-TestStampPattern-455105330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04273ca629b04809bb095bdfce87b461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ad4e60-79", "ovs_interfaceid": "47ad4e60-7966-44ea-b188-b78fe76158f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:2d:c5,bridge_name='br-int',has_traffic_filtering=True,id=47ad4e60-7966-44ea-b188-b78fe76158f4,network=Network(0f3f2141-ab52-4769-afb8-9fc69aba88c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47ad4e60-79') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG nova.objects.instance [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lazy-loading 'pci_devices' on Instance uuid e689f22e-9d71-40ed-a22e-1ded548b4f17 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] End _get_guest_xml xml=<domain type="kvm">
Nov 22 08:24:02 user nova-compute[74348]:   <uuid>e689f22e-9d71-40ed-a22e-1ded548b4f17</uuid>
Nov 22 08:24:02 user nova-compute[74348]:   <name>instance-0000002d</name>
Nov 22 08:24:02 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 08:24:02 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 08:24:02 user nova-compute[74348]:   <metadata>
Nov 22 08:24:02 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 08:24:02 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 08:24:02 user nova-compute[74348]:       <nova:name>tempest-TestStampPattern-server-1954896474</nova:name>
Nov 22 08:24:02 user nova-compute[74348]:       <nova:creationTime>2023-11-22 08:24:02</nova:creationTime>
Nov 22 08:24:02 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 08:24:02 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 08:24:02 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 08:24:02 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 08:24:02 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 08:24:02 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 08:24:02 user nova-compute[74348]:       </nova:flavor>
Nov 22 08:24:02 user nova-compute[74348]:       <nova:owner>
Nov 22 08:24:02 user nova-compute[74348]:         <nova:user uuid="73f355ba09f346a3bbeec09de69630de">tempest-TestStampPattern-1355704184-project-member</nova:user>
Nov 22 08:24:02 user nova-compute[74348]:         <nova:project uuid="04273ca629b04809bb095bdfce87b461">tempest-TestStampPattern-1355704184</nova:project>
Nov 22 08:24:02 user nova-compute[74348]:       </nova:owner>
Nov 22 08:24:02 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 08:24:02 user nova-compute[74348]:       <nova:ports>
Nov 22 08:24:02 user nova-compute[74348]:         <nova:port uuid="47ad4e60-7966-44ea-b188-b78fe76158f4">
Nov 22 08:24:02 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 22 08:24:02 user nova-compute[74348]:         </nova:port>
Nov 22 08:24:02 user nova-compute[74348]:       </nova:ports>
Nov 22 08:24:02 user nova-compute[74348]:     </nova:instance>
Nov 22 08:24:02 user nova-compute[74348]:   </metadata>
Nov 22 08:24:02 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 08:24:02 user nova-compute[74348]:     <system>
Nov 22 08:24:02 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 08:24:02 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 08:24:02 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 08:24:02 user nova-compute[74348]:       <entry name="serial">e689f22e-9d71-40ed-a22e-1ded548b4f17</entry>
Nov 22 08:24:02 user nova-compute[74348]:       <entry name="uuid">e689f22e-9d71-40ed-a22e-1ded548b4f17</entry>
Nov 22 08:24:02 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 08:24:02 user nova-compute[74348]:     </system>
Nov 22 08:24:02 user nova-compute[74348]:   </sysinfo>
Nov 22 08:24:02 user nova-compute[74348]:   <os>
Nov 22 08:24:02 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 08:24:02 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 08:24:02 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 08:24:02 user nova-compute[74348]:   </os>
Nov 22 08:24:02 user nova-compute[74348]:   <features>
Nov 22 08:24:02 user nova-compute[74348]:     <acpi/>
Nov 22 08:24:02 user nova-compute[74348]:     <apic/>
Nov 22 08:24:02 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 08:24:02 user nova-compute[74348]:   </features>
Nov 22 08:24:02 user nova-compute[74348]:   <clock offset="utc">
Nov 22 08:24:02 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 08:24:02 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 08:24:02 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 08:24:02 user nova-compute[74348]:   </clock>
Nov 22 08:24:02 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 08:24:02 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 08:24:02 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 08:24:02 user nova-compute[74348]:   </cpu>
Nov 22 08:24:02 user nova-compute[74348]:   <devices>
Nov 22 08:24:02 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 08:24:02 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 08:24:02 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17/disk"/>
Nov 22 08:24:02 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 08:24:02 user nova-compute[74348]:     </disk>
Nov 22 08:24:02 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 08:24:02 user nova-compute[74348]:       <mac address="fa:16:3e:e8:2d:c5"/>
Nov 22 08:24:02 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:24:02 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 08:24:02 user nova-compute[74348]:       <target dev="tap47ad4e60-79"/>
Nov 22 08:24:02 user nova-compute[74348]:     </interface>
Nov 22 08:24:02 user nova-compute[74348]:     <serial type="pty">
Nov 22 08:24:02 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17/console.log" append="off"/>
Nov 22 08:24:02 user nova-compute[74348]:     </serial>
Nov 22 08:24:02 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 08:24:02 user nova-compute[74348]:     <video>
Nov 22 08:24:02 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:24:02 user nova-compute[74348]:     </video>
Nov 22 08:24:02 user nova-compute[74348]:     <rng model="virtio">
Nov 22 08:24:02 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 08:24:02 user nova-compute[74348]:     </rng>
Nov 22 08:24:02 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 08:24:02 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 08:24:02 user nova-compute[74348]:       <stats period="10"/>
Nov 22 08:24:02 user nova-compute[74348]:     </memballoon>
Nov 22 08:24:02 user nova-compute[74348]:   </devices>
Nov 22 08:24:02 user nova-compute[74348]: </domain>
Nov 22 08:24:02 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:23:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1954896474',display_name='tempest-TestStampPattern-server-1954896474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1954896474',id=45,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlUnFKyNzS1mXvj2RBw5DmkD3+qjXoM5C122ESkjwExv4XOw6jmefFB7MRuLNKPdpMIrw4H12Bhnzb8PXfADXBPw55Gh+zMggP8MIeh0a5Ad23x1r79I+bH41DLq7nsnA==',key_name='tempest-TestStampPattern-1253083494',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04273ca629b04809bb095bdfce87b461',ramdisk_id='',reservation_id='r-uswl3mpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1355704184',owner_user_name='tempest-TestStampPattern-1355704184-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:24:00Z,user_data=None,user_id='73f355ba09f346a3bbeec09de69630de',uuid=e689f22e-9d71-40ed-a22e-1ded548b4f17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47ad4e60-7966-44ea-b188-b78fe76158f4", "address": "fa:16:3e:e8:2d:c5", "network": {"id": "0f3f2141-ab52-4769-afb8-9fc69aba88c5", "bridge": "br-int", "label": "tempest-TestStampPattern-455105330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04273ca629b04809bb095bdfce87b461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ad4e60-79", "ovs_interfaceid": "47ad4e60-7966-44ea-b188-b78fe76158f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Converting VIF {"id": "47ad4e60-7966-44ea-b188-b78fe76158f4", "address": "fa:16:3e:e8:2d:c5", "network": {"id": "0f3f2141-ab52-4769-afb8-9fc69aba88c5", "bridge": "br-int", "label": "tempest-TestStampPattern-455105330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04273ca629b04809bb095bdfce87b461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ad4e60-79", "ovs_interfaceid": "47ad4e60-7966-44ea-b188-b78fe76158f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:2d:c5,bridge_name='br-int',has_traffic_filtering=True,id=47ad4e60-7966-44ea-b188-b78fe76158f4,network=Network(0f3f2141-ab52-4769-afb8-9fc69aba88c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47ad4e60-79') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG os_vif [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:2d:c5,bridge_name='br-int',has_traffic_filtering=True,id=47ad4e60-7966-44ea-b188-b78fe76158f4,network=Network(0f3f2141-ab52-4769-afb8-9fc69aba88c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47ad4e60-79') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c224cdd5-e1dc-5a2e-8813-5d342f87e823', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47ad4e60-79, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap47ad4e60-79, col_values=(('qos', UUID('5ac2a68b-d01b-43e1-b0eb-2a2565d72f70')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap47ad4e60-79, col_values=(('external_ids', {'iface-id': '47ad4e60-7966-44ea-b188-b78fe76158f4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:2d:c5', 'vm-uuid': 'e689f22e-9d71-40ed-a22e-1ded548b4f17'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:24:02 user nova-compute[74348]: INFO os_vif [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:2d:c5,bridge_name='br-int',has_traffic_filtering=True,id=47ad4e60-7966-44ea-b188-b78fe76158f4,network=Network(0f3f2141-ab52-4769-afb8-9fc69aba88c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47ad4e60-79')
Nov 22 08:24:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:24:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] No VIF found with MAC fa:16:3e:e8:2d:c5, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:24:03 user nova-compute[74348]: DEBUG nova.network.neutron [req-14381365-7e33-4f94-aa0d-6aa282bff40b req-f427eeba-dc25-40b9-9628-2982e5ba5b83 service nova] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Updated VIF entry in instance network info cache for port 47ad4e60-7966-44ea-b188-b78fe76158f4. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:24:03 user nova-compute[74348]: DEBUG nova.network.neutron [req-14381365-7e33-4f94-aa0d-6aa282bff40b req-f427eeba-dc25-40b9-9628-2982e5ba5b83 service nova] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Updating instance_info_cache with network_info: [{"id": "47ad4e60-7966-44ea-b188-b78fe76158f4", "address": "fa:16:3e:e8:2d:c5", "network": {"id": "0f3f2141-ab52-4769-afb8-9fc69aba88c5", "bridge": "br-int", "label": "tempest-TestStampPattern-455105330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04273ca629b04809bb095bdfce87b461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ad4e60-79", "ovs_interfaceid": "47ad4e60-7966-44ea-b188-b78fe76158f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:24:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-14381365-7e33-4f94-aa0d-6aa282bff40b req-f427eeba-dc25-40b9-9628-2982e5ba5b83 service nova] Releasing lock "refresh_cache-e689f22e-9d71-40ed-a22e-1ded548b4f17" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:24:03 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:24:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:24:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:24:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:24:03 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:24:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:24:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:24:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:24:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:24:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:24:04 user nova-compute[74348]: DEBUG nova.compute.manager [req-9bd0c1e9-df28-4948-bf8f-2c528ad9626f req-ee16667f-92be-470c-b01e-612f378d8407 service nova] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Received event network-vif-plugged-47ad4e60-7966-44ea-b188-b78fe76158f4 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:24:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9bd0c1e9-df28-4948-bf8f-2c528ad9626f req-ee16667f-92be-470c-b01e-612f378d8407 service nova] Acquiring lock "e689f22e-9d71-40ed-a22e-1ded548b4f17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:24:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9bd0c1e9-df28-4948-bf8f-2c528ad9626f req-ee16667f-92be-470c-b01e-612f378d8407 service nova] Lock "e689f22e-9d71-40ed-a22e-1ded548b4f17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:24:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9bd0c1e9-df28-4948-bf8f-2c528ad9626f req-ee16667f-92be-470c-b01e-612f378d8407 service nova] Lock "e689f22e-9d71-40ed-a22e-1ded548b4f17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:24:04 user nova-compute[74348]: DEBUG nova.compute.manager [req-9bd0c1e9-df28-4948-bf8f-2c528ad9626f req-ee16667f-92be-470c-b01e-612f378d8407 service nova] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] No waiting events found dispatching network-vif-plugged-47ad4e60-7966-44ea-b188-b78fe76158f4 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:24:04 user nova-compute[74348]: WARNING nova.compute.manager [req-9bd0c1e9-df28-4948-bf8f-2c528ad9626f req-ee16667f-92be-470c-b01e-612f378d8407 service nova] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Received unexpected event network-vif-plugged-47ad4e60-7966-44ea-b188-b78fe76158f4 for instance with vm_state building and task_state spawning.
Nov 22 08:24:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:24:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:24:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:24:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:24:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:24:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:24:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:24:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:24:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:24:05 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:24:05 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:24:05 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:24:06 user nova-compute[74348]: DEBUG nova.compute.manager [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 08:24:06 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 08:24:06 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:24:06 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:24:06 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=8882MB free_disk=24.94847869873047GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:24:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:24:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:24:06 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Instance spawned successfully.
Nov 22 08:24:06 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 08:24:06 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:24:06 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:24:06 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:24:06 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:24:06 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:24:06 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:24:06 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:24:06 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance e689f22e-9d71-40ed-a22e-1ded548b4f17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:24:06 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:24:06 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:24:06 user nova-compute[74348]: INFO nova.compute.manager [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Took 6.27 seconds to spawn the instance on the hypervisor.
Nov 22 08:24:06 user nova-compute[74348]: DEBUG nova.compute.manager [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:24:06 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:24:06 user nova-compute[74348]: DEBUG nova.compute.manager [req-48353fe1-cde4-4079-96dd-643cacbb75fb req-eeae2ab8-99e1-4912-bf50-0c146f1ef775 service nova] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Received event network-vif-plugged-47ad4e60-7966-44ea-b188-b78fe76158f4 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:24:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-48353fe1-cde4-4079-96dd-643cacbb75fb req-eeae2ab8-99e1-4912-bf50-0c146f1ef775 service nova] Acquiring lock "e689f22e-9d71-40ed-a22e-1ded548b4f17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:24:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-48353fe1-cde4-4079-96dd-643cacbb75fb req-eeae2ab8-99e1-4912-bf50-0c146f1ef775 service nova] Lock "e689f22e-9d71-40ed-a22e-1ded548b4f17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:24:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-48353fe1-cde4-4079-96dd-643cacbb75fb req-eeae2ab8-99e1-4912-bf50-0c146f1ef775 service nova] Lock "e689f22e-9d71-40ed-a22e-1ded548b4f17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:24:06 user nova-compute[74348]: DEBUG nova.compute.manager [req-48353fe1-cde4-4079-96dd-643cacbb75fb req-eeae2ab8-99e1-4912-bf50-0c146f1ef775 service nova] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] No waiting events found dispatching network-vif-plugged-47ad4e60-7966-44ea-b188-b78fe76158f4 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:24:06 user nova-compute[74348]: WARNING nova.compute.manager [req-48353fe1-cde4-4079-96dd-643cacbb75fb req-eeae2ab8-99e1-4912-bf50-0c146f1ef775 service nova] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Received unexpected event network-vif-plugged-47ad4e60-7966-44ea-b188-b78fe76158f4 for instance with vm_state building and task_state spawning.
Nov 22 08:24:06 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:24:06 user nova-compute[74348]: INFO nova.compute.manager [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Took 7.21 seconds to build instance.
Nov 22 08:24:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-bb9a4667-bae9-44d4-8956-fb440dcbbf06 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "e689f22e-9d71-40ed-a22e-1ded548b4f17" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.308s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:24:06 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:24:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.268s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:24:06 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:24:06 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Cleaning up deleted instances {{(pid=74348) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 22 08:24:06 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] There are 0 instances to clean {{(pid=74348) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 22 08:24:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:24:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:24:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:24:11 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:24:11 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74348) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 22 08:24:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:24:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:24:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:24:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:24:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:24:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:24:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:24:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:24:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:24:24 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:24:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:24:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f9fefd16-8d00-4276-8880-9e028bfe53e5 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Acquiring lock "4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:24:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f9fefd16-8d00-4276-8880-9e028bfe53e5 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lock "4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:24:29 user nova-compute[74348]: INFO nova.compute.manager [None req-f9fefd16-8d00-4276-8880-9e028bfe53e5 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Detaching volume 06374015-b411-4c70-ac68-92bf57f5f68a
Nov 22 08:24:29 user nova-compute[74348]: INFO nova.virt.block_device [None req-f9fefd16-8d00-4276-8880-9e028bfe53e5 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Attempting to driver detach volume 06374015-b411-4c70-ac68-92bf57f5f68a from mountpoint /dev/vdb
Nov 22 08:24:29 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-f9fefd16-8d00-4276-8880-9e028bfe53e5 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Attempting to detach device vdb from instance 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723 from the persistent domain config. {{(pid=74348) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 08:24:29 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-f9fefd16-8d00-4276-8880-9e028bfe53e5 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:24:29 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:24:29 user nova-compute[74348]:   <source dev="/dev/sdb"/>
Nov 22 08:24:29 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:24:29 user nova-compute[74348]:   <serial>06374015-b411-4c70-ac68-92bf57f5f68a</serial>
Nov 22 08:24:29 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 08:24:29 user nova-compute[74348]: </disk>
Nov 22 08:24:29 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:24:29 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-f9fefd16-8d00-4276-8880-9e028bfe53e5 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Successfully detached device vdb from instance 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723 from the persistent domain config.
Nov 22 08:24:29 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-f9fefd16-8d00-4276-8880-9e028bfe53e5 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723 from the live domain config. {{(pid=74348) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 08:24:29 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-f9fefd16-8d00-4276-8880-9e028bfe53e5 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:24:29 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:24:29 user nova-compute[74348]:   <source dev="/dev/sdb"/>
Nov 22 08:24:29 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:24:29 user nova-compute[74348]:   <serial>06374015-b411-4c70-ac68-92bf57f5f68a</serial>
Nov 22 08:24:29 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 08:24:29 user nova-compute[74348]: </disk>
Nov 22 08:24:29 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:24:29 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-f9fefd16-8d00-4276-8880-9e028bfe53e5 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723 {{(pid=74348) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 08:24:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:24:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:24:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:24:37 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:24:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:24:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:24:49 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-f9fefd16-8d00-4276-8880-9e028bfe53e5 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723 is timed out.
Nov 22 08:24:49 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-f9fefd16-8d00-4276-8880-9e028bfe53e5 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Successfully detached device vdb from instance 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723 from the live domain config.
Nov 22 08:24:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9fefd16-8d00-4276-8880-9e028bfe53e5 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9fefd16-8d00-4276-8880-9e028bfe53e5 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sWGDoLzn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:24:49 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-f9fefd16-8d00-4276-8880-9e028bfe53e5 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:24:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-f9fefd16-8d00-4276-8880-9e028bfe53e5 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-f9fefd16-8d00-4276-8880-9e028bfe53e5 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e15ba78-9499-4373-8b7f-dd768284ab63]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9fefd16-8d00-4276-8880-9e028bfe53e5 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 08:24:49 user nova-compute[74348]: No targets found.
Nov 22 08:24:49 user nova-compute[74348]: iSNS:
Nov 22 08:24:49 user nova-compute[74348]: No targets found.
Nov 22 08:24:49 user nova-compute[74348]: STATIC:
Nov 22 08:24:49 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a
Nov 22 08:24:49 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:24:49 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:24:49 user nova-compute[74348]: FIRMWARE:
Nov 22 08:24:49 user nova-compute[74348]: No targets found.
Nov 22 08:24:49 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9fefd16-8d00-4276-8880-9e028bfe53e5 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 08:24:49 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 08:24:49 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9fefd16-8d00-4276-8880-9e028bfe53e5 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2dc9ac-8fc3-45a9-b83f-7ed34ab3ea4b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab360b1-a0fb-4ad0-b12d-718f885eeff2]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9fefd16-8d00-4276-8880-9e028bfe53e5 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a (non-flash)
Nov 22 08:24:49 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9fefd16-8d00-4276-8880-9e028bfe53e5 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a (non-flash)
Nov 22 08:24:49 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9fefd16-8d00-4276-8880-9e028bfe53e5 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f222836c790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a'): ({'sdb'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-f9fefd16-8d00-4276-8880-9e028bfe53e5 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Removing single pathed devices sdb {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[274451f9-4131-4e84-b7bb-e7a4898241c4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f085d5-69d0-4869-a410-0d1d9c119469]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-f9fefd16-8d00-4276-8880-9e028bfe53e5 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Flushing IO for device /dev/sdb {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2d1a7f-eeb8-435b-b2e4-cb2e962db82a]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-f9fefd16-8d00-4276-8880-9e028bfe53e5 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fea19b-28df-4067-9ed5-9802563da241]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-f9fefd16-8d00-4276-8880-9e028bfe53e5 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-f9fefd16-8d00-4276-8880-9e028bfe53e5 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] SCSI volumes sdb have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9fefd16-8d00-4276-8880-9e028bfe53e5 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9fa39c-d4ff-4f1d-9002-5c7d43d89eaa]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9fefd16-8d00-4276-8880-9e028bfe53e5 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[117d425c-a160-43ec-b383-c384e134c384]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9fefd16-8d00-4276-8880-9e028bfe53e5 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a, portal: 172.16.0.220,3260]
Nov 22 08:24:49 user nova-compute[74348]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a, portal: 172.16.0.220,3260] successful.
Nov 22 08:24:49 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06374015-b411-4c70-ac68-92bf57f5f68a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c345b438-333f-4c54-bfcb-c4d8de076be9]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9fefd16-8d00-4276-8880-9e028bfe53e5 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-f9fefd16-8d00-4276-8880-9e028bfe53e5 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9fefd16-8d00-4276-8880-9e028bfe53e5 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] <== disconnect_volume: return (271ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:24:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9fefd16-8d00-4276-8880-9e028bfe53e5 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 08:24:50 user nova-compute[74348]: DEBUG nova.objects.instance [None req-f9fefd16-8d00-4276-8880-9e028bfe53e5 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lazy-loading 'flavor' on Instance uuid 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:24:50 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f9fefd16-8d00-4276-8880-9e028bfe53e5 tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lock "4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.887s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:24:51 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:24:51 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:24:51 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Rebuilding the list of instances to heal {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 08:24:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:24:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:24:51 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 08:24:51 user nova-compute[74348]: DEBUG nova.objects.instance [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lazy-loading 'info_cache' on Instance uuid 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:24:52 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Updating instance_info_cache with network_info: [{"id": "7cc1a5d8-94a4-488d-9e21-67bd6037de7f", "address": "fa:16:3e:e6:3a:57", "network": {"id": "d9c6413a-e220-4028-9f88-536d89a316a8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1645865569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66b1c567f5f44bc69012abed3fa2fed7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc1a5d8-94", "ovs_interfaceid": "7cc1a5d8-94a4-488d-9e21-67bd6037de7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:24:52 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:24:52 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 08:24:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:24:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:24:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:24:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:24:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:24:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:24:55 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:24:57 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:24:57 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:24:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:24:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:24:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:24:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:24:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:24:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:24:58 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:25:00 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:25:00 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:25:02 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:25:02 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:25:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:25:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:25:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:25:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:25:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:25:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:25:04 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:25:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:25:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:25:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:25:04 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:25:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:25:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:25:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:25:05 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:25:05 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:25:05 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:25:05 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:25:05 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:25:05 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:25:05 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:25:05 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=8906MB free_disk=24.910404205322266GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:25:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:25:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:25:05 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:25:05 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance e689f22e-9d71-40ed-a22e-1ded548b4f17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:25:05 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:25:05 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:25:05 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:25:06 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:25:06 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:25:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.255s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:25:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:25:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:25:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:25:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:25:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:25:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:25:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:25:13 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:25:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:25:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:25:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:25:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:25:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:25:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:25:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-0507e9b6-2ad9-4712-bd21-61ea923bf17f tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Acquiring lock "4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:25:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-0507e9b6-2ad9-4712-bd21-61ea923bf17f tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lock "4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:25:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-0507e9b6-2ad9-4712-bd21-61ea923bf17f tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Acquiring lock "4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:25:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-0507e9b6-2ad9-4712-bd21-61ea923bf17f tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lock "4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:25:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-0507e9b6-2ad9-4712-bd21-61ea923bf17f tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lock "4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:25:19 user nova-compute[74348]: INFO nova.compute.manager [None req-0507e9b6-2ad9-4712-bd21-61ea923bf17f tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Terminating instance
Nov 22 08:25:19 user nova-compute[74348]: DEBUG nova.compute.manager [None req-0507e9b6-2ad9-4712-bd21-61ea923bf17f tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 08:25:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:25:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:25:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:25:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:25:19 user nova-compute[74348]: DEBUG nova.compute.manager [req-5b8f9d71-975c-4f1b-868c-d3f115d5e474 req-9a8d4638-259b-4521-aa90-cc21e35a96e0 service nova] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Received event network-vif-unplugged-7cc1a5d8-94a4-488d-9e21-67bd6037de7f {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:25:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-5b8f9d71-975c-4f1b-868c-d3f115d5e474 req-9a8d4638-259b-4521-aa90-cc21e35a96e0 service nova] Acquiring lock "4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:25:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-5b8f9d71-975c-4f1b-868c-d3f115d5e474 req-9a8d4638-259b-4521-aa90-cc21e35a96e0 service nova] Lock "4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:25:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-5b8f9d71-975c-4f1b-868c-d3f115d5e474 req-9a8d4638-259b-4521-aa90-cc21e35a96e0 service nova] Lock "4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:25:19 user nova-compute[74348]: DEBUG nova.compute.manager [req-5b8f9d71-975c-4f1b-868c-d3f115d5e474 req-9a8d4638-259b-4521-aa90-cc21e35a96e0 service nova] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] No waiting events found dispatching network-vif-unplugged-7cc1a5d8-94a4-488d-9e21-67bd6037de7f {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:25:19 user nova-compute[74348]: DEBUG nova.compute.manager [req-5b8f9d71-975c-4f1b-868c-d3f115d5e474 req-9a8d4638-259b-4521-aa90-cc21e35a96e0 service nova] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Received event network-vif-unplugged-7cc1a5d8-94a4-488d-9e21-67bd6037de7f for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 08:25:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:25:20 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Instance destroyed successfully.
Nov 22 08:25:20 user nova-compute[74348]: DEBUG nova.objects.instance [None req-0507e9b6-2ad9-4712-bd21-61ea923bf17f tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lazy-loading 'resources' on Instance uuid 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:25:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-0507e9b6-2ad9-4712-bd21-61ea923bf17f tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:21:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-978729776',display_name='tempest-TestServerVolumeAttachmentScenario-server-978729776',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-978729776',id=44,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYUGQB4vRXX5DkLw14hSn8vU2Is8kzEso+0vODv3bsSkpqbzmdULqxpRzdnotLNV5SJ86y4SDRvFcNzezPcV419teVrBfc+MAClFb8K7moG/xDnDryK6nrzzAa0+R03Uw==',key_name='tempest-keypair-789713225',keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:21:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66b1c567f5f44bc69012abed3fa2fed7',ramdisk_id='',reservation_id='r-pkyzxsc9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-318747544',owner_user_name='tempest-TestServerVolumeAttachmentScenario-318747544-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T08:21:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='078c813dade14ab5b9ad1e2f7fa02d65',uuid=4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7cc1a5d8-94a4-488d-9e21-67bd6037de7f", "address": "fa:16:3e:e6:3a:57", "network": {"id": "d9c6413a-e220-4028-9f88-536d89a316a8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1645865569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66b1c567f5f44bc69012abed3fa2fed7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc1a5d8-94", "ovs_interfaceid": "7cc1a5d8-94a4-488d-9e21-67bd6037de7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:25:20 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-0507e9b6-2ad9-4712-bd21-61ea923bf17f tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Converting VIF {"id": "7cc1a5d8-94a4-488d-9e21-67bd6037de7f", "address": "fa:16:3e:e6:3a:57", "network": {"id": "d9c6413a-e220-4028-9f88-536d89a316a8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1645865569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66b1c567f5f44bc69012abed3fa2fed7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc1a5d8-94", "ovs_interfaceid": "7cc1a5d8-94a4-488d-9e21-67bd6037de7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:25:20 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-0507e9b6-2ad9-4712-bd21-61ea923bf17f tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:3a:57,bridge_name='br-int',has_traffic_filtering=True,id=7cc1a5d8-94a4-488d-9e21-67bd6037de7f,network=Network(d9c6413a-e220-4028-9f88-536d89a316a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc1a5d8-94') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:25:20 user nova-compute[74348]: DEBUG os_vif [None req-0507e9b6-2ad9-4712-bd21-61ea923bf17f tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:3a:57,bridge_name='br-int',has_traffic_filtering=True,id=7cc1a5d8-94a4-488d-9e21-67bd6037de7f,network=Network(d9c6413a-e220-4028-9f88-536d89a316a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc1a5d8-94') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:25:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:25:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7cc1a5d8-94, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:25:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:25:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:25:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:25:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ae201233-a0c6-4805-96be-12df17761533) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:25:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:25:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:25:20 user nova-compute[74348]: INFO os_vif [None req-0507e9b6-2ad9-4712-bd21-61ea923bf17f tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:3a:57,bridge_name='br-int',has_traffic_filtering=True,id=7cc1a5d8-94a4-488d-9e21-67bd6037de7f,network=Network(d9c6413a-e220-4028-9f88-536d89a316a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc1a5d8-94')
Nov 22 08:25:20 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-0507e9b6-2ad9-4712-bd21-61ea923bf17f tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Deleting instance files /opt/stack/data/nova/instances/4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723_del
Nov 22 08:25:20 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-0507e9b6-2ad9-4712-bd21-61ea923bf17f tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Deletion of /opt/stack/data/nova/instances/4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723_del complete
Nov 22 08:25:20 user nova-compute[74348]: INFO nova.compute.manager [None req-0507e9b6-2ad9-4712-bd21-61ea923bf17f tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 22 08:25:20 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-0507e9b6-2ad9-4712-bd21-61ea923bf17f tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 08:25:20 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 08:25:20 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 08:25:21 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:25:21 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Took 0.62 seconds to deallocate network for instance.
Nov 22 08:25:21 user nova-compute[74348]: DEBUG nova.compute.manager [req-936ab396-644a-4757-ab84-ed4c2ded1493 req-1ae264ae-c76b-46c8-b4b5-8f027e3599b2 service nova] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Received event network-vif-deleted-7cc1a5d8-94a4-488d-9e21-67bd6037de7f {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:25:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-0507e9b6-2ad9-4712-bd21-61ea923bf17f tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:25:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-0507e9b6-2ad9-4712-bd21-61ea923bf17f tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:25:21 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-0507e9b6-2ad9-4712-bd21-61ea923bf17f tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:25:21 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-0507e9b6-2ad9-4712-bd21-61ea923bf17f tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:25:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-0507e9b6-2ad9-4712-bd21-61ea923bf17f tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.149s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:25:21 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-0507e9b6-2ad9-4712-bd21-61ea923bf17f tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Deleted allocations for instance 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723
Nov 22 08:25:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-0507e9b6-2ad9-4712-bd21-61ea923bf17f tempest-TestServerVolumeAttachmentScenario-318747544 tempest-TestServerVolumeAttachmentScenario-318747544-project-member] Lock "4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.817s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:25:21 user nova-compute[74348]: DEBUG nova.compute.manager [req-4db15bea-c665-462e-b91a-50d35fd8a7d5 req-ec44d87b-24bc-4407-a5ae-faf3a5cfef26 service nova] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Received event network-vif-plugged-7cc1a5d8-94a4-488d-9e21-67bd6037de7f {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:25:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4db15bea-c665-462e-b91a-50d35fd8a7d5 req-ec44d87b-24bc-4407-a5ae-faf3a5cfef26 service nova] Acquiring lock "4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:25:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4db15bea-c665-462e-b91a-50d35fd8a7d5 req-ec44d87b-24bc-4407-a5ae-faf3a5cfef26 service nova] Lock "4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:25:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-4db15bea-c665-462e-b91a-50d35fd8a7d5 req-ec44d87b-24bc-4407-a5ae-faf3a5cfef26 service nova] Lock "4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:25:21 user nova-compute[74348]: DEBUG nova.compute.manager [req-4db15bea-c665-462e-b91a-50d35fd8a7d5 req-ec44d87b-24bc-4407-a5ae-faf3a5cfef26 service nova] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] No waiting events found dispatching network-vif-plugged-7cc1a5d8-94a4-488d-9e21-67bd6037de7f {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:25:21 user nova-compute[74348]: WARNING nova.compute.manager [req-4db15bea-c665-462e-b91a-50d35fd8a7d5 req-ec44d87b-24bc-4407-a5ae-faf3a5cfef26 service nova] [instance: 4062d8e4-c7d1-4d8c-b7e1-4cefb9d1c723] Received unexpected event network-vif-plugged-7cc1a5d8-94a4-488d-9e21-67bd6037de7f for instance with vm_state deleted and task_state None.
Nov 22 08:25:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:25:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:25:35 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:25:40 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:25:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:25:50 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:25:51 user nova-compute[74348]: DEBUG nova.compute.manager [req-aa5ea63a-dafa-4c47-a3e5-c57b3b5ef003 req-38283b09-68c9-436c-805c-e122b5e76185 service nova] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Received event network-changed-47ad4e60-7966-44ea-b188-b78fe76158f4 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:25:51 user nova-compute[74348]: DEBUG nova.compute.manager [req-aa5ea63a-dafa-4c47-a3e5-c57b3b5ef003 req-38283b09-68c9-436c-805c-e122b5e76185 service nova] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Refreshing instance network info cache due to event network-changed-47ad4e60-7966-44ea-b188-b78fe76158f4. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:25:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-aa5ea63a-dafa-4c47-a3e5-c57b3b5ef003 req-38283b09-68c9-436c-805c-e122b5e76185 service nova] Acquiring lock "refresh_cache-e689f22e-9d71-40ed-a22e-1ded548b4f17" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:25:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-aa5ea63a-dafa-4c47-a3e5-c57b3b5ef003 req-38283b09-68c9-436c-805c-e122b5e76185 service nova] Acquired lock "refresh_cache-e689f22e-9d71-40ed-a22e-1ded548b4f17" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:25:51 user nova-compute[74348]: DEBUG nova.network.neutron [req-aa5ea63a-dafa-4c47-a3e5-c57b3b5ef003 req-38283b09-68c9-436c-805c-e122b5e76185 service nova] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Refreshing network info cache for port 47ad4e60-7966-44ea-b188-b78fe76158f4 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:25:51 user nova-compute[74348]: DEBUG nova.network.neutron [req-aa5ea63a-dafa-4c47-a3e5-c57b3b5ef003 req-38283b09-68c9-436c-805c-e122b5e76185 service nova] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Updated VIF entry in instance network info cache for port 47ad4e60-7966-44ea-b188-b78fe76158f4. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:25:51 user nova-compute[74348]: DEBUG nova.network.neutron [req-aa5ea63a-dafa-4c47-a3e5-c57b3b5ef003 req-38283b09-68c9-436c-805c-e122b5e76185 service nova] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Updating instance_info_cache with network_info: [{"id": "47ad4e60-7966-44ea-b188-b78fe76158f4", "address": "fa:16:3e:e8:2d:c5", "network": {"id": "0f3f2141-ab52-4769-afb8-9fc69aba88c5", "bridge": "br-int", "label": "tempest-TestStampPattern-455105330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04273ca629b04809bb095bdfce87b461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ad4e60-79", "ovs_interfaceid": "47ad4e60-7966-44ea-b188-b78fe76158f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:25:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-aa5ea63a-dafa-4c47-a3e5-c57b3b5ef003 req-38283b09-68c9-436c-805c-e122b5e76185 service nova] Releasing lock "refresh_cache-e689f22e-9d71-40ed-a22e-1ded548b4f17" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:25:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Acquiring lock "e689f22e-9d71-40ed-a22e-1ded548b4f17" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:25:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "e689f22e-9d71-40ed-a22e-1ded548b4f17" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:25:51 user nova-compute[74348]: DEBUG nova.objects.instance [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lazy-loading 'flavor' on Instance uuid e689f22e-9d71-40ed-a22e-1ded548b4f17 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:25:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "e689f22e-9d71-40ed-a22e-1ded548b4f17" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:25:52 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Acquiring lock "e689f22e-9d71-40ed-a22e-1ded548b4f17" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:25:52 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "e689f22e-9d71-40ed-a22e-1ded548b4f17" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:25:52 user nova-compute[74348]: INFO nova.compute.manager [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Attaching volume 4f527e6c-3c11-46cb-a3f8-d716cab09a0b to /dev/vdb
Nov 22 08:25:52 user nova-compute[74348]: DEBUG os_brick.utils [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:25:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:25:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:25:52 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[14834630-a86b-4697-9410-960f142dd27b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:25:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:25:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:25:52 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fb2795-ce07-499a-9452-aab0dceccc65]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:25:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:25:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:25:52 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2976f09c-1195-48ad-a72b-c4017dfe419a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:25:52 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[067be5c2-4876-456b-8010-4f29f55c1c19]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:25:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:25:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:25:52 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 08:25:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:25:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:25:52 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 08:25:52 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bd9923-bbbb-49af-823d-c383374a7f6b]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:25:52 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 08:25:52 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 08:25:52 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 08:25:52 user nova-compute[74348]: DEBUG os_brick.utils [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:25:52 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Updating existing volume attachment record: 64db3dff-36f1-469e-a83b-7ee9dcbcce97 {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 08:25:52 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:25:52 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:25:52 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-e689f22e-9d71-40ed-a22e-1ded548b4f17" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:25:52 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-e689f22e-9d71-40ed-a22e-1ded548b4f17" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:25:52 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 08:25:52 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Updating instance_info_cache with network_info: [{"id": "47ad4e60-7966-44ea-b188-b78fe76158f4", "address": "fa:16:3e:e8:2d:c5", "network": {"id": "0f3f2141-ab52-4769-afb8-9fc69aba88c5", "bridge": "br-int", "label": "tempest-TestStampPattern-455105330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04273ca629b04809bb095bdfce87b461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ad4e60-79", "ovs_interfaceid": "47ad4e60-7966-44ea-b188-b78fe76158f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:25:52 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-e689f22e-9d71-40ed-a22e-1ded548b4f17" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:25:52 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 08:25:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:25:55 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:25:55 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:25:57 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 08:25:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uWwGketh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:25:57 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:25:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:25:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:25:57 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:25:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:25:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:25:57 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 08:25:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:25:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:25:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fccc2a-8059-483f-a23e-809e53a1987a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:25:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 08:25:57 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:25:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:25:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:25:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[40885991-9de5-4bd8-895e-7c61c10ac7c6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:25:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b] added
Nov 22 08:25:57 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:25:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:25:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:25:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b52e1a4-e4ab-47e1-8760-6b3eeb26ce21]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:25:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:25:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:25:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:25:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c18971-084f-4989-942b-cb075f52fc49]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:25:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:25:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uWwGketh {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:25:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uWwGketh" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:25:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[28318d08-43f2-429d-8267-53d77d988371]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:25:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uWwGketh'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:25:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:25:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:25:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7603f19-b1b7-4b75-a3a5-5f94da632f4b]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:25:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:25:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:25:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:25:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afc66c6-9cf6-44ef-b57a-2e8b6971ca5b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:25:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 22 08:25:57 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:25:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 22 08:25:57 user nova-compute[74348]:  {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:25:57 user nova-compute[74348]: WARNING os_brick.initiator.connectors.iscsi [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 22 08:25:57 user nova-compute[74348]: 
Nov 22 08:25:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:25:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:25:58 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[04aa070a-8b62-42d3-adf5-baf8bf9f6395]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:25:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b, portal: 172.16.0.220,3260]
Nov 22 08:25:58 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b, portal: 172.16.0.220,3260] successful.
Nov 22 08:25:58 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:25:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:25:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:25:58 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8209c804-7e0e-43b3-a811-9a38deccde1a]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:25:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:25:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:25:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:25:58 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0dcfa4-592d-48e6-82cc-da026f3fac53]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:25:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b (non-flash)
Nov 22 08:25:58 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:25:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b (non-flash)
Nov 22 08:25:58 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:25:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.244s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:25:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 08:25:58 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 08:25:58 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 08:25:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:25:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:25:58 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4dc0f6-b352-4f2d-8b2c-df40d5d39230]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:25:58 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:25:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uWwGketh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 08:25:58 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:25:58 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:25:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:25:59 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] <== connect_volume: return (1277ms) {'type': 'block', 'scsi_wwn': '23463383535303362', 'path': '/dev/sdb'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:25:59 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463383535303362', 'path': '/dev/sdb'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 08:25:59 user nova-compute[74348]: DEBUG nova.objects.instance [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lazy-loading 'flavor' on Instance uuid e689f22e-9d71-40ed-a22e-1ded548b4f17 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:25:59 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 08:25:59 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:25:59 user nova-compute[74348]:   <source dev="/dev/sdb"/>
Nov 22 08:25:59 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:25:59 user nova-compute[74348]:   <serial>4f527e6c-3c11-46cb-a3f8-d716cab09a0b</serial>
Nov 22 08:25:59 user nova-compute[74348]: </disk>
Nov 22 08:25:59 user nova-compute[74348]:  {{(pid=74348) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 08:25:59 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:25:59 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:25:59 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:25:59 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] No VIF found with MAC fa:16:3e:e8:2d:c5, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:25:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-699f61ac-7963-418d-ac70-73171b5e4b1f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "e689f22e-9d71-40ed-a22e-1ded548b4f17" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.609s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:25:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:26:00 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:26:02 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:26:02 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:26:02 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:26:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1a107a2e-ac8f-495f-bddc-88257549f270 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Acquiring lock "e689f22e-9d71-40ed-a22e-1ded548b4f17" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:26:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1a107a2e-ac8f-495f-bddc-88257549f270 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "e689f22e-9d71-40ed-a22e-1ded548b4f17" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:26:02 user nova-compute[74348]: INFO nova.compute.manager [None req-1a107a2e-ac8f-495f-bddc-88257549f270 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Detaching volume 4f527e6c-3c11-46cb-a3f8-d716cab09a0b
Nov 22 08:26:03 user nova-compute[74348]: INFO nova.virt.block_device [None req-1a107a2e-ac8f-495f-bddc-88257549f270 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Attempting to driver detach volume 4f527e6c-3c11-46cb-a3f8-d716cab09a0b from mountpoint /dev/vdb
Nov 22 08:26:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-1a107a2e-ac8f-495f-bddc-88257549f270 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Attempting to detach device vdb from instance e689f22e-9d71-40ed-a22e-1ded548b4f17 from the persistent domain config. {{(pid=74348) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 08:26:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-1a107a2e-ac8f-495f-bddc-88257549f270 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:26:03 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:26:03 user nova-compute[74348]:   <source dev="/dev/sdb"/>
Nov 22 08:26:03 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:26:03 user nova-compute[74348]:   <serial>4f527e6c-3c11-46cb-a3f8-d716cab09a0b</serial>
Nov 22 08:26:03 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 08:26:03 user nova-compute[74348]: </disk>
Nov 22 08:26:03 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:26:03 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-1a107a2e-ac8f-495f-bddc-88257549f270 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Successfully detached device vdb from instance e689f22e-9d71-40ed-a22e-1ded548b4f17 from the persistent domain config.
Nov 22 08:26:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-1a107a2e-ac8f-495f-bddc-88257549f270 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e689f22e-9d71-40ed-a22e-1ded548b4f17 from the live domain config. {{(pid=74348) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 08:26:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-1a107a2e-ac8f-495f-bddc-88257549f270 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:26:03 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:26:03 user nova-compute[74348]:   <source dev="/dev/sdb"/>
Nov 22 08:26:03 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:26:03 user nova-compute[74348]:   <serial>4f527e6c-3c11-46cb-a3f8-d716cab09a0b</serial>
Nov 22 08:26:03 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 08:26:03 user nova-compute[74348]: </disk>
Nov 22 08:26:03 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:26:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-1a107a2e-ac8f-495f-bddc-88257549f270 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e689f22e-9d71-40ed-a22e-1ded548b4f17 {{(pid=74348) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 08:26:03 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:26:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:26:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:26:06 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:26:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:26:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:26:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:26:06 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:26:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:26:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:26:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:26:07 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:26:07 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:26:07 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:26:07 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=8988MB free_disk=24.937149047851562GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:26:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:26:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:26:07 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance e689f22e-9d71-40ed-a22e-1ded548b4f17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:26:07 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:26:07 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:26:07 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:26:07 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:26:07 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:26:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.216s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:26:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:26:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:26:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:26:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:26:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:26:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:26:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:26:23 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-1a107a2e-ac8f-495f-bddc-88257549f270 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e689f22e-9d71-40ed-a22e-1ded548b4f17 is timed out.
Nov 22 08:26:23 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-1a107a2e-ac8f-495f-bddc-88257549f270 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Successfully detached device vdb from instance e689f22e-9d71-40ed-a22e-1ded548b4f17 from the live domain config.
Nov 22 08:26:23 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a107a2e-ac8f-495f-bddc-88257549f270 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a107a2e-ac8f-495f-bddc-88257549f270 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uWwGketh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:26:23 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-1a107a2e-ac8f-495f-bddc-88257549f270 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:26:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-1a107a2e-ac8f-495f-bddc-88257549f270 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-1a107a2e-ac8f-495f-bddc-88257549f270 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a7f222-71f9-4780-8ae2-44b766b6c3dd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a107a2e-ac8f-495f-bddc-88257549f270 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 08:26:23 user nova-compute[74348]: No targets found.
Nov 22 08:26:23 user nova-compute[74348]: iSNS:
Nov 22 08:26:23 user nova-compute[74348]: No targets found.
Nov 22 08:26:23 user nova-compute[74348]: STATIC:
Nov 22 08:26:23 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b
Nov 22 08:26:23 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:26:23 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:26:23 user nova-compute[74348]: FIRMWARE:
Nov 22 08:26:23 user nova-compute[74348]: No targets found.
Nov 22 08:26:23 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a107a2e-ac8f-495f-bddc-88257549f270 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 08:26:23 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 08:26:23 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a107a2e-ac8f-495f-bddc-88257549f270 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c7d8da-40b8-4e4e-b331-1ea933a962e6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[02107886-3d99-4ff9-8318-482d3c35c3d8]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a107a2e-ac8f-495f-bddc-88257549f270 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b (non-flash)
Nov 22 08:26:23 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a107a2e-ac8f-495f-bddc-88257549f270 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b (non-flash)
Nov 22 08:26:23 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a107a2e-ac8f-495f-bddc-88257549f270 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f22283380d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b'): ({'sdb'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-1a107a2e-ac8f-495f-bddc-88257549f270 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Removing single pathed devices sdb {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[350672d8-bdfe-4055-8833-25cfae2c50fd]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f856e7-680c-4ee0-a92e-ab6102322a75]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-1a107a2e-ac8f-495f-bddc-88257549f270 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Flushing IO for device /dev/sdb {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6cc387-ab4b-4b5a-bc18-60e486cfc84a]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-1a107a2e-ac8f-495f-bddc-88257549f270 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6780fad3-169d-410e-b60d-1766cd33fe47]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-1a107a2e-ac8f-495f-bddc-88257549f270 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-1a107a2e-ac8f-495f-bddc-88257549f270 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] SCSI volumes sdb have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a107a2e-ac8f-495f-bddc-88257549f270 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.042s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b627558d-e2f1-4be7-9884-ed5c8bf940f5]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a107a2e-ac8f-495f-bddc-88257549f270 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[523a5361-8dfa-4287-bac8-1d7fa479b360]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a107a2e-ac8f-495f-bddc-88257549f270 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b, portal: 172.16.0.220,3260]
Nov 22 08:26:23 user nova-compute[74348]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b, portal: 172.16.0.220,3260] successful.
Nov 22 08:26:23 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f527e6c-3c11-46cb-a3f8-d716cab09a0b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b57c47-849b-439a-a0fe-bf955526a981]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a107a2e-ac8f-495f-bddc-88257549f270 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-1a107a2e-ac8f-495f-bddc-88257549f270 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a107a2e-ac8f-495f-bddc-88257549f270 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] <== disconnect_volume: return (304ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:26:23 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a107a2e-ac8f-495f-bddc-88257549f270 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 08:26:24 user nova-compute[74348]: DEBUG nova.objects.instance [None req-1a107a2e-ac8f-495f-bddc-88257549f270 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lazy-loading 'flavor' on Instance uuid e689f22e-9d71-40ed-a22e-1ded548b4f17 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:26:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1a107a2e-ac8f-495f-bddc-88257549f270 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "e689f22e-9d71-40ed-a22e-1ded548b4f17" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.645s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:26:24 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:26:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:26:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:26:35 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:26:40 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:26:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:26:50 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:26:55 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:26:55 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:26:55 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:26:55 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Rebuilding the list of instances to heal {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 08:26:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-e689f22e-9d71-40ed-a22e-1ded548b4f17" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:26:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-e689f22e-9d71-40ed-a22e-1ded548b4f17" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:26:55 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 08:26:55 user nova-compute[74348]: DEBUG nova.objects.instance [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lazy-loading 'info_cache' on Instance uuid e689f22e-9d71-40ed-a22e-1ded548b4f17 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:26:56 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Updating instance_info_cache with network_info: [{"id": "47ad4e60-7966-44ea-b188-b78fe76158f4", "address": "fa:16:3e:e8:2d:c5", "network": {"id": "0f3f2141-ab52-4769-afb8-9fc69aba88c5", "bridge": "br-int", "label": "tempest-TestStampPattern-455105330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04273ca629b04809bb095bdfce87b461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ad4e60-79", "ovs_interfaceid": "47ad4e60-7966-44ea-b188-b78fe76158f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:26:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-e689f22e-9d71-40ed-a22e-1ded548b4f17" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:26:56 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 08:26:56 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:26:57 user nova-compute[74348]: DEBUG nova.compute.manager [None req-d8cc1b34-b265-4204-852b-57fee9eb209f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:26:57 user nova-compute[74348]: INFO nova.compute.manager [None req-d8cc1b34-b265-4204-852b-57fee9eb209f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] instance snapshotting
Nov 22 08:26:57 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-d8cc1b34-b265-4204-852b-57fee9eb209f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Beginning live snapshot process
Nov 22 08:26:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-d8cc1b34-b265-4204-852b-57fee9eb209f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17/disk --force-share --output=json -f qcow2 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:26:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-d8cc1b34-b265-4204-852b-57fee9eb209f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17/disk --force-share --output=json -f qcow2" returned: 0 in 0.187s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:26:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-d8cc1b34-b265-4204-852b-57fee9eb209f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17/disk --force-share --output=json -f qcow2 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:26:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-d8cc1b34-b265-4204-852b-57fee9eb209f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17/disk --force-share --output=json -f qcow2" returned: 0 in 0.183s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:26:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-d8cc1b34-b265-4204-852b-57fee9eb209f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:26:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-d8cc1b34-b265-4204-852b-57fee9eb209f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.173s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:26:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-d8cc1b34-b265-4204-852b-57fee9eb209f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpvmjvcpc8/dbd4327aafb54340b92d150311714d28.delta 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:26:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-d8cc1b34-b265-4204-852b-57fee9eb209f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpvmjvcpc8/dbd4327aafb54340b92d150311714d28.delta 1073741824" returned: 0 in 0.046s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:26:58 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-d8cc1b34-b265-4204-852b-57fee9eb209f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 22 08:26:58 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:26:58 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:26:59 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-d8cc1b34-b265-4204-852b-57fee9eb209f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] COPY block job progress, current cursor: 65536 final cursor: 75563008 {{(pid=74348) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 08:26:59 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-d8cc1b34-b265-4204-852b-57fee9eb209f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74348) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 08:26:59 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-d8cc1b34-b265-4204-852b-57fee9eb209f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 22 08:26:59 user nova-compute[74348]: DEBUG nova.privsep.utils [None req-d8cc1b34-b265-4204-852b-57fee9eb209f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74348) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 08:26:59 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-d8cc1b34-b265-4204-852b-57fee9eb209f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpvmjvcpc8/dbd4327aafb54340b92d150311714d28.delta /opt/stack/data/nova/instances/snapshots/tmpvmjvcpc8/dbd4327aafb54340b92d150311714d28 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:27:00 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-d8cc1b34-b265-4204-852b-57fee9eb209f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpvmjvcpc8/dbd4327aafb54340b92d150311714d28.delta /opt/stack/data/nova/instances/snapshots/tmpvmjvcpc8/dbd4327aafb54340b92d150311714d28" returned: 0 in 0.441s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:27:00 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-d8cc1b34-b265-4204-852b-57fee9eb209f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Snapshot extracted, beginning image upload
Nov 22 08:27:00 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:27:00 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:27:02 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:27:02 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-d8cc1b34-b265-4204-852b-57fee9eb209f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Snapshot image upload complete
Nov 22 08:27:02 user nova-compute[74348]: INFO nova.compute.manager [None req-d8cc1b34-b265-4204-852b-57fee9eb209f tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Took 5.20 seconds to snapshot the instance on the hypervisor.
Nov 22 08:27:04 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:27:04 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:27:04 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:27:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Acquiring lock "6782e58b-70ee-47df-ab5c-dc10d76eb156" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:27:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "6782e58b-70ee-47df-ab5c-dc10d76eb156" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:27:05 user nova-compute[74348]: DEBUG nova.compute.manager [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 08:27:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:27:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:27:05 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 08:27:05 user nova-compute[74348]: INFO nova.compute.claims [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Claim successful on node user
Nov 22 08:27:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:27:05 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:27:05 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:27:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.213s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:27:05 user nova-compute[74348]: DEBUG nova.compute.manager [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 08:27:05 user nova-compute[74348]: DEBUG nova.compute.manager [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 08:27:05 user nova-compute[74348]: DEBUG nova.network.neutron [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 08:27:05 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 08:27:05 user nova-compute[74348]: DEBUG nova.compute.manager [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 08:27:05 user nova-compute[74348]: DEBUG nova.policy [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73f355ba09f346a3bbeec09de69630de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04273ca629b04809bb095bdfce87b461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 08:27:05 user nova-compute[74348]: DEBUG nova.compute.manager [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 08:27:05 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 08:27:05 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Creating image(s)
Nov 22 08:27:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Acquiring lock "/opt/stack/data/nova/instances/6782e58b-70ee-47df-ab5c-dc10d76eb156/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:27:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "/opt/stack/data/nova/instances/6782e58b-70ee-47df-ab5c-dc10d76eb156/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:27:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "/opt/stack/data/nova/instances/6782e58b-70ee-47df-ab5c-dc10d76eb156/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:27:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Acquiring lock "4f6a0fe9ef4f38aac9da872d6fdbaf6a28c73c99" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:27:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "4f6a0fe9ef4f38aac9da872d6fdbaf6a28c73c99" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:27:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f6a0fe9ef4f38aac9da872d6fdbaf6a28c73c99.part --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:27:06 user nova-compute[74348]: DEBUG nova.network.neutron [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Successfully created port: 340367c3-bbc3-458a-98cc-2a8e327db11c {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 08:27:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f6a0fe9ef4f38aac9da872d6fdbaf6a28c73c99.part --force-share --output=json" returned: 0 in 0.196s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:27:06 user nova-compute[74348]: DEBUG nova.virt.images [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] 048f5135-1438-4370-8beb-967a321b0c75 was qcow2, converting to raw {{(pid=74348) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 22 08:27:06 user nova-compute[74348]: DEBUG nova.privsep.utils [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74348) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 08:27:06 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4f6a0fe9ef4f38aac9da872d6fdbaf6a28c73c99.part /opt/stack/data/nova/instances/_base/4f6a0fe9ef4f38aac9da872d6fdbaf6a28c73c99.converted {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:27:07 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4f6a0fe9ef4f38aac9da872d6fdbaf6a28c73c99.part /opt/stack/data/nova/instances/_base/4f6a0fe9ef4f38aac9da872d6fdbaf6a28c73c99.converted" returned: 0 in 0.261s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:27:07 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f6a0fe9ef4f38aac9da872d6fdbaf6a28c73c99.converted --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:27:07 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f6a0fe9ef4f38aac9da872d6fdbaf6a28c73c99.converted --force-share --output=json" returned: 0 in 0.169s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:27:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "4f6a0fe9ef4f38aac9da872d6fdbaf6a28c73c99" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.525s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:27:07 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f6a0fe9ef4f38aac9da872d6fdbaf6a28c73c99 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:27:07 user nova-compute[74348]: DEBUG nova.network.neutron [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Successfully updated port: 340367c3-bbc3-458a-98cc-2a8e327db11c {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 08:27:07 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f6a0fe9ef4f38aac9da872d6fdbaf6a28c73c99 --force-share --output=json" returned: 0 in 0.179s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:27:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Acquiring lock "4f6a0fe9ef4f38aac9da872d6fdbaf6a28c73c99" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:27:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "4f6a0fe9ef4f38aac9da872d6fdbaf6a28c73c99" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:27:07 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f6a0fe9ef4f38aac9da872d6fdbaf6a28c73c99 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:27:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Acquiring lock "refresh_cache-6782e58b-70ee-47df-ab5c-dc10d76eb156" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:27:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Acquired lock "refresh_cache-6782e58b-70ee-47df-ab5c-dc10d76eb156" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:27:07 user nova-compute[74348]: DEBUG nova.network.neutron [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:27:07 user nova-compute[74348]: DEBUG nova.compute.manager [req-5b839e0a-26f3-4dde-95c4-fa7caef26d08 req-2ff6ab5c-931e-4cba-bba8-2c493ea06089 service nova] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Received event network-changed-340367c3-bbc3-458a-98cc-2a8e327db11c {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:27:07 user nova-compute[74348]: DEBUG nova.compute.manager [req-5b839e0a-26f3-4dde-95c4-fa7caef26d08 req-2ff6ab5c-931e-4cba-bba8-2c493ea06089 service nova] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Refreshing instance network info cache due to event network-changed-340367c3-bbc3-458a-98cc-2a8e327db11c. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:27:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-5b839e0a-26f3-4dde-95c4-fa7caef26d08 req-2ff6ab5c-931e-4cba-bba8-2c493ea06089 service nova] Acquiring lock "refresh_cache-6782e58b-70ee-47df-ab5c-dc10d76eb156" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:27:07 user nova-compute[74348]: DEBUG nova.network.neutron [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 08:27:07 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f6a0fe9ef4f38aac9da872d6fdbaf6a28c73c99 --force-share --output=json" returned: 0 in 0.177s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:27:07 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f6a0fe9ef4f38aac9da872d6fdbaf6a28c73c99,backing_fmt=raw /opt/stack/data/nova/instances/6782e58b-70ee-47df-ab5c-dc10d76eb156/disk 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:27:07 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f6a0fe9ef4f38aac9da872d6fdbaf6a28c73c99,backing_fmt=raw /opt/stack/data/nova/instances/6782e58b-70ee-47df-ab5c-dc10d76eb156/disk 1073741824" returned: 0 in 0.047s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:27:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "4f6a0fe9ef4f38aac9da872d6fdbaf6a28c73c99" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:27:07 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f6a0fe9ef4f38aac9da872d6fdbaf6a28c73c99 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:27:07 user nova-compute[74348]: DEBUG nova.network.neutron [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Updating instance_info_cache with network_info: [{"id": "340367c3-bbc3-458a-98cc-2a8e327db11c", "address": "fa:16:3e:3b:e2:af", "network": {"id": "0f3f2141-ab52-4769-afb8-9fc69aba88c5", "bridge": "br-int", "label": "tempest-TestStampPattern-455105330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04273ca629b04809bb095bdfce87b461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap340367c3-bb", "ovs_interfaceid": "340367c3-bbc3-458a-98cc-2a8e327db11c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:27:07 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f6a0fe9ef4f38aac9da872d6fdbaf6a28c73c99 --force-share --output=json" returned: 0 in 0.170s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:27:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 08:27:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Ensure instance console log exists: /opt/stack/data/nova/instances/6782e58b-70ee-47df-ab5c-dc10d76eb156/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 08:27:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:27:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:27:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:27:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Releasing lock "refresh_cache-6782e58b-70ee-47df-ab5c-dc10d76eb156" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:27:07 user nova-compute[74348]: DEBUG nova.compute.manager [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Instance network_info: |[{"id": "340367c3-bbc3-458a-98cc-2a8e327db11c", "address": "fa:16:3e:3b:e2:af", "network": {"id": "0f3f2141-ab52-4769-afb8-9fc69aba88c5", "bridge": "br-int", "label": "tempest-TestStampPattern-455105330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04273ca629b04809bb095bdfce87b461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap340367c3-bb", "ovs_interfaceid": "340367c3-bbc3-458a-98cc-2a8e327db11c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 08:27:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-5b839e0a-26f3-4dde-95c4-fa7caef26d08 req-2ff6ab5c-931e-4cba-bba8-2c493ea06089 service nova] Acquired lock "refresh_cache-6782e58b-70ee-47df-ab5c-dc10d76eb156" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:27:07 user nova-compute[74348]: DEBUG nova.network.neutron [req-5b839e0a-26f3-4dde-95c4-fa7caef26d08 req-2ff6ab5c-931e-4cba-bba8-2c493ea06089 service nova] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Refreshing network info cache for port 340367c3-bbc3-458a-98cc-2a8e327db11c {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:27:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Start _get_guest_xml network_info=[{"id": "340367c3-bbc3-458a-98cc-2a8e327db11c", "address": "fa:16:3e:3b:e2:af", "network": {"id": "0f3f2141-ab52-4769-afb8-9fc69aba88c5", "bridge": "br-int", "label": "tempest-TestStampPattern-455105330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04273ca629b04809bb095bdfce87b461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap340367c3-bb", "ovs_interfaceid": "340367c3-bbc3-458a-98cc-2a8e327db11c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='8f1c09976e8bd5234fbddb96c4c40fbb',container_format='bare',created_at=2023-11-22T08:26:57Z,direct_url=<?>,disk_format='qcow2',id=048f5135-1438-4370-8beb-967a321b0c75,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-369389735',owner='04273ca629b04809bb095bdfce87b461',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-22T08:27:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '048f5135-1438-4370-8beb-967a321b0c75'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 08:27:07 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:27:07 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:27:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 08:27:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 08:27:08 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 08:27:08 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 08:27:08 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 08:27:08 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='8f1c09976e8bd5234fbddb96c4c40fbb',container_format='bare',created_at=2023-11-22T08:26:57Z,direct_url=<?>,disk_format='qcow2',id=048f5135-1438-4370-8beb-967a321b0c75,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-369389735',owner='04273ca629b04809bb095bdfce87b461',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-22T08:27:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 08:27:08 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 08:27:08 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 08:27:08 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 08:27:08 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 08:27:08 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 08:27:08 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 08:27:08 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 08:27:08 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 08:27:08 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 08:27:08 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 08:27:08 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:27:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1187116575',display_name='tempest-TestStampPattern-server-1187116575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1187116575',id=46,image_ref='048f5135-1438-4370-8beb-967a321b0c75',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlUnFKyNzS1mXvj2RBw5DmkD3+qjXoM5C122ESkjwExv4XOw6jmefFB7MRuLNKPdpMIrw4H12Bhnzb8PXfADXBPw55Gh+zMggP8MIeh0a5Ad23x1r79I+bH41DLq7nsnA==',key_name='tempest-TestStampPattern-1253083494',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04273ca629b04809bb095bdfce87b461',ramdisk_id='',reservation_id='r-m0m9af59',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='e689f22e-9d71-40ed-a22e-1ded548b4f17',image_min_disk='1',image_min_ram='0',image_owner_id='04273ca629b04809bb095bdfce87b461',image_owner_project_name='tempest-TestStampPattern-1355704184',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1355704184-project-member',image_user_id='73f355ba09f346a3bbeec09de69630de',network_allocated='True',owner_project_name='tempest-TestStampPattern-1355704184',owner_user_name='tempest-TestStampPattern-1355704184-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:27:06Z,user_data=None,user_id='73f355ba09f346a3bbeec09de69630de',uuid=6782e58b-70ee-47df-ab5c-dc10d76eb156,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "340367c3-bbc3-458a-98cc-2a8e327db11c", "address": "fa:16:3e:3b:e2:af", "network": {"id": "0f3f2141-ab52-4769-afb8-9fc69aba88c5", "bridge": "br-int", "label": "tempest-TestStampPattern-455105330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04273ca629b04809bb095bdfce87b461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap340367c3-bb", "ovs_interfaceid": "340367c3-bbc3-458a-98cc-2a8e327db11c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 08:27:08 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Converting VIF {"id": "340367c3-bbc3-458a-98cc-2a8e327db11c", "address": "fa:16:3e:3b:e2:af", "network": {"id": "0f3f2141-ab52-4769-afb8-9fc69aba88c5", "bridge": "br-int", "label": "tempest-TestStampPattern-455105330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04273ca629b04809bb095bdfce87b461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap340367c3-bb", "ovs_interfaceid": "340367c3-bbc3-458a-98cc-2a8e327db11c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:27:08 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:e2:af,bridge_name='br-int',has_traffic_filtering=True,id=340367c3-bbc3-458a-98cc-2a8e327db11c,network=Network(0f3f2141-ab52-4769-afb8-9fc69aba88c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap340367c3-bb') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:27:08 user nova-compute[74348]: DEBUG nova.objects.instance [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lazy-loading 'pci_devices' on Instance uuid 6782e58b-70ee-47df-ab5c-dc10d76eb156 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:27:08 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] End _get_guest_xml xml=<domain type="kvm">
Nov 22 08:27:08 user nova-compute[74348]:   <uuid>6782e58b-70ee-47df-ab5c-dc10d76eb156</uuid>
Nov 22 08:27:08 user nova-compute[74348]:   <name>instance-0000002e</name>
Nov 22 08:27:08 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 08:27:08 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 08:27:08 user nova-compute[74348]:   <metadata>
Nov 22 08:27:08 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 08:27:08 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 08:27:08 user nova-compute[74348]:       <nova:name>tempest-TestStampPattern-server-1187116575</nova:name>
Nov 22 08:27:08 user nova-compute[74348]:       <nova:creationTime>2023-11-22 08:27:07</nova:creationTime>
Nov 22 08:27:08 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 08:27:08 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 08:27:08 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 08:27:08 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 08:27:08 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 08:27:08 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 08:27:08 user nova-compute[74348]:       </nova:flavor>
Nov 22 08:27:08 user nova-compute[74348]:       <nova:owner>
Nov 22 08:27:08 user nova-compute[74348]:         <nova:user uuid="73f355ba09f346a3bbeec09de69630de">tempest-TestStampPattern-1355704184-project-member</nova:user>
Nov 22 08:27:08 user nova-compute[74348]:         <nova:project uuid="04273ca629b04809bb095bdfce87b461">tempest-TestStampPattern-1355704184</nova:project>
Nov 22 08:27:08 user nova-compute[74348]:       </nova:owner>
Nov 22 08:27:08 user nova-compute[74348]:       <nova:root type="image" uuid="048f5135-1438-4370-8beb-967a321b0c75"/>
Nov 22 08:27:08 user nova-compute[74348]:       <nova:ports>
Nov 22 08:27:08 user nova-compute[74348]:         <nova:port uuid="340367c3-bbc3-458a-98cc-2a8e327db11c">
Nov 22 08:27:08 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 22 08:27:08 user nova-compute[74348]:         </nova:port>
Nov 22 08:27:08 user nova-compute[74348]:       </nova:ports>
Nov 22 08:27:08 user nova-compute[74348]:     </nova:instance>
Nov 22 08:27:08 user nova-compute[74348]:   </metadata>
Nov 22 08:27:08 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 08:27:08 user nova-compute[74348]:     <system>
Nov 22 08:27:08 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 08:27:08 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 08:27:08 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 08:27:08 user nova-compute[74348]:       <entry name="serial">6782e58b-70ee-47df-ab5c-dc10d76eb156</entry>
Nov 22 08:27:08 user nova-compute[74348]:       <entry name="uuid">6782e58b-70ee-47df-ab5c-dc10d76eb156</entry>
Nov 22 08:27:08 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 08:27:08 user nova-compute[74348]:     </system>
Nov 22 08:27:08 user nova-compute[74348]:   </sysinfo>
Nov 22 08:27:08 user nova-compute[74348]:   <os>
Nov 22 08:27:08 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 08:27:08 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 08:27:08 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 08:27:08 user nova-compute[74348]:   </os>
Nov 22 08:27:08 user nova-compute[74348]:   <features>
Nov 22 08:27:08 user nova-compute[74348]:     <acpi/>
Nov 22 08:27:08 user nova-compute[74348]:     <apic/>
Nov 22 08:27:08 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 08:27:08 user nova-compute[74348]:   </features>
Nov 22 08:27:08 user nova-compute[74348]:   <clock offset="utc">
Nov 22 08:27:08 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 08:27:08 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 08:27:08 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 08:27:08 user nova-compute[74348]:   </clock>
Nov 22 08:27:08 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 08:27:08 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 08:27:08 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 08:27:08 user nova-compute[74348]:   </cpu>
Nov 22 08:27:08 user nova-compute[74348]:   <devices>
Nov 22 08:27:08 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 08:27:08 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 08:27:08 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/6782e58b-70ee-47df-ab5c-dc10d76eb156/disk"/>
Nov 22 08:27:08 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 08:27:08 user nova-compute[74348]:     </disk>
Nov 22 08:27:08 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 08:27:08 user nova-compute[74348]:       <mac address="fa:16:3e:3b:e2:af"/>
Nov 22 08:27:08 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:27:08 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 08:27:08 user nova-compute[74348]:       <target dev="tap340367c3-bb"/>
Nov 22 08:27:08 user nova-compute[74348]:     </interface>
Nov 22 08:27:08 user nova-compute[74348]:     <serial type="pty">
Nov 22 08:27:08 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/6782e58b-70ee-47df-ab5c-dc10d76eb156/console.log" append="off"/>
Nov 22 08:27:08 user nova-compute[74348]:     </serial>
Nov 22 08:27:08 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 08:27:08 user nova-compute[74348]:     <video>
Nov 22 08:27:08 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:27:08 user nova-compute[74348]:     </video>
Nov 22 08:27:08 user nova-compute[74348]:     <rng model="virtio">
Nov 22 08:27:08 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 08:27:08 user nova-compute[74348]:     </rng>
Nov 22 08:27:08 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 08:27:08 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 08:27:08 user nova-compute[74348]:       <stats period="10"/>
Nov 22 08:27:08 user nova-compute[74348]:     </memballoon>
Nov 22 08:27:08 user nova-compute[74348]:   </devices>
Nov 22 08:27:08 user nova-compute[74348]: </domain>
Nov 22 08:27:08 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 08:27:08 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:27:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1187116575',display_name='tempest-TestStampPattern-server-1187116575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1187116575',id=46,image_ref='048f5135-1438-4370-8beb-967a321b0c75',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlUnFKyNzS1mXvj2RBw5DmkD3+qjXoM5C122ESkjwExv4XOw6jmefFB7MRuLNKPdpMIrw4H12Bhnzb8PXfADXBPw55Gh+zMggP8MIeh0a5Ad23x1r79I+bH41DLq7nsnA==',key_name='tempest-TestStampPattern-1253083494',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04273ca629b04809bb095bdfce87b461',ramdisk_id='',reservation_id='r-m0m9af59',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='e689f22e-9d71-40ed-a22e-1ded548b4f17',image_min_disk='1',image_min_ram='0',image_owner_id='04273ca629b04809bb095bdfce87b461',image_owner_project_name='tempest-TestStampPattern-1355704184',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1355704184-project-member',image_user_id='73f355ba09f346a3bbeec09de69630de',network_allocated='True',owner_project_name='tempest-TestStampPattern-1355704184',owner_user_name='tempest-TestStampPattern-1355704184-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:27:06Z,user_data=None,user_id='73f355ba09f346a3bbeec09de69630de',uuid=6782e58b-70ee-47df-ab5c-dc10d76eb156,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "340367c3-bbc3-458a-98cc-2a8e327db11c", "address": "fa:16:3e:3b:e2:af", "network": {"id": "0f3f2141-ab52-4769-afb8-9fc69aba88c5", "bridge": "br-int", "label": "tempest-TestStampPattern-455105330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04273ca629b04809bb095bdfce87b461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap340367c3-bb", "ovs_interfaceid": "340367c3-bbc3-458a-98cc-2a8e327db11c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 08:27:08 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Converting VIF {"id": "340367c3-bbc3-458a-98cc-2a8e327db11c", "address": "fa:16:3e:3b:e2:af", "network": {"id": "0f3f2141-ab52-4769-afb8-9fc69aba88c5", "bridge": "br-int", "label": "tempest-TestStampPattern-455105330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04273ca629b04809bb095bdfce87b461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap340367c3-bb", "ovs_interfaceid": "340367c3-bbc3-458a-98cc-2a8e327db11c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:27:08 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:e2:af,bridge_name='br-int',has_traffic_filtering=True,id=340367c3-bbc3-458a-98cc-2a8e327db11c,network=Network(0f3f2141-ab52-4769-afb8-9fc69aba88c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap340367c3-bb') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:27:08 user nova-compute[74348]: DEBUG os_vif [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:e2:af,bridge_name='br-int',has_traffic_filtering=True,id=340367c3-bbc3-458a-98cc-2a8e327db11c,network=Network(0f3f2141-ab52-4769-afb8-9fc69aba88c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap340367c3-bb') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 08:27:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:27:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:27:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 08:27:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:27:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0b3d0ba2-a00c-52b7-8641-3376744edece', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:27:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:27:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:27:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:27:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap340367c3-bb, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:27:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap340367c3-bb, col_values=(('qos', UUID('9b4cf13b-25f3-4c14-bd7a-ccdb6c292202')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:27:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap340367c3-bb, col_values=(('external_ids', {'iface-id': '340367c3-bbc3-458a-98cc-2a8e327db11c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:e2:af', 'vm-uuid': '6782e58b-70ee-47df-ab5c-dc10d76eb156'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:27:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:27:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:27:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:27:08 user nova-compute[74348]: INFO os_vif [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:e2:af,bridge_name='br-int',has_traffic_filtering=True,id=340367c3-bbc3-458a-98cc-2a8e327db11c,network=Network(0f3f2141-ab52-4769-afb8-9fc69aba88c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap340367c3-bb')
Nov 22 08:27:08 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:27:08 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] No VIF found with MAC fa:16:3e:3b:e2:af, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:27:08 user nova-compute[74348]: DEBUG nova.network.neutron [req-5b839e0a-26f3-4dde-95c4-fa7caef26d08 req-2ff6ab5c-931e-4cba-bba8-2c493ea06089 service nova] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Updated VIF entry in instance network info cache for port 340367c3-bbc3-458a-98cc-2a8e327db11c. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:27:08 user nova-compute[74348]: DEBUG nova.network.neutron [req-5b839e0a-26f3-4dde-95c4-fa7caef26d08 req-2ff6ab5c-931e-4cba-bba8-2c493ea06089 service nova] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Updating instance_info_cache with network_info: [{"id": "340367c3-bbc3-458a-98cc-2a8e327db11c", "address": "fa:16:3e:3b:e2:af", "network": {"id": "0f3f2141-ab52-4769-afb8-9fc69aba88c5", "bridge": "br-int", "label": "tempest-TestStampPattern-455105330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04273ca629b04809bb095bdfce87b461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap340367c3-bb", "ovs_interfaceid": "340367c3-bbc3-458a-98cc-2a8e327db11c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:27:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-5b839e0a-26f3-4dde-95c4-fa7caef26d08 req-2ff6ab5c-931e-4cba-bba8-2c493ea06089 service nova] Releasing lock "refresh_cache-6782e58b-70ee-47df-ab5c-dc10d76eb156" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:27:08 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:27:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:27:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:27:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:27:08 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:27:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:27:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:27:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:27:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:27:09 user nova-compute[74348]: DEBUG nova.compute.manager [req-5b1120a8-a8aa-45f4-a3dc-24613b5b57b4 req-b5d8e329-5330-4d3e-bb71-69c537c92d31 service nova] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Received event network-vif-plugged-340367c3-bbc3-458a-98cc-2a8e327db11c {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:27:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-5b1120a8-a8aa-45f4-a3dc-24613b5b57b4 req-b5d8e329-5330-4d3e-bb71-69c537c92d31 service nova] Acquiring lock "6782e58b-70ee-47df-ab5c-dc10d76eb156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:27:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-5b1120a8-a8aa-45f4-a3dc-24613b5b57b4 req-b5d8e329-5330-4d3e-bb71-69c537c92d31 service nova] Lock "6782e58b-70ee-47df-ab5c-dc10d76eb156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:27:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-5b1120a8-a8aa-45f4-a3dc-24613b5b57b4 req-b5d8e329-5330-4d3e-bb71-69c537c92d31 service nova] Lock "6782e58b-70ee-47df-ab5c-dc10d76eb156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:27:09 user nova-compute[74348]: DEBUG nova.compute.manager [req-5b1120a8-a8aa-45f4-a3dc-24613b5b57b4 req-b5d8e329-5330-4d3e-bb71-69c537c92d31 service nova] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] No waiting events found dispatching network-vif-plugged-340367c3-bbc3-458a-98cc-2a8e327db11c {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:27:09 user nova-compute[74348]: WARNING nova.compute.manager [req-5b1120a8-a8aa-45f4-a3dc-24613b5b57b4 req-b5d8e329-5330-4d3e-bb71-69c537c92d31 service nova] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Received unexpected event network-vif-plugged-340367c3-bbc3-458a-98cc-2a8e327db11c for instance with vm_state building and task_state spawning.
Nov 22 08:27:09 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6782e58b-70ee-47df-ab5c-dc10d76eb156/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:27:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6782e58b-70ee-47df-ab5c-dc10d76eb156/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:27:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6782e58b-70ee-47df-ab5c-dc10d76eb156/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:27:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6782e58b-70ee-47df-ab5c-dc10d76eb156/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:27:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:27:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:27:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:27:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:27:11 user nova-compute[74348]: DEBUG nova.compute.manager [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 08:27:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 08:27:11 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:27:11 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:27:11 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=9034MB free_disk=24.791893005371094GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:27:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:27:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:27:11 user nova-compute[74348]: DEBUG nova.compute.manager [req-0484df51-87f2-4473-9b87-591066b94808 req-16b1966f-eb3b-4734-b0d9-36886ae85b88 service nova] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Received event network-vif-plugged-340367c3-bbc3-458a-98cc-2a8e327db11c {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:27:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-0484df51-87f2-4473-9b87-591066b94808 req-16b1966f-eb3b-4734-b0d9-36886ae85b88 service nova] Acquiring lock "6782e58b-70ee-47df-ab5c-dc10d76eb156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:27:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-0484df51-87f2-4473-9b87-591066b94808 req-16b1966f-eb3b-4734-b0d9-36886ae85b88 service nova] Lock "6782e58b-70ee-47df-ab5c-dc10d76eb156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:27:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-0484df51-87f2-4473-9b87-591066b94808 req-16b1966f-eb3b-4734-b0d9-36886ae85b88 service nova] Lock "6782e58b-70ee-47df-ab5c-dc10d76eb156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:27:11 user nova-compute[74348]: DEBUG nova.compute.manager [req-0484df51-87f2-4473-9b87-591066b94808 req-16b1966f-eb3b-4734-b0d9-36886ae85b88 service nova] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] No waiting events found dispatching network-vif-plugged-340367c3-bbc3-458a-98cc-2a8e327db11c {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:27:11 user nova-compute[74348]: WARNING nova.compute.manager [req-0484df51-87f2-4473-9b87-591066b94808 req-16b1966f-eb3b-4734-b0d9-36886ae85b88 service nova] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Received unexpected event network-vif-plugged-340367c3-bbc3-458a-98cc-2a8e327db11c for instance with vm_state building and task_state spawning.
Nov 22 08:27:11 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Instance spawned successfully.
Nov 22 08:27:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 08:27:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:27:11 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:27:11 user nova-compute[74348]: INFO nova.compute.manager [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Took 5.94 seconds to spawn the instance on the hypervisor.
Nov 22 08:27:11 user nova-compute[74348]: DEBUG nova.compute.manager [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:27:11 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance e689f22e-9d71-40ed-a22e-1ded548b4f17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:27:11 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 6782e58b-70ee-47df-ab5c-dc10d76eb156 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:27:11 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:27:11 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:27:11 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:27:11 user nova-compute[74348]: INFO nova.compute.manager [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Took 6.52 seconds to build instance.
Nov 22 08:27:11 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:27:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-be08851f-0e5e-4942-b473-5449fd4103d3 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "6782e58b-70ee-47df-ab5c-dc10d76eb156" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.661s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:27:11 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:27:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.244s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:27:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:27:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:27:15 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:27:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:27:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:27:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:27:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:27:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:27:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:27:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:27:39 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:27:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:27:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:27:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:27:54 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:27:54 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:27:54 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Rebuilding the list of instances to heal {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 08:27:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-e689f22e-9d71-40ed-a22e-1ded548b4f17" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:27:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-e689f22e-9d71-40ed-a22e-1ded548b4f17" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:27:54 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 08:27:54 user nova-compute[74348]: DEBUG nova.objects.instance [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lazy-loading 'info_cache' on Instance uuid e689f22e-9d71-40ed-a22e-1ded548b4f17 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:27:55 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Updating instance_info_cache with network_info: [{"id": "47ad4e60-7966-44ea-b188-b78fe76158f4", "address": "fa:16:3e:e8:2d:c5", "network": {"id": "0f3f2141-ab52-4769-afb8-9fc69aba88c5", "bridge": "br-int", "label": "tempest-TestStampPattern-455105330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04273ca629b04809bb095bdfce87b461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ad4e60-79", "ovs_interfaceid": "47ad4e60-7966-44ea-b188-b78fe76158f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:27:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-e689f22e-9d71-40ed-a22e-1ded548b4f17" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:27:55 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 08:27:56 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:27:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:27:59 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:27:59 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:28:01 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:28:02 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:28:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:28:04 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:28:06 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:28:06 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:28:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:28:10 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:28:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:28:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:28:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:28:10 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:28:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6782e58b-70ee-47df-ab5c-dc10d76eb156/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:28:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6782e58b-70ee-47df-ab5c-dc10d76eb156/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:28:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6782e58b-70ee-47df-ab5c-dc10d76eb156/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:28:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6782e58b-70ee-47df-ab5c-dc10d76eb156/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:28:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:28:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:28:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:28:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:28:11 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:28:11 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:28:11 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=8954MB free_disk=24.78964614868164GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:28:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:28:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:28:11 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance e689f22e-9d71-40ed-a22e-1ded548b4f17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:28:11 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 6782e58b-70ee-47df-ab5c-dc10d76eb156 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:28:11 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:28:11 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:28:11 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:28:11 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:28:11 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:28:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.226s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:28:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:28:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:28:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:28:23 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:28:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:28:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:28:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:28:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:28:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:28:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:28:23 user nova-compute[74348]: DEBUG nova.virt.libvirt.imagecache [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Verify base images {{(pid=74348) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 22 08:28:23 user nova-compute[74348]: DEBUG nova.virt.libvirt.imagecache [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Image id 048f5135-1438-4370-8beb-967a321b0c75 yields fingerprint 4f6a0fe9ef4f38aac9da872d6fdbaf6a28c73c99 {{(pid=74348) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 22 08:28:23 user nova-compute[74348]: INFO nova.virt.libvirt.imagecache [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] image 048f5135-1438-4370-8beb-967a321b0c75 at (/opt/stack/data/nova/instances/_base/4f6a0fe9ef4f38aac9da872d6fdbaf6a28c73c99): checking
Nov 22 08:28:23 user nova-compute[74348]: DEBUG nova.virt.libvirt.imagecache [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] image 048f5135-1438-4370-8beb-967a321b0c75 at (/opt/stack/data/nova/instances/_base/4f6a0fe9ef4f38aac9da872d6fdbaf6a28c73c99): image is in use {{(pid=74348) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 22 08:28:23 user nova-compute[74348]: DEBUG nova.virt.libvirt.imagecache [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74348) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 22 08:28:23 user nova-compute[74348]: DEBUG nova.virt.libvirt.imagecache [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Image id 7abe07a9-4f70-41a1-a0fc-c06f9c8dd109 yields fingerprint 98e1a2fcccec982a0896b68bf8d9d2efe3433263 {{(pid=74348) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 22 08:28:23 user nova-compute[74348]: INFO nova.virt.libvirt.imagecache [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] image 7abe07a9-4f70-41a1-a0fc-c06f9c8dd109 at (/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263): checking
Nov 22 08:28:23 user nova-compute[74348]: DEBUG nova.virt.libvirt.imagecache [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] image 7abe07a9-4f70-41a1-a0fc-c06f9c8dd109 at (/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263): image is in use {{(pid=74348) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 22 08:28:23 user nova-compute[74348]: DEBUG nova.virt.libvirt.imagecache [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] e689f22e-9d71-40ed-a22e-1ded548b4f17 is a valid instance name {{(pid=74348) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 22 08:28:23 user nova-compute[74348]: DEBUG nova.virt.libvirt.imagecache [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] e689f22e-9d71-40ed-a22e-1ded548b4f17 has a disk file {{(pid=74348) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 22 08:28:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:28:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:28:23 user nova-compute[74348]: DEBUG nova.virt.libvirt.imagecache [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance e689f22e-9d71-40ed-a22e-1ded548b4f17 is backed by 98e1a2fcccec982a0896b68bf8d9d2efe3433263 {{(pid=74348) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 22 08:28:23 user nova-compute[74348]: DEBUG nova.virt.libvirt.imagecache [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] 6782e58b-70ee-47df-ab5c-dc10d76eb156 is a valid instance name {{(pid=74348) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 22 08:28:23 user nova-compute[74348]: DEBUG nova.virt.libvirt.imagecache [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] 6782e58b-70ee-47df-ab5c-dc10d76eb156 has a disk file {{(pid=74348) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 22 08:28:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6782e58b-70ee-47df-ab5c-dc10d76eb156/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:28:23 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6782e58b-70ee-47df-ab5c-dc10d76eb156/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:28:23 user nova-compute[74348]: DEBUG nova.virt.libvirt.imagecache [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 6782e58b-70ee-47df-ab5c-dc10d76eb156 is backed by 4f6a0fe9ef4f38aac9da872d6fdbaf6a28c73c99 {{(pid=74348) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 22 08:28:23 user nova-compute[74348]: WARNING nova.virt.libvirt.imagecache [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Unknown base file: /opt/stack/data/nova/instances/_base/7e6b8e7450cb8e786a5bb42a4d499f23fc2cbed0
Nov 22 08:28:23 user nova-compute[74348]: WARNING nova.virt.libvirt.imagecache [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Unknown base file: /opt/stack/data/nova/instances/_base/b7a5e4adbbfeb9a70d9166224120b3b8d8eb4b0b
Nov 22 08:28:23 user nova-compute[74348]: WARNING nova.virt.libvirt.imagecache [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Unknown base file: /opt/stack/data/nova/instances/_base/561eca1592e32a8ffe2eacefe61059b4b753129d
Nov 22 08:28:23 user nova-compute[74348]: WARNING nova.virt.libvirt.imagecache [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Unknown base file: /opt/stack/data/nova/instances/_base/c0a0ab07e0255008917ccfe2a84fa5c48f3999af
Nov 22 08:28:23 user nova-compute[74348]: WARNING nova.virt.libvirt.imagecache [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Unknown base file: /opt/stack/data/nova/instances/_base/0f06c382829d3f4aaafb7d4b649f1ad2bf44f3dc
Nov 22 08:28:23 user nova-compute[74348]: WARNING nova.virt.libvirt.imagecache [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Unknown base file: /opt/stack/data/nova/instances/_base/93ba6134c82bcbb951d3cc380862ab9b2f4cfe57
Nov 22 08:28:23 user nova-compute[74348]: WARNING nova.virt.libvirt.imagecache [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Unknown base file: /opt/stack/data/nova/instances/_base/7c8539d873e018dbefb214a5b90fc70a13691f17
Nov 22 08:28:23 user nova-compute[74348]: WARNING nova.virt.libvirt.imagecache [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Unknown base file: /opt/stack/data/nova/instances/_base/6745adfa35c492ddbf81ca32efdb81eeb7ca9e1a
Nov 22 08:28:23 user nova-compute[74348]: INFO nova.virt.libvirt.imagecache [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Active base files: /opt/stack/data/nova/instances/_base/4f6a0fe9ef4f38aac9da872d6fdbaf6a28c73c99 /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263
Nov 22 08:28:23 user nova-compute[74348]: INFO nova.virt.libvirt.imagecache [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Removable base files: /opt/stack/data/nova/instances/_base/7e6b8e7450cb8e786a5bb42a4d499f23fc2cbed0 /opt/stack/data/nova/instances/_base/b7a5e4adbbfeb9a70d9166224120b3b8d8eb4b0b /opt/stack/data/nova/instances/_base/561eca1592e32a8ffe2eacefe61059b4b753129d /opt/stack/data/nova/instances/_base/c0a0ab07e0255008917ccfe2a84fa5c48f3999af /opt/stack/data/nova/instances/_base/0f06c382829d3f4aaafb7d4b649f1ad2bf44f3dc /opt/stack/data/nova/instances/_base/93ba6134c82bcbb951d3cc380862ab9b2f4cfe57 /opt/stack/data/nova/instances/_base/7c8539d873e018dbefb214a5b90fc70a13691f17 /opt/stack/data/nova/instances/_base/6745adfa35c492ddbf81ca32efdb81eeb7ca9e1a
Nov 22 08:28:23 user nova-compute[74348]: INFO nova.virt.libvirt.imagecache [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7e6b8e7450cb8e786a5bb42a4d499f23fc2cbed0
Nov 22 08:28:23 user nova-compute[74348]: INFO nova.virt.libvirt.imagecache [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b7a5e4adbbfeb9a70d9166224120b3b8d8eb4b0b
Nov 22 08:28:23 user nova-compute[74348]: INFO nova.virt.libvirt.imagecache [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/561eca1592e32a8ffe2eacefe61059b4b753129d
Nov 22 08:28:23 user nova-compute[74348]: INFO nova.virt.libvirt.imagecache [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c0a0ab07e0255008917ccfe2a84fa5c48f3999af
Nov 22 08:28:23 user nova-compute[74348]: INFO nova.virt.libvirt.imagecache [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0f06c382829d3f4aaafb7d4b649f1ad2bf44f3dc
Nov 22 08:28:23 user nova-compute[74348]: INFO nova.virt.libvirt.imagecache [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/93ba6134c82bcbb951d3cc380862ab9b2f4cfe57
Nov 22 08:28:23 user nova-compute[74348]: INFO nova.virt.libvirt.imagecache [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7c8539d873e018dbefb214a5b90fc70a13691f17
Nov 22 08:28:23 user nova-compute[74348]: INFO nova.virt.libvirt.imagecache [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6745adfa35c492ddbf81ca32efdb81eeb7ca9e1a
Nov 22 08:28:23 user nova-compute[74348]: DEBUG nova.virt.libvirt.imagecache [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Verification complete {{(pid=74348) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 22 08:28:23 user nova-compute[74348]: DEBUG nova.virt.libvirt.imagecache [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Verify swap images {{(pid=74348) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 22 08:28:23 user nova-compute[74348]: DEBUG nova.virt.libvirt.imagecache [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Verify ephemeral images {{(pid=74348) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 22 08:28:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:28:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:28:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:28:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:28:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:28:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:28:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:28:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:28:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:28:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:28:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:28:54 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:28:54 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:28:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-6782e58b-70ee-47df-ab5c-dc10d76eb156" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:28:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-6782e58b-70ee-47df-ab5c-dc10d76eb156" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:28:55 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 08:28:55 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Updating instance_info_cache with network_info: [{"id": "340367c3-bbc3-458a-98cc-2a8e327db11c", "address": "fa:16:3e:3b:e2:af", "network": {"id": "0f3f2141-ab52-4769-afb8-9fc69aba88c5", "bridge": "br-int", "label": "tempest-TestStampPattern-455105330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04273ca629b04809bb095bdfce87b461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap340367c3-bb", "ovs_interfaceid": "340367c3-bbc3-458a-98cc-2a8e327db11c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:28:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-6782e58b-70ee-47df-ab5c-dc10d76eb156" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:28:55 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 08:28:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:28:56 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:28:57 user nova-compute[74348]: DEBUG nova.compute.manager [req-23e4125c-1ef5-40fa-bdf6-17221003b1e9 req-0f0dcf88-efa3-4981-96b5-8d54d47c4c44 service nova] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Received event network-changed-340367c3-bbc3-458a-98cc-2a8e327db11c {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:28:57 user nova-compute[74348]: DEBUG nova.compute.manager [req-23e4125c-1ef5-40fa-bdf6-17221003b1e9 req-0f0dcf88-efa3-4981-96b5-8d54d47c4c44 service nova] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Refreshing instance network info cache due to event network-changed-340367c3-bbc3-458a-98cc-2a8e327db11c. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:28:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-23e4125c-1ef5-40fa-bdf6-17221003b1e9 req-0f0dcf88-efa3-4981-96b5-8d54d47c4c44 service nova] Acquiring lock "refresh_cache-6782e58b-70ee-47df-ab5c-dc10d76eb156" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:28:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-23e4125c-1ef5-40fa-bdf6-17221003b1e9 req-0f0dcf88-efa3-4981-96b5-8d54d47c4c44 service nova] Acquired lock "refresh_cache-6782e58b-70ee-47df-ab5c-dc10d76eb156" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:28:57 user nova-compute[74348]: DEBUG nova.network.neutron [req-23e4125c-1ef5-40fa-bdf6-17221003b1e9 req-0f0dcf88-efa3-4981-96b5-8d54d47c4c44 service nova] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Refreshing network info cache for port 340367c3-bbc3-458a-98cc-2a8e327db11c {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:28:57 user nova-compute[74348]: DEBUG nova.network.neutron [req-23e4125c-1ef5-40fa-bdf6-17221003b1e9 req-0f0dcf88-efa3-4981-96b5-8d54d47c4c44 service nova] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Updated VIF entry in instance network info cache for port 340367c3-bbc3-458a-98cc-2a8e327db11c. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:28:57 user nova-compute[74348]: DEBUG nova.network.neutron [req-23e4125c-1ef5-40fa-bdf6-17221003b1e9 req-0f0dcf88-efa3-4981-96b5-8d54d47c4c44 service nova] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Updating instance_info_cache with network_info: [{"id": "340367c3-bbc3-458a-98cc-2a8e327db11c", "address": "fa:16:3e:3b:e2:af", "network": {"id": "0f3f2141-ab52-4769-afb8-9fc69aba88c5", "bridge": "br-int", "label": "tempest-TestStampPattern-455105330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04273ca629b04809bb095bdfce87b461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap340367c3-bb", "ovs_interfaceid": "340367c3-bbc3-458a-98cc-2a8e327db11c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:28:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-23e4125c-1ef5-40fa-bdf6-17221003b1e9 req-0f0dcf88-efa3-4981-96b5-8d54d47c4c44 service nova] Releasing lock "refresh_cache-6782e58b-70ee-47df-ab5c-dc10d76eb156" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:28:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Acquiring lock "6782e58b-70ee-47df-ab5c-dc10d76eb156" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:28:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "6782e58b-70ee-47df-ab5c-dc10d76eb156" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:28:57 user nova-compute[74348]: DEBUG nova.objects.instance [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lazy-loading 'flavor' on Instance uuid 6782e58b-70ee-47df-ab5c-dc10d76eb156 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:28:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "6782e58b-70ee-47df-ab5c-dc10d76eb156" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:28:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Acquiring lock "6782e58b-70ee-47df-ab5c-dc10d76eb156" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:28:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "6782e58b-70ee-47df-ab5c-dc10d76eb156" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:28:57 user nova-compute[74348]: INFO nova.compute.manager [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Attaching volume 620ef81b-f120-49c1-b172-843cb7c982b7 to /dev/vdb
Nov 22 08:28:57 user nova-compute[74348]: DEBUG os_brick.utils [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:28:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:28:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:28:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f16350-3df4-4bef-9763-ab3e062ffbc8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:28:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:28:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:28:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ed706f-360e-4874-9278-6b59007ed0f1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:28:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:28:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:28:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e44770d-f346-4c89-ae76-6fb3df212ccc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:28:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e7f72c-fdfb-4085-8d4b-f39722180963]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:28:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:28:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:28:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 08:28:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:28:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:28:57 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 08:28:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac2afc4-2b4d-4b87-8f60-8e386e432079]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:28:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 08:28:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 08:28:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 08:28:57 user nova-compute[74348]: DEBUG os_brick.utils [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:28:57 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Updating existing volume attachment record: 2af19682-0a82-4eae-b7b8-423e908e5f4b {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 08:28:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:28:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:29:00 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:29:00 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:29:02 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:29:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:29:03 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:29:03 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FSVfQIic', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:29:04 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:29:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:29:04 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:29:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:29:04 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 08:29:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7 -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e04f03-262b-4134-9034-53e891e8f2f9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 08:29:04 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a0473c-1bc5-4404-9caf-68ecc97a9ebe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7] added
Nov 22 08:29:04 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4878b282-8b56-4255-9b7b-e062abb805fb]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f5e32c-54ec-428e-ad96-5581bb2f01f2]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FSVfQIic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FSVfQIic" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b4935d-461d-4b44-b73b-5fc2f2f175ca]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FSVfQIic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec62188-702d-4afe-8ae9-3523c6925a27]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc60e1ed-15c4-4a66-acdc-debd4877b00e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 22 08:29:04 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 22 08:29:04 user nova-compute[74348]:  {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:29:04 user nova-compute[74348]: WARNING os_brick.initiator.connectors.iscsi [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 22 08:29:04 user nova-compute[74348]: 
Nov 22 08:29:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7 -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa81ee9-d008-44ac-a45e-a469db87d161]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7, portal: 172.16.0.220,3260]
Nov 22 08:29:04 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7, portal: 172.16.0.220,3260] successful.
Nov 22 08:29:04 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0073aafb-e5ab-4c15-868c-d6b8c72b23a5]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e484fa8-cec6-42de-82a2-684df96d0fc9]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7 (non-flash)
Nov 22 08:29:04 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7 (non-flash)
Nov 22 08:29:04 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[28420f92-a2bc-4c1d-8a2d-7031fa36eb28]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FSVfQIic', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:29:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:29:05 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:29:05 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '26362663637386461', 'path': '/dev/sdb'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:29:05 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362663637386461', 'path': '/dev/sdb'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 08:29:05 user nova-compute[74348]: DEBUG nova.objects.instance [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lazy-loading 'flavor' on Instance uuid 6782e58b-70ee-47df-ab5c-dc10d76eb156 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:29:05 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 08:29:05 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:29:05 user nova-compute[74348]:   <source dev="/dev/sdb"/>
Nov 22 08:29:05 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:29:05 user nova-compute[74348]:   <serial>620ef81b-f120-49c1-b172-843cb7c982b7</serial>
Nov 22 08:29:05 user nova-compute[74348]: </disk>
Nov 22 08:29:05 user nova-compute[74348]:  {{(pid=74348) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 08:29:05 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:29:05 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:29:05 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] No VIF found with MAC fa:16:3e:3b:e2:af, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:29:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4e382827-7324-4ad1-9186-367281a2b7ad tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "6782e58b-70ee-47df-ab5c-dc10d76eb156" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.247s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:29:07 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:29:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-597a1818-9725-4a56-8a4b-b02c79f288d4 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Acquiring lock "6782e58b-70ee-47df-ab5c-dc10d76eb156" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:29:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-597a1818-9725-4a56-8a4b-b02c79f288d4 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "6782e58b-70ee-47df-ab5c-dc10d76eb156" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:29:07 user nova-compute[74348]: INFO nova.compute.manager [None req-597a1818-9725-4a56-8a4b-b02c79f288d4 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Detaching volume 620ef81b-f120-49c1-b172-843cb7c982b7
Nov 22 08:29:07 user nova-compute[74348]: INFO nova.virt.block_device [None req-597a1818-9725-4a56-8a4b-b02c79f288d4 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Attempting to driver detach volume 620ef81b-f120-49c1-b172-843cb7c982b7 from mountpoint /dev/vdb
Nov 22 08:29:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-597a1818-9725-4a56-8a4b-b02c79f288d4 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Attempting to detach device vdb from instance 6782e58b-70ee-47df-ab5c-dc10d76eb156 from the persistent domain config. {{(pid=74348) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 08:29:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-597a1818-9725-4a56-8a4b-b02c79f288d4 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:29:07 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:29:07 user nova-compute[74348]:   <source dev="/dev/sdb"/>
Nov 22 08:29:07 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:29:07 user nova-compute[74348]:   <serial>620ef81b-f120-49c1-b172-843cb7c982b7</serial>
Nov 22 08:29:07 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 08:29:07 user nova-compute[74348]: </disk>
Nov 22 08:29:07 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:29:07 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-597a1818-9725-4a56-8a4b-b02c79f288d4 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Successfully detached device vdb from instance 6782e58b-70ee-47df-ab5c-dc10d76eb156 from the persistent domain config.
Nov 22 08:29:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-597a1818-9725-4a56-8a4b-b02c79f288d4 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6782e58b-70ee-47df-ab5c-dc10d76eb156 from the live domain config. {{(pid=74348) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 08:29:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-597a1818-9725-4a56-8a4b-b02c79f288d4 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:29:07 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:29:07 user nova-compute[74348]:   <source dev="/dev/sdb"/>
Nov 22 08:29:07 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:29:07 user nova-compute[74348]:   <serial>620ef81b-f120-49c1-b172-843cb7c982b7</serial>
Nov 22 08:29:07 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 08:29:07 user nova-compute[74348]: </disk>
Nov 22 08:29:07 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:29:08 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-597a1818-9725-4a56-8a4b-b02c79f288d4 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6782e58b-70ee-47df-ab5c-dc10d76eb156 {{(pid=74348) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 08:29:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:29:08 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:29:08 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:29:08 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Cleaning up deleted instances {{(pid=74348) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 22 08:29:08 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] There are 0 instances to clean {{(pid=74348) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 22 08:29:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:29:12 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:29:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:29:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:29:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:29:12 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:29:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6782e58b-70ee-47df-ab5c-dc10d76eb156/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:29:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6782e58b-70ee-47df-ab5c-dc10d76eb156/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:29:12 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6782e58b-70ee-47df-ab5c-dc10d76eb156/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:29:13 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6782e58b-70ee-47df-ab5c-dc10d76eb156/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:29:13 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:29:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:29:13 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:29:13 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:29:13 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:29:13 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:29:13 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:29:13 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=8936MB free_disk=24.788562774658203GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:29:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:29:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:29:13 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance e689f22e-9d71-40ed-a22e-1ded548b4f17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:29:13 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 6782e58b-70ee-47df-ab5c-dc10d76eb156 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:29:13 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:29:13 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:29:13 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Refreshing inventories for resource provider 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 22 08:29:14 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Updating ProviderTree inventory for provider 52690f6a-773f-4e8d-be85-d278b6522975 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 22 08:29:14 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Updating inventory in ProviderTree for provider 52690f6a-773f-4e8d-be85-d278b6522975 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 22 08:29:14 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Refreshing aggregate associations for resource provider 52690f6a-773f-4e8d-be85-d278b6522975, aggregates: None {{(pid=74348) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 22 08:29:14 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Refreshing trait associations for resource provider 52690f6a-773f-4e8d-be85-d278b6522975, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=74348) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 22 08:29:14 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:29:14 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:29:14 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:29:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.391s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:29:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:29:15 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:29:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:29:18 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:29:18 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74348) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 22 08:29:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:29:28 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-597a1818-9725-4a56-8a4b-b02c79f288d4 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6782e58b-70ee-47df-ab5c-dc10d76eb156 is timed out.
Nov 22 08:29:28 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-597a1818-9725-4a56-8a4b-b02c79f288d4 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Successfully detached device vdb from instance 6782e58b-70ee-47df-ab5c-dc10d76eb156 from the live domain config.
Nov 22 08:29:28 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-597a1818-9725-4a56-8a4b-b02c79f288d4 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-597a1818-9725-4a56-8a4b-b02c79f288d4 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FSVfQIic', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:29:28 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-597a1818-9725-4a56-8a4b-b02c79f288d4 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:29:28 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-597a1818-9725-4a56-8a4b-b02c79f288d4 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-597a1818-9725-4a56-8a4b-b02c79f288d4 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d73095-1ff4-4fe7-a697-a6478803d64a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-597a1818-9725-4a56-8a4b-b02c79f288d4 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 08:29:28 user nova-compute[74348]: No targets found.
Nov 22 08:29:28 user nova-compute[74348]: iSNS:
Nov 22 08:29:28 user nova-compute[74348]: No targets found.
Nov 22 08:29:28 user nova-compute[74348]: STATIC:
Nov 22 08:29:28 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7
Nov 22 08:29:28 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:29:28 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:29:28 user nova-compute[74348]: FIRMWARE:
Nov 22 08:29:28 user nova-compute[74348]: No targets found.
Nov 22 08:29:28 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-597a1818-9725-4a56-8a4b-b02c79f288d4 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 08:29:28 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 08:29:28 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-597a1818-9725-4a56-8a4b-b02c79f288d4 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4b2b4f-3c14-4980-81f8-99367250b941]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ae76a1-91f2-4e92-b6a0-b42596f8823e]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-597a1818-9725-4a56-8a4b-b02c79f288d4 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7 (non-flash)
Nov 22 08:29:28 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-597a1818-9725-4a56-8a4b-b02c79f288d4 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7 (non-flash)
Nov 22 08:29:28 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-597a1818-9725-4a56-8a4b-b02c79f288d4 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f225ec25870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7'): ({'sdb'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-597a1818-9725-4a56-8a4b-b02c79f288d4 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Removing single pathed devices sdb {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac01b382-598b-431f-8566-25a2240f40e2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[40954521-ad31-47b6-b722-b0f95477cb12]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-597a1818-9725-4a56-8a4b-b02c79f288d4 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Flushing IO for device /dev/sdb {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b3e17c-5d0b-4f6c-8510-df33a2541647]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-597a1818-9725-4a56-8a4b-b02c79f288d4 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4acfba-5390-4cd1-af54-d65f91e2290c]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-597a1818-9725-4a56-8a4b-b02c79f288d4 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-597a1818-9725-4a56-8a4b-b02c79f288d4 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] SCSI volumes sdb have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-597a1818-9725-4a56-8a4b-b02c79f288d4 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f518db37-2816-4e5c-a698-de7c51179d81]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-597a1818-9725-4a56-8a4b-b02c79f288d4 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7 -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52838b6-a9de-45a7-b810-c63222905628]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-597a1818-9725-4a56-8a4b-b02c79f288d4 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7, portal: 172.16.0.220,3260]
Nov 22 08:29:28 user nova-compute[74348]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7, portal: 172.16.0.220,3260] successful.
Nov 22 08:29:28 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7 -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:620ef81b-f120-49c1-b172-843cb7c982b7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e70af35-7eb5-4bd4-9087-e444b2cc56ea]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-597a1818-9725-4a56-8a4b-b02c79f288d4 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-597a1818-9725-4a56-8a4b-b02c79f288d4 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-597a1818-9725-4a56-8a4b-b02c79f288d4 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] <== disconnect_volume: return (306ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:29:28 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-597a1818-9725-4a56-8a4b-b02c79f288d4 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 08:29:29 user nova-compute[74348]: DEBUG nova.objects.instance [None req-597a1818-9725-4a56-8a4b-b02c79f288d4 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lazy-loading 'flavor' on Instance uuid 6782e58b-70ee-47df-ab5c-dc10d76eb156 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:29:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-597a1818-9725-4a56-8a4b-b02c79f288d4 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "6782e58b-70ee-47df-ab5c-dc10d76eb156" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.644s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:29:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:29:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:29:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:29:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:29:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:29:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:29:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:29:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:29:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:29:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:29:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:29:55 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:29:55 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:29:55 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Rebuilding the list of instances to heal {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 08:29:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-e689f22e-9d71-40ed-a22e-1ded548b4f17" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:29:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-e689f22e-9d71-40ed-a22e-1ded548b4f17" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:29:55 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 08:29:55 user nova-compute[74348]: DEBUG nova.objects.instance [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lazy-loading 'info_cache' on Instance uuid e689f22e-9d71-40ed-a22e-1ded548b4f17 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:29:56 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Updating instance_info_cache with network_info: [{"id": "47ad4e60-7966-44ea-b188-b78fe76158f4", "address": "fa:16:3e:e8:2d:c5", "network": {"id": "0f3f2141-ab52-4769-afb8-9fc69aba88c5", "bridge": "br-int", "label": "tempest-TestStampPattern-455105330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04273ca629b04809bb095bdfce87b461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ad4e60-79", "ovs_interfaceid": "47ad4e60-7966-44ea-b188-b78fe76158f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:29:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-e689f22e-9d71-40ed-a22e-1ded548b4f17" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:29:56 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 08:29:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:29:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:29:58 user nova-compute[74348]: DEBUG nova.compute.manager [req-b13f2b5b-494d-49f6-afb1-b958e5046d61 req-592cff89-2572-4ab6-9559-f07a80550047 service nova] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Received event network-changed-340367c3-bbc3-458a-98cc-2a8e327db11c {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:29:58 user nova-compute[74348]: DEBUG nova.compute.manager [req-b13f2b5b-494d-49f6-afb1-b958e5046d61 req-592cff89-2572-4ab6-9559-f07a80550047 service nova] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Refreshing instance network info cache due to event network-changed-340367c3-bbc3-458a-98cc-2a8e327db11c. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:29:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b13f2b5b-494d-49f6-afb1-b958e5046d61 req-592cff89-2572-4ab6-9559-f07a80550047 service nova] Acquiring lock "refresh_cache-6782e58b-70ee-47df-ab5c-dc10d76eb156" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:29:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b13f2b5b-494d-49f6-afb1-b958e5046d61 req-592cff89-2572-4ab6-9559-f07a80550047 service nova] Acquired lock "refresh_cache-6782e58b-70ee-47df-ab5c-dc10d76eb156" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:29:58 user nova-compute[74348]: DEBUG nova.network.neutron [req-b13f2b5b-494d-49f6-afb1-b958e5046d61 req-592cff89-2572-4ab6-9559-f07a80550047 service nova] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Refreshing network info cache for port 340367c3-bbc3-458a-98cc-2a8e327db11c {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:29:58 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._sync_power_states {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:29:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-6150d397-b43c-4bc2-8d58-c9feff8a1ffa tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Acquiring lock "6782e58b-70ee-47df-ab5c-dc10d76eb156" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:29:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-6150d397-b43c-4bc2-8d58-c9feff8a1ffa tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "6782e58b-70ee-47df-ab5c-dc10d76eb156" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:29:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-6150d397-b43c-4bc2-8d58-c9feff8a1ffa tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Acquiring lock "6782e58b-70ee-47df-ab5c-dc10d76eb156-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:29:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-6150d397-b43c-4bc2-8d58-c9feff8a1ffa tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "6782e58b-70ee-47df-ab5c-dc10d76eb156-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:29:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-6150d397-b43c-4bc2-8d58-c9feff8a1ffa tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "6782e58b-70ee-47df-ab5c-dc10d76eb156-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:29:58 user nova-compute[74348]: INFO nova.compute.manager [None req-6150d397-b43c-4bc2-8d58-c9feff8a1ffa tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Terminating instance
Nov 22 08:29:58 user nova-compute[74348]: DEBUG nova.compute.manager [None req-6150d397-b43c-4bc2-8d58-c9feff8a1ffa tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 08:29:58 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Triggering sync for uuid e689f22e-9d71-40ed-a22e-1ded548b4f17 {{(pid=74348) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 08:29:58 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Triggering sync for uuid 6782e58b-70ee-47df-ab5c-dc10d76eb156 {{(pid=74348) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 08:29:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "e689f22e-9d71-40ed-a22e-1ded548b4f17" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:29:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "e689f22e-9d71-40ed-a22e-1ded548b4f17" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:29:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "6782e58b-70ee-47df-ab5c-dc10d76eb156" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:29:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "e689f22e-9d71-40ed-a22e-1ded548b4f17" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:29:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:29:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:29:58 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:29:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:29:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:29:58 user nova-compute[74348]: DEBUG nova.compute.manager [req-a53870d0-ee94-47c0-964e-7a57f94d32e3 req-b094a30b-83c6-4674-ac3d-748cdf99a96c service nova] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Received event network-vif-unplugged-340367c3-bbc3-458a-98cc-2a8e327db11c {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:29:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a53870d0-ee94-47c0-964e-7a57f94d32e3 req-b094a30b-83c6-4674-ac3d-748cdf99a96c service nova] Acquiring lock "6782e58b-70ee-47df-ab5c-dc10d76eb156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:29:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a53870d0-ee94-47c0-964e-7a57f94d32e3 req-b094a30b-83c6-4674-ac3d-748cdf99a96c service nova] Lock "6782e58b-70ee-47df-ab5c-dc10d76eb156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:29:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-a53870d0-ee94-47c0-964e-7a57f94d32e3 req-b094a30b-83c6-4674-ac3d-748cdf99a96c service nova] Lock "6782e58b-70ee-47df-ab5c-dc10d76eb156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:29:58 user nova-compute[74348]: DEBUG nova.compute.manager [req-a53870d0-ee94-47c0-964e-7a57f94d32e3 req-b094a30b-83c6-4674-ac3d-748cdf99a96c service nova] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] No waiting events found dispatching network-vif-unplugged-340367c3-bbc3-458a-98cc-2a8e327db11c {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:29:58 user nova-compute[74348]: DEBUG nova.compute.manager [req-a53870d0-ee94-47c0-964e-7a57f94d32e3 req-b094a30b-83c6-4674-ac3d-748cdf99a96c service nova] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Received event network-vif-unplugged-340367c3-bbc3-458a-98cc-2a8e327db11c for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 08:29:59 user nova-compute[74348]: DEBUG nova.network.neutron [req-b13f2b5b-494d-49f6-afb1-b958e5046d61 req-592cff89-2572-4ab6-9559-f07a80550047 service nova] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Updated VIF entry in instance network info cache for port 340367c3-bbc3-458a-98cc-2a8e327db11c. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:29:59 user nova-compute[74348]: DEBUG nova.network.neutron [req-b13f2b5b-494d-49f6-afb1-b958e5046d61 req-592cff89-2572-4ab6-9559-f07a80550047 service nova] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Updating instance_info_cache with network_info: [{"id": "340367c3-bbc3-458a-98cc-2a8e327db11c", "address": "fa:16:3e:3b:e2:af", "network": {"id": "0f3f2141-ab52-4769-afb8-9fc69aba88c5", "bridge": "br-int", "label": "tempest-TestStampPattern-455105330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04273ca629b04809bb095bdfce87b461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap340367c3-bb", "ovs_interfaceid": "340367c3-bbc3-458a-98cc-2a8e327db11c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:29:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b13f2b5b-494d-49f6-afb1-b958e5046d61 req-592cff89-2572-4ab6-9559-f07a80550047 service nova] Releasing lock "refresh_cache-6782e58b-70ee-47df-ab5c-dc10d76eb156" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:29:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:29:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:29:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:29:59 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Instance destroyed successfully.
Nov 22 08:29:59 user nova-compute[74348]: DEBUG nova.objects.instance [None req-6150d397-b43c-4bc2-8d58-c9feff8a1ffa tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lazy-loading 'resources' on Instance uuid 6782e58b-70ee-47df-ab5c-dc10d76eb156 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:29:59 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-6150d397-b43c-4bc2-8d58-c9feff8a1ffa tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:27:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1187116575',display_name='tempest-TestStampPattern-server-1187116575',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1187116575',id=46,image_ref='048f5135-1438-4370-8beb-967a321b0c75',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlUnFKyNzS1mXvj2RBw5DmkD3+qjXoM5C122ESkjwExv4XOw6jmefFB7MRuLNKPdpMIrw4H12Bhnzb8PXfADXBPw55Gh+zMggP8MIeh0a5Ad23x1r79I+bH41DLq7nsnA==',key_name='tempest-TestStampPattern-1253083494',keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:27:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04273ca629b04809bb095bdfce87b461',ramdisk_id='',reservation_id='r-m0m9af59',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='e689f22e-9d71-40ed-a22e-1ded548b4f17',image_min_disk='1',image_min_ram='0',image_owner_id='04273ca629b04809bb095bdfce87b461',image_owner_project_name='tempest-TestStampPattern-1355704184',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1355704184-project-member',image_user_id='73f355ba09f346a3bbeec09de69630de',owner_project_name='tempest-TestStampPattern-1355704184',owner_user_name='tempest-TestStampPattern-1355704184-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T08:27:12Z,user_data=None,user_id='73f355ba09f346a3bbeec09de69630de',uuid=6782e58b-70ee-47df-ab5c-dc10d76eb156,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "340367c3-bbc3-458a-98cc-2a8e327db11c", "address": "fa:16:3e:3b:e2:af", "network": {"id": "0f3f2141-ab52-4769-afb8-9fc69aba88c5", "bridge": "br-int", "label": "tempest-TestStampPattern-455105330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04273ca629b04809bb095bdfce87b461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap340367c3-bb", "ovs_interfaceid": "340367c3-bbc3-458a-98cc-2a8e327db11c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:29:59 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-6150d397-b43c-4bc2-8d58-c9feff8a1ffa tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Converting VIF {"id": "340367c3-bbc3-458a-98cc-2a8e327db11c", "address": "fa:16:3e:3b:e2:af", "network": {"id": "0f3f2141-ab52-4769-afb8-9fc69aba88c5", "bridge": "br-int", "label": "tempest-TestStampPattern-455105330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04273ca629b04809bb095bdfce87b461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap340367c3-bb", "ovs_interfaceid": "340367c3-bbc3-458a-98cc-2a8e327db11c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:29:59 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-6150d397-b43c-4bc2-8d58-c9feff8a1ffa tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:e2:af,bridge_name='br-int',has_traffic_filtering=True,id=340367c3-bbc3-458a-98cc-2a8e327db11c,network=Network(0f3f2141-ab52-4769-afb8-9fc69aba88c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap340367c3-bb') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:29:59 user nova-compute[74348]: DEBUG os_vif [None req-6150d397-b43c-4bc2-8d58-c9feff8a1ffa tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:e2:af,bridge_name='br-int',has_traffic_filtering=True,id=340367c3-bbc3-458a-98cc-2a8e327db11c,network=Network(0f3f2141-ab52-4769-afb8-9fc69aba88c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap340367c3-bb') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:29:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:29:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap340367c3-bb, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:29:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:29:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:29:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9b4cf13b-25f3-4c14-bd7a-ccdb6c292202) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:29:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:29:59 user nova-compute[74348]: INFO os_vif [None req-6150d397-b43c-4bc2-8d58-c9feff8a1ffa tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:e2:af,bridge_name='br-int',has_traffic_filtering=True,id=340367c3-bbc3-458a-98cc-2a8e327db11c,network=Network(0f3f2141-ab52-4769-afb8-9fc69aba88c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap340367c3-bb')
Nov 22 08:29:59 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-6150d397-b43c-4bc2-8d58-c9feff8a1ffa tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Deleting instance files /opt/stack/data/nova/instances/6782e58b-70ee-47df-ab5c-dc10d76eb156_del
Nov 22 08:29:59 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-6150d397-b43c-4bc2-8d58-c9feff8a1ffa tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Deletion of /opt/stack/data/nova/instances/6782e58b-70ee-47df-ab5c-dc10d76eb156_del complete
Nov 22 08:29:59 user nova-compute[74348]: INFO nova.compute.manager [None req-6150d397-b43c-4bc2-8d58-c9feff8a1ffa tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 22 08:29:59 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-6150d397-b43c-4bc2-8d58-c9feff8a1ffa tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 08:29:59 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 08:29:59 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 08:29:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:29:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:29:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:29:59 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:29:59 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Took 0.71 seconds to deallocate network for instance.
Nov 22 08:30:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-6150d397-b43c-4bc2-8d58-c9feff8a1ffa tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:30:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-6150d397-b43c-4bc2-8d58-c9feff8a1ffa tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:30:00 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-6150d397-b43c-4bc2-8d58-c9feff8a1ffa tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:30:00 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-6150d397-b43c-4bc2-8d58-c9feff8a1ffa tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:30:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-6150d397-b43c-4bc2-8d58-c9feff8a1ffa tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.139s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:30:00 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-6150d397-b43c-4bc2-8d58-c9feff8a1ffa tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Deleted allocations for instance 6782e58b-70ee-47df-ab5c-dc10d76eb156
Nov 22 08:30:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-6150d397-b43c-4bc2-8d58-c9feff8a1ffa tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "6782e58b-70ee-47df-ab5c-dc10d76eb156" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.920s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:30:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "6782e58b-70ee-47df-ab5c-dc10d76eb156" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.907s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:30:00 user nova-compute[74348]: INFO nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 22 08:30:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "6782e58b-70ee-47df-ab5c-dc10d76eb156" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:30:00 user nova-compute[74348]: DEBUG nova.compute.manager [req-5acadf5a-5cbc-41ef-bcc8-cfbc39824ccc req-a1b4c3ec-5595-4f6b-8b3b-dc2f9f16a546 service nova] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Received event network-vif-plugged-340367c3-bbc3-458a-98cc-2a8e327db11c {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:30:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-5acadf5a-5cbc-41ef-bcc8-cfbc39824ccc req-a1b4c3ec-5595-4f6b-8b3b-dc2f9f16a546 service nova] Acquiring lock "6782e58b-70ee-47df-ab5c-dc10d76eb156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:30:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-5acadf5a-5cbc-41ef-bcc8-cfbc39824ccc req-a1b4c3ec-5595-4f6b-8b3b-dc2f9f16a546 service nova] Lock "6782e58b-70ee-47df-ab5c-dc10d76eb156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:30:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-5acadf5a-5cbc-41ef-bcc8-cfbc39824ccc req-a1b4c3ec-5595-4f6b-8b3b-dc2f9f16a546 service nova] Lock "6782e58b-70ee-47df-ab5c-dc10d76eb156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:30:00 user nova-compute[74348]: DEBUG nova.compute.manager [req-5acadf5a-5cbc-41ef-bcc8-cfbc39824ccc req-a1b4c3ec-5595-4f6b-8b3b-dc2f9f16a546 service nova] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] No waiting events found dispatching network-vif-plugged-340367c3-bbc3-458a-98cc-2a8e327db11c {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:30:00 user nova-compute[74348]: WARNING nova.compute.manager [req-5acadf5a-5cbc-41ef-bcc8-cfbc39824ccc req-a1b4c3ec-5595-4f6b-8b3b-dc2f9f16a546 service nova] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Received unexpected event network-vif-plugged-340367c3-bbc3-458a-98cc-2a8e327db11c for instance with vm_state deleted and task_state None.
Nov 22 08:30:00 user nova-compute[74348]: DEBUG nova.compute.manager [req-5acadf5a-5cbc-41ef-bcc8-cfbc39824ccc req-a1b4c3ec-5595-4f6b-8b3b-dc2f9f16a546 service nova] [instance: 6782e58b-70ee-47df-ab5c-dc10d76eb156] Received event network-vif-deleted-340367c3-bbc3-458a-98cc-2a8e327db11c {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:30:01 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:30:01 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:30:03 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:30:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:30:04 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:30:05 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:30:07 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:30:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:30:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:30:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:30:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:30:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:30:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:30:10 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:30:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:30:14 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:30:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:30:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:30:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:30:14 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:30:14 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:30:14 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:30:14 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:30:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:30:15 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:30:15 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:30:15 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=9020MB free_disk=24.781219482421875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:30:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:30:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:30:15 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance e689f22e-9d71-40ed-a22e-1ded548b4f17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:30:15 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:30:15 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:30:15 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:30:15 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:30:15 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:30:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:30:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:30:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:30:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:30:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:30:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:30:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:30:24 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:30:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:30:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:30:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:30:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:30:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:30:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:30:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:30:39 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:30:39 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:30:39 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:30:39 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:30:39 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:30:39 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:30:44 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:30:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:30:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:30:56 user nova-compute[74348]: DEBUG nova.compute.manager [req-13caeff5-51b9-4077-8018-8d9cb061e8e8 req-9330fadc-932c-4eff-839c-5611a4c11953 service nova] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Received event network-changed-47ad4e60-7966-44ea-b188-b78fe76158f4 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:30:56 user nova-compute[74348]: DEBUG nova.compute.manager [req-13caeff5-51b9-4077-8018-8d9cb061e8e8 req-9330fadc-932c-4eff-839c-5611a4c11953 service nova] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Refreshing instance network info cache due to event network-changed-47ad4e60-7966-44ea-b188-b78fe76158f4. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:30:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-13caeff5-51b9-4077-8018-8d9cb061e8e8 req-9330fadc-932c-4eff-839c-5611a4c11953 service nova] Acquiring lock "refresh_cache-e689f22e-9d71-40ed-a22e-1ded548b4f17" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:30:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-13caeff5-51b9-4077-8018-8d9cb061e8e8 req-9330fadc-932c-4eff-839c-5611a4c11953 service nova] Acquired lock "refresh_cache-e689f22e-9d71-40ed-a22e-1ded548b4f17" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:30:56 user nova-compute[74348]: DEBUG nova.network.neutron [req-13caeff5-51b9-4077-8018-8d9cb061e8e8 req-9330fadc-932c-4eff-839c-5611a4c11953 service nova] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Refreshing network info cache for port 47ad4e60-7966-44ea-b188-b78fe76158f4 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:30:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9cd62f0f-f3f7-4bc1-8fc6-9ca9cf8d3b32 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Acquiring lock "e689f22e-9d71-40ed-a22e-1ded548b4f17" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:30:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9cd62f0f-f3f7-4bc1-8fc6-9ca9cf8d3b32 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "e689f22e-9d71-40ed-a22e-1ded548b4f17" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:30:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9cd62f0f-f3f7-4bc1-8fc6-9ca9cf8d3b32 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Acquiring lock "e689f22e-9d71-40ed-a22e-1ded548b4f17-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:30:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9cd62f0f-f3f7-4bc1-8fc6-9ca9cf8d3b32 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "e689f22e-9d71-40ed-a22e-1ded548b4f17-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:30:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9cd62f0f-f3f7-4bc1-8fc6-9ca9cf8d3b32 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "e689f22e-9d71-40ed-a22e-1ded548b4f17-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:30:56 user nova-compute[74348]: INFO nova.compute.manager [None req-9cd62f0f-f3f7-4bc1-8fc6-9ca9cf8d3b32 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Terminating instance
Nov 22 08:30:56 user nova-compute[74348]: DEBUG nova.compute.manager [None req-9cd62f0f-f3f7-4bc1-8fc6-9ca9cf8d3b32 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 08:30:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:30:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:30:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:30:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:30:57 user nova-compute[74348]: DEBUG nova.network.neutron [req-13caeff5-51b9-4077-8018-8d9cb061e8e8 req-9330fadc-932c-4eff-839c-5611a4c11953 service nova] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Updated VIF entry in instance network info cache for port 47ad4e60-7966-44ea-b188-b78fe76158f4. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:30:57 user nova-compute[74348]: DEBUG nova.network.neutron [req-13caeff5-51b9-4077-8018-8d9cb061e8e8 req-9330fadc-932c-4eff-839c-5611a4c11953 service nova] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Updating instance_info_cache with network_info: [{"id": "47ad4e60-7966-44ea-b188-b78fe76158f4", "address": "fa:16:3e:e8:2d:c5", "network": {"id": "0f3f2141-ab52-4769-afb8-9fc69aba88c5", "bridge": "br-int", "label": "tempest-TestStampPattern-455105330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04273ca629b04809bb095bdfce87b461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ad4e60-79", "ovs_interfaceid": "47ad4e60-7966-44ea-b188-b78fe76158f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:30:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-13caeff5-51b9-4077-8018-8d9cb061e8e8 req-9330fadc-932c-4eff-839c-5611a4c11953 service nova] Releasing lock "refresh_cache-e689f22e-9d71-40ed-a22e-1ded548b4f17" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:30:57 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Instance destroyed successfully.
Nov 22 08:30:57 user nova-compute[74348]: DEBUG nova.objects.instance [None req-9cd62f0f-f3f7-4bc1-8fc6-9ca9cf8d3b32 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lazy-loading 'resources' on Instance uuid e689f22e-9d71-40ed-a22e-1ded548b4f17 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:30:57 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-9cd62f0f-f3f7-4bc1-8fc6-9ca9cf8d3b32 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:23:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1954896474',display_name='tempest-TestStampPattern-server-1954896474',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1954896474',id=45,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlUnFKyNzS1mXvj2RBw5DmkD3+qjXoM5C122ESkjwExv4XOw6jmefFB7MRuLNKPdpMIrw4H12Bhnzb8PXfADXBPw55Gh+zMggP8MIeh0a5Ad23x1r79I+bH41DLq7nsnA==',key_name='tempest-TestStampPattern-1253083494',keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:24:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04273ca629b04809bb095bdfce87b461',ramdisk_id='',reservation_id='r-uswl3mpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1355704184',owner_user_name='tempest-TestStampPattern-1355704184-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T08:27:03Z,user_data=None,user_id='73f355ba09f346a3bbeec09de69630de',uuid=e689f22e-9d71-40ed-a22e-1ded548b4f17,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47ad4e60-7966-44ea-b188-b78fe76158f4", "address": "fa:16:3e:e8:2d:c5", "network": {"id": "0f3f2141-ab52-4769-afb8-9fc69aba88c5", "bridge": "br-int", "label": "tempest-TestStampPattern-455105330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04273ca629b04809bb095bdfce87b461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ad4e60-79", "ovs_interfaceid": "47ad4e60-7966-44ea-b188-b78fe76158f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:30:57 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-9cd62f0f-f3f7-4bc1-8fc6-9ca9cf8d3b32 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Converting VIF {"id": "47ad4e60-7966-44ea-b188-b78fe76158f4", "address": "fa:16:3e:e8:2d:c5", "network": {"id": "0f3f2141-ab52-4769-afb8-9fc69aba88c5", "bridge": "br-int", "label": "tempest-TestStampPattern-455105330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04273ca629b04809bb095bdfce87b461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ad4e60-79", "ovs_interfaceid": "47ad4e60-7966-44ea-b188-b78fe76158f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:30:57 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-9cd62f0f-f3f7-4bc1-8fc6-9ca9cf8d3b32 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:2d:c5,bridge_name='br-int',has_traffic_filtering=True,id=47ad4e60-7966-44ea-b188-b78fe76158f4,network=Network(0f3f2141-ab52-4769-afb8-9fc69aba88c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47ad4e60-79') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:30:57 user nova-compute[74348]: DEBUG os_vif [None req-9cd62f0f-f3f7-4bc1-8fc6-9ca9cf8d3b32 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:2d:c5,bridge_name='br-int',has_traffic_filtering=True,id=47ad4e60-7966-44ea-b188-b78fe76158f4,network=Network(0f3f2141-ab52-4769-afb8-9fc69aba88c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47ad4e60-79') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:30:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:30:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47ad4e60-79, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:30:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:30:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:30:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:30:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5ac2a68b-d01b-43e1-b0eb-2a2565d72f70) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:30:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:30:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:30:57 user nova-compute[74348]: INFO os_vif [None req-9cd62f0f-f3f7-4bc1-8fc6-9ca9cf8d3b32 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:2d:c5,bridge_name='br-int',has_traffic_filtering=True,id=47ad4e60-7966-44ea-b188-b78fe76158f4,network=Network(0f3f2141-ab52-4769-afb8-9fc69aba88c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47ad4e60-79')
Nov 22 08:30:57 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-9cd62f0f-f3f7-4bc1-8fc6-9ca9cf8d3b32 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Deleting instance files /opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17_del
Nov 22 08:30:57 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-9cd62f0f-f3f7-4bc1-8fc6-9ca9cf8d3b32 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Deletion of /opt/stack/data/nova/instances/e689f22e-9d71-40ed-a22e-1ded548b4f17_del complete
Nov 22 08:30:57 user nova-compute[74348]: INFO nova.compute.manager [None req-9cd62f0f-f3f7-4bc1-8fc6-9ca9cf8d3b32 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 22 08:30:57 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-9cd62f0f-f3f7-4bc1-8fc6-9ca9cf8d3b32 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 08:30:57 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 08:30:57 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 08:30:58 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:30:58 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Took 0.38 seconds to deallocate network for instance.
Nov 22 08:30:58 user nova-compute[74348]: DEBUG nova.compute.manager [req-d884e9a3-73da-4f61-bae5-0f082156ffb1 req-08842367-fae8-4b11-9167-6761a0e25cc2 service nova] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Received event network-vif-deleted-47ad4e60-7966-44ea-b188-b78fe76158f4 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:30:58 user nova-compute[74348]: INFO nova.compute.manager [req-d884e9a3-73da-4f61-bae5-0f082156ffb1 req-08842367-fae8-4b11-9167-6761a0e25cc2 service nova] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Neutron deleted interface 47ad4e60-7966-44ea-b188-b78fe76158f4; detaching it from the instance and deleting it from the info cache
Nov 22 08:30:58 user nova-compute[74348]: DEBUG nova.network.neutron [req-d884e9a3-73da-4f61-bae5-0f082156ffb1 req-08842367-fae8-4b11-9167-6761a0e25cc2 service nova] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:30:58 user nova-compute[74348]: DEBUG nova.compute.manager [req-d884e9a3-73da-4f61-bae5-0f082156ffb1 req-08842367-fae8-4b11-9167-6761a0e25cc2 service nova] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Detach interface failed, port_id=47ad4e60-7966-44ea-b188-b78fe76158f4, reason: Instance e689f22e-9d71-40ed-a22e-1ded548b4f17 could not be found. {{(pid=74348) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 08:30:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9cd62f0f-f3f7-4bc1-8fc6-9ca9cf8d3b32 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:30:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9cd62f0f-f3f7-4bc1-8fc6-9ca9cf8d3b32 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:30:58 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-9cd62f0f-f3f7-4bc1-8fc6-9ca9cf8d3b32 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:30:58 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-9cd62f0f-f3f7-4bc1-8fc6-9ca9cf8d3b32 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:30:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9cd62f0f-f3f7-4bc1-8fc6-9ca9cf8d3b32 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.116s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:30:58 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-9cd62f0f-f3f7-4bc1-8fc6-9ca9cf8d3b32 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Deleted allocations for instance e689f22e-9d71-40ed-a22e-1ded548b4f17
Nov 22 08:30:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9cd62f0f-f3f7-4bc1-8fc6-9ca9cf8d3b32 tempest-TestStampPattern-1355704184 tempest-TestStampPattern-1355704184-project-member] Lock "e689f22e-9d71-40ed-a22e-1ded548b4f17" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.540s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:30:58 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:30:58 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:30:58 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Didn't find any instances for network info cache update. {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 08:30:58 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:30:58 user nova-compute[74348]: DEBUG nova.compute.manager [req-18556ec5-44e4-42ab-8ea3-4598c1dfcdc4 req-89b9d539-0fed-490d-923b-42d3f82fc4f3 service nova] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Received event network-vif-unplugged-47ad4e60-7966-44ea-b188-b78fe76158f4 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:30:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-18556ec5-44e4-42ab-8ea3-4598c1dfcdc4 req-89b9d539-0fed-490d-923b-42d3f82fc4f3 service nova] Acquiring lock "e689f22e-9d71-40ed-a22e-1ded548b4f17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:30:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-18556ec5-44e4-42ab-8ea3-4598c1dfcdc4 req-89b9d539-0fed-490d-923b-42d3f82fc4f3 service nova] Lock "e689f22e-9d71-40ed-a22e-1ded548b4f17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:30:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-18556ec5-44e4-42ab-8ea3-4598c1dfcdc4 req-89b9d539-0fed-490d-923b-42d3f82fc4f3 service nova] Lock "e689f22e-9d71-40ed-a22e-1ded548b4f17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:30:58 user nova-compute[74348]: DEBUG nova.compute.manager [req-18556ec5-44e4-42ab-8ea3-4598c1dfcdc4 req-89b9d539-0fed-490d-923b-42d3f82fc4f3 service nova] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] No waiting events found dispatching network-vif-unplugged-47ad4e60-7966-44ea-b188-b78fe76158f4 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:30:58 user nova-compute[74348]: WARNING nova.compute.manager [req-18556ec5-44e4-42ab-8ea3-4598c1dfcdc4 req-89b9d539-0fed-490d-923b-42d3f82fc4f3 service nova] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Received unexpected event network-vif-unplugged-47ad4e60-7966-44ea-b188-b78fe76158f4 for instance with vm_state deleted and task_state None.
Nov 22 08:30:58 user nova-compute[74348]: DEBUG nova.compute.manager [req-18556ec5-44e4-42ab-8ea3-4598c1dfcdc4 req-89b9d539-0fed-490d-923b-42d3f82fc4f3 service nova] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Received event network-vif-plugged-47ad4e60-7966-44ea-b188-b78fe76158f4 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:30:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-18556ec5-44e4-42ab-8ea3-4598c1dfcdc4 req-89b9d539-0fed-490d-923b-42d3f82fc4f3 service nova] Acquiring lock "e689f22e-9d71-40ed-a22e-1ded548b4f17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:30:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-18556ec5-44e4-42ab-8ea3-4598c1dfcdc4 req-89b9d539-0fed-490d-923b-42d3f82fc4f3 service nova] Lock "e689f22e-9d71-40ed-a22e-1ded548b4f17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:30:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-18556ec5-44e4-42ab-8ea3-4598c1dfcdc4 req-89b9d539-0fed-490d-923b-42d3f82fc4f3 service nova] Lock "e689f22e-9d71-40ed-a22e-1ded548b4f17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:30:58 user nova-compute[74348]: DEBUG nova.compute.manager [req-18556ec5-44e4-42ab-8ea3-4598c1dfcdc4 req-89b9d539-0fed-490d-923b-42d3f82fc4f3 service nova] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] No waiting events found dispatching network-vif-plugged-47ad4e60-7966-44ea-b188-b78fe76158f4 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:30:58 user nova-compute[74348]: WARNING nova.compute.manager [req-18556ec5-44e4-42ab-8ea3-4598c1dfcdc4 req-89b9d539-0fed-490d-923b-42d3f82fc4f3 service nova] [instance: e689f22e-9d71-40ed-a22e-1ded548b4f17] Received unexpected event network-vif-plugged-47ad4e60-7966-44ea-b188-b78fe76158f4 for instance with vm_state deleted and task_state None.
Nov 22 08:31:01 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:31:01 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:31:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:31:03 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:31:04 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:31:07 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:31:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:31:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:31:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:31:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:31:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:31:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:31:09 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:31:12 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:31:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:31:14 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:31:16 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:31:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:31:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:31:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:31:16 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:31:16 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:31:16 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:31:16 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=9174MB free_disk=24.90591049194336GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:31:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:31:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:31:16 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:31:16 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:31:17 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:31:17 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:31:17 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:31:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:31:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:31:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:31:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:31:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:31:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:31:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:31:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:31:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:31:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:31:37 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:31:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:31:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:31:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:31:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:31:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:31:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:31:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:31:50 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:31:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:31:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:31:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:31:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:31:59 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:31:59 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:31:59 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Rebuilding the list of instances to heal {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 08:31:59 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Didn't find any instances for network info cache update. {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 08:31:59 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:32:01 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:32:01 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:32:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:32:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:32:03 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:32:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:32:04 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:32:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:32:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:32:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:32:09 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:32:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:32:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:32:10 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:32:12 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:32:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:32:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:32:16 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:32:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:32:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:32:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:32:16 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:32:16 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:32:16 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:32:16 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=9182MB free_disk=24.903736114501953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:32:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:32:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:32:16 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:32:16 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:32:16 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:32:16 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:32:16 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:32:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.105s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:32:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:32:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "a82fc860-be12-4fd5-9d56-0c35f4dd81b1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:32:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "a82fc860-be12-4fd5-9d56-0c35f4dd81b1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:32:19 user nova-compute[74348]: DEBUG nova.compute.manager [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 08:32:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:32:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:32:19 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 08:32:19 user nova-compute[74348]: INFO nova.compute.claims [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Claim successful on node user
Nov 22 08:32:19 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:32:19 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:32:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.181s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:32:19 user nova-compute[74348]: DEBUG nova.compute.manager [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 08:32:19 user nova-compute[74348]: DEBUG nova.compute.manager [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 08:32:19 user nova-compute[74348]: DEBUG nova.network.neutron [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 08:32:19 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 08:32:19 user nova-compute[74348]: DEBUG nova.compute.manager [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 08:32:19 user nova-compute[74348]: DEBUG nova.policy [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b510235916f547b8b0f5c3c150fe9dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a81615aef8948718005d104403e260e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 08:32:19 user nova-compute[74348]: INFO nova.virt.block_device [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Booting with volume snapshot c338c489-3d76-4708-8cb7-7a492cf45db7 at /dev/vda
Nov 22 08:32:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:32:20 user nova-compute[74348]: DEBUG nova.network.neutron [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Successfully created port: 9fec27b4-2d46-482b-80e6-36cf60b1bfb8 {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 08:32:20 user nova-compute[74348]: DEBUG nova.network.neutron [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Successfully updated port: 9fec27b4-2d46-482b-80e6-36cf60b1bfb8 {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 08:32:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "refresh_cache-a82fc860-be12-4fd5-9d56-0c35f4dd81b1" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:32:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquired lock "refresh_cache-a82fc860-be12-4fd5-9d56-0c35f4dd81b1" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:32:20 user nova-compute[74348]: DEBUG nova.network.neutron [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:32:20 user nova-compute[74348]: DEBUG nova.compute.manager [req-181af35e-c681-4549-8271-484cd3db77be req-14f4032a-8fed-4c77-a446-60289c5c9925 service nova] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Received event network-changed-9fec27b4-2d46-482b-80e6-36cf60b1bfb8 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:32:20 user nova-compute[74348]: DEBUG nova.compute.manager [req-181af35e-c681-4549-8271-484cd3db77be req-14f4032a-8fed-4c77-a446-60289c5c9925 service nova] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Refreshing instance network info cache due to event network-changed-9fec27b4-2d46-482b-80e6-36cf60b1bfb8. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:32:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-181af35e-c681-4549-8271-484cd3db77be req-14f4032a-8fed-4c77-a446-60289c5c9925 service nova] Acquiring lock "refresh_cache-a82fc860-be12-4fd5-9d56-0c35f4dd81b1" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:32:21 user nova-compute[74348]: DEBUG nova.network.neutron [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 08:32:21 user nova-compute[74348]: DEBUG nova.network.neutron [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Updating instance_info_cache with network_info: [{"id": "9fec27b4-2d46-482b-80e6-36cf60b1bfb8", "address": "fa:16:3e:dd:1b:f4", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fec27b4-2d", "ovs_interfaceid": "9fec27b4-2d46-482b-80e6-36cf60b1bfb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:32:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Releasing lock "refresh_cache-a82fc860-be12-4fd5-9d56-0c35f4dd81b1" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:32:21 user nova-compute[74348]: DEBUG nova.compute.manager [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Instance network_info: |[{"id": "9fec27b4-2d46-482b-80e6-36cf60b1bfb8", "address": "fa:16:3e:dd:1b:f4", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fec27b4-2d", "ovs_interfaceid": "9fec27b4-2d46-482b-80e6-36cf60b1bfb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 08:32:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-181af35e-c681-4549-8271-484cd3db77be req-14f4032a-8fed-4c77-a446-60289c5c9925 service nova] Acquired lock "refresh_cache-a82fc860-be12-4fd5-9d56-0c35f4dd81b1" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:32:21 user nova-compute[74348]: DEBUG nova.network.neutron [req-181af35e-c681-4549-8271-484cd3db77be req-14f4032a-8fed-4c77-a446-60289c5c9925 service nova] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Refreshing network info cache for port 9fec27b4-2d46-482b-80e6-36cf60b1bfb8 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:32:21 user nova-compute[74348]: DEBUG nova.network.neutron [req-181af35e-c681-4549-8271-484cd3db77be req-14f4032a-8fed-4c77-a446-60289c5c9925 service nova] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Updated VIF entry in instance network info cache for port 9fec27b4-2d46-482b-80e6-36cf60b1bfb8. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:32:21 user nova-compute[74348]: DEBUG nova.network.neutron [req-181af35e-c681-4549-8271-484cd3db77be req-14f4032a-8fed-4c77-a446-60289c5c9925 service nova] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Updating instance_info_cache with network_info: [{"id": "9fec27b4-2d46-482b-80e6-36cf60b1bfb8", "address": "fa:16:3e:dd:1b:f4", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fec27b4-2d", "ovs_interfaceid": "9fec27b4-2d46-482b-80e6-36cf60b1bfb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:32:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-181af35e-c681-4549-8271-484cd3db77be req-14f4032a-8fed-4c77-a446-60289c5c9925 service nova] Releasing lock "refresh_cache-a82fc860-be12-4fd5-9d56-0c35f4dd81b1" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:32:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:32:24 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:32:25 user nova-compute[74348]: DEBUG os_brick.utils [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:32:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:32:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:32:25 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbc30c1-7833-44ee-8749-f8a28e555ae2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:32:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:32:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:32:25 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5867a7-9513-45f6-947e-11227f5db1a1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:32:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:32:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:32:25 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f6d349-55b9-45e0-8413-199f86a582e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:32:25 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc678786-62a9-4d00-abb8-7231959b463a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:32:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:32:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:32:25 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 08:32:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:32:25 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:32:25 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 08:32:25 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[24effcc5-6e7c-4eb1-a5ec-2acb579882ce]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:32:25 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 08:32:25 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 08:32:25 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 08:32:25 user nova-compute[74348]: DEBUG os_brick.utils [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:32:25 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Updating existing volume attachment record: bcce18b5-a422-4d0a-a2c3-02c7b7c23a1a {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 08:32:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG nova.compute.manager [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 08:32:31 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Creating image(s)
Nov 22 08:32:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Did not create local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Ensure instance console log exists: /opt/stack/data/nova/instances/a82fc860-be12-4fd5-9d56-0c35f4dd81b1/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Start _get_guest_xml network_info=[{"id": "9fec27b4-2d46-482b-80e6-36cf60b1bfb8", "address": "fa:16:3e:dd:1b:f4", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fec27b4-2d", "ovs_interfaceid": "9fec27b4-2d46-482b-80e6-36cf60b1bfb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oTdnqStX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a82fc860-be12-4fd5-9d56-0c35f4dd81b1', 'attached_at': '', 'detached_at': '', 'volume_id': 'a6762dba-6cb6-4b26-b2fc-3a4ab476db7c', 'serial': 'a6762dba-6cb6-4b26-b2fc-3a4ab476db7c'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'bcce18b5-a422-4d0a-a2c3-02c7b7c23a1a', 'volume_type': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 08:32:31 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:32:31 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:32:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oTdnqStX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:32:31 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:32:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:32:31 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:32:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:32:31 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 08:32:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f44e030-ee30-4926-8ddd-8b20b1a47b3a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 08:32:31 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[008d36b2-31f5-4ed6-8dd3-7821ba84889e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c] added
Nov 22 08:32:31 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4994e5-8fac-4986-8e3b-14b4fc7117cb]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.068s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8f2c8d-c099-43ff-8b5f-1e0f6b2381c3]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oTdnqStX {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oTdnqStX" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8943778-ccff-4c03-ad78-d2c7a0e87c2d]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oTdnqStX'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[156dc111-02e1-4fce-9200-b958495282b6]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[18693dc1-b06d-4a5a-8dac-f03c8d82f638]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 22 08:32:31 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 22 08:32:31 user nova-compute[74348]:  {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:32:31 user nova-compute[74348]: WARNING os_brick.initiator.connectors.iscsi [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 22 08:32:31 user nova-compute[74348]: 
Nov 22 08:32:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[34748997-7110-4e3f-8ffe-34128102dbcb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c, portal: 172.16.0.220,3260]
Nov 22 08:32:31 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c, portal: 172.16.0.220,3260] successful.
Nov 22 08:32:31 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc4b8e4-66f1-4f67-b354-f445d9e841f4]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9848ead5-6e90-4c86-a354-23fa026b04e5]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c (non-flash)
Nov 22 08:32:31 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c (non-flash)
Nov 22 08:32:31 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d479b01-286a-4ec9-8f43-50966baa55b7]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:32:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oTdnqStX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 08:32:32 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:32:32 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23061356664653065', 'path': '/dev/sdb'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:32:32 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061356664653065', 'path': '/dev/sdb'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 08:32:32 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:32:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-926642972',display_name='tempest-TestVolumeBootPattern-server-926642972',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-926642972',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a81615aef8948718005d104403e260e',ramdisk_id='',reservation_id='r-ovjrihwj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1316917970',owner_user_name='tempest-TestVolumeBootPattern-1316917970-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:32:20Z,user_data=None,user_id='b510235916f547b8b0f5c3c150fe9dac',uuid=a82fc860-be12-4fd5-9d56-0c35f4dd81b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fec27b4-2d46-482b-80e6-36cf60b1bfb8", "address": "fa:16:3e:dd:1b:f4", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fec27b4-2d", "ovs_interfaceid": "9fec27b4-2d46-482b-80e6-36cf60b1bfb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 08:32:32 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Converting VIF {"id": "9fec27b4-2d46-482b-80e6-36cf60b1bfb8", "address": "fa:16:3e:dd:1b:f4", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fec27b4-2d", "ovs_interfaceid": "9fec27b4-2d46-482b-80e6-36cf60b1bfb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:32:32 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:1b:f4,bridge_name='br-int',has_traffic_filtering=True,id=9fec27b4-2d46-482b-80e6-36cf60b1bfb8,network=Network(aed76530-d78f-4747-ba48-e5a0eed6ef6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fec27b4-2d') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:32:32 user nova-compute[74348]: DEBUG nova.objects.instance [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lazy-loading 'pci_devices' on Instance uuid a82fc860-be12-4fd5-9d56-0c35f4dd81b1 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:32:32 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] End _get_guest_xml xml=<domain type="kvm">
Nov 22 08:32:32 user nova-compute[74348]:   <uuid>a82fc860-be12-4fd5-9d56-0c35f4dd81b1</uuid>
Nov 22 08:32:32 user nova-compute[74348]:   <name>instance-0000002f</name>
Nov 22 08:32:32 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 08:32:32 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 08:32:32 user nova-compute[74348]:   <metadata>
Nov 22 08:32:32 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 08:32:32 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 08:32:32 user nova-compute[74348]:       <nova:name>tempest-TestVolumeBootPattern-server-926642972</nova:name>
Nov 22 08:32:32 user nova-compute[74348]:       <nova:creationTime>2023-11-22 08:32:31</nova:creationTime>
Nov 22 08:32:32 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 08:32:32 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 08:32:32 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 08:32:32 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 08:32:32 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 08:32:32 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 08:32:32 user nova-compute[74348]:       </nova:flavor>
Nov 22 08:32:32 user nova-compute[74348]:       <nova:owner>
Nov 22 08:32:32 user nova-compute[74348]:         <nova:user uuid="b510235916f547b8b0f5c3c150fe9dac">tempest-TestVolumeBootPattern-1316917970-project-member</nova:user>
Nov 22 08:32:32 user nova-compute[74348]:         <nova:project uuid="1a81615aef8948718005d104403e260e">tempest-TestVolumeBootPattern-1316917970</nova:project>
Nov 22 08:32:32 user nova-compute[74348]:       </nova:owner>
Nov 22 08:32:32 user nova-compute[74348]:       <nova:ports>
Nov 22 08:32:32 user nova-compute[74348]:         <nova:port uuid="9fec27b4-2d46-482b-80e6-36cf60b1bfb8">
Nov 22 08:32:32 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 22 08:32:32 user nova-compute[74348]:         </nova:port>
Nov 22 08:32:32 user nova-compute[74348]:       </nova:ports>
Nov 22 08:32:32 user nova-compute[74348]:     </nova:instance>
Nov 22 08:32:32 user nova-compute[74348]:   </metadata>
Nov 22 08:32:32 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 08:32:32 user nova-compute[74348]:     <system>
Nov 22 08:32:32 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 08:32:32 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 08:32:32 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 08:32:32 user nova-compute[74348]:       <entry name="serial">a82fc860-be12-4fd5-9d56-0c35f4dd81b1</entry>
Nov 22 08:32:32 user nova-compute[74348]:       <entry name="uuid">a82fc860-be12-4fd5-9d56-0c35f4dd81b1</entry>
Nov 22 08:32:32 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 08:32:32 user nova-compute[74348]:     </system>
Nov 22 08:32:32 user nova-compute[74348]:   </sysinfo>
Nov 22 08:32:32 user nova-compute[74348]:   <os>
Nov 22 08:32:32 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 08:32:32 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 08:32:32 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 08:32:32 user nova-compute[74348]:   </os>
Nov 22 08:32:32 user nova-compute[74348]:   <features>
Nov 22 08:32:32 user nova-compute[74348]:     <acpi/>
Nov 22 08:32:32 user nova-compute[74348]:     <apic/>
Nov 22 08:32:32 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 08:32:32 user nova-compute[74348]:   </features>
Nov 22 08:32:32 user nova-compute[74348]:   <clock offset="utc">
Nov 22 08:32:32 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 08:32:32 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 08:32:32 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 08:32:32 user nova-compute[74348]:   </clock>
Nov 22 08:32:32 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 08:32:32 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 08:32:32 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 08:32:32 user nova-compute[74348]:   </cpu>
Nov 22 08:32:32 user nova-compute[74348]:   <devices>
Nov 22 08:32:32 user nova-compute[74348]:     <disk type="block" device="disk">
Nov 22 08:32:32 user nova-compute[74348]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:32:32 user nova-compute[74348]:       <source dev="/dev/sdb"/>
Nov 22 08:32:32 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 08:32:32 user nova-compute[74348]:       <serial>a6762dba-6cb6-4b26-b2fc-3a4ab476db7c</serial>
Nov 22 08:32:32 user nova-compute[74348]:     </disk>
Nov 22 08:32:32 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 08:32:32 user nova-compute[74348]:       <mac address="fa:16:3e:dd:1b:f4"/>
Nov 22 08:32:32 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:32:32 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 08:32:32 user nova-compute[74348]:       <target dev="tap9fec27b4-2d"/>
Nov 22 08:32:32 user nova-compute[74348]:     </interface>
Nov 22 08:32:32 user nova-compute[74348]:     <serial type="pty">
Nov 22 08:32:32 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/a82fc860-be12-4fd5-9d56-0c35f4dd81b1/console.log" append="off"/>
Nov 22 08:32:32 user nova-compute[74348]:     </serial>
Nov 22 08:32:32 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 08:32:32 user nova-compute[74348]:     <video>
Nov 22 08:32:32 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:32:32 user nova-compute[74348]:     </video>
Nov 22 08:32:32 user nova-compute[74348]:     <rng model="virtio">
Nov 22 08:32:32 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 08:32:32 user nova-compute[74348]:     </rng>
Nov 22 08:32:32 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 08:32:32 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 08:32:32 user nova-compute[74348]:       <stats period="10"/>
Nov 22 08:32:32 user nova-compute[74348]:     </memballoon>
Nov 22 08:32:32 user nova-compute[74348]:   </devices>
Nov 22 08:32:32 user nova-compute[74348]: </domain>
Nov 22 08:32:32 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 08:32:32 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:32:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-926642972',display_name='tempest-TestVolumeBootPattern-server-926642972',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-926642972',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a81615aef8948718005d104403e260e',ramdisk_id='',reservation_id='r-ovjrihwj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1316917970',owner_user_name='tempest-TestVolumeBootPattern-1316917970-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:32:20Z,user_data=None,user_id='b510235916f547b8b0f5c3c150fe9dac',uuid=a82fc860-be12-4fd5-9d56-0c35f4dd81b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fec27b4-2d46-482b-80e6-36cf60b1bfb8", "address": "fa:16:3e:dd:1b:f4", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fec27b4-2d", "ovs_interfaceid": "9fec27b4-2d46-482b-80e6-36cf60b1bfb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 08:32:32 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Converting VIF {"id": "9fec27b4-2d46-482b-80e6-36cf60b1bfb8", "address": "fa:16:3e:dd:1b:f4", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fec27b4-2d", "ovs_interfaceid": "9fec27b4-2d46-482b-80e6-36cf60b1bfb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:32:32 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:1b:f4,bridge_name='br-int',has_traffic_filtering=True,id=9fec27b4-2d46-482b-80e6-36cf60b1bfb8,network=Network(aed76530-d78f-4747-ba48-e5a0eed6ef6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fec27b4-2d') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:32:32 user nova-compute[74348]: DEBUG os_vif [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:1b:f4,bridge_name='br-int',has_traffic_filtering=True,id=9fec27b4-2d46-482b-80e6-36cf60b1bfb8,network=Network(aed76530-d78f-4747-ba48-e5a0eed6ef6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fec27b4-2d') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 08:32:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:32:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:32:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 08:32:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:32:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8cf7d0e2-92e8-5f9f-aa8c-9ace9beb31a4', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:32:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:32:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:32:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:32:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9fec27b4-2d, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:32:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9fec27b4-2d, col_values=(('qos', UUID('75d93320-4a8a-4c0a-885b-a38d84faae00')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:32:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9fec27b4-2d, col_values=(('external_ids', {'iface-id': '9fec27b4-2d46-482b-80e6-36cf60b1bfb8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:1b:f4', 'vm-uuid': 'a82fc860-be12-4fd5-9d56-0c35f4dd81b1'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:32:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:32:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:32:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:32:32 user nova-compute[74348]: INFO os_vif [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:1b:f4,bridge_name='br-int',has_traffic_filtering=True,id=9fec27b4-2d46-482b-80e6-36cf60b1bfb8,network=Network(aed76530-d78f-4747-ba48-e5a0eed6ef6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fec27b4-2d')
Nov 22 08:32:32 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:32:32 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] No VIF found with MAC fa:16:3e:dd:1b:f4, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:32:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:32:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:32:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:32:34 user nova-compute[74348]: DEBUG nova.compute.manager [req-418b1514-b252-46a1-86be-11dddf6ac5b9 req-ec9f60df-14e0-4908-9a1c-86a23cd9724a service nova] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Received event network-vif-plugged-9fec27b4-2d46-482b-80e6-36cf60b1bfb8 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:32:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-418b1514-b252-46a1-86be-11dddf6ac5b9 req-ec9f60df-14e0-4908-9a1c-86a23cd9724a service nova] Acquiring lock "a82fc860-be12-4fd5-9d56-0c35f4dd81b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:32:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-418b1514-b252-46a1-86be-11dddf6ac5b9 req-ec9f60df-14e0-4908-9a1c-86a23cd9724a service nova] Lock "a82fc860-be12-4fd5-9d56-0c35f4dd81b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:32:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-418b1514-b252-46a1-86be-11dddf6ac5b9 req-ec9f60df-14e0-4908-9a1c-86a23cd9724a service nova] Lock "a82fc860-be12-4fd5-9d56-0c35f4dd81b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:32:34 user nova-compute[74348]: DEBUG nova.compute.manager [req-418b1514-b252-46a1-86be-11dddf6ac5b9 req-ec9f60df-14e0-4908-9a1c-86a23cd9724a service nova] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] No waiting events found dispatching network-vif-plugged-9fec27b4-2d46-482b-80e6-36cf60b1bfb8 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:32:34 user nova-compute[74348]: WARNING nova.compute.manager [req-418b1514-b252-46a1-86be-11dddf6ac5b9 req-ec9f60df-14e0-4908-9a1c-86a23cd9724a service nova] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Received unexpected event network-vif-plugged-9fec27b4-2d46-482b-80e6-36cf60b1bfb8 for instance with vm_state building and task_state spawning.
Nov 22 08:32:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:32:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:32:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:32:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:32:36 user nova-compute[74348]: DEBUG nova.compute.manager [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 08:32:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 08:32:36 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Instance spawned successfully.
Nov 22 08:32:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 08:32:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:32:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:32:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:32:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:32:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:32:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:32:36 user nova-compute[74348]: INFO nova.compute.manager [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Took 4.94 seconds to spawn the instance on the hypervisor.
Nov 22 08:32:36 user nova-compute[74348]: DEBUG nova.compute.manager [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:32:36 user nova-compute[74348]: DEBUG nova.compute.manager [req-2c3578bf-9b1b-40f6-9ec4-523a7fad938c req-bf92e628-704b-4d1b-aa07-22f3723ef08d service nova] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Received event network-vif-plugged-9fec27b4-2d46-482b-80e6-36cf60b1bfb8 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:32:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2c3578bf-9b1b-40f6-9ec4-523a7fad938c req-bf92e628-704b-4d1b-aa07-22f3723ef08d service nova] Acquiring lock "a82fc860-be12-4fd5-9d56-0c35f4dd81b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:32:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2c3578bf-9b1b-40f6-9ec4-523a7fad938c req-bf92e628-704b-4d1b-aa07-22f3723ef08d service nova] Lock "a82fc860-be12-4fd5-9d56-0c35f4dd81b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:32:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2c3578bf-9b1b-40f6-9ec4-523a7fad938c req-bf92e628-704b-4d1b-aa07-22f3723ef08d service nova] Lock "a82fc860-be12-4fd5-9d56-0c35f4dd81b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:32:36 user nova-compute[74348]: DEBUG nova.compute.manager [req-2c3578bf-9b1b-40f6-9ec4-523a7fad938c req-bf92e628-704b-4d1b-aa07-22f3723ef08d service nova] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] No waiting events found dispatching network-vif-plugged-9fec27b4-2d46-482b-80e6-36cf60b1bfb8 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:32:36 user nova-compute[74348]: WARNING nova.compute.manager [req-2c3578bf-9b1b-40f6-9ec4-523a7fad938c req-bf92e628-704b-4d1b-aa07-22f3723ef08d service nova] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Received unexpected event network-vif-plugged-9fec27b4-2d46-482b-80e6-36cf60b1bfb8 for instance with vm_state active and task_state None.
Nov 22 08:32:36 user nova-compute[74348]: INFO nova.compute.manager [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Took 16.82 seconds to build instance.
Nov 22 08:32:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-90ea1d66-e79f-44c2-8d17-a9399ed67ada tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "a82fc860-be12-4fd5-9d56-0c35f4dd81b1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.910s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:32:37 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:32:39 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:32:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:32:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:32:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:32:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:32:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:32:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:32:59 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:33:00 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:33:00 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:33:00 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Rebuilding the list of instances to heal {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 08:33:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-a82fc860-be12-4fd5-9d56-0c35f4dd81b1" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:33:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-a82fc860-be12-4fd5-9d56-0c35f4dd81b1" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:33:00 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 08:33:00 user nova-compute[74348]: DEBUG nova.objects.instance [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lazy-loading 'info_cache' on Instance uuid a82fc860-be12-4fd5-9d56-0c35f4dd81b1 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:33:01 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Updating instance_info_cache with network_info: [{"id": "9fec27b4-2d46-482b-80e6-36cf60b1bfb8", "address": "fa:16:3e:dd:1b:f4", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fec27b4-2d", "ovs_interfaceid": "9fec27b4-2d46-482b-80e6-36cf60b1bfb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:33:01 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-a82fc860-be12-4fd5-9d56-0c35f4dd81b1" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:33:01 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 08:33:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:33:03 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:33:03 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:33:04 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:33:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:33:05 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:33:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:33:09 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:33:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:33:12 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:33:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:33:14 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:33:16 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:33:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:33:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:33:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:33:16 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:33:16 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:33:16 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:33:16 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:33:16 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=9029MB free_disk=24.901912689208984GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:33:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:33:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:33:17 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance a82fc860-be12-4fd5-9d56-0c35f4dd81b1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:33:17 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:33:17 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:33:17 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:33:17 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:33:17 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:33:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.201s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:33:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:33:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:33:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:33:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:33:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:33:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:33:18 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:33:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:33:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:33:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:33:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:33:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:33:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:33:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:33:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:33:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:33:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:33:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:33:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:33:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:33:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:33:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:33:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:33:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:33:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:33:37 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:33:37 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:33:37 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:33:37 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:33:37 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:33:37 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:33:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:33:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:33:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:33:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:33:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:33:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:33:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:33:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:33:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:33:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:33:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:33:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:33:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:33:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:34:00 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:34:00 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:34:00 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Rebuilding the list of instances to heal {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 08:34:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-a82fc860-be12-4fd5-9d56-0c35f4dd81b1" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:34:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-a82fc860-be12-4fd5-9d56-0c35f4dd81b1" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:34:00 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 08:34:00 user nova-compute[74348]: DEBUG nova.objects.instance [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lazy-loading 'info_cache' on Instance uuid a82fc860-be12-4fd5-9d56-0c35f4dd81b1 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:34:00 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Updating instance_info_cache with network_info: [{"id": "9fec27b4-2d46-482b-80e6-36cf60b1bfb8", "address": "fa:16:3e:dd:1b:f4", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fec27b4-2d", "ovs_interfaceid": "9fec27b4-2d46-482b-80e6-36cf60b1bfb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:34:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-a82fc860-be12-4fd5-9d56-0c35f4dd81b1" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:34:00 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 08:34:01 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:34:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:34:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:34:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:34:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:34:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:34:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:34:03 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:34:04 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:34:04 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:34:04 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:34:06 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:34:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:34:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "a82fc860-be12-4fd5-9d56-0c35f4dd81b1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:34:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "a82fc860-be12-4fd5-9d56-0c35f4dd81b1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:34:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "a82fc860-be12-4fd5-9d56-0c35f4dd81b1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:34:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "a82fc860-be12-4fd5-9d56-0c35f4dd81b1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:34:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "a82fc860-be12-4fd5-9d56-0c35f4dd81b1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:34:09 user nova-compute[74348]: INFO nova.compute.manager [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Terminating instance
Nov 22 08:34:09 user nova-compute[74348]: DEBUG nova.compute.manager [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 08:34:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:34:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:34:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:34:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG nova.compute.manager [req-7217da60-9cb7-4c6a-b1f0-a0ad2d28dc06 req-32ca41b7-6a75-4b78-bacb-d91440426b64 service nova] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Received event network-vif-unplugged-9fec27b4-2d46-482b-80e6-36cf60b1bfb8 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-7217da60-9cb7-4c6a-b1f0-a0ad2d28dc06 req-32ca41b7-6a75-4b78-bacb-d91440426b64 service nova] Acquiring lock "a82fc860-be12-4fd5-9d56-0c35f4dd81b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-7217da60-9cb7-4c6a-b1f0-a0ad2d28dc06 req-32ca41b7-6a75-4b78-bacb-d91440426b64 service nova] Lock "a82fc860-be12-4fd5-9d56-0c35f4dd81b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-7217da60-9cb7-4c6a-b1f0-a0ad2d28dc06 req-32ca41b7-6a75-4b78-bacb-d91440426b64 service nova] Lock "a82fc860-be12-4fd5-9d56-0c35f4dd81b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG nova.compute.manager [req-7217da60-9cb7-4c6a-b1f0-a0ad2d28dc06 req-32ca41b7-6a75-4b78-bacb-d91440426b64 service nova] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] No waiting events found dispatching network-vif-unplugged-9fec27b4-2d46-482b-80e6-36cf60b1bfb8 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG nova.compute.manager [req-7217da60-9cb7-4c6a-b1f0-a0ad2d28dc06 req-32ca41b7-6a75-4b78-bacb-d91440426b64 service nova] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Received event network-vif-unplugged-9fec27b4-2d46-482b-80e6-36cf60b1bfb8 for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:34:10 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Instance destroyed successfully.
Nov 22 08:34:10 user nova-compute[74348]: DEBUG nova.objects.instance [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lazy-loading 'resources' on Instance uuid a82fc860-be12-4fd5-9d56-0c35f4dd81b1 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:32:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-926642972',display_name='tempest-TestVolumeBootPattern-server-926642972',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-926642972',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:32:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1a81615aef8948718005d104403e260e',ramdisk_id='',reservation_id='r-ovjrihwj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1316917970',owner_user_name='tempest-TestVolumeBootPattern-1316917970-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T08:32:36Z,user_data=None,user_id='b510235916f547b8b0f5c3c150fe9dac',uuid=a82fc860-be12-4fd5-9d56-0c35f4dd81b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9fec27b4-2d46-482b-80e6-36cf60b1bfb8", "address": "fa:16:3e:dd:1b:f4", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fec27b4-2d", "ovs_interfaceid": "9fec27b4-2d46-482b-80e6-36cf60b1bfb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Converting VIF {"id": "9fec27b4-2d46-482b-80e6-36cf60b1bfb8", "address": "fa:16:3e:dd:1b:f4", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fec27b4-2d", "ovs_interfaceid": "9fec27b4-2d46-482b-80e6-36cf60b1bfb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:1b:f4,bridge_name='br-int',has_traffic_filtering=True,id=9fec27b4-2d46-482b-80e6-36cf60b1bfb8,network=Network(aed76530-d78f-4747-ba48-e5a0eed6ef6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fec27b4-2d') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG os_vif [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:1b:f4,bridge_name='br-int',has_traffic_filtering=True,id=9fec27b4-2d46-482b-80e6-36cf60b1bfb8,network=Network(aed76530-d78f-4747-ba48-e5a0eed6ef6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fec27b4-2d') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9fec27b4-2d, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=75d93320-4a8a-4c0a-885b-a38d84faae00) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:34:10 user nova-compute[74348]: INFO os_vif [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:1b:f4,bridge_name='br-int',has_traffic_filtering=True,id=9fec27b4-2d46-482b-80e6-36cf60b1bfb8,network=Network(aed76530-d78f-4747-ba48-e5a0eed6ef6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fec27b4-2d')
Nov 22 08:34:10 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oTdnqStX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:34:10 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:34:10 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ecf3c8-02eb-4794-8214-00533a3d6b9f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 08:34:10 user nova-compute[74348]: No targets found.
Nov 22 08:34:10 user nova-compute[74348]: iSNS:
Nov 22 08:34:10 user nova-compute[74348]: No targets found.
Nov 22 08:34:10 user nova-compute[74348]: STATIC:
Nov 22 08:34:10 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c
Nov 22 08:34:10 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:34:10 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:34:10 user nova-compute[74348]: FIRMWARE:
Nov 22 08:34:10 user nova-compute[74348]: No targets found.
Nov 22 08:34:10 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 08:34:10 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 08:34:10 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed092e06-52c4-4eb5-b56b-e3574eb68026]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[124a41f1-54a2-4ff8-9648-9668eba6c1e6]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c (non-flash)
Nov 22 08:34:10 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c (non-flash)
Nov 22 08:34:10 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f22283293f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c'): ({'sdb'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Removing single pathed devices sdb {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b4312d-5d8c-44ba-af54-35b06e143d11]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd271812-f4b8-4413-bc77-9aab9e7c9846]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Flushing IO for device /dev/sdb {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7881357-31eb-4a68-8cf1-f34f7d19494f]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.067s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[da99b558-cb6c-474d-8fd8-3612111f11b7]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] SCSI volumes sdb have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOc058dc9f-0a5fde0ef2fd5506', '/dev/disk/by-id/scsi-23061356664653065', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_c058dc9f') {{(pid=85159) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17650db-9419-4d48-b785-29a75372a69e]: (4, None) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6c95c6-1275-4517-aa6d-c48a09e0284d]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[91847bbe-3bdc-46d3-a0c2-31b0eaa66f20]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c, portal: 172.16.0.220,3260]
Nov 22 08:34:10 user nova-compute[74348]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c, portal: 172.16.0.220,3260] successful.
Nov 22 08:34:10 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6762dba-6cb6-4b26-b2fc-3a4ab476db7c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e8f277-999e-4735-8c26-bf0cdbca4bc5]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] <== disconnect_volume: return (307ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:34:10 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 08:34:10 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Deleting instance files /opt/stack/data/nova/instances/a82fc860-be12-4fd5-9d56-0c35f4dd81b1_del
Nov 22 08:34:10 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Deletion of /opt/stack/data/nova/instances/a82fc860-be12-4fd5-9d56-0c35f4dd81b1_del complete
Nov 22 08:34:11 user nova-compute[74348]: INFO nova.compute.manager [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 22 08:34:11 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 08:34:11 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 08:34:11 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 08:34:11 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:34:11 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Took 0.38 seconds to deallocate network for instance.
Nov 22 08:34:11 user nova-compute[74348]: DEBUG nova.compute.manager [req-1a458110-2e4d-4154-855b-923f5eae7d75 req-d549395d-fd56-4199-84ae-3c23b9d201b3 service nova] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Received event network-vif-deleted-9fec27b4-2d46-482b-80e6-36cf60b1bfb8 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:34:11 user nova-compute[74348]: INFO nova.compute.manager [req-1a458110-2e4d-4154-855b-923f5eae7d75 req-d549395d-fd56-4199-84ae-3c23b9d201b3 service nova] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Neutron deleted interface 9fec27b4-2d46-482b-80e6-36cf60b1bfb8; detaching it from the instance and deleting it from the info cache
Nov 22 08:34:11 user nova-compute[74348]: DEBUG nova.network.neutron [req-1a458110-2e4d-4154-855b-923f5eae7d75 req-d549395d-fd56-4199-84ae-3c23b9d201b3 service nova] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:34:11 user nova-compute[74348]: DEBUG nova.compute.manager [req-1a458110-2e4d-4154-855b-923f5eae7d75 req-d549395d-fd56-4199-84ae-3c23b9d201b3 service nova] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Detach interface failed, port_id=9fec27b4-2d46-482b-80e6-36cf60b1bfb8, reason: Instance a82fc860-be12-4fd5-9d56-0c35f4dd81b1 could not be found. {{(pid=74348) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 08:34:11 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:34:12 user nova-compute[74348]: INFO nova.compute.manager [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Took 0.75 seconds to detach 1 volumes for instance.
Nov 22 08:34:12 user nova-compute[74348]: DEBUG nova.compute.manager [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Deleting volume: a6762dba-6cb6-4b26-b2fc-3a4ab476db7c {{(pid=74348) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 22 08:34:12 user nova-compute[74348]: DEBUG nova.compute.manager [req-811bb29f-7753-4555-acf1-086d32e35159 req-dfdcc54e-bce0-48d8-bc62-56c6c7defcfc service nova] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Received event network-vif-plugged-9fec27b4-2d46-482b-80e6-36cf60b1bfb8 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:34:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-811bb29f-7753-4555-acf1-086d32e35159 req-dfdcc54e-bce0-48d8-bc62-56c6c7defcfc service nova] Acquiring lock "a82fc860-be12-4fd5-9d56-0c35f4dd81b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:34:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-811bb29f-7753-4555-acf1-086d32e35159 req-dfdcc54e-bce0-48d8-bc62-56c6c7defcfc service nova] Lock "a82fc860-be12-4fd5-9d56-0c35f4dd81b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:34:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-811bb29f-7753-4555-acf1-086d32e35159 req-dfdcc54e-bce0-48d8-bc62-56c6c7defcfc service nova] Lock "a82fc860-be12-4fd5-9d56-0c35f4dd81b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:34:12 user nova-compute[74348]: DEBUG nova.compute.manager [req-811bb29f-7753-4555-acf1-086d32e35159 req-dfdcc54e-bce0-48d8-bc62-56c6c7defcfc service nova] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] No waiting events found dispatching network-vif-plugged-9fec27b4-2d46-482b-80e6-36cf60b1bfb8 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:34:12 user nova-compute[74348]: WARNING nova.compute.manager [req-811bb29f-7753-4555-acf1-086d32e35159 req-dfdcc54e-bce0-48d8-bc62-56c6c7defcfc service nova] [instance: a82fc860-be12-4fd5-9d56-0c35f4dd81b1] Received unexpected event network-vif-plugged-9fec27b4-2d46-482b-80e6-36cf60b1bfb8 for instance with vm_state active and task_state deleting.
Nov 22 08:34:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:34:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:34:12 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:34:12 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:34:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.156s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:34:12 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Deleted allocations for instance a82fc860-be12-4fd5-9d56-0c35f4dd81b1
Nov 22 08:34:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-b9597998-0afa-4797-9ca2-c730f714b457 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "a82fc860-be12-4fd5-9d56-0c35f4dd81b1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.694s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:34:13 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:34:15 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:34:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:34:17 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:34:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:34:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:34:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:34:17 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:34:17 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:34:17 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:34:17 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=9161MB free_disk=24.901145935058594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:34:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:34:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:34:18 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:34:18 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:34:18 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Refreshing inventories for resource provider 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 22 08:34:18 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Updating ProviderTree inventory for provider 52690f6a-773f-4e8d-be85-d278b6522975 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 22 08:34:18 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Updating inventory in ProviderTree for provider 52690f6a-773f-4e8d-be85-d278b6522975 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 22 08:34:18 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Refreshing aggregate associations for resource provider 52690f6a-773f-4e8d-be85-d278b6522975, aggregates: None {{(pid=74348) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 22 08:34:18 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Refreshing trait associations for resource provider 52690f6a-773f-4e8d-be85-d278b6522975, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=74348) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 22 08:34:18 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:34:18 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:34:18 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:34:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.293s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:34:18 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:34:18 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Cleaning up deleted instances {{(pid=74348) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 22 08:34:18 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] There are 0 instances to clean {{(pid=74348) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 22 08:34:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:34:23 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:34:23 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74348) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 22 08:34:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:34:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:34:35 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:34:40 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:34:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:34:50 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:34:55 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:35:00 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:35:02 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:35:02 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:35:02 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Rebuilding the list of instances to heal {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 08:35:02 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Didn't find any instances for network info cache update. {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 08:35:02 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:35:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:35:06 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:35:06 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:35:06 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:35:07 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:35:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:35:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:35:13 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:35:13 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:35:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "55efc55d-7739-49b2-955f-427810c68ade" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:35:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "55efc55d-7739-49b2-955f-427810c68ade" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:35:14 user nova-compute[74348]: DEBUG nova.compute.manager [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 08:35:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:35:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:35:14 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 08:35:14 user nova-compute[74348]: INFO nova.compute.claims [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Claim successful on node user
Nov 22 08:35:14 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:35:14 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:35:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.194s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:35:14 user nova-compute[74348]: DEBUG nova.compute.manager [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 08:35:14 user nova-compute[74348]: DEBUG nova.compute.manager [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 08:35:14 user nova-compute[74348]: DEBUG nova.network.neutron [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 55efc55d-7739-49b2-955f-427810c68ade] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 08:35:14 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 08:35:14 user nova-compute[74348]: DEBUG nova.compute.manager [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 08:35:14 user nova-compute[74348]: DEBUG nova.policy [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b510235916f547b8b0f5c3c150fe9dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a81615aef8948718005d104403e260e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 08:35:14 user nova-compute[74348]: INFO nova.virt.block_device [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Booting with volume f3005e4a-6a84-4993-9961-e861758e2c2e at /dev/vda
Nov 22 08:35:14 user nova-compute[74348]: DEBUG os_brick.utils [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:35:14 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:35:14 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:35:14 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4742015c-7dab-464f-9ed8-06f71db94f9e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:35:14 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:35:14 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:35:14 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec1258a-3802-4a21-b989-58c9361a4e76]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:35:14 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:35:14 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:35:14 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2c3fdb-d07e-4f61-94a3-e8690bc5bab6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:35:14 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4cd1c6-1f06-4f2e-97fa-3cdd0a2f0a2d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:35:14 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:35:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:35:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 08:35:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:35:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:35:15 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 08:35:15 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[cadfd602-15a3-48d9-b6bd-36ca4a8752bd]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:35:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 08:35:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 08:35:15 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 08:35:15 user nova-compute[74348]: DEBUG os_brick.utils [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:35:15 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Updating existing volume attachment record: 6aebe84e-69be-4ce4-81e9-d303502b2dee {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 08:35:15 user nova-compute[74348]: DEBUG nova.network.neutron [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Successfully created port: e8312049-b234-4a84-9c6a-a53910a2ae3d {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 08:35:15 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:35:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:35:16 user nova-compute[74348]: DEBUG nova.network.neutron [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Successfully updated port: e8312049-b234-4a84-9c6a-a53910a2ae3d {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 08:35:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "refresh_cache-55efc55d-7739-49b2-955f-427810c68ade" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:35:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquired lock "refresh_cache-55efc55d-7739-49b2-955f-427810c68ade" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:35:16 user nova-compute[74348]: DEBUG nova.network.neutron [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:35:16 user nova-compute[74348]: DEBUG nova.network.neutron [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 08:35:16 user nova-compute[74348]: DEBUG nova.compute.manager [req-1425e692-dbc8-4204-9475-5ec7749b2648 req-b3106348-b6bb-493c-976f-8b5ddd715fea service nova] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Received event network-changed-e8312049-b234-4a84-9c6a-a53910a2ae3d {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:35:16 user nova-compute[74348]: DEBUG nova.compute.manager [req-1425e692-dbc8-4204-9475-5ec7749b2648 req-b3106348-b6bb-493c-976f-8b5ddd715fea service nova] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Refreshing instance network info cache due to event network-changed-e8312049-b234-4a84-9c6a-a53910a2ae3d. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:35:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-1425e692-dbc8-4204-9475-5ec7749b2648 req-b3106348-b6bb-493c-976f-8b5ddd715fea service nova] Acquiring lock "refresh_cache-55efc55d-7739-49b2-955f-427810c68ade" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:35:16 user nova-compute[74348]: DEBUG nova.network.neutron [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Updating instance_info_cache with network_info: [{"id": "e8312049-b234-4a84-9c6a-a53910a2ae3d", "address": "fa:16:3e:f4:67:40", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8312049-b2", "ovs_interfaceid": "e8312049-b234-4a84-9c6a-a53910a2ae3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:35:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Releasing lock "refresh_cache-55efc55d-7739-49b2-955f-427810c68ade" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:35:16 user nova-compute[74348]: DEBUG nova.compute.manager [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Instance network_info: |[{"id": "e8312049-b234-4a84-9c6a-a53910a2ae3d", "address": "fa:16:3e:f4:67:40", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8312049-b2", "ovs_interfaceid": "e8312049-b234-4a84-9c6a-a53910a2ae3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 08:35:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-1425e692-dbc8-4204-9475-5ec7749b2648 req-b3106348-b6bb-493c-976f-8b5ddd715fea service nova] Acquired lock "refresh_cache-55efc55d-7739-49b2-955f-427810c68ade" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:35:16 user nova-compute[74348]: DEBUG nova.network.neutron [req-1425e692-dbc8-4204-9475-5ec7749b2648 req-b3106348-b6bb-493c-976f-8b5ddd715fea service nova] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Refreshing network info cache for port e8312049-b234-4a84-9c6a-a53910a2ae3d {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:35:16 user nova-compute[74348]: DEBUG nova.network.neutron [req-1425e692-dbc8-4204-9475-5ec7749b2648 req-b3106348-b6bb-493c-976f-8b5ddd715fea service nova] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Updated VIF entry in instance network info cache for port e8312049-b234-4a84-9c6a-a53910a2ae3d. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:35:16 user nova-compute[74348]: DEBUG nova.network.neutron [req-1425e692-dbc8-4204-9475-5ec7749b2648 req-b3106348-b6bb-493c-976f-8b5ddd715fea service nova] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Updating instance_info_cache with network_info: [{"id": "e8312049-b234-4a84-9c6a-a53910a2ae3d", "address": "fa:16:3e:f4:67:40", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8312049-b2", "ovs_interfaceid": "e8312049-b234-4a84-9c6a-a53910a2ae3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:35:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-1425e692-dbc8-4204-9475-5ec7749b2648 req-b3106348-b6bb-493c-976f-8b5ddd715fea service nova] Releasing lock "refresh_cache-55efc55d-7739-49b2-955f-427810c68ade" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:35:19 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:35:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:35:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:35:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:35:19 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:35:19 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:35:19 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:35:19 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=9177MB free_disk=24.892051696777344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:35:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:35:19 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:35:19 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 55efc55d-7739-49b2-955f-427810c68ade actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:35:19 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:35:19 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.187s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG nova.compute.manager [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 08:35:20 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Creating image(s)
Nov 22 08:35:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Did not create local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Ensure instance console log exists: /opt/stack/data/nova/instances/55efc55d-7739-49b2-955f-427810c68ade/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Start _get_guest_xml network_info=[{"id": "e8312049-b234-4a84-9c6a-a53910a2ae3d", "address": "fa:16:3e:f4:67:40", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8312049-b2", "ovs_interfaceid": "e8312049-b234-4a84-9c6a-a53910a2ae3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcFRHbAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '55efc55d-7739-49b2-955f-427810c68ade', 'attached_at': '', 'detached_at': '', 'volume_id': 'f3005e4a-6a84-4993-9961-e861758e2c2e', 'serial': 'f3005e4a-6a84-4993-9961-e861758e2c2e'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '6aebe84e-69be-4ce4-81e9-d303502b2dee', 'volume_type': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 08:35:20 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:35:20 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:35:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcFRHbAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:35:20 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:35:20 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:35:20 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:35:20 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:35:20 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 08:35:20 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[33799c5e-1d44-48b5-bcc1-003ac281d733]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 08:35:20 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1636c783-5e78-497c-8c23-543e03dfe199]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e] added
Nov 22 08:35:20 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[46834367-c888-437f-b93f-526fe0756663]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e775d0-2bca-4dd1-a8e7-7701688c20c6]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CcFRHbAV {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CcFRHbAV" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[14dcf8c8-87b8-4176-b97e-8baaa019d8a5]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CcFRHbAV'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2da620-cb4d-4b43-9147-b467607e283b]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e4f016-779a-4cf8-9dca-9dc1e218755b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 22 08:35:20 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:35:20 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 22 08:35:20 user nova-compute[74348]:  {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:35:20 user nova-compute[74348]: WARNING os_brick.initiator.connectors.iscsi [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 22 08:35:20 user nova-compute[74348]: 
Nov 22 08:35:20 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:35:21 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:35:21 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b6e394-e172-466d-b264-74d6689912b7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:35:21 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e, portal: 172.16.0.220,3260]
Nov 22 08:35:21 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e, portal: 172.16.0.220,3260] successful.
Nov 22 08:35:21 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:35:21 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:35:21 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:35:21 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1c6092-7e9c-4778-bfdc-368f060c165d]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:35:21 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:35:21 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:35:21 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:35:21 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc879f6c-fef2-4439-876a-0eaf1e723cca]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:35:21 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e (non-flash)
Nov 22 08:35:21 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:35:21 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e (non-flash)
Nov 22 08:35:21 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:35:21 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.232s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:35:21 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 08:35:21 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 08:35:21 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 08:35:21 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:35:21 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:35:21 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:35:21 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81218cd-b7b3-4a0c-8dca-3af1d3236d99]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:35:21 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:35:21 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcFRHbAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 08:35:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.260s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:35:22 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] <== connect_volume: return (1262ms) {'type': 'block', 'scsi_wwn': '26562336561613864', 'path': '/dev/sdb'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:35:22 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562336561613864', 'path': '/dev/sdb'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 08:35:22 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:35:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-934453333',display_name='tempest-TestVolumeBootPattern-volume-backed-server-934453333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-934453333',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFteDFtLquhhC0KbmDJQaknbAyXbJ2Q4mnLX920ek/NU5i0rr2i7fEdWK2mR/gAJcbHlcaLvfu6WIcql3ai4t99GBBl4NjcmDNxBQOZBUFDgUADhzsdFhkp9s4rR+Eiyww==',key_name='tempest-keypair-1807093791',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a81615aef8948718005d104403e260e',ramdisk_id='',reservation_id='r-m98fxgad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1316917970',owner_user_name='tempest-TestVolumeBootPattern-1316917970-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:35:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b510235916f547b8b0f5c3c150fe9dac',uuid=55efc55d-7739-49b2-955f-427810c68ade,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8312049-b234-4a84-9c6a-a53910a2ae3d", "address": "fa:16:3e:f4:67:40", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8312049-b2", "ovs_interfaceid": "e8312049-b234-4a84-9c6a-a53910a2ae3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 08:35:22 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Converting VIF {"id": "e8312049-b234-4a84-9c6a-a53910a2ae3d", "address": "fa:16:3e:f4:67:40", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8312049-b2", "ovs_interfaceid": "e8312049-b234-4a84-9c6a-a53910a2ae3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:35:22 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:67:40,bridge_name='br-int',has_traffic_filtering=True,id=e8312049-b234-4a84-9c6a-a53910a2ae3d,network=Network(aed76530-d78f-4747-ba48-e5a0eed6ef6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8312049-b2') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:35:22 user nova-compute[74348]: DEBUG nova.objects.instance [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lazy-loading 'pci_devices' on Instance uuid 55efc55d-7739-49b2-955f-427810c68ade {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:35:22 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 55efc55d-7739-49b2-955f-427810c68ade] End _get_guest_xml xml=<domain type="kvm">
Nov 22 08:35:22 user nova-compute[74348]:   <uuid>55efc55d-7739-49b2-955f-427810c68ade</uuid>
Nov 22 08:35:22 user nova-compute[74348]:   <name>instance-00000030</name>
Nov 22 08:35:22 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 08:35:22 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 08:35:22 user nova-compute[74348]:   <metadata>
Nov 22 08:35:22 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 08:35:22 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 08:35:22 user nova-compute[74348]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-934453333</nova:name>
Nov 22 08:35:22 user nova-compute[74348]:       <nova:creationTime>2023-11-22 08:35:20</nova:creationTime>
Nov 22 08:35:22 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 08:35:22 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 08:35:22 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 08:35:22 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 08:35:22 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 08:35:22 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 08:35:22 user nova-compute[74348]:       </nova:flavor>
Nov 22 08:35:22 user nova-compute[74348]:       <nova:owner>
Nov 22 08:35:22 user nova-compute[74348]:         <nova:user uuid="b510235916f547b8b0f5c3c150fe9dac">tempest-TestVolumeBootPattern-1316917970-project-member</nova:user>
Nov 22 08:35:22 user nova-compute[74348]:         <nova:project uuid="1a81615aef8948718005d104403e260e">tempest-TestVolumeBootPattern-1316917970</nova:project>
Nov 22 08:35:22 user nova-compute[74348]:       </nova:owner>
Nov 22 08:35:22 user nova-compute[74348]:       <nova:ports>
Nov 22 08:35:22 user nova-compute[74348]:         <nova:port uuid="e8312049-b234-4a84-9c6a-a53910a2ae3d">
Nov 22 08:35:22 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 22 08:35:22 user nova-compute[74348]:         </nova:port>
Nov 22 08:35:22 user nova-compute[74348]:       </nova:ports>
Nov 22 08:35:22 user nova-compute[74348]:     </nova:instance>
Nov 22 08:35:22 user nova-compute[74348]:   </metadata>
Nov 22 08:35:22 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 08:35:22 user nova-compute[74348]:     <system>
Nov 22 08:35:22 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 08:35:22 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 08:35:22 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 08:35:22 user nova-compute[74348]:       <entry name="serial">55efc55d-7739-49b2-955f-427810c68ade</entry>
Nov 22 08:35:22 user nova-compute[74348]:       <entry name="uuid">55efc55d-7739-49b2-955f-427810c68ade</entry>
Nov 22 08:35:22 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 08:35:22 user nova-compute[74348]:     </system>
Nov 22 08:35:22 user nova-compute[74348]:   </sysinfo>
Nov 22 08:35:22 user nova-compute[74348]:   <os>
Nov 22 08:35:22 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 08:35:22 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 08:35:22 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 08:35:22 user nova-compute[74348]:   </os>
Nov 22 08:35:22 user nova-compute[74348]:   <features>
Nov 22 08:35:22 user nova-compute[74348]:     <acpi/>
Nov 22 08:35:22 user nova-compute[74348]:     <apic/>
Nov 22 08:35:22 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 08:35:22 user nova-compute[74348]:   </features>
Nov 22 08:35:22 user nova-compute[74348]:   <clock offset="utc">
Nov 22 08:35:22 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 08:35:22 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 08:35:22 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 08:35:22 user nova-compute[74348]:   </clock>
Nov 22 08:35:22 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 08:35:22 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 08:35:22 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 08:35:22 user nova-compute[74348]:   </cpu>
Nov 22 08:35:22 user nova-compute[74348]:   <devices>
Nov 22 08:35:22 user nova-compute[74348]:     <disk type="block" device="disk">
Nov 22 08:35:22 user nova-compute[74348]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:35:22 user nova-compute[74348]:       <source dev="/dev/sdb"/>
Nov 22 08:35:22 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 08:35:22 user nova-compute[74348]:       <serial>f3005e4a-6a84-4993-9961-e861758e2c2e</serial>
Nov 22 08:35:22 user nova-compute[74348]:     </disk>
Nov 22 08:35:22 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 08:35:22 user nova-compute[74348]:       <mac address="fa:16:3e:f4:67:40"/>
Nov 22 08:35:22 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:35:22 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 08:35:22 user nova-compute[74348]:       <target dev="tape8312049-b2"/>
Nov 22 08:35:22 user nova-compute[74348]:     </interface>
Nov 22 08:35:22 user nova-compute[74348]:     <serial type="pty">
Nov 22 08:35:22 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/55efc55d-7739-49b2-955f-427810c68ade/console.log" append="off"/>
Nov 22 08:35:22 user nova-compute[74348]:     </serial>
Nov 22 08:35:22 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 08:35:22 user nova-compute[74348]:     <video>
Nov 22 08:35:22 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:35:22 user nova-compute[74348]:     </video>
Nov 22 08:35:22 user nova-compute[74348]:     <rng model="virtio">
Nov 22 08:35:22 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 08:35:22 user nova-compute[74348]:     </rng>
Nov 22 08:35:22 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 08:35:22 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 08:35:22 user nova-compute[74348]:       <stats period="10"/>
Nov 22 08:35:22 user nova-compute[74348]:     </memballoon>
Nov 22 08:35:22 user nova-compute[74348]:   </devices>
Nov 22 08:35:22 user nova-compute[74348]: </domain>
Nov 22 08:35:22 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 08:35:22 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:35:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-934453333',display_name='tempest-TestVolumeBootPattern-volume-backed-server-934453333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-934453333',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFteDFtLquhhC0KbmDJQaknbAyXbJ2Q4mnLX920ek/NU5i0rr2i7fEdWK2mR/gAJcbHlcaLvfu6WIcql3ai4t99GBBl4NjcmDNxBQOZBUFDgUADhzsdFhkp9s4rR+Eiyww==',key_name='tempest-keypair-1807093791',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a81615aef8948718005d104403e260e',ramdisk_id='',reservation_id='r-m98fxgad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1316917970',owner_user_name='tempest-TestVolumeBootPattern-1316917970-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:35:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b510235916f547b8b0f5c3c150fe9dac',uuid=55efc55d-7739-49b2-955f-427810c68ade,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8312049-b234-4a84-9c6a-a53910a2ae3d", "address": "fa:16:3e:f4:67:40", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8312049-b2", "ovs_interfaceid": "e8312049-b234-4a84-9c6a-a53910a2ae3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 08:35:22 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Converting VIF {"id": "e8312049-b234-4a84-9c6a-a53910a2ae3d", "address": "fa:16:3e:f4:67:40", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8312049-b2", "ovs_interfaceid": "e8312049-b234-4a84-9c6a-a53910a2ae3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:35:22 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:67:40,bridge_name='br-int',has_traffic_filtering=True,id=e8312049-b234-4a84-9c6a-a53910a2ae3d,network=Network(aed76530-d78f-4747-ba48-e5a0eed6ef6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8312049-b2') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:35:22 user nova-compute[74348]: DEBUG os_vif [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:67:40,bridge_name='br-int',has_traffic_filtering=True,id=e8312049-b234-4a84-9c6a-a53910a2ae3d,network=Network(aed76530-d78f-4747-ba48-e5a0eed6ef6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8312049-b2') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 08:35:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:35:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:35:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 08:35:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:35:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4af6e8b3-8ce2-59aa-9779-1cac7dc52421', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:35:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:35:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:35:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:35:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8312049-b2, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:35:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape8312049-b2, col_values=(('qos', UUID('87d0fb32-ef89-47c8-b3f9-c737b9a00261')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:35:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape8312049-b2, col_values=(('external_ids', {'iface-id': 'e8312049-b234-4a84-9c6a-a53910a2ae3d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:67:40', 'vm-uuid': '55efc55d-7739-49b2-955f-427810c68ade'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:35:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:35:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:35:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:35:22 user nova-compute[74348]: INFO os_vif [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:67:40,bridge_name='br-int',has_traffic_filtering=True,id=e8312049-b234-4a84-9c6a-a53910a2ae3d,network=Network(aed76530-d78f-4747-ba48-e5a0eed6ef6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8312049-b2')
Nov 22 08:35:22 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:35:22 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] No VIF found with MAC fa:16:3e:f4:67:40, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:35:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:35:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:35:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:35:23 user nova-compute[74348]: DEBUG nova.compute.manager [req-8292dd30-2b77-4ede-ad0d-8e50f59eaa82 req-31377b1c-ef90-4c4a-a74e-2e1e7ad7e6f0 service nova] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Received event network-vif-plugged-e8312049-b234-4a84-9c6a-a53910a2ae3d {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:35:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-8292dd30-2b77-4ede-ad0d-8e50f59eaa82 req-31377b1c-ef90-4c4a-a74e-2e1e7ad7e6f0 service nova] Acquiring lock "55efc55d-7739-49b2-955f-427810c68ade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:35:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-8292dd30-2b77-4ede-ad0d-8e50f59eaa82 req-31377b1c-ef90-4c4a-a74e-2e1e7ad7e6f0 service nova] Lock "55efc55d-7739-49b2-955f-427810c68ade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:35:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-8292dd30-2b77-4ede-ad0d-8e50f59eaa82 req-31377b1c-ef90-4c4a-a74e-2e1e7ad7e6f0 service nova] Lock "55efc55d-7739-49b2-955f-427810c68ade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:35:23 user nova-compute[74348]: DEBUG nova.compute.manager [req-8292dd30-2b77-4ede-ad0d-8e50f59eaa82 req-31377b1c-ef90-4c4a-a74e-2e1e7ad7e6f0 service nova] [instance: 55efc55d-7739-49b2-955f-427810c68ade] No waiting events found dispatching network-vif-plugged-e8312049-b234-4a84-9c6a-a53910a2ae3d {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:35:23 user nova-compute[74348]: WARNING nova.compute.manager [req-8292dd30-2b77-4ede-ad0d-8e50f59eaa82 req-31377b1c-ef90-4c4a-a74e-2e1e7ad7e6f0 service nova] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Received unexpected event network-vif-plugged-e8312049-b234-4a84-9c6a-a53910a2ae3d for instance with vm_state building and task_state spawning.
Nov 22 08:35:24 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:35:24 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:35:24 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:35:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:35:25 user nova-compute[74348]: DEBUG nova.compute.manager [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 08:35:25 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 08:35:25 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Instance spawned successfully.
Nov 22 08:35:25 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 08:35:25 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:35:25 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:35:25 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:35:25 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:35:25 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:35:25 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:35:25 user nova-compute[74348]: INFO nova.compute.manager [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Took 4.86 seconds to spawn the instance on the hypervisor.
Nov 22 08:35:25 user nova-compute[74348]: DEBUG nova.compute.manager [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:35:25 user nova-compute[74348]: INFO nova.compute.manager [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Took 11.23 seconds to build instance.
Nov 22 08:35:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-1ff0f4b0-44e7-4049-9a31-9be65a3f10c4 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "55efc55d-7739-49b2-955f-427810c68ade" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.419s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:35:25 user nova-compute[74348]: DEBUG nova.compute.manager [req-245ad3d5-6e37-4186-89b5-fefb190dde57 req-b74bbfca-8ceb-40f9-8189-4ef9f5818acb service nova] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Received event network-vif-plugged-e8312049-b234-4a84-9c6a-a53910a2ae3d {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:35:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-245ad3d5-6e37-4186-89b5-fefb190dde57 req-b74bbfca-8ceb-40f9-8189-4ef9f5818acb service nova] Acquiring lock "55efc55d-7739-49b2-955f-427810c68ade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:35:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-245ad3d5-6e37-4186-89b5-fefb190dde57 req-b74bbfca-8ceb-40f9-8189-4ef9f5818acb service nova] Lock "55efc55d-7739-49b2-955f-427810c68ade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:35:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-245ad3d5-6e37-4186-89b5-fefb190dde57 req-b74bbfca-8ceb-40f9-8189-4ef9f5818acb service nova] Lock "55efc55d-7739-49b2-955f-427810c68ade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:35:25 user nova-compute[74348]: DEBUG nova.compute.manager [req-245ad3d5-6e37-4186-89b5-fefb190dde57 req-b74bbfca-8ceb-40f9-8189-4ef9f5818acb service nova] [instance: 55efc55d-7739-49b2-955f-427810c68ade] No waiting events found dispatching network-vif-plugged-e8312049-b234-4a84-9c6a-a53910a2ae3d {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:35:25 user nova-compute[74348]: WARNING nova.compute.manager [req-245ad3d5-6e37-4186-89b5-fefb190dde57 req-b74bbfca-8ceb-40f9-8189-4ef9f5818acb service nova] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Received unexpected event network-vif-plugged-e8312049-b234-4a84-9c6a-a53910a2ae3d for instance with vm_state active and task_state None.
Nov 22 08:35:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:35:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:35:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:35:37 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:35:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:35:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:35:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:35:50 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:35:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:35:55 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:35:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:36:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:36:02 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:36:02 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:36:02 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Rebuilding the list of instances to heal {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 08:36:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-55efc55d-7739-49b2-955f-427810c68ade" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:36:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-55efc55d-7739-49b2-955f-427810c68ade" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:36:02 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 08:36:02 user nova-compute[74348]: DEBUG nova.objects.instance [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lazy-loading 'info_cache' on Instance uuid 55efc55d-7739-49b2-955f-427810c68ade {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:36:02 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Updating instance_info_cache with network_info: [{"id": "e8312049-b234-4a84-9c6a-a53910a2ae3d", "address": "fa:16:3e:f4:67:40", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8312049-b2", "ovs_interfaceid": "e8312049-b234-4a84-9c6a-a53910a2ae3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:36:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-55efc55d-7739-49b2-955f-427810c68ade" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:36:03 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 08:36:04 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:36:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:36:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:36:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:36:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:36:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:36:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:36:07 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:36:08 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:36:08 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:36:08 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:36:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:36:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:36:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:36:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:36:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:36:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:36:14 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:36:15 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:36:15 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:36:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:36:20 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:36:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:36:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:36:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:36:20 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:36:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:36:20 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:36:20 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:36:20 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=9023MB free_disk=24.89067840576172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:36:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:36:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:36:21 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 55efc55d-7739-49b2-955f-427810c68ade actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:36:21 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:36:21 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:36:21 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:36:21 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:36:21 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:36:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.205s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:36:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:36:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:36:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:36:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:36:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:36:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:36:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:36:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:36:37 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:36:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:36:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:36:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:36:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:37:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:37:04 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:37:04 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:37:04 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Rebuilding the list of instances to heal {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 08:37:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-55efc55d-7739-49b2-955f-427810c68ade" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:37:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-55efc55d-7739-49b2-955f-427810c68ade" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:37:04 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 08:37:04 user nova-compute[74348]: DEBUG nova.objects.instance [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lazy-loading 'info_cache' on Instance uuid 55efc55d-7739-49b2-955f-427810c68ade {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:37:04 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Updating instance_info_cache with network_info: [{"id": "e8312049-b234-4a84-9c6a-a53910a2ae3d", "address": "fa:16:3e:f4:67:40", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8312049-b2", "ovs_interfaceid": "e8312049-b234-4a84-9c6a-a53910a2ae3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:37:04 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-55efc55d-7739-49b2-955f-427810c68ade" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:37:04 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 08:37:05 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:37:05 user nova-compute[74348]: DEBUG nova.compute.manager [req-2a35c24c-b24e-4f2b-8fce-0296c2d6880e req-55e8d12f-b769-4815-8614-587354b3d108 service nova] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Received event network-changed-e8312049-b234-4a84-9c6a-a53910a2ae3d {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:37:05 user nova-compute[74348]: DEBUG nova.compute.manager [req-2a35c24c-b24e-4f2b-8fce-0296c2d6880e req-55e8d12f-b769-4815-8614-587354b3d108 service nova] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Refreshing instance network info cache due to event network-changed-e8312049-b234-4a84-9c6a-a53910a2ae3d. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:37:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2a35c24c-b24e-4f2b-8fce-0296c2d6880e req-55e8d12f-b769-4815-8614-587354b3d108 service nova] Acquiring lock "refresh_cache-55efc55d-7739-49b2-955f-427810c68ade" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:37:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2a35c24c-b24e-4f2b-8fce-0296c2d6880e req-55e8d12f-b769-4815-8614-587354b3d108 service nova] Acquired lock "refresh_cache-55efc55d-7739-49b2-955f-427810c68ade" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:37:05 user nova-compute[74348]: DEBUG nova.network.neutron [req-2a35c24c-b24e-4f2b-8fce-0296c2d6880e req-55e8d12f-b769-4815-8614-587354b3d108 service nova] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Refreshing network info cache for port e8312049-b234-4a84-9c6a-a53910a2ae3d {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:37:06 user nova-compute[74348]: DEBUG nova.network.neutron [req-2a35c24c-b24e-4f2b-8fce-0296c2d6880e req-55e8d12f-b769-4815-8614-587354b3d108 service nova] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Updated VIF entry in instance network info cache for port e8312049-b234-4a84-9c6a-a53910a2ae3d. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:37:06 user nova-compute[74348]: DEBUG nova.network.neutron [req-2a35c24c-b24e-4f2b-8fce-0296c2d6880e req-55e8d12f-b769-4815-8614-587354b3d108 service nova] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Updating instance_info_cache with network_info: [{"id": "e8312049-b234-4a84-9c6a-a53910a2ae3d", "address": "fa:16:3e:f4:67:40", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8312049-b2", "ovs_interfaceid": "e8312049-b234-4a84-9c6a-a53910a2ae3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:37:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-2a35c24c-b24e-4f2b-8fce-0296c2d6880e req-55e8d12f-b769-4815-8614-587354b3d108 service nova] Releasing lock "refresh_cache-55efc55d-7739-49b2-955f-427810c68ade" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:37:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:37:07 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:37:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:37:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:37:10 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:37:10 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:37:10 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:37:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "282ce5c5-1259-4189-a60d-ea906da9cf23" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:37:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "282ce5c5-1259-4189-a60d-ea906da9cf23" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:37:11 user nova-compute[74348]: DEBUG nova.compute.manager [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 08:37:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:37:11 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:37:11 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 08:37:11 user nova-compute[74348]: INFO nova.compute.claims [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Claim successful on node user
Nov 22 08:37:12 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:37:12 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:37:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.352s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:37:12 user nova-compute[74348]: DEBUG nova.compute.manager [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 08:37:12 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 08:37:12 user nova-compute[74348]: DEBUG nova.compute.manager [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 08:37:12 user nova-compute[74348]: DEBUG nova.network.neutron [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 08:37:12 user nova-compute[74348]: DEBUG nova.compute.manager [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 08:37:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:37:12 user nova-compute[74348]: INFO nova.virt.block_device [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Booting with volume snapshot 7118203b-6bcd-45a1-81f6-9574bf6ed9cb at /dev/vda
Nov 22 08:37:12 user nova-compute[74348]: DEBUG nova.policy [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b510235916f547b8b0f5c3c150fe9dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a81615aef8948718005d104403e260e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 08:37:12 user nova-compute[74348]: DEBUG nova.network.neutron [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Successfully created port: 2cf014cf-f377-448c-8c4f-25282c0c398f {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 08:37:13 user nova-compute[74348]: DEBUG nova.network.neutron [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Successfully updated port: 2cf014cf-f377-448c-8c4f-25282c0c398f {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 08:37:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "refresh_cache-282ce5c5-1259-4189-a60d-ea906da9cf23" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:37:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquired lock "refresh_cache-282ce5c5-1259-4189-a60d-ea906da9cf23" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:37:13 user nova-compute[74348]: DEBUG nova.network.neutron [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:37:13 user nova-compute[74348]: DEBUG nova.compute.manager [req-df581bc4-5d82-4a6c-8a7f-98255e5695a4 req-433e51b3-143f-41d0-a1a0-90c5f2f2b038 service nova] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Received event network-changed-2cf014cf-f377-448c-8c4f-25282c0c398f {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:37:13 user nova-compute[74348]: DEBUG nova.compute.manager [req-df581bc4-5d82-4a6c-8a7f-98255e5695a4 req-433e51b3-143f-41d0-a1a0-90c5f2f2b038 service nova] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Refreshing instance network info cache due to event network-changed-2cf014cf-f377-448c-8c4f-25282c0c398f. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:37:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-df581bc4-5d82-4a6c-8a7f-98255e5695a4 req-433e51b3-143f-41d0-a1a0-90c5f2f2b038 service nova] Acquiring lock "refresh_cache-282ce5c5-1259-4189-a60d-ea906da9cf23" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:37:13 user nova-compute[74348]: DEBUG nova.network.neutron [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 08:37:13 user nova-compute[74348]: DEBUG nova.network.neutron [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Updating instance_info_cache with network_info: [{"id": "2cf014cf-f377-448c-8c4f-25282c0c398f", "address": "fa:16:3e:4a:1e:64", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf014cf-f3", "ovs_interfaceid": "2cf014cf-f377-448c-8c4f-25282c0c398f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:37:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Releasing lock "refresh_cache-282ce5c5-1259-4189-a60d-ea906da9cf23" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:37:13 user nova-compute[74348]: DEBUG nova.compute.manager [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Instance network_info: |[{"id": "2cf014cf-f377-448c-8c4f-25282c0c398f", "address": "fa:16:3e:4a:1e:64", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf014cf-f3", "ovs_interfaceid": "2cf014cf-f377-448c-8c4f-25282c0c398f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 08:37:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-df581bc4-5d82-4a6c-8a7f-98255e5695a4 req-433e51b3-143f-41d0-a1a0-90c5f2f2b038 service nova] Acquired lock "refresh_cache-282ce5c5-1259-4189-a60d-ea906da9cf23" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:37:13 user nova-compute[74348]: DEBUG nova.network.neutron [req-df581bc4-5d82-4a6c-8a7f-98255e5695a4 req-433e51b3-143f-41d0-a1a0-90c5f2f2b038 service nova] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Refreshing network info cache for port 2cf014cf-f377-448c-8c4f-25282c0c398f {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:37:14 user nova-compute[74348]: DEBUG nova.network.neutron [req-df581bc4-5d82-4a6c-8a7f-98255e5695a4 req-433e51b3-143f-41d0-a1a0-90c5f2f2b038 service nova] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Updated VIF entry in instance network info cache for port 2cf014cf-f377-448c-8c4f-25282c0c398f. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:37:14 user nova-compute[74348]: DEBUG nova.network.neutron [req-df581bc4-5d82-4a6c-8a7f-98255e5695a4 req-433e51b3-143f-41d0-a1a0-90c5f2f2b038 service nova] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Updating instance_info_cache with network_info: [{"id": "2cf014cf-f377-448c-8c4f-25282c0c398f", "address": "fa:16:3e:4a:1e:64", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf014cf-f3", "ovs_interfaceid": "2cf014cf-f377-448c-8c4f-25282c0c398f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:37:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-df581bc4-5d82-4a6c-8a7f-98255e5695a4 req-433e51b3-143f-41d0-a1a0-90c5f2f2b038 service nova] Releasing lock "refresh_cache-282ce5c5-1259-4189-a60d-ea906da9cf23" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:37:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:37:15 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:37:16 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:37:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:37:17 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:37:18 user nova-compute[74348]: DEBUG os_brick.utils [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:37:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:37:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:37:18 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[15eeea6a-024a-4384-bf48-08fa0e4f17e6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:37:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:37:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:37:18 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86d6608-ac49-4c2e-9c1a-3d4e60d82a76]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:37:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:37:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:37:18 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[454be550-74b2-4f9e-a859-71cd7c76a31c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:37:18 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f97ba8f-2273-4031-8757-ee32a92a38d0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:37:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:37:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:37:18 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 08:37:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:37:18 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:37:18 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 08:37:18 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea77816-0df5-4003-9eaf-15610302f5ae]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:37:18 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 08:37:18 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 08:37:18 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 08:37:18 user nova-compute[74348]: DEBUG os_brick.utils [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:37:18 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Updating existing volume attachment record: 717bb960-3ed6-46f1-8a3c-4bc8ede29a02 {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 08:37:20 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:37:20 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:37:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:37:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:37:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:37:20 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:37:20 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:37:21 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:37:21 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:37:21 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=9019MB free_disk=24.889415740966797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:37:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:37:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:37:21 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 55efc55d-7739-49b2-955f-427810c68ade actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:37:21 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 282ce5c5-1259-4189-a60d-ea906da9cf23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:37:21 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:37:21 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:37:21 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:37:21 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:37:21 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:37:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.232s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:37:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:37:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:37:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:37:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:37:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:37:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG nova.compute.manager [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 08:37:24 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Creating image(s)
Nov 22 08:37:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Did not create local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Ensure instance console log exists: /opt/stack/data/nova/instances/282ce5c5-1259-4189-a60d-ea906da9cf23/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Start _get_guest_xml network_info=[{"id": "2cf014cf-f377-448c-8c4f-25282c0c398f", "address": "fa:16:3e:4a:1e:64", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf014cf-f3", "ovs_interfaceid": "2cf014cf-f377-448c-8c4f-25282c0c398f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-22T08:37:07Z,direct_url=<?>,disk_format='qcow2',id=6099c42b-6b8e-4142-b05d-032a7f7a1b22,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-263220297',owner='1a81615aef8948718005d104403e260e',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-22T08:37:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HJicOAor', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '282ce5c5-1259-4189-a60d-ea906da9cf23', 'attached_at': '', 'detached_at': '', 'volume_id': 'b8ddf7e3-3487-4904-84f4-311ecdeda5ba', 'serial': 'b8ddf7e3-3487-4904-84f4-311ecdeda5ba'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '717bb960-3ed6-46f1-8a3c-4bc8ede29a02', 'volume_type': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 08:37:24 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:37:24 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:37:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-22T08:37:07Z,direct_url=<?>,disk_format='qcow2',id=6099c42b-6b8e-4142-b05d-032a7f7a1b22,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-263220297',owner='1a81615aef8948718005d104403e260e',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-22T08:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HJicOAor', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:37:24 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:37:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:37:24 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:37:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:37:24 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 08:37:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58c534a-3e0a-412c-9815-ee02be1db21e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 08:37:24 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1272e260-75b0-49b6-a7fc-2418995d96f3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba] added
Nov 22 08:37:24 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[681cec89-545e-4415-9834-03449860445e]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f70f4d-67d2-4ad3-811c-c8bf44ebed32]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HJicOAor {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HJicOAor" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b0de02-e904-4776-ad5e-13642c314338]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HJicOAor'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83afac7-109c-49fc-b858-568c29989857]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9887715f-bfb0-4a7b-ba26-4f702a54f985]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e (non-flash)
Nov 22 08:37:24 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e (non-flash)
Nov 22 08:37:24 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4810826e-8e47-489c-822b-213d57376f71]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba, portal: 172.16.0.220,3260]
Nov 22 08:37:24 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba, portal: 172.16.0.220,3260] successful.
Nov 22 08:37:24 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca178f76-b802-47ab-b543-1b61797473a4]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7444d33-dd61-4497-93bb-1d5a1c522596]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e (non-flash)
Nov 22 08:37:24 user nova-compute[74348]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba (non-flash)
Nov 22 08:37:24 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e (non-flash)
Nov 22 08:37:24 user nova-compute[74348]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba (non-flash)
Nov 22 08:37:24 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a367a73-7500-4cbc-ae94-3dc7b8c6aa8f]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:37:24 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: None {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:37:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:37:25 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:37:25 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HJicOAor', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 08:37:25 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:37:25 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23835323962363538', 'path': '/dev/sdc'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:37:25 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835323962363538', 'path': '/dev/sdc'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 08:37:25 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:37:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1038763101',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1038763101',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1038763101',id=49,image_ref='6099c42b-6b8e-4142-b05d-032a7f7a1b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM93++MDnX7fDyN8bs1fbYQkeR8u1hvBkIo3pg0uclkGtCW9gpelcpPlMsCpxWUUimYC15wBXx+7oVTphLNwHWrQ5Y9OC8kvu2vc2+IjlgsD4lYrdSrAya4x4Gm42k221Q==',key_name='tempest-keypair-117081087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a81615aef8948718005d104403e260e',ramdisk_id='',reservation_id='r-9v00algq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1316917970',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1316917970-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1316917970',owner_user_name='tempest-TestVolumeBootPattern-1316917970-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:37:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b510235916f547b8b0f5c3c150fe9dac',uuid=282ce5c5-1259-4189-a60d-ea906da9cf23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2cf014cf-f377-448c-8c4f-25282c0c398f", "address": "fa:16:3e:4a:1e:64", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf014cf-f3", "ovs_interfaceid": "2cf014cf-f377-448c-8c4f-25282c0c398f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 08:37:25 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Converting VIF {"id": "2cf014cf-f377-448c-8c4f-25282c0c398f", "address": "fa:16:3e:4a:1e:64", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf014cf-f3", "ovs_interfaceid": "2cf014cf-f377-448c-8c4f-25282c0c398f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:37:25 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:1e:64,bridge_name='br-int',has_traffic_filtering=True,id=2cf014cf-f377-448c-8c4f-25282c0c398f,network=Network(aed76530-d78f-4747-ba48-e5a0eed6ef6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cf014cf-f3') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:37:25 user nova-compute[74348]: DEBUG nova.objects.instance [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lazy-loading 'pci_devices' on Instance uuid 282ce5c5-1259-4189-a60d-ea906da9cf23 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:37:25 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] End _get_guest_xml xml=<domain type="kvm">
Nov 22 08:37:25 user nova-compute[74348]:   <uuid>282ce5c5-1259-4189-a60d-ea906da9cf23</uuid>
Nov 22 08:37:25 user nova-compute[74348]:   <name>instance-00000031</name>
Nov 22 08:37:25 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 08:37:25 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 08:37:25 user nova-compute[74348]:   <metadata>
Nov 22 08:37:25 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 08:37:25 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 08:37:25 user nova-compute[74348]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1038763101</nova:name>
Nov 22 08:37:25 user nova-compute[74348]:       <nova:creationTime>2023-11-22 08:37:24</nova:creationTime>
Nov 22 08:37:25 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 08:37:25 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 08:37:25 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 08:37:25 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 08:37:25 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 08:37:25 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 08:37:25 user nova-compute[74348]:       </nova:flavor>
Nov 22 08:37:25 user nova-compute[74348]:       <nova:owner>
Nov 22 08:37:25 user nova-compute[74348]:         <nova:user uuid="b510235916f547b8b0f5c3c150fe9dac">tempest-TestVolumeBootPattern-1316917970-project-member</nova:user>
Nov 22 08:37:25 user nova-compute[74348]:         <nova:project uuid="1a81615aef8948718005d104403e260e">tempest-TestVolumeBootPattern-1316917970</nova:project>
Nov 22 08:37:25 user nova-compute[74348]:       </nova:owner>
Nov 22 08:37:25 user nova-compute[74348]:       <nova:root type="image" uuid="6099c42b-6b8e-4142-b05d-032a7f7a1b22"/>
Nov 22 08:37:25 user nova-compute[74348]:       <nova:ports>
Nov 22 08:37:25 user nova-compute[74348]:         <nova:port uuid="2cf014cf-f377-448c-8c4f-25282c0c398f">
Nov 22 08:37:25 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 22 08:37:25 user nova-compute[74348]:         </nova:port>
Nov 22 08:37:25 user nova-compute[74348]:       </nova:ports>
Nov 22 08:37:25 user nova-compute[74348]:     </nova:instance>
Nov 22 08:37:25 user nova-compute[74348]:   </metadata>
Nov 22 08:37:25 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 08:37:25 user nova-compute[74348]:     <system>
Nov 22 08:37:25 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 08:37:25 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 08:37:25 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 08:37:25 user nova-compute[74348]:       <entry name="serial">282ce5c5-1259-4189-a60d-ea906da9cf23</entry>
Nov 22 08:37:25 user nova-compute[74348]:       <entry name="uuid">282ce5c5-1259-4189-a60d-ea906da9cf23</entry>
Nov 22 08:37:25 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 08:37:25 user nova-compute[74348]:     </system>
Nov 22 08:37:25 user nova-compute[74348]:   </sysinfo>
Nov 22 08:37:25 user nova-compute[74348]:   <os>
Nov 22 08:37:25 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 08:37:25 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 08:37:25 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 08:37:25 user nova-compute[74348]:   </os>
Nov 22 08:37:25 user nova-compute[74348]:   <features>
Nov 22 08:37:25 user nova-compute[74348]:     <acpi/>
Nov 22 08:37:25 user nova-compute[74348]:     <apic/>
Nov 22 08:37:25 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 08:37:25 user nova-compute[74348]:   </features>
Nov 22 08:37:25 user nova-compute[74348]:   <clock offset="utc">
Nov 22 08:37:25 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 08:37:25 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 08:37:25 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 08:37:25 user nova-compute[74348]:   </clock>
Nov 22 08:37:25 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 08:37:25 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 08:37:25 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 08:37:25 user nova-compute[74348]:   </cpu>
Nov 22 08:37:25 user nova-compute[74348]:   <devices>
Nov 22 08:37:25 user nova-compute[74348]:     <disk type="block" device="disk">
Nov 22 08:37:25 user nova-compute[74348]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:37:25 user nova-compute[74348]:       <source dev="/dev/sdc"/>
Nov 22 08:37:25 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 08:37:25 user nova-compute[74348]:       <serial>b8ddf7e3-3487-4904-84f4-311ecdeda5ba</serial>
Nov 22 08:37:25 user nova-compute[74348]:     </disk>
Nov 22 08:37:25 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 08:37:25 user nova-compute[74348]:       <mac address="fa:16:3e:4a:1e:64"/>
Nov 22 08:37:25 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:37:25 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 08:37:25 user nova-compute[74348]:       <target dev="tap2cf014cf-f3"/>
Nov 22 08:37:25 user nova-compute[74348]:     </interface>
Nov 22 08:37:25 user nova-compute[74348]:     <serial type="pty">
Nov 22 08:37:25 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/282ce5c5-1259-4189-a60d-ea906da9cf23/console.log" append="off"/>
Nov 22 08:37:25 user nova-compute[74348]:     </serial>
Nov 22 08:37:25 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 08:37:25 user nova-compute[74348]:     <video>
Nov 22 08:37:25 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:37:25 user nova-compute[74348]:     </video>
Nov 22 08:37:25 user nova-compute[74348]:     <rng model="virtio">
Nov 22 08:37:25 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 08:37:25 user nova-compute[74348]:     </rng>
Nov 22 08:37:25 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 08:37:25 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 08:37:25 user nova-compute[74348]:       <stats period="10"/>
Nov 22 08:37:25 user nova-compute[74348]:     </memballoon>
Nov 22 08:37:25 user nova-compute[74348]:   </devices>
Nov 22 08:37:25 user nova-compute[74348]: </domain>
Nov 22 08:37:25 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 08:37:25 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:37:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1038763101',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1038763101',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1038763101',id=49,image_ref='6099c42b-6b8e-4142-b05d-032a7f7a1b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM93++MDnX7fDyN8bs1fbYQkeR8u1hvBkIo3pg0uclkGtCW9gpelcpPlMsCpxWUUimYC15wBXx+7oVTphLNwHWrQ5Y9OC8kvu2vc2+IjlgsD4lYrdSrAya4x4Gm42k221Q==',key_name='tempest-keypair-117081087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a81615aef8948718005d104403e260e',ramdisk_id='',reservation_id='r-9v00algq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1316917970',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1316917970-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1316917970',owner_user_name='tempest-TestVolumeBootPattern-1316917970-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:37:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b510235916f547b8b0f5c3c150fe9dac',uuid=282ce5c5-1259-4189-a60d-ea906da9cf23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2cf014cf-f377-448c-8c4f-25282c0c398f", "address": "fa:16:3e:4a:1e:64", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf014cf-f3", "ovs_interfaceid": "2cf014cf-f377-448c-8c4f-25282c0c398f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 08:37:25 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Converting VIF {"id": "2cf014cf-f377-448c-8c4f-25282c0c398f", "address": "fa:16:3e:4a:1e:64", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf014cf-f3", "ovs_interfaceid": "2cf014cf-f377-448c-8c4f-25282c0c398f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:37:25 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:1e:64,bridge_name='br-int',has_traffic_filtering=True,id=2cf014cf-f377-448c-8c4f-25282c0c398f,network=Network(aed76530-d78f-4747-ba48-e5a0eed6ef6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cf014cf-f3') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:37:25 user nova-compute[74348]: DEBUG os_vif [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:1e:64,bridge_name='br-int',has_traffic_filtering=True,id=2cf014cf-f377-448c-8c4f-25282c0c398f,network=Network(aed76530-d78f-4747-ba48-e5a0eed6ef6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cf014cf-f3') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 08:37:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:37:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:37:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 08:37:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:37:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '37e1dfe9-e617-5d6e-9648-54cde3fc1fce', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:37:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:37:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:37:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:37:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2cf014cf-f3, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:37:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2cf014cf-f3, col_values=(('qos', UUID('e81d49e8-66a2-48bf-b272-fc296c17b178')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:37:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2cf014cf-f3, col_values=(('external_ids', {'iface-id': '2cf014cf-f377-448c-8c4f-25282c0c398f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:1e:64', 'vm-uuid': '282ce5c5-1259-4189-a60d-ea906da9cf23'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:37:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:37:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:37:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:37:25 user nova-compute[74348]: INFO os_vif [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:1e:64,bridge_name='br-int',has_traffic_filtering=True,id=2cf014cf-f377-448c-8c4f-25282c0c398f,network=Network(aed76530-d78f-4747-ba48-e5a0eed6ef6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cf014cf-f3')
Nov 22 08:37:25 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:37:25 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] No VIF found with MAC fa:16:3e:4a:1e:64, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:37:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:37:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:37:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:37:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:37:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:37:27 user nova-compute[74348]: DEBUG nova.compute.manager [req-06fec417-7557-4998-aea3-bbb3e52bbe55 req-3e50de0b-f1f5-425c-b527-7dd861f5e352 service nova] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Received event network-vif-plugged-2cf014cf-f377-448c-8c4f-25282c0c398f {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:37:27 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-06fec417-7557-4998-aea3-bbb3e52bbe55 req-3e50de0b-f1f5-425c-b527-7dd861f5e352 service nova] Acquiring lock "282ce5c5-1259-4189-a60d-ea906da9cf23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:37:27 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-06fec417-7557-4998-aea3-bbb3e52bbe55 req-3e50de0b-f1f5-425c-b527-7dd861f5e352 service nova] Lock "282ce5c5-1259-4189-a60d-ea906da9cf23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:37:27 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-06fec417-7557-4998-aea3-bbb3e52bbe55 req-3e50de0b-f1f5-425c-b527-7dd861f5e352 service nova] Lock "282ce5c5-1259-4189-a60d-ea906da9cf23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:37:27 user nova-compute[74348]: DEBUG nova.compute.manager [req-06fec417-7557-4998-aea3-bbb3e52bbe55 req-3e50de0b-f1f5-425c-b527-7dd861f5e352 service nova] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] No waiting events found dispatching network-vif-plugged-2cf014cf-f377-448c-8c4f-25282c0c398f {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:37:27 user nova-compute[74348]: WARNING nova.compute.manager [req-06fec417-7557-4998-aea3-bbb3e52bbe55 req-3e50de0b-f1f5-425c-b527-7dd861f5e352 service nova] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Received unexpected event network-vif-plugged-2cf014cf-f377-448c-8c4f-25282c0c398f for instance with vm_state building and task_state spawning.
Nov 22 08:37:29 user nova-compute[74348]: DEBUG nova.compute.manager [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 08:37:29 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 08:37:29 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Instance spawned successfully.
Nov 22 08:37:29 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 08:37:29 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:37:29 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:37:29 user nova-compute[74348]: INFO nova.compute.manager [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Took 5.16 seconds to spawn the instance on the hypervisor.
Nov 22 08:37:29 user nova-compute[74348]: DEBUG nova.compute.manager [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:37:29 user nova-compute[74348]: INFO nova.compute.manager [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Took 17.62 seconds to build instance.
Nov 22 08:37:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-9ee27fa6-9792-4df7-bf33-5d37462916f5 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "282ce5c5-1259-4189-a60d-ea906da9cf23" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.739s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:37:29 user nova-compute[74348]: DEBUG nova.compute.manager [req-0c51524b-2606-4c36-bfc7-cab8f84d6f7d req-e6633897-d27a-47a3-b9db-88780e3efc44 service nova] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Received event network-vif-plugged-2cf014cf-f377-448c-8c4f-25282c0c398f {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:37:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-0c51524b-2606-4c36-bfc7-cab8f84d6f7d req-e6633897-d27a-47a3-b9db-88780e3efc44 service nova] Acquiring lock "282ce5c5-1259-4189-a60d-ea906da9cf23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:37:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-0c51524b-2606-4c36-bfc7-cab8f84d6f7d req-e6633897-d27a-47a3-b9db-88780e3efc44 service nova] Lock "282ce5c5-1259-4189-a60d-ea906da9cf23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:37:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-0c51524b-2606-4c36-bfc7-cab8f84d6f7d req-e6633897-d27a-47a3-b9db-88780e3efc44 service nova] Lock "282ce5c5-1259-4189-a60d-ea906da9cf23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:37:29 user nova-compute[74348]: DEBUG nova.compute.manager [req-0c51524b-2606-4c36-bfc7-cab8f84d6f7d req-e6633897-d27a-47a3-b9db-88780e3efc44 service nova] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] No waiting events found dispatching network-vif-plugged-2cf014cf-f377-448c-8c4f-25282c0c398f {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:37:29 user nova-compute[74348]: WARNING nova.compute.manager [req-0c51524b-2606-4c36-bfc7-cab8f84d6f7d req-e6633897-d27a-47a3-b9db-88780e3efc44 service nova] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Received unexpected event network-vif-plugged-2cf014cf-f377-448c-8c4f-25282c0c398f for instance with vm_state active and task_state None.
Nov 22 08:37:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:37:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:37:35 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:37:40 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:37:40 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:37:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:37:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:37:50 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:37:50 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:37:55 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:37:55 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:38:00 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:38:00 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:38:05 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:38:05 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:38:05 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Rebuilding the list of instances to heal {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 08:38:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-55efc55d-7739-49b2-955f-427810c68ade" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:38:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-55efc55d-7739-49b2-955f-427810c68ade" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:38:05 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 08:38:05 user nova-compute[74348]: DEBUG nova.objects.instance [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lazy-loading 'info_cache' on Instance uuid 55efc55d-7739-49b2-955f-427810c68ade {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:38:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:38:05 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Updating instance_info_cache with network_info: [{"id": "e8312049-b234-4a84-9c6a-a53910a2ae3d", "address": "fa:16:3e:f4:67:40", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8312049-b2", "ovs_interfaceid": "e8312049-b234-4a84-9c6a-a53910a2ae3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:38:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-55efc55d-7739-49b2-955f-427810c68ade" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:38:05 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 08:38:07 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:38:07 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:38:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:38:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:38:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:38:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:38:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:38:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:38:11 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:38:11 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:38:11 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:38:15 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:38:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:38:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:38:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:38:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:38:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:38:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:38:17 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:38:18 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:38:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:38:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:38:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:38:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:38:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:38:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:38:21 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:38:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:38:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:38:21 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:38:21 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:38:21 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:38:21 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:38:22 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:38:22 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:38:22 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=8958MB free_disk=24.888092041015625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:38:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:38:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:38:22 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 55efc55d-7739-49b2-955f-427810c68ade actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:38:22 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 282ce5c5-1259-4189-a60d-ea906da9cf23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:38:22 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:38:22 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:38:22 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:38:22 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:38:22 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:38:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.232s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:38:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:38:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:38:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:38:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:38:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:38:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:38:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:38:35 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:38:35 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:38:35 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:38:35 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:38:35 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:38:35 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:38:40 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:38:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:38:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:38:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:38:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:38:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:38:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:38:50 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:38:55 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:39:00 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:39:02 user nova-compute[74348]: DEBUG nova.compute.manager [req-aee7d957-6d99-4ce3-87a1-a94a91e1d596 req-26c6781b-1e0e-4e70-abdf-c89563ff3f8f service nova] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Received event network-changed-2cf014cf-f377-448c-8c4f-25282c0c398f {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:39:02 user nova-compute[74348]: DEBUG nova.compute.manager [req-aee7d957-6d99-4ce3-87a1-a94a91e1d596 req-26c6781b-1e0e-4e70-abdf-c89563ff3f8f service nova] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Refreshing instance network info cache due to event network-changed-2cf014cf-f377-448c-8c4f-25282c0c398f. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:39:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-aee7d957-6d99-4ce3-87a1-a94a91e1d596 req-26c6781b-1e0e-4e70-abdf-c89563ff3f8f service nova] Acquiring lock "refresh_cache-282ce5c5-1259-4189-a60d-ea906da9cf23" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:39:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-aee7d957-6d99-4ce3-87a1-a94a91e1d596 req-26c6781b-1e0e-4e70-abdf-c89563ff3f8f service nova] Acquired lock "refresh_cache-282ce5c5-1259-4189-a60d-ea906da9cf23" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:39:02 user nova-compute[74348]: DEBUG nova.network.neutron [req-aee7d957-6d99-4ce3-87a1-a94a91e1d596 req-26c6781b-1e0e-4e70-abdf-c89563ff3f8f service nova] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Refreshing network info cache for port 2cf014cf-f377-448c-8c4f-25282c0c398f {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:39:03 user nova-compute[74348]: DEBUG nova.network.neutron [req-aee7d957-6d99-4ce3-87a1-a94a91e1d596 req-26c6781b-1e0e-4e70-abdf-c89563ff3f8f service nova] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Updated VIF entry in instance network info cache for port 2cf014cf-f377-448c-8c4f-25282c0c398f. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:39:03 user nova-compute[74348]: DEBUG nova.network.neutron [req-aee7d957-6d99-4ce3-87a1-a94a91e1d596 req-26c6781b-1e0e-4e70-abdf-c89563ff3f8f service nova] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Updating instance_info_cache with network_info: [{"id": "2cf014cf-f377-448c-8c4f-25282c0c398f", "address": "fa:16:3e:4a:1e:64", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf014cf-f3", "ovs_interfaceid": "2cf014cf-f377-448c-8c4f-25282c0c398f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:39:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "282ce5c5-1259-4189-a60d-ea906da9cf23" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:39:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "282ce5c5-1259-4189-a60d-ea906da9cf23" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:39:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "282ce5c5-1259-4189-a60d-ea906da9cf23-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:39:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "282ce5c5-1259-4189-a60d-ea906da9cf23-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:39:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "282ce5c5-1259-4189-a60d-ea906da9cf23-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:39:03 user nova-compute[74348]: INFO nova.compute.manager [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Terminating instance
Nov 22 08:39:03 user nova-compute[74348]: DEBUG nova.compute.manager [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 08:39:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-aee7d957-6d99-4ce3-87a1-a94a91e1d596 req-26c6781b-1e0e-4e70-abdf-c89563ff3f8f service nova] Releasing lock "refresh_cache-282ce5c5-1259-4189-a60d-ea906da9cf23" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:39:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:39:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:39:03 user nova-compute[74348]: DEBUG nova.compute.manager [req-bd021363-6b5c-4964-8bd2-8e34f573b356 req-dc257b23-44c3-41be-9296-e54833b1a41d service nova] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Received event network-vif-unplugged-2cf014cf-f377-448c-8c4f-25282c0c398f {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:39:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-bd021363-6b5c-4964-8bd2-8e34f573b356 req-dc257b23-44c3-41be-9296-e54833b1a41d service nova] Acquiring lock "282ce5c5-1259-4189-a60d-ea906da9cf23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:39:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-bd021363-6b5c-4964-8bd2-8e34f573b356 req-dc257b23-44c3-41be-9296-e54833b1a41d service nova] Lock "282ce5c5-1259-4189-a60d-ea906da9cf23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:39:03 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-bd021363-6b5c-4964-8bd2-8e34f573b356 req-dc257b23-44c3-41be-9296-e54833b1a41d service nova] Lock "282ce5c5-1259-4189-a60d-ea906da9cf23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:39:03 user nova-compute[74348]: DEBUG nova.compute.manager [req-bd021363-6b5c-4964-8bd2-8e34f573b356 req-dc257b23-44c3-41be-9296-e54833b1a41d service nova] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] No waiting events found dispatching network-vif-unplugged-2cf014cf-f377-448c-8c4f-25282c0c398f {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:39:03 user nova-compute[74348]: DEBUG nova.compute.manager [req-bd021363-6b5c-4964-8bd2-8e34f573b356 req-dc257b23-44c3-41be-9296-e54833b1a41d service nova] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Received event network-vif-unplugged-2cf014cf-f377-448c-8c4f-25282c0c398f for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 08:39:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:39:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:39:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:39:03 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Instance destroyed successfully.
Nov 22 08:39:03 user nova-compute[74348]: DEBUG nova.objects.instance [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lazy-loading 'resources' on Instance uuid 282ce5c5-1259-4189-a60d-ea906da9cf23 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:39:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:37:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1038763101',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1038763101',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1038763101',id=49,image_ref='6099c42b-6b8e-4142-b05d-032a7f7a1b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM93++MDnX7fDyN8bs1fbYQkeR8u1hvBkIo3pg0uclkGtCW9gpelcpPlMsCpxWUUimYC15wBXx+7oVTphLNwHWrQ5Y9OC8kvu2vc2+IjlgsD4lYrdSrAya4x4Gm42k221Q==',key_name='tempest-keypair-117081087',keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:37:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1a81615aef8948718005d104403e260e',ramdisk_id='',reservation_id='r-9v00algq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1316917970',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1316917970-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1316917970',owner_user_name='tempest-TestVolumeBootPattern-1316917970-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T08:37:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b510235916f547b8b0f5c3c150fe9dac',uuid=282ce5c5-1259-4189-a60d-ea906da9cf23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2cf014cf-f377-448c-8c4f-25282c0c398f", "address": "fa:16:3e:4a:1e:64", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf014cf-f3", "ovs_interfaceid": "2cf014cf-f377-448c-8c4f-25282c0c398f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:39:03 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Converting VIF {"id": "2cf014cf-f377-448c-8c4f-25282c0c398f", "address": "fa:16:3e:4a:1e:64", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf014cf-f3", "ovs_interfaceid": "2cf014cf-f377-448c-8c4f-25282c0c398f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:39:03 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:1e:64,bridge_name='br-int',has_traffic_filtering=True,id=2cf014cf-f377-448c-8c4f-25282c0c398f,network=Network(aed76530-d78f-4747-ba48-e5a0eed6ef6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cf014cf-f3') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:39:03 user nova-compute[74348]: DEBUG os_vif [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:1e:64,bridge_name='br-int',has_traffic_filtering=True,id=2cf014cf-f377-448c-8c4f-25282c0c398f,network=Network(aed76530-d78f-4747-ba48-e5a0eed6ef6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cf014cf-f3') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:39:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:39:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2cf014cf-f3, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:39:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:39:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:39:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:39:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e81d49e8-66a2-48bf-b272-fc296c17b178) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:39:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:39:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:39:03 user nova-compute[74348]: INFO os_vif [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:1e:64,bridge_name='br-int',has_traffic_filtering=True,id=2cf014cf-f377-448c-8c4f-25282c0c398f,network=Network(aed76530-d78f-4747-ba48-e5a0eed6ef6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cf014cf-f3')
Nov 22 08:39:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 08:39:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HJicOAor', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:39:03 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:39:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:39:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:39:03 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9895dd9a-89ae-42fc-bb42-177ba33c3652]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 08:39:04 user nova-compute[74348]: No targets found.
Nov 22 08:39:04 user nova-compute[74348]: iSNS:
Nov 22 08:39:04 user nova-compute[74348]: No targets found.
Nov 22 08:39:04 user nova-compute[74348]: STATIC:
Nov 22 08:39:04 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e
Nov 22 08:39:04 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:39:04 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:39:04 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba
Nov 22 08:39:04 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:39:04 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:39:04 user nova-compute[74348]: FIRMWARE:
Nov 22 08:39:04 user nova-compute[74348]: No targets found.
Nov 22 08:39:04 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 08:39:04 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 08:39:04 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa27f9bf-7491-43cd-b27e-835f629bee90]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b4d6a5-e585-4729-9a57-adbbb6562342]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e (non-flash)
Nov 22 08:39:04 user nova-compute[74348]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba (non-flash)
Nov 22 08:39:04 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e (non-flash)
Nov 22 08:39:04 user nova-compute[74348]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba (non-flash)
Nov 22 08:39:04 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2228328ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba'): ({'sdc'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Removing single pathed devices sdc {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[684f1367-361f-42c3-8fac-8a8ea35c319f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f698ac-12bb-4923-a5ed-2e00422955ac]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Flushing IO for device /dev/sdc {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4a14e3-e6fe-4026-ab7d-c27c85bae0a2]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[72784551-92fc-4065-b63c-c413f685119e]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] SCSI volumes sdc have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_9456cb43',) {{(pid=85159) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[32df96ef-e96f-4b01-8629-9ac34f68df1c]: (4, None) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b76e7c-224b-4290-bf10-495a9207ca96]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6243d30-4b6c-425b-b3e6-de3f6cdb287d]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba, portal: 172.16.0.220,3260]
Nov 22 08:39:04 user nova-compute[74348]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba, portal: 172.16.0.220,3260] successful.
Nov 22 08:39:04 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8ddf7e3-3487-4904-84f4-311ecdeda5ba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7730ea-c4c6-428d-8e94-57bc8eab9585]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] <== disconnect_volume: return (311ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 08:39:04 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Deleting instance files /opt/stack/data/nova/instances/282ce5c5-1259-4189-a60d-ea906da9cf23_del
Nov 22 08:39:04 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Deletion of /opt/stack/data/nova/instances/282ce5c5-1259-4189-a60d-ea906da9cf23_del complete
Nov 22 08:39:04 user nova-compute[74348]: INFO nova.compute.manager [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 22 08:39:04 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Skipping network cache update for instance because it is being deleted. {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9971}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Didn't find any instances for network info cache update. {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 08:39:04 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:39:05 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:39:05 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Took 0.69 seconds to deallocate network for instance.
Nov 22 08:39:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:39:05 user nova-compute[74348]: DEBUG nova.compute.manager [req-d8e11a50-44a9-4e05-bae9-82f0b0301314 req-9fa42d9f-a093-4cb1-8ec9-520c52a5c9b5 service nova] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Received event network-vif-plugged-2cf014cf-f377-448c-8c4f-25282c0c398f {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:39:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d8e11a50-44a9-4e05-bae9-82f0b0301314 req-9fa42d9f-a093-4cb1-8ec9-520c52a5c9b5 service nova] Acquiring lock "282ce5c5-1259-4189-a60d-ea906da9cf23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:39:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d8e11a50-44a9-4e05-bae9-82f0b0301314 req-9fa42d9f-a093-4cb1-8ec9-520c52a5c9b5 service nova] Lock "282ce5c5-1259-4189-a60d-ea906da9cf23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:39:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-d8e11a50-44a9-4e05-bae9-82f0b0301314 req-9fa42d9f-a093-4cb1-8ec9-520c52a5c9b5 service nova] Lock "282ce5c5-1259-4189-a60d-ea906da9cf23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:39:05 user nova-compute[74348]: DEBUG nova.compute.manager [req-d8e11a50-44a9-4e05-bae9-82f0b0301314 req-9fa42d9f-a093-4cb1-8ec9-520c52a5c9b5 service nova] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] No waiting events found dispatching network-vif-plugged-2cf014cf-f377-448c-8c4f-25282c0c398f {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:39:05 user nova-compute[74348]: WARNING nova.compute.manager [req-d8e11a50-44a9-4e05-bae9-82f0b0301314 req-9fa42d9f-a093-4cb1-8ec9-520c52a5c9b5 service nova] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Received unexpected event network-vif-plugged-2cf014cf-f377-448c-8c4f-25282c0c398f for instance with vm_state active and task_state deleting.
Nov 22 08:39:05 user nova-compute[74348]: DEBUG nova.compute.manager [req-d8e11a50-44a9-4e05-bae9-82f0b0301314 req-9fa42d9f-a093-4cb1-8ec9-520c52a5c9b5 service nova] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Received event network-vif-deleted-2cf014cf-f377-448c-8c4f-25282c0c398f {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:39:05 user nova-compute[74348]: INFO nova.compute.manager [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Took 0.72 seconds to detach 1 volumes for instance.
Nov 22 08:39:05 user nova-compute[74348]: DEBUG nova.compute.manager [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 282ce5c5-1259-4189-a60d-ea906da9cf23] Deleting volume: b8ddf7e3-3487-4904-84f4-311ecdeda5ba {{(pid=74348) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 22 08:39:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:39:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:39:06 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:39:06 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:39:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.140s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:39:06 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Deleted allocations for instance 282ce5c5-1259-4189-a60d-ea906da9cf23
Nov 22 08:39:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-4e07c775-ef12-4e68-acf1-8eb2993ee446 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "282ce5c5-1259-4189-a60d-ea906da9cf23" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.013s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:39:08 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:39:08 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:39:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:39:13 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:39:13 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:39:13 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:39:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:39:17 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:39:18 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:39:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:39:19 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:39:22 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:39:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:39:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:39:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:39:22 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:39:22 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:39:22 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:39:22 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:39:22 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=9024MB free_disk=24.887237548828125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:39:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:39:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:39:23 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 55efc55d-7739-49b2-955f-427810c68ade actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:39:23 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:39:23 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:39:23 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Refreshing inventories for resource provider 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 22 08:39:23 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Updating ProviderTree inventory for provider 52690f6a-773f-4e8d-be85-d278b6522975 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 22 08:39:23 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Updating inventory in ProviderTree for provider 52690f6a-773f-4e8d-be85-d278b6522975 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 22 08:39:23 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Refreshing aggregate associations for resource provider 52690f6a-773f-4e8d-be85-d278b6522975, aggregates: None {{(pid=74348) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 22 08:39:23 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Refreshing trait associations for resource provider 52690f6a-773f-4e8d-be85-d278b6522975, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=74348) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 22 08:39:23 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:39:23 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:39:23 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:39:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.357s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:39:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:39:24 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:39:26 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:39:26 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Cleaning up deleted instances {{(pid=74348) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 22 08:39:26 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] There are 0 instances to clean {{(pid=74348) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 22 08:39:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:39:32 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:39:32 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74348) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 22 08:39:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:39:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:39:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:39:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:39:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:39:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "55efc55d-7739-49b2-955f-427810c68ade" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:39:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "55efc55d-7739-49b2-955f-427810c68ade" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:39:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "55efc55d-7739-49b2-955f-427810c68ade-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:39:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "55efc55d-7739-49b2-955f-427810c68ade-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:39:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "55efc55d-7739-49b2-955f-427810c68ade-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:39:56 user nova-compute[74348]: INFO nova.compute.manager [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Terminating instance
Nov 22 08:39:56 user nova-compute[74348]: DEBUG nova.compute.manager [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 08:39:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG nova.compute.manager [req-fe31e8f2-8852-4f53-bd99-28c022e39e88 req-2d4143d6-74dd-4d63-86c1-566493515224 service nova] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Received event network-vif-unplugged-e8312049-b234-4a84-9c6a-a53910a2ae3d {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-fe31e8f2-8852-4f53-bd99-28c022e39e88 req-2d4143d6-74dd-4d63-86c1-566493515224 service nova] Acquiring lock "55efc55d-7739-49b2-955f-427810c68ade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-fe31e8f2-8852-4f53-bd99-28c022e39e88 req-2d4143d6-74dd-4d63-86c1-566493515224 service nova] Lock "55efc55d-7739-49b2-955f-427810c68ade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-fe31e8f2-8852-4f53-bd99-28c022e39e88 req-2d4143d6-74dd-4d63-86c1-566493515224 service nova] Lock "55efc55d-7739-49b2-955f-427810c68ade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG nova.compute.manager [req-fe31e8f2-8852-4f53-bd99-28c022e39e88 req-2d4143d6-74dd-4d63-86c1-566493515224 service nova] [instance: 55efc55d-7739-49b2-955f-427810c68ade] No waiting events found dispatching network-vif-unplugged-e8312049-b234-4a84-9c6a-a53910a2ae3d {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG nova.compute.manager [req-fe31e8f2-8852-4f53-bd99-28c022e39e88 req-2d4143d6-74dd-4d63-86c1-566493515224 service nova] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Received event network-vif-unplugged-e8312049-b234-4a84-9c6a-a53910a2ae3d for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:39:57 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Instance destroyed successfully.
Nov 22 08:39:57 user nova-compute[74348]: DEBUG nova.objects.instance [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lazy-loading 'resources' on Instance uuid 55efc55d-7739-49b2-955f-427810c68ade {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:35:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-934453333',display_name='tempest-TestVolumeBootPattern-volume-backed-server-934453333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-934453333',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFteDFtLquhhC0KbmDJQaknbAyXbJ2Q4mnLX920ek/NU5i0rr2i7fEdWK2mR/gAJcbHlcaLvfu6WIcql3ai4t99GBBl4NjcmDNxBQOZBUFDgUADhzsdFhkp9s4rR+Eiyww==',key_name='tempest-keypair-1807093791',keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:35:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1a81615aef8948718005d104403e260e',ramdisk_id='',reservation_id='r-m98fxgad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1316917970',owner_user_name='tempest-TestVolumeBootPattern-1316917970-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T08:35:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b510235916f547b8b0f5c3c150fe9dac',uuid=55efc55d-7739-49b2-955f-427810c68ade,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8312049-b234-4a84-9c6a-a53910a2ae3d", "address": "fa:16:3e:f4:67:40", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8312049-b2", "ovs_interfaceid": "e8312049-b234-4a84-9c6a-a53910a2ae3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Converting VIF {"id": "e8312049-b234-4a84-9c6a-a53910a2ae3d", "address": "fa:16:3e:f4:67:40", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8312049-b2", "ovs_interfaceid": "e8312049-b234-4a84-9c6a-a53910a2ae3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:67:40,bridge_name='br-int',has_traffic_filtering=True,id=e8312049-b234-4a84-9c6a-a53910a2ae3d,network=Network(aed76530-d78f-4747-ba48-e5a0eed6ef6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8312049-b2') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG os_vif [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:67:40,bridge_name='br-int',has_traffic_filtering=True,id=e8312049-b234-4a84-9c6a-a53910a2ae3d,network=Network(aed76530-d78f-4747-ba48-e5a0eed6ef6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8312049-b2') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8312049-b2, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=87d0fb32-ef89-47c8-b3f9-c737b9a00261) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:39:57 user nova-compute[74348]: INFO os_vif [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:67:40,bridge_name='br-int',has_traffic_filtering=True,id=e8312049-b234-4a84-9c6a-a53910a2ae3d,network=Network(aed76530-d78f-4747-ba48-e5a0eed6ef6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8312049-b2')
Nov 22 08:39:57 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 55efc55d-7739-49b2-955f-427810c68ade] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcFRHbAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:39:57 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:39:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[54798ef8-9fb2-4b85-a150-f10957a0c3c8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 08:39:57 user nova-compute[74348]: No targets found.
Nov 22 08:39:57 user nova-compute[74348]: iSNS:
Nov 22 08:39:57 user nova-compute[74348]: No targets found.
Nov 22 08:39:57 user nova-compute[74348]: STATIC:
Nov 22 08:39:57 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e
Nov 22 08:39:57 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:39:57 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:39:57 user nova-compute[74348]: FIRMWARE:
Nov 22 08:39:57 user nova-compute[74348]: No targets found.
Nov 22 08:39:57 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 08:39:57 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 08:39:57 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ee9ddf-9ca6-43f9-a008-4a01fbeae51a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e481971b-743e-4d50-a562-0798d5702d6d]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e (non-flash)
Nov 22 08:39:57 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e (non-flash)
Nov 22 08:39:57 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f222832b520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e'): ({'sdb'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Removing single pathed devices sdb {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[92eeeea0-7743-43e8-98b8-47da69c798cd]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[02211f3b-a841-497f-99e4-3102cf8d27a8]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Flushing IO for device /dev/sdb {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f67894-bc0d-4fb1-91fc-926346fa9234]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a58ebb5-d8ef-4382-a16f-43b1ac630ea7]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] SCSI volumes sdb have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO59a5e155-eb3eaa8d40cdf7c6', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_59a5e155', '/dev/disk/by-id/scsi-26562336561613864') {{(pid=85159) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c17187f-fc4c-408b-b05c-cbfed9e0d8bf]: (4, None) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e633e412-be06-4976-b729-8858a86ac01a]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:39:57 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:39:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:39:58 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe7f6a5-baa9-4908-9c35-8d365ba21811]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:39:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e, portal: 172.16.0.220,3260]
Nov 22 08:39:58 user nova-compute[74348]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e, portal: 172.16.0.220,3260] successful.
Nov 22 08:39:58 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:39:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:39:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3005e4a-6a84-4993-9961-e861758e2c2e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:39:58 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[07420fdc-b84b-4c7f-9361-1cfd4f4787f1]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:39:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:39:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:39:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] <== disconnect_volume: return (310ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:39:58 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 08:39:58 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Deleting instance files /opt/stack/data/nova/instances/55efc55d-7739-49b2-955f-427810c68ade_del
Nov 22 08:39:58 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Deletion of /opt/stack/data/nova/instances/55efc55d-7739-49b2-955f-427810c68ade_del complete
Nov 22 08:39:58 user nova-compute[74348]: INFO nova.compute.manager [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 22 08:39:58 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 08:39:58 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 08:39:58 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 55efc55d-7739-49b2-955f-427810c68ade] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 08:39:58 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:39:58 user nova-compute[74348]: DEBUG nova.compute.manager [req-41faaaa8-75b3-4742-be33-5862b4001f38 req-b3d41d85-9774-463c-937d-eeb16316d094 service nova] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Received event network-vif-deleted-e8312049-b234-4a84-9c6a-a53910a2ae3d {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:39:58 user nova-compute[74348]: INFO nova.compute.manager [req-41faaaa8-75b3-4742-be33-5862b4001f38 req-b3d41d85-9774-463c-937d-eeb16316d094 service nova] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Neutron deleted interface e8312049-b234-4a84-9c6a-a53910a2ae3d; detaching it from the instance and deleting it from the info cache
Nov 22 08:39:58 user nova-compute[74348]: DEBUG nova.network.neutron [req-41faaaa8-75b3-4742-be33-5862b4001f38 req-b3d41d85-9774-463c-937d-eeb16316d094 service nova] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:39:58 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Took 0.80 seconds to deallocate network for instance.
Nov 22 08:39:58 user nova-compute[74348]: DEBUG nova.compute.manager [req-41faaaa8-75b3-4742-be33-5862b4001f38 req-b3d41d85-9774-463c-937d-eeb16316d094 service nova] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Detach interface failed, port_id=e8312049-b234-4a84-9c6a-a53910a2ae3d, reason: Instance 55efc55d-7739-49b2-955f-427810c68ade could not be found. {{(pid=74348) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 08:39:59 user nova-compute[74348]: DEBUG nova.compute.manager [req-826864d4-0493-4870-bd4a-f0b2be50626e req-82bd1d3b-a9e5-479f-9ea2-22b7a77397af service nova] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Received event network-vif-plugged-e8312049-b234-4a84-9c6a-a53910a2ae3d {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:39:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-826864d4-0493-4870-bd4a-f0b2be50626e req-82bd1d3b-a9e5-479f-9ea2-22b7a77397af service nova] Acquiring lock "55efc55d-7739-49b2-955f-427810c68ade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:39:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-826864d4-0493-4870-bd4a-f0b2be50626e req-82bd1d3b-a9e5-479f-9ea2-22b7a77397af service nova] Lock "55efc55d-7739-49b2-955f-427810c68ade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:39:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-826864d4-0493-4870-bd4a-f0b2be50626e req-82bd1d3b-a9e5-479f-9ea2-22b7a77397af service nova] Lock "55efc55d-7739-49b2-955f-427810c68ade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:39:59 user nova-compute[74348]: DEBUG nova.compute.manager [req-826864d4-0493-4870-bd4a-f0b2be50626e req-82bd1d3b-a9e5-479f-9ea2-22b7a77397af service nova] [instance: 55efc55d-7739-49b2-955f-427810c68ade] No waiting events found dispatching network-vif-plugged-e8312049-b234-4a84-9c6a-a53910a2ae3d {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:39:59 user nova-compute[74348]: WARNING nova.compute.manager [req-826864d4-0493-4870-bd4a-f0b2be50626e req-82bd1d3b-a9e5-479f-9ea2-22b7a77397af service nova] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Received unexpected event network-vif-plugged-e8312049-b234-4a84-9c6a-a53910a2ae3d for instance with vm_state active and task_state deleting.
Nov 22 08:39:59 user nova-compute[74348]: INFO nova.compute.manager [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Took 0.73 seconds to detach 1 volumes for instance.
Nov 22 08:39:59 user nova-compute[74348]: DEBUG nova.compute.manager [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 55efc55d-7739-49b2-955f-427810c68ade] Deleting volume: f3005e4a-6a84-4993-9961-e861758e2c2e {{(pid=74348) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 22 08:39:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:39:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:39:59 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:39:59 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:39:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.120s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:39:59 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Deleted allocations for instance 55efc55d-7739-49b2-955f-427810c68ade
Nov 22 08:40:00 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-f6734c2d-dce4-4e03-a187-be899542a299 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "55efc55d-7739-49b2-955f-427810c68ade" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.137s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:40:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:40:06 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:40:06 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:40:06 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Rebuilding the list of instances to heal {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 08:40:06 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Didn't find any instances for network info cache update. {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 08:40:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:40:08 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:40:09 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:40:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:40:14 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:40:14 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:40:14 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:40:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:40:19 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:40:19 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:40:20 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:40:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:40:24 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:40:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:40:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:40:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:40:24 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:40:24 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:40:24 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:40:24 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=9178MB free_disk=24.886432647705078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:40:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:40:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:40:24 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:40:24 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:40:25 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:40:25 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:40:25 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:40:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:40:26 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._sync_power_states {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:40:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:40:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:40:37 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:40:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:40:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:40:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:40:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:40:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "a76af0d6-59c7-405e-aebf-5d9aeeb61ef0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:40:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "a76af0d6-59c7-405e-aebf-5d9aeeb61ef0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:40:55 user nova-compute[74348]: DEBUG nova.compute.manager [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 08:40:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:40:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:40:55 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 08:40:55 user nova-compute[74348]: INFO nova.compute.claims [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Claim successful on node user
Nov 22 08:40:55 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:40:56 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:40:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.176s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:40:56 user nova-compute[74348]: DEBUG nova.compute.manager [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 08:40:56 user nova-compute[74348]: DEBUG nova.compute.manager [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 08:40:56 user nova-compute[74348]: DEBUG nova.network.neutron [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 08:40:56 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 08:40:56 user nova-compute[74348]: DEBUG nova.compute.manager [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 08:40:56 user nova-compute[74348]: DEBUG nova.policy [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b510235916f547b8b0f5c3c150fe9dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a81615aef8948718005d104403e260e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 08:40:56 user nova-compute[74348]: INFO nova.virt.block_device [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Booting with volume 19ef4422-cdac-49d6-a0ae-a737355ef4c3 at /dev/vda
Nov 22 08:40:56 user nova-compute[74348]: DEBUG os_brick.utils [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:40:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:40:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:40:56 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c538e160-f194-4b43-8dcc-bcc13f1e07ee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:40:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:40:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:40:56 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f14840-7280-484c-adca-9f1c9fbc984e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:40:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:40:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:40:56 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b2b422-e76c-4e76-8538-9dd9a25334b2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:40:56 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a53cd6-c255-41f3-a28b-79d0e9bdd78c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:40:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:40:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:40:56 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 08:40:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:40:56 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:40:56 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 08:40:56 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8afa3bd-73d6-4c1e-86e0-b59dad4ed35f]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:40:56 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 08:40:56 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 08:40:56 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 08:40:56 user nova-compute[74348]: DEBUG os_brick.utils [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:40:56 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Updating existing volume attachment record: 1b979440-b7e9-413e-b8d7-253bf83b0426 {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 08:40:56 user nova-compute[74348]: DEBUG nova.network.neutron [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Successfully created port: 45646c87-9a5f-439c-9cae-356b9917b77a {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 08:40:57 user nova-compute[74348]: DEBUG nova.network.neutron [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Successfully updated port: 45646c87-9a5f-439c-9cae-356b9917b77a {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 08:40:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "refresh_cache-a76af0d6-59c7-405e-aebf-5d9aeeb61ef0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:40:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquired lock "refresh_cache-a76af0d6-59c7-405e-aebf-5d9aeeb61ef0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:40:57 user nova-compute[74348]: DEBUG nova.network.neutron [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:40:57 user nova-compute[74348]: DEBUG nova.network.neutron [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 08:40:57 user nova-compute[74348]: DEBUG nova.compute.manager [req-5920105b-a7ff-4c3f-910f-d8db3b1e5d00 req-1c49bc0e-ea32-4899-bd9f-006484941a10 service nova] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Received event network-changed-45646c87-9a5f-439c-9cae-356b9917b77a {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:40:57 user nova-compute[74348]: DEBUG nova.compute.manager [req-5920105b-a7ff-4c3f-910f-d8db3b1e5d00 req-1c49bc0e-ea32-4899-bd9f-006484941a10 service nova] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Refreshing instance network info cache due to event network-changed-45646c87-9a5f-439c-9cae-356b9917b77a. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:40:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-5920105b-a7ff-4c3f-910f-d8db3b1e5d00 req-1c49bc0e-ea32-4899-bd9f-006484941a10 service nova] Acquiring lock "refresh_cache-a76af0d6-59c7-405e-aebf-5d9aeeb61ef0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:40:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:40:57 user nova-compute[74348]: DEBUG nova.network.neutron [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Updating instance_info_cache with network_info: [{"id": "45646c87-9a5f-439c-9cae-356b9917b77a", "address": "fa:16:3e:14:ca:9f", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45646c87-9a", "ovs_interfaceid": "45646c87-9a5f-439c-9cae-356b9917b77a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:40:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Releasing lock "refresh_cache-a76af0d6-59c7-405e-aebf-5d9aeeb61ef0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:40:57 user nova-compute[74348]: DEBUG nova.compute.manager [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Instance network_info: |[{"id": "45646c87-9a5f-439c-9cae-356b9917b77a", "address": "fa:16:3e:14:ca:9f", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45646c87-9a", "ovs_interfaceid": "45646c87-9a5f-439c-9cae-356b9917b77a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 08:40:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-5920105b-a7ff-4c3f-910f-d8db3b1e5d00 req-1c49bc0e-ea32-4899-bd9f-006484941a10 service nova] Acquired lock "refresh_cache-a76af0d6-59c7-405e-aebf-5d9aeeb61ef0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:40:57 user nova-compute[74348]: DEBUG nova.network.neutron [req-5920105b-a7ff-4c3f-910f-d8db3b1e5d00 req-1c49bc0e-ea32-4899-bd9f-006484941a10 service nova] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Refreshing network info cache for port 45646c87-9a5f-439c-9cae-356b9917b77a {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:40:58 user nova-compute[74348]: DEBUG nova.network.neutron [req-5920105b-a7ff-4c3f-910f-d8db3b1e5d00 req-1c49bc0e-ea32-4899-bd9f-006484941a10 service nova] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Updated VIF entry in instance network info cache for port 45646c87-9a5f-439c-9cae-356b9917b77a. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:40:58 user nova-compute[74348]: DEBUG nova.network.neutron [req-5920105b-a7ff-4c3f-910f-d8db3b1e5d00 req-1c49bc0e-ea32-4899-bd9f-006484941a10 service nova] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Updating instance_info_cache with network_info: [{"id": "45646c87-9a5f-439c-9cae-356b9917b77a", "address": "fa:16:3e:14:ca:9f", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45646c87-9a", "ovs_interfaceid": "45646c87-9a5f-439c-9cae-356b9917b77a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:40:58 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-5920105b-a7ff-4c3f-910f-d8db3b1e5d00 req-1c49bc0e-ea32-4899-bd9f-006484941a10 service nova] Releasing lock "refresh_cache-a76af0d6-59c7-405e-aebf-5d9aeeb61ef0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG nova.compute.manager [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 08:41:02 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Creating image(s)
Nov 22 08:41:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Did not create local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Ensure instance console log exists: /opt/stack/data/nova/instances/a76af0d6-59c7-405e-aebf-5d9aeeb61ef0/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Start _get_guest_xml network_info=[{"id": "45646c87-9a5f-439c-9cae-356b9917b77a", "address": "fa:16:3e:14:ca:9f", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45646c87-9a", "ovs_interfaceid": "45646c87-9a5f-439c-9cae-356b9917b77a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjmMCGTz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a76af0d6-59c7-405e-aebf-5d9aeeb61ef0', 'attached_at': '', 'detached_at': '', 'volume_id': '19ef4422-cdac-49d6-a0ae-a737355ef4c3', 'serial': '19ef4422-cdac-49d6-a0ae-a737355ef4c3'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '1b979440-b7e9-413e-b8d7-253bf83b0426', 'volume_type': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 08:41:02 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:41:02 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:41:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjmMCGTz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:41:02 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:41:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:41:02 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:41:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:41:02 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 08:41:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b3c3b0-257c-4d40-919e-989885b79715]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 08:41:02 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5e661c-3f60-4385-9388-e04790da2d93]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3] added
Nov 22 08:41:02 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d2a9f5-8c18-4df2-9c6a-731b1c5eff29]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[349353ea-07f0-4ea2-8d63-cf606e22592b]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kjmMCGTz {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kjmMCGTz" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[613527d3-793a-491c-9636-eefbced03453]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kjmMCGTz'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c770cf35-a51d-4bd3-b17f-58f66350ca42]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95e2b8a-cecf-4cb1-baf7-08128adcf584]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 22 08:41:02 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 22 08:41:02 user nova-compute[74348]:  {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:41:02 user nova-compute[74348]: WARNING os_brick.initiator.connectors.iscsi [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 22 08:41:02 user nova-compute[74348]: 
Nov 22 08:41:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4550ad71-4427-458d-9cf1-79c772625f06]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3, portal: 172.16.0.220,3260]
Nov 22 08:41:02 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3, portal: 172.16.0.220,3260] successful.
Nov 22 08:41:02 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef836105-cf77-4bde-b6fc-e5a74fe0e94a]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd25024d-1bfa-40fb-98db-31fcc9002f8e]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 (non-flash)
Nov 22 08:41:02 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 (non-flash)
Nov 22 08:41:02 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a74e051-8c74-4784-a10e-34ce30df2863]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: None {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:41:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:41:03 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:41:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjmMCGTz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 08:41:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:41:03 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '26538363631336236', 'path': '/dev/sdb'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:41:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538363631336236', 'path': '/dev/sdb'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 08:41:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:40:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-683563075',display_name='tempest-TestVolumeBootPattern-server-683563075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-683563075',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5q5hQzMSuk+sNGJnDRmtWK/6BKD87prla8huISA+ZthbmLQtye643HeDBlLY9Mo3uF5oVpKXrTj1o4wta3IDeKU9ciPV2epUfA3DB6baSC2/EpV7k8Mbb5IhAko6F/ug==',key_name='tempest-TestVolumeBootPattern-944686512',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a81615aef8948718005d104403e260e',ramdisk_id='',reservation_id='r-jg1b3mug',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1316917970',owner_user_name='tempest-TestVolumeBootPattern-1316917970-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:40:56Z,user_data=None,user_id='b510235916f547b8b0f5c3c150fe9dac',uuid=a76af0d6-59c7-405e-aebf-5d9aeeb61ef0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45646c87-9a5f-439c-9cae-356b9917b77a", "address": "fa:16:3e:14:ca:9f", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45646c87-9a", "ovs_interfaceid": "45646c87-9a5f-439c-9cae-356b9917b77a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 08:41:03 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Converting VIF {"id": "45646c87-9a5f-439c-9cae-356b9917b77a", "address": "fa:16:3e:14:ca:9f", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45646c87-9a", "ovs_interfaceid": "45646c87-9a5f-439c-9cae-356b9917b77a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:41:03 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:ca:9f,bridge_name='br-int',has_traffic_filtering=True,id=45646c87-9a5f-439c-9cae-356b9917b77a,network=Network(aed76530-d78f-4747-ba48-e5a0eed6ef6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45646c87-9a') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:41:03 user nova-compute[74348]: DEBUG nova.objects.instance [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lazy-loading 'pci_devices' on Instance uuid a76af0d6-59c7-405e-aebf-5d9aeeb61ef0 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:41:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] End _get_guest_xml xml=<domain type="kvm">
Nov 22 08:41:03 user nova-compute[74348]:   <uuid>a76af0d6-59c7-405e-aebf-5d9aeeb61ef0</uuid>
Nov 22 08:41:03 user nova-compute[74348]:   <name>instance-00000032</name>
Nov 22 08:41:03 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 08:41:03 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 08:41:03 user nova-compute[74348]:   <metadata>
Nov 22 08:41:03 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 08:41:03 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 08:41:03 user nova-compute[74348]:       <nova:name>tempest-TestVolumeBootPattern-server-683563075</nova:name>
Nov 22 08:41:03 user nova-compute[74348]:       <nova:creationTime>2023-11-22 08:41:02</nova:creationTime>
Nov 22 08:41:03 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 08:41:03 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 08:41:03 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 08:41:03 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 08:41:03 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 08:41:03 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 08:41:03 user nova-compute[74348]:       </nova:flavor>
Nov 22 08:41:03 user nova-compute[74348]:       <nova:owner>
Nov 22 08:41:03 user nova-compute[74348]:         <nova:user uuid="b510235916f547b8b0f5c3c150fe9dac">tempest-TestVolumeBootPattern-1316917970-project-member</nova:user>
Nov 22 08:41:03 user nova-compute[74348]:         <nova:project uuid="1a81615aef8948718005d104403e260e">tempest-TestVolumeBootPattern-1316917970</nova:project>
Nov 22 08:41:03 user nova-compute[74348]:       </nova:owner>
Nov 22 08:41:03 user nova-compute[74348]:       <nova:ports>
Nov 22 08:41:03 user nova-compute[74348]:         <nova:port uuid="45646c87-9a5f-439c-9cae-356b9917b77a">
Nov 22 08:41:03 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 22 08:41:03 user nova-compute[74348]:         </nova:port>
Nov 22 08:41:03 user nova-compute[74348]:       </nova:ports>
Nov 22 08:41:03 user nova-compute[74348]:     </nova:instance>
Nov 22 08:41:03 user nova-compute[74348]:   </metadata>
Nov 22 08:41:03 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 08:41:03 user nova-compute[74348]:     <system>
Nov 22 08:41:03 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 08:41:03 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 08:41:03 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 08:41:03 user nova-compute[74348]:       <entry name="serial">a76af0d6-59c7-405e-aebf-5d9aeeb61ef0</entry>
Nov 22 08:41:03 user nova-compute[74348]:       <entry name="uuid">a76af0d6-59c7-405e-aebf-5d9aeeb61ef0</entry>
Nov 22 08:41:03 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 08:41:03 user nova-compute[74348]:     </system>
Nov 22 08:41:03 user nova-compute[74348]:   </sysinfo>
Nov 22 08:41:03 user nova-compute[74348]:   <os>
Nov 22 08:41:03 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 08:41:03 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 08:41:03 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 08:41:03 user nova-compute[74348]:   </os>
Nov 22 08:41:03 user nova-compute[74348]:   <features>
Nov 22 08:41:03 user nova-compute[74348]:     <acpi/>
Nov 22 08:41:03 user nova-compute[74348]:     <apic/>
Nov 22 08:41:03 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 08:41:03 user nova-compute[74348]:   </features>
Nov 22 08:41:03 user nova-compute[74348]:   <clock offset="utc">
Nov 22 08:41:03 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 08:41:03 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 08:41:03 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 08:41:03 user nova-compute[74348]:   </clock>
Nov 22 08:41:03 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 08:41:03 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 08:41:03 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 08:41:03 user nova-compute[74348]:   </cpu>
Nov 22 08:41:03 user nova-compute[74348]:   <devices>
Nov 22 08:41:03 user nova-compute[74348]:     <disk type="block" device="disk">
Nov 22 08:41:03 user nova-compute[74348]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:41:03 user nova-compute[74348]:       <source dev="/dev/sdb"/>
Nov 22 08:41:03 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 08:41:03 user nova-compute[74348]:       <serial>19ef4422-cdac-49d6-a0ae-a737355ef4c3</serial>
Nov 22 08:41:03 user nova-compute[74348]:     </disk>
Nov 22 08:41:03 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 08:41:03 user nova-compute[74348]:       <mac address="fa:16:3e:14:ca:9f"/>
Nov 22 08:41:03 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:41:03 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 08:41:03 user nova-compute[74348]:       <target dev="tap45646c87-9a"/>
Nov 22 08:41:03 user nova-compute[74348]:     </interface>
Nov 22 08:41:03 user nova-compute[74348]:     <serial type="pty">
Nov 22 08:41:03 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/a76af0d6-59c7-405e-aebf-5d9aeeb61ef0/console.log" append="off"/>
Nov 22 08:41:03 user nova-compute[74348]:     </serial>
Nov 22 08:41:03 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 08:41:03 user nova-compute[74348]:     <video>
Nov 22 08:41:03 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:41:03 user nova-compute[74348]:     </video>
Nov 22 08:41:03 user nova-compute[74348]:     <rng model="virtio">
Nov 22 08:41:03 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 08:41:03 user nova-compute[74348]:     </rng>
Nov 22 08:41:03 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 08:41:03 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 08:41:03 user nova-compute[74348]:       <stats period="10"/>
Nov 22 08:41:03 user nova-compute[74348]:     </memballoon>
Nov 22 08:41:03 user nova-compute[74348]:   </devices>
Nov 22 08:41:03 user nova-compute[74348]: </domain>
Nov 22 08:41:03 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 08:41:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:40:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-683563075',display_name='tempest-TestVolumeBootPattern-server-683563075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-683563075',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5q5hQzMSuk+sNGJnDRmtWK/6BKD87prla8huISA+ZthbmLQtye643HeDBlLY9Mo3uF5oVpKXrTj1o4wta3IDeKU9ciPV2epUfA3DB6baSC2/EpV7k8Mbb5IhAko6F/ug==',key_name='tempest-TestVolumeBootPattern-944686512',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a81615aef8948718005d104403e260e',ramdisk_id='',reservation_id='r-jg1b3mug',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1316917970',owner_user_name='tempest-TestVolumeBootPattern-1316917970-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:40:56Z,user_data=None,user_id='b510235916f547b8b0f5c3c150fe9dac',uuid=a76af0d6-59c7-405e-aebf-5d9aeeb61ef0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45646c87-9a5f-439c-9cae-356b9917b77a", "address": "fa:16:3e:14:ca:9f", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45646c87-9a", "ovs_interfaceid": "45646c87-9a5f-439c-9cae-356b9917b77a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 08:41:03 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Converting VIF {"id": "45646c87-9a5f-439c-9cae-356b9917b77a", "address": "fa:16:3e:14:ca:9f", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45646c87-9a", "ovs_interfaceid": "45646c87-9a5f-439c-9cae-356b9917b77a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:41:03 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:ca:9f,bridge_name='br-int',has_traffic_filtering=True,id=45646c87-9a5f-439c-9cae-356b9917b77a,network=Network(aed76530-d78f-4747-ba48-e5a0eed6ef6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45646c87-9a') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:41:03 user nova-compute[74348]: DEBUG os_vif [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:ca:9f,bridge_name='br-int',has_traffic_filtering=True,id=45646c87-9a5f-439c-9cae-356b9917b77a,network=Network(aed76530-d78f-4747-ba48-e5a0eed6ef6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45646c87-9a') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 08:41:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:41:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:41:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 08:41:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:41:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0e7b1a6e-fb91-5abb-8ba1-5839820f52e7', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:41:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:41:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:41:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:41:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap45646c87-9a, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:41:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap45646c87-9a, col_values=(('qos', UUID('a90daf76-8ba2-417f-a36f-34951b61f696')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:41:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap45646c87-9a, col_values=(('external_ids', {'iface-id': '45646c87-9a5f-439c-9cae-356b9917b77a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:ca:9f', 'vm-uuid': 'a76af0d6-59c7-405e-aebf-5d9aeeb61ef0'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:41:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:41:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:41:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:41:03 user nova-compute[74348]: INFO os_vif [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:ca:9f,bridge_name='br-int',has_traffic_filtering=True,id=45646c87-9a5f-439c-9cae-356b9917b77a,network=Network(aed76530-d78f-4747-ba48-e5a0eed6ef6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45646c87-9a')
Nov 22 08:41:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:41:03 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] No VIF found with MAC fa:16:3e:14:ca:9f, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:41:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:41:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:41:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:41:05 user nova-compute[74348]: DEBUG nova.compute.manager [req-3c2f12f0-4229-45fc-b08f-b7fa7569f9c7 req-d974cea1-ac0e-4a26-ba74-46ef52875306 service nova] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Received event network-vif-plugged-45646c87-9a5f-439c-9cae-356b9917b77a {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:41:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3c2f12f0-4229-45fc-b08f-b7fa7569f9c7 req-d974cea1-ac0e-4a26-ba74-46ef52875306 service nova] Acquiring lock "a76af0d6-59c7-405e-aebf-5d9aeeb61ef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:41:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3c2f12f0-4229-45fc-b08f-b7fa7569f9c7 req-d974cea1-ac0e-4a26-ba74-46ef52875306 service nova] Lock "a76af0d6-59c7-405e-aebf-5d9aeeb61ef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:41:05 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3c2f12f0-4229-45fc-b08f-b7fa7569f9c7 req-d974cea1-ac0e-4a26-ba74-46ef52875306 service nova] Lock "a76af0d6-59c7-405e-aebf-5d9aeeb61ef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:41:05 user nova-compute[74348]: DEBUG nova.compute.manager [req-3c2f12f0-4229-45fc-b08f-b7fa7569f9c7 req-d974cea1-ac0e-4a26-ba74-46ef52875306 service nova] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] No waiting events found dispatching network-vif-plugged-45646c87-9a5f-439c-9cae-356b9917b77a {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:41:05 user nova-compute[74348]: WARNING nova.compute.manager [req-3c2f12f0-4229-45fc-b08f-b7fa7569f9c7 req-d974cea1-ac0e-4a26-ba74-46ef52875306 service nova] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Received unexpected event network-vif-plugged-45646c87-9a5f-439c-9cae-356b9917b77a for instance with vm_state building and task_state spawning.
Nov 22 08:41:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:41:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:41:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:41:06 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:41:06 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:41:06 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Rebuilding the list of instances to heal {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 08:41:06 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Skipping network cache update for instance because it is Building. {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 22 08:41:06 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Didn't find any instances for network info cache update. {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 08:41:07 user nova-compute[74348]: DEBUG nova.compute.manager [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 08:41:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 08:41:07 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Instance spawned successfully.
Nov 22 08:41:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 08:41:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:41:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:41:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:41:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:41:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:41:07 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:41:07 user nova-compute[74348]: INFO nova.compute.manager [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Took 4.93 seconds to spawn the instance on the hypervisor.
Nov 22 08:41:07 user nova-compute[74348]: DEBUG nova.compute.manager [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:41:07 user nova-compute[74348]: DEBUG nova.compute.manager [req-b429c7ef-4378-40e9-a847-c077dc010cbb req-dda350e5-59fb-42a9-b0a6-a24635ea8022 service nova] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Received event network-vif-plugged-45646c87-9a5f-439c-9cae-356b9917b77a {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:41:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b429c7ef-4378-40e9-a847-c077dc010cbb req-dda350e5-59fb-42a9-b0a6-a24635ea8022 service nova] Acquiring lock "a76af0d6-59c7-405e-aebf-5d9aeeb61ef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:41:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b429c7ef-4378-40e9-a847-c077dc010cbb req-dda350e5-59fb-42a9-b0a6-a24635ea8022 service nova] Lock "a76af0d6-59c7-405e-aebf-5d9aeeb61ef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:41:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b429c7ef-4378-40e9-a847-c077dc010cbb req-dda350e5-59fb-42a9-b0a6-a24635ea8022 service nova] Lock "a76af0d6-59c7-405e-aebf-5d9aeeb61ef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:41:07 user nova-compute[74348]: DEBUG nova.compute.manager [req-b429c7ef-4378-40e9-a847-c077dc010cbb req-dda350e5-59fb-42a9-b0a6-a24635ea8022 service nova] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] No waiting events found dispatching network-vif-plugged-45646c87-9a5f-439c-9cae-356b9917b77a {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:41:07 user nova-compute[74348]: WARNING nova.compute.manager [req-b429c7ef-4378-40e9-a847-c077dc010cbb req-dda350e5-59fb-42a9-b0a6-a24635ea8022 service nova] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Received unexpected event network-vif-plugged-45646c87-9a5f-439c-9cae-356b9917b77a for instance with vm_state building and task_state spawning.
Nov 22 08:41:07 user nova-compute[74348]: INFO nova.compute.manager [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Took 11.45 seconds to build instance.
Nov 22 08:41:07 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-5cc185a7-8095-4371-91ac-23fcf30b2dae tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "a76af0d6-59c7-405e-aebf-5d9aeeb61ef0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.589s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:41:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:41:09 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:41:09 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:41:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:41:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:41:14 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:41:15 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:41:15 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:41:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:41:19 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:41:21 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:41:21 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:41:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:41:24 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:41:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:41:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:41:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:41:24 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:41:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:41:24 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:41:24 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:41:24 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=8960MB free_disk=24.884357452392578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:41:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:41:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:41:25 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance a76af0d6-59c7-405e-aebf-5d9aeeb61ef0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:41:25 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:41:25 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:41:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:41:25 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:41:25 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:41:25 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:41:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.183s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:41:28 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:41:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:41:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:41:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:41:35 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:41:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:41:40 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:41:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:41:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:41:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:41:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:42:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:42:08 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:42:08 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:42:08 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Rebuilding the list of instances to heal {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 08:42:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-a76af0d6-59c7-405e-aebf-5d9aeeb61ef0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:42:08 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-a76af0d6-59c7-405e-aebf-5d9aeeb61ef0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:42:08 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 08:42:08 user nova-compute[74348]: DEBUG nova.objects.instance [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lazy-loading 'info_cache' on Instance uuid a76af0d6-59c7-405e-aebf-5d9aeeb61ef0 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:42:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:42:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:42:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:42:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:42:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:42:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:42:08 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Updating instance_info_cache with network_info: [{"id": "45646c87-9a5f-439c-9cae-356b9917b77a", "address": "fa:16:3e:14:ca:9f", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45646c87-9a", "ovs_interfaceid": "45646c87-9a5f-439c-9cae-356b9917b77a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:42:09 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-a76af0d6-59c7-405e-aebf-5d9aeeb61ef0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:42:09 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 08:42:09 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:42:10 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:42:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:42:16 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:42:17 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:42:17 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:42:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:42:21 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:42:21 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:42:22 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:42:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:42:24 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:42:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:42:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:42:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:42:24 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:42:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:42:25 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:42:25 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:42:25 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=9039MB free_disk=24.88372039794922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:42:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:42:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:42:25 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance a76af0d6-59c7-405e-aebf-5d9aeeb61ef0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:42:25 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:42:25 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:42:25 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:42:25 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:42:25 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:42:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.149s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:42:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:42:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:42:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:42:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:42:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:42:47 user nova-compute[74348]: DEBUG nova.compute.manager [req-cc4eff5d-2f75-483a-a4d7-d9f17d6b66a3 req-aa63d281-caf9-4bf0-b18d-1fbe1685addc service nova] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Received event network-changed-45646c87-9a5f-439c-9cae-356b9917b77a {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:42:47 user nova-compute[74348]: DEBUG nova.compute.manager [req-cc4eff5d-2f75-483a-a4d7-d9f17d6b66a3 req-aa63d281-caf9-4bf0-b18d-1fbe1685addc service nova] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Refreshing instance network info cache due to event network-changed-45646c87-9a5f-439c-9cae-356b9917b77a. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:42:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-cc4eff5d-2f75-483a-a4d7-d9f17d6b66a3 req-aa63d281-caf9-4bf0-b18d-1fbe1685addc service nova] Acquiring lock "refresh_cache-a76af0d6-59c7-405e-aebf-5d9aeeb61ef0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:42:47 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-cc4eff5d-2f75-483a-a4d7-d9f17d6b66a3 req-aa63d281-caf9-4bf0-b18d-1fbe1685addc service nova] Acquired lock "refresh_cache-a76af0d6-59c7-405e-aebf-5d9aeeb61ef0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:42:47 user nova-compute[74348]: DEBUG nova.network.neutron [req-cc4eff5d-2f75-483a-a4d7-d9f17d6b66a3 req-aa63d281-caf9-4bf0-b18d-1fbe1685addc service nova] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Refreshing network info cache for port 45646c87-9a5f-439c-9cae-356b9917b77a {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:42:48 user nova-compute[74348]: DEBUG nova.network.neutron [req-cc4eff5d-2f75-483a-a4d7-d9f17d6b66a3 req-aa63d281-caf9-4bf0-b18d-1fbe1685addc service nova] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Updated VIF entry in instance network info cache for port 45646c87-9a5f-439c-9cae-356b9917b77a. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:42:48 user nova-compute[74348]: DEBUG nova.network.neutron [req-cc4eff5d-2f75-483a-a4d7-d9f17d6b66a3 req-aa63d281-caf9-4bf0-b18d-1fbe1685addc service nova] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Updating instance_info_cache with network_info: [{"id": "45646c87-9a5f-439c-9cae-356b9917b77a", "address": "fa:16:3e:14:ca:9f", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45646c87-9a", "ovs_interfaceid": "45646c87-9a5f-439c-9cae-356b9917b77a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:42:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-cc4eff5d-2f75-483a-a4d7-d9f17d6b66a3 req-aa63d281-caf9-4bf0-b18d-1fbe1685addc service nova] Releasing lock "refresh_cache-a76af0d6-59c7-405e-aebf-5d9aeeb61ef0" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:42:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:42:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "a76af0d6-59c7-405e-aebf-5d9aeeb61ef0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:42:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "a76af0d6-59c7-405e-aebf-5d9aeeb61ef0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:42:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "a76af0d6-59c7-405e-aebf-5d9aeeb61ef0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:42:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "a76af0d6-59c7-405e-aebf-5d9aeeb61ef0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:42:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "a76af0d6-59c7-405e-aebf-5d9aeeb61ef0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:42:49 user nova-compute[74348]: INFO nova.compute.manager [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Terminating instance
Nov 22 08:42:49 user nova-compute[74348]: DEBUG nova.compute.manager [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 08:42:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:42:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:42:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:42:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:42:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG nova.compute.manager [req-346cde0d-cf61-4091-8905-72105ec490ee req-c27f9e57-c6ee-45f9-b0af-b4a4dac6ceef service nova] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Received event network-vif-unplugged-45646c87-9a5f-439c-9cae-356b9917b77a {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-346cde0d-cf61-4091-8905-72105ec490ee req-c27f9e57-c6ee-45f9-b0af-b4a4dac6ceef service nova] Acquiring lock "a76af0d6-59c7-405e-aebf-5d9aeeb61ef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-346cde0d-cf61-4091-8905-72105ec490ee req-c27f9e57-c6ee-45f9-b0af-b4a4dac6ceef service nova] Lock "a76af0d6-59c7-405e-aebf-5d9aeeb61ef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-346cde0d-cf61-4091-8905-72105ec490ee req-c27f9e57-c6ee-45f9-b0af-b4a4dac6ceef service nova] Lock "a76af0d6-59c7-405e-aebf-5d9aeeb61ef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG nova.compute.manager [req-346cde0d-cf61-4091-8905-72105ec490ee req-c27f9e57-c6ee-45f9-b0af-b4a4dac6ceef service nova] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] No waiting events found dispatching network-vif-unplugged-45646c87-9a5f-439c-9cae-356b9917b77a {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG nova.compute.manager [req-346cde0d-cf61-4091-8905-72105ec490ee req-c27f9e57-c6ee-45f9-b0af-b4a4dac6ceef service nova] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Received event network-vif-unplugged-45646c87-9a5f-439c-9cae-356b9917b77a for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG nova.compute.manager [req-346cde0d-cf61-4091-8905-72105ec490ee req-c27f9e57-c6ee-45f9-b0af-b4a4dac6ceef service nova] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Received event network-vif-plugged-45646c87-9a5f-439c-9cae-356b9917b77a {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-346cde0d-cf61-4091-8905-72105ec490ee req-c27f9e57-c6ee-45f9-b0af-b4a4dac6ceef service nova] Acquiring lock "a76af0d6-59c7-405e-aebf-5d9aeeb61ef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-346cde0d-cf61-4091-8905-72105ec490ee req-c27f9e57-c6ee-45f9-b0af-b4a4dac6ceef service nova] Lock "a76af0d6-59c7-405e-aebf-5d9aeeb61ef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-346cde0d-cf61-4091-8905-72105ec490ee req-c27f9e57-c6ee-45f9-b0af-b4a4dac6ceef service nova] Lock "a76af0d6-59c7-405e-aebf-5d9aeeb61ef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG nova.compute.manager [req-346cde0d-cf61-4091-8905-72105ec490ee req-c27f9e57-c6ee-45f9-b0af-b4a4dac6ceef service nova] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] No waiting events found dispatching network-vif-plugged-45646c87-9a5f-439c-9cae-356b9917b77a {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:42:50 user nova-compute[74348]: WARNING nova.compute.manager [req-346cde0d-cf61-4091-8905-72105ec490ee req-c27f9e57-c6ee-45f9-b0af-b4a4dac6ceef service nova] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Received unexpected event network-vif-plugged-45646c87-9a5f-439c-9cae-356b9917b77a for instance with vm_state active and task_state deleting.
Nov 22 08:42:50 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:42:50 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Instance destroyed successfully.
Nov 22 08:42:50 user nova-compute[74348]: DEBUG nova.objects.instance [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lazy-loading 'resources' on Instance uuid a76af0d6-59c7-405e-aebf-5d9aeeb61ef0 {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:40:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-683563075',display_name='tempest-TestVolumeBootPattern-server-683563075',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-683563075',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5q5hQzMSuk+sNGJnDRmtWK/6BKD87prla8huISA+ZthbmLQtye643HeDBlLY9Mo3uF5oVpKXrTj1o4wta3IDeKU9ciPV2epUfA3DB6baSC2/EpV7k8Mbb5IhAko6F/ug==',key_name='tempest-TestVolumeBootPattern-944686512',keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:41:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1a81615aef8948718005d104403e260e',ramdisk_id='',reservation_id='r-jg1b3mug',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1316917970',owner_user_name='tempest-TestVolumeBootPattern-1316917970-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T08:41:07Z,user_data=None,user_id='b510235916f547b8b0f5c3c150fe9dac',uuid=a76af0d6-59c7-405e-aebf-5d9aeeb61ef0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45646c87-9a5f-439c-9cae-356b9917b77a", "address": "fa:16:3e:14:ca:9f", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45646c87-9a", "ovs_interfaceid": "45646c87-9a5f-439c-9cae-356b9917b77a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Converting VIF {"id": "45646c87-9a5f-439c-9cae-356b9917b77a", "address": "fa:16:3e:14:ca:9f", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45646c87-9a", "ovs_interfaceid": "45646c87-9a5f-439c-9cae-356b9917b77a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:ca:9f,bridge_name='br-int',has_traffic_filtering=True,id=45646c87-9a5f-439c-9cae-356b9917b77a,network=Network(aed76530-d78f-4747-ba48-e5a0eed6ef6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45646c87-9a') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG os_vif [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:ca:9f,bridge_name='br-int',has_traffic_filtering=True,id=45646c87-9a5f-439c-9cae-356b9917b77a,network=Network(aed76530-d78f-4747-ba48-e5a0eed6ef6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45646c87-9a') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap45646c87-9a, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a90daf76-8ba2-417f-a36f-34951b61f696) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:42:50 user nova-compute[74348]: INFO os_vif [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:ca:9f,bridge_name='br-int',has_traffic_filtering=True,id=45646c87-9a5f-439c-9cae-356b9917b77a,network=Network(aed76530-d78f-4747-ba48-e5a0eed6ef6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45646c87-9a')
Nov 22 08:42:50 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjmMCGTz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:42:50 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:42:50 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[21295dfe-6b74-42e1-89db-1880f6fe3ca1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 08:42:50 user nova-compute[74348]: No targets found.
Nov 22 08:42:50 user nova-compute[74348]: iSNS:
Nov 22 08:42:50 user nova-compute[74348]: No targets found.
Nov 22 08:42:50 user nova-compute[74348]: STATIC:
Nov 22 08:42:50 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3
Nov 22 08:42:50 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:42:50 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:42:50 user nova-compute[74348]: FIRMWARE:
Nov 22 08:42:50 user nova-compute[74348]: No targets found.
Nov 22 08:42:50 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 08:42:50 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 08:42:50 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e69270d-94f7-4fdc-8610-806818844871]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ef938d-914b-42fa-ad34-2b93084ac199]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 (non-flash)
Nov 22 08:42:50 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 (non-flash)
Nov 22 08:42:50 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f224c458d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3'): ({'sdb'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Removing single pathed devices sdb {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebff8fa6-3f61-4ccf-bcac-882223947b68]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[906b768e-55d0-4054-87c2-48ca8a9e6920]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Flushing IO for device /dev/sdb {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b583d4-d351-4261-abce-d4f122072b79]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9544c457-06be-4243-91e7-3515bb2657c9]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] SCSI volumes sdb have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO5d34a13f-e86613b68ec23198', '/dev/disk/by-id/scsi-26538363631336236', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_5d34a13f') {{(pid=85159) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41061d3-4bd1-45b7-a158-2cd8509e88f5]: (4, None) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24cdf4f-6424-42f0-9306-f8dbd9a484ed]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd1d676-5c31-49ea-82f9-b42c669c6af5]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3, portal: 172.16.0.220,3260]
Nov 22 08:42:50 user nova-compute[74348]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3, portal: 172.16.0.220,3260] successful.
Nov 22 08:42:50 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3d6d75-33b3-4f00-822e-954475cf7bd0]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] <== disconnect_volume: return (312ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 08:42:50 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Deleting instance files /opt/stack/data/nova/instances/a76af0d6-59c7-405e-aebf-5d9aeeb61ef0_del
Nov 22 08:42:50 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Deletion of /opt/stack/data/nova/instances/a76af0d6-59c7-405e-aebf-5d9aeeb61ef0_del complete
Nov 22 08:42:50 user nova-compute[74348]: INFO nova.compute.manager [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 22 08:42:50 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:42:50 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:42:51 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:42:51 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Took 0.68 seconds to deallocate network for instance.
Nov 22 08:42:52 user nova-compute[74348]: DEBUG nova.compute.manager [req-55d1e4d7-1e90-4a4e-8254-b6e637c01369 req-b484912e-242a-448e-85b9-00409456b42b service nova] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Received event network-vif-deleted-45646c87-9a5f-439c-9cae-356b9917b77a {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:42:52 user nova-compute[74348]: INFO nova.compute.manager [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: a76af0d6-59c7-405e-aebf-5d9aeeb61ef0] Took 0.73 seconds to detach 1 volumes for instance.
Nov 22 08:42:52 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:42:52 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:42:52 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:42:52 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:42:52 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.107s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:42:52 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Deleted allocations for instance a76af0d6-59c7-405e-aebf-5d9aeeb61ef0
Nov 22 08:42:52 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-19ce5877-ee47-45be-9336-443e3046868d tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "a76af0d6-59c7-405e-aebf-5d9aeeb61ef0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.856s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:42:55 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:42:55 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:43:00 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:43:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:43:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:43:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:43:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:43:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:43:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:43:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:43:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:43:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:43:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:43:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:43:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:43:11 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:43:11 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:43:11 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Rebuilding the list of instances to heal {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 08:43:11 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Didn't find any instances for network info cache update. {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 08:43:11 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:43:12 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:43:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:43:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:43:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:43:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:43:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:43:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:43:16 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:43:19 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:43:19 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:43:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:43:21 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:43:22 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:43:22 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:43:24 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:43:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:43:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:43:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:43:24 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:43:25 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:43:25 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:43:25 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=9168MB free_disk=24.882862091064453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:43:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:43:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:43:25 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:43:25 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:43:25 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:43:25 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:43:25 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:43:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.155s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:43:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:43:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:43:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:43:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:43:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:43:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:43:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:43:32 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:43:35 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:43:40 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:43:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:43:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:43:41 user nova-compute[74348]: DEBUG nova.compute.manager [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 08:43:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:43:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:43:41 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 08:43:41 user nova-compute[74348]: INFO nova.compute.claims [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Claim successful on node user
Nov 22 08:43:41 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:43:41 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:43:42 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:43:42 user nova-compute[74348]: DEBUG nova.compute.manager [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 08:43:42 user nova-compute[74348]: DEBUG nova.compute.manager [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 08:43:42 user nova-compute[74348]: DEBUG nova.network.neutron [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 08:43:42 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 08:43:42 user nova-compute[74348]: DEBUG nova.compute.manager [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 08:43:42 user nova-compute[74348]: INFO nova.virt.block_device [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Booting with volume 19ef4422-cdac-49d6-a0ae-a737355ef4c3 at /dev/vda
Nov 22 08:43:42 user nova-compute[74348]: DEBUG nova.policy [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b510235916f547b8b0f5c3c150fe9dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a81615aef8948718005d104403e260e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 08:43:42 user nova-compute[74348]: DEBUG os_brick.utils [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:43:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:43:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:43:42 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d50e1f-8dcf-4116-9597-92bccd63d6c1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:43:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:43:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:43:42 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fba21d6-3320-40bc-acbb-828902748cbc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:43:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:43:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:43:42 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d9507c-d799-491c-99f7-e71b65f95203]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:43:42 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b793ed9-9b33-4296-871f-de7fbbe8c8d1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:43:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:43:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:43:42 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 08:43:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:43:42 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:43:42 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 08:43:42 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d275c97c-a8b3-4094-9b3c-c6b35421b389]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:43:42 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 08:43:42 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 08:43:42 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 08:43:42 user nova-compute[74348]: DEBUG os_brick.utils [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:43:42 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Updating existing volume attachment record: 1f037d21-661d-425d-b0ad-d93b9f0e6770 {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 08:43:42 user nova-compute[74348]: DEBUG nova.network.neutron [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Successfully created port: a79d46c5-8157-4754-9670-ddc05eeb22c3 {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 08:43:43 user nova-compute[74348]: DEBUG nova.network.neutron [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Successfully updated port: a79d46c5-8157-4754-9670-ddc05eeb22c3 {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 08:43:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "refresh_cache-1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:43:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquired lock "refresh_cache-1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:43:43 user nova-compute[74348]: DEBUG nova.network.neutron [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:43:43 user nova-compute[74348]: DEBUG nova.compute.manager [req-f16a388e-5d3b-49c0-9328-11a165c2a266 req-4204c7af-0685-4a04-b0e9-9cf23b903d76 service nova] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Received event network-changed-a79d46c5-8157-4754-9670-ddc05eeb22c3 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:43:43 user nova-compute[74348]: DEBUG nova.compute.manager [req-f16a388e-5d3b-49c0-9328-11a165c2a266 req-4204c7af-0685-4a04-b0e9-9cf23b903d76 service nova] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Refreshing instance network info cache due to event network-changed-a79d46c5-8157-4754-9670-ddc05eeb22c3. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:43:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f16a388e-5d3b-49c0-9328-11a165c2a266 req-4204c7af-0685-4a04-b0e9-9cf23b903d76 service nova] Acquiring lock "refresh_cache-1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:43:43 user nova-compute[74348]: DEBUG nova.network.neutron [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 08:43:43 user nova-compute[74348]: DEBUG nova.network.neutron [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Updating instance_info_cache with network_info: [{"id": "a79d46c5-8157-4754-9670-ddc05eeb22c3", "address": "fa:16:3e:28:06:cb", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa79d46c5-81", "ovs_interfaceid": "a79d46c5-8157-4754-9670-ddc05eeb22c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:43:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Releasing lock "refresh_cache-1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:43:43 user nova-compute[74348]: DEBUG nova.compute.manager [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Instance network_info: |[{"id": "a79d46c5-8157-4754-9670-ddc05eeb22c3", "address": "fa:16:3e:28:06:cb", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa79d46c5-81", "ovs_interfaceid": "a79d46c5-8157-4754-9670-ddc05eeb22c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 08:43:43 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f16a388e-5d3b-49c0-9328-11a165c2a266 req-4204c7af-0685-4a04-b0e9-9cf23b903d76 service nova] Acquired lock "refresh_cache-1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:43:43 user nova-compute[74348]: DEBUG nova.network.neutron [req-f16a388e-5d3b-49c0-9328-11a165c2a266 req-4204c7af-0685-4a04-b0e9-9cf23b903d76 service nova] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Refreshing network info cache for port a79d46c5-8157-4754-9670-ddc05eeb22c3 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:43:44 user nova-compute[74348]: DEBUG nova.network.neutron [req-f16a388e-5d3b-49c0-9328-11a165c2a266 req-4204c7af-0685-4a04-b0e9-9cf23b903d76 service nova] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Updated VIF entry in instance network info cache for port a79d46c5-8157-4754-9670-ddc05eeb22c3. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:43:44 user nova-compute[74348]: DEBUG nova.network.neutron [req-f16a388e-5d3b-49c0-9328-11a165c2a266 req-4204c7af-0685-4a04-b0e9-9cf23b903d76 service nova] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Updating instance_info_cache with network_info: [{"id": "a79d46c5-8157-4754-9670-ddc05eeb22c3", "address": "fa:16:3e:28:06:cb", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa79d46c5-81", "ovs_interfaceid": "a79d46c5-8157-4754-9670-ddc05eeb22c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:43:44 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f16a388e-5d3b-49c0-9328-11a165c2a266 req-4204c7af-0685-4a04-b0e9-9cf23b903d76 service nova] Releasing lock "refresh_cache-1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:43:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:43:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:43:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:43:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:43:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:43:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG nova.compute.manager [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 08:43:48 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Creating image(s)
Nov 22 08:43:48 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Did not create local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Ensure instance console log exists: /opt/stack/data/nova/instances/1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Start _get_guest_xml network_info=[{"id": "a79d46c5-8157-4754-9670-ddc05eeb22c3", "address": "fa:16:3e:28:06:cb", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa79d46c5-81", "ovs_interfaceid": "a79d46c5-8157-4754-9670-ddc05eeb22c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjmMCGTz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b', 'attached_at': '', 'detached_at': '', 'volume_id': '19ef4422-cdac-49d6-a0ae-a737355ef4c3', 'serial': '19ef4422-cdac-49d6-a0ae-a737355ef4c3'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '1f037d21-661d-425d-b0ad-d93b9f0e6770', 'volume_type': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 08:43:48 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:43:48 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:43:48 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjmMCGTz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:43:48 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:43:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:43:48 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:43:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:43:48 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 08:43:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[642b5b95-c1c7-4855-b888-5c004818994b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 08:43:48 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9056a6d9-91b2-440b-83ff-5bacaf55892d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3] added
Nov 22 08:43:48 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9f9a81-410c-484c-86bf-e51e390a9082]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9a6e0d-3e03-4ce6-b040-deca93d016ff]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kjmMCGTz {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kjmMCGTz" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e445bb82-1ec9-4371-bcac-edff1605178a]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kjmMCGTz'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf58974-e0c9-43d5-8609-c224f20f33cd]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c396954-2a48-42aa-bc0f-87943429eec5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 22 08:43:48 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 22 08:43:48 user nova-compute[74348]:  {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:43:48 user nova-compute[74348]: WARNING os_brick.initiator.connectors.iscsi [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 22 08:43:48 user nova-compute[74348]: 
Nov 22 08:43:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f9e7d1-7739-4a5b-b234-975b3c7e80dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3, portal: 172.16.0.220,3260]
Nov 22 08:43:48 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3, portal: 172.16.0.220,3260] successful.
Nov 22 08:43:48 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd114258-b2f3-42f7-9802-e0989b51d16b]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[51268800-3475-4d98-9c18-0895baf306fa]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 (non-flash)
Nov 22 08:43:48 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 (non-flash)
Nov 22 08:43:48 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b59154-d5ad-4ea8-9474-f999f5589559]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:43:48 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: None {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:43:49 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:43:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjmMCGTz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 08:43:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:43:49 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '26538363631336236', 'path': '/dev/sdb'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:43:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538363631336236', 'path': '/dev/sdb'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 08:43:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:43:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1976686305',display_name='tempest-TestVolumeBootPattern-server-1976686305',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1976686305',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5q5hQzMSuk+sNGJnDRmtWK/6BKD87prla8huISA+ZthbmLQtye643HeDBlLY9Mo3uF5oVpKXrTj1o4wta3IDeKU9ciPV2epUfA3DB6baSC2/EpV7k8Mbb5IhAko6F/ug==',key_name='tempest-TestVolumeBootPattern-944686512',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a81615aef8948718005d104403e260e',ramdisk_id='',reservation_id='r-7echdp9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1316917970',owner_user_name='tempest-TestVolumeBootPattern-1316917970-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:43:42Z,user_data=None,user_id='b510235916f547b8b0f5c3c150fe9dac',uuid=1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a79d46c5-8157-4754-9670-ddc05eeb22c3", "address": "fa:16:3e:28:06:cb", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa79d46c5-81", "ovs_interfaceid": "a79d46c5-8157-4754-9670-ddc05eeb22c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 08:43:49 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Converting VIF {"id": "a79d46c5-8157-4754-9670-ddc05eeb22c3", "address": "fa:16:3e:28:06:cb", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa79d46c5-81", "ovs_interfaceid": "a79d46c5-8157-4754-9670-ddc05eeb22c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:43:49 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:06:cb,bridge_name='br-int',has_traffic_filtering=True,id=a79d46c5-8157-4754-9670-ddc05eeb22c3,network=Network(aed76530-d78f-4747-ba48-e5a0eed6ef6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa79d46c5-81') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:43:49 user nova-compute[74348]: DEBUG nova.objects.instance [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:43:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] End _get_guest_xml xml=<domain type="kvm">
Nov 22 08:43:49 user nova-compute[74348]:   <uuid>1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b</uuid>
Nov 22 08:43:49 user nova-compute[74348]:   <name>instance-00000033</name>
Nov 22 08:43:49 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 08:43:49 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 08:43:49 user nova-compute[74348]:   <metadata>
Nov 22 08:43:49 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 08:43:49 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 08:43:49 user nova-compute[74348]:       <nova:name>tempest-TestVolumeBootPattern-server-1976686305</nova:name>
Nov 22 08:43:49 user nova-compute[74348]:       <nova:creationTime>2023-11-22 08:43:48</nova:creationTime>
Nov 22 08:43:49 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 08:43:49 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 08:43:49 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 08:43:49 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 08:43:49 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 08:43:49 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 08:43:49 user nova-compute[74348]:       </nova:flavor>
Nov 22 08:43:49 user nova-compute[74348]:       <nova:owner>
Nov 22 08:43:49 user nova-compute[74348]:         <nova:user uuid="b510235916f547b8b0f5c3c150fe9dac">tempest-TestVolumeBootPattern-1316917970-project-member</nova:user>
Nov 22 08:43:49 user nova-compute[74348]:         <nova:project uuid="1a81615aef8948718005d104403e260e">tempest-TestVolumeBootPattern-1316917970</nova:project>
Nov 22 08:43:49 user nova-compute[74348]:       </nova:owner>
Nov 22 08:43:49 user nova-compute[74348]:       <nova:ports>
Nov 22 08:43:49 user nova-compute[74348]:         <nova:port uuid="a79d46c5-8157-4754-9670-ddc05eeb22c3">
Nov 22 08:43:49 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 22 08:43:49 user nova-compute[74348]:         </nova:port>
Nov 22 08:43:49 user nova-compute[74348]:       </nova:ports>
Nov 22 08:43:49 user nova-compute[74348]:     </nova:instance>
Nov 22 08:43:49 user nova-compute[74348]:   </metadata>
Nov 22 08:43:49 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 08:43:49 user nova-compute[74348]:     <system>
Nov 22 08:43:49 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 08:43:49 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 08:43:49 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 08:43:49 user nova-compute[74348]:       <entry name="serial">1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b</entry>
Nov 22 08:43:49 user nova-compute[74348]:       <entry name="uuid">1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b</entry>
Nov 22 08:43:49 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 08:43:49 user nova-compute[74348]:     </system>
Nov 22 08:43:49 user nova-compute[74348]:   </sysinfo>
Nov 22 08:43:49 user nova-compute[74348]:   <os>
Nov 22 08:43:49 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 08:43:49 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 08:43:49 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 08:43:49 user nova-compute[74348]:   </os>
Nov 22 08:43:49 user nova-compute[74348]:   <features>
Nov 22 08:43:49 user nova-compute[74348]:     <acpi/>
Nov 22 08:43:49 user nova-compute[74348]:     <apic/>
Nov 22 08:43:49 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 08:43:49 user nova-compute[74348]:   </features>
Nov 22 08:43:49 user nova-compute[74348]:   <clock offset="utc">
Nov 22 08:43:49 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 08:43:49 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 08:43:49 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 08:43:49 user nova-compute[74348]:   </clock>
Nov 22 08:43:49 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 08:43:49 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 08:43:49 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 08:43:49 user nova-compute[74348]:   </cpu>
Nov 22 08:43:49 user nova-compute[74348]:   <devices>
Nov 22 08:43:49 user nova-compute[74348]:     <disk type="block" device="disk">
Nov 22 08:43:49 user nova-compute[74348]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:43:49 user nova-compute[74348]:       <source dev="/dev/sdb"/>
Nov 22 08:43:49 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 08:43:49 user nova-compute[74348]:       <serial>19ef4422-cdac-49d6-a0ae-a737355ef4c3</serial>
Nov 22 08:43:49 user nova-compute[74348]:     </disk>
Nov 22 08:43:49 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 08:43:49 user nova-compute[74348]:       <mac address="fa:16:3e:28:06:cb"/>
Nov 22 08:43:49 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:43:49 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 08:43:49 user nova-compute[74348]:       <target dev="tapa79d46c5-81"/>
Nov 22 08:43:49 user nova-compute[74348]:     </interface>
Nov 22 08:43:49 user nova-compute[74348]:     <serial type="pty">
Nov 22 08:43:49 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b/console.log" append="off"/>
Nov 22 08:43:49 user nova-compute[74348]:     </serial>
Nov 22 08:43:49 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 08:43:49 user nova-compute[74348]:     <video>
Nov 22 08:43:49 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:43:49 user nova-compute[74348]:     </video>
Nov 22 08:43:49 user nova-compute[74348]:     <rng model="virtio">
Nov 22 08:43:49 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 08:43:49 user nova-compute[74348]:     </rng>
Nov 22 08:43:49 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 08:43:49 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 08:43:49 user nova-compute[74348]:       <stats period="10"/>
Nov 22 08:43:49 user nova-compute[74348]:     </memballoon>
Nov 22 08:43:49 user nova-compute[74348]:   </devices>
Nov 22 08:43:49 user nova-compute[74348]: </domain>
Nov 22 08:43:49 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 08:43:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:43:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1976686305',display_name='tempest-TestVolumeBootPattern-server-1976686305',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1976686305',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5q5hQzMSuk+sNGJnDRmtWK/6BKD87prla8huISA+ZthbmLQtye643HeDBlLY9Mo3uF5oVpKXrTj1o4wta3IDeKU9ciPV2epUfA3DB6baSC2/EpV7k8Mbb5IhAko6F/ug==',key_name='tempest-TestVolumeBootPattern-944686512',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a81615aef8948718005d104403e260e',ramdisk_id='',reservation_id='r-7echdp9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1316917970',owner_user_name='tempest-TestVolumeBootPattern-1316917970-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:43:42Z,user_data=None,user_id='b510235916f547b8b0f5c3c150fe9dac',uuid=1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a79d46c5-8157-4754-9670-ddc05eeb22c3", "address": "fa:16:3e:28:06:cb", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa79d46c5-81", "ovs_interfaceid": "a79d46c5-8157-4754-9670-ddc05eeb22c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 08:43:49 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Converting VIF {"id": "a79d46c5-8157-4754-9670-ddc05eeb22c3", "address": "fa:16:3e:28:06:cb", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa79d46c5-81", "ovs_interfaceid": "a79d46c5-8157-4754-9670-ddc05eeb22c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:43:49 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:06:cb,bridge_name='br-int',has_traffic_filtering=True,id=a79d46c5-8157-4754-9670-ddc05eeb22c3,network=Network(aed76530-d78f-4747-ba48-e5a0eed6ef6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa79d46c5-81') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:43:49 user nova-compute[74348]: DEBUG os_vif [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:06:cb,bridge_name='br-int',has_traffic_filtering=True,id=a79d46c5-8157-4754-9670-ddc05eeb22c3,network=Network(aed76530-d78f-4747-ba48-e5a0eed6ef6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa79d46c5-81') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 08:43:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:43:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:43:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 08:43:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:43:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a2c40bf-dff3-58e0-ba79-39a690d6e8d2', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:43:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:43:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:43:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa79d46c5-81, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:43:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa79d46c5-81, col_values=(('qos', UUID('e3736404-e825-4920-a006-e2907094a930')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:43:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa79d46c5-81, col_values=(('external_ids', {'iface-id': 'a79d46c5-8157-4754-9670-ddc05eeb22c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:06:cb', 'vm-uuid': '1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:43:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:43:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:43:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:43:49 user nova-compute[74348]: INFO os_vif [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:06:cb,bridge_name='br-int',has_traffic_filtering=True,id=a79d46c5-8157-4754-9670-ddc05eeb22c3,network=Network(aed76530-d78f-4747-ba48-e5a0eed6ef6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa79d46c5-81')
Nov 22 08:43:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:43:49 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] No VIF found with MAC fa:16:3e:28:06:cb, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:43:50 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:43:50 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:43:50 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:43:51 user nova-compute[74348]: DEBUG nova.compute.manager [req-3f0b2b84-4eca-4a3a-9cc1-63e992596d9f req-371e57dc-8859-4a56-8398-e09aa26c69c9 service nova] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Received event network-vif-plugged-a79d46c5-8157-4754-9670-ddc05eeb22c3 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:43:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3f0b2b84-4eca-4a3a-9cc1-63e992596d9f req-371e57dc-8859-4a56-8398-e09aa26c69c9 service nova] Acquiring lock "1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:43:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3f0b2b84-4eca-4a3a-9cc1-63e992596d9f req-371e57dc-8859-4a56-8398-e09aa26c69c9 service nova] Lock "1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:43:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-3f0b2b84-4eca-4a3a-9cc1-63e992596d9f req-371e57dc-8859-4a56-8398-e09aa26c69c9 service nova] Lock "1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:43:51 user nova-compute[74348]: DEBUG nova.compute.manager [req-3f0b2b84-4eca-4a3a-9cc1-63e992596d9f req-371e57dc-8859-4a56-8398-e09aa26c69c9 service nova] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] No waiting events found dispatching network-vif-plugged-a79d46c5-8157-4754-9670-ddc05eeb22c3 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:43:51 user nova-compute[74348]: WARNING nova.compute.manager [req-3f0b2b84-4eca-4a3a-9cc1-63e992596d9f req-371e57dc-8859-4a56-8398-e09aa26c69c9 service nova] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Received unexpected event network-vif-plugged-a79d46c5-8157-4754-9670-ddc05eeb22c3 for instance with vm_state building and task_state spawning.
Nov 22 08:43:51 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:43:51 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:43:51 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:43:51 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:43:52 user nova-compute[74348]: DEBUG nova.compute.manager [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 08:43:52 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 08:43:52 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Instance spawned successfully.
Nov 22 08:43:52 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 08:43:52 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:43:52 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:43:52 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:43:52 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:43:52 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:43:52 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:43:53 user nova-compute[74348]: INFO nova.compute.manager [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Took 4.84 seconds to spawn the instance on the hypervisor.
Nov 22 08:43:53 user nova-compute[74348]: DEBUG nova.compute.manager [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:43:53 user nova-compute[74348]: INFO nova.compute.manager [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Took 11.62 seconds to build instance.
Nov 22 08:43:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-c084e23b-4c4d-49b4-a4d3-0ca6168a5526 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.721s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:43:53 user nova-compute[74348]: DEBUG nova.compute.manager [req-b8086499-53da-454f-b5da-1ae7d0a76c1f req-7eb55ff6-c462-43fd-bb5a-b95f95db9170 service nova] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Received event network-vif-plugged-a79d46c5-8157-4754-9670-ddc05eeb22c3 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:43:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b8086499-53da-454f-b5da-1ae7d0a76c1f req-7eb55ff6-c462-43fd-bb5a-b95f95db9170 service nova] Acquiring lock "1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:43:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b8086499-53da-454f-b5da-1ae7d0a76c1f req-7eb55ff6-c462-43fd-bb5a-b95f95db9170 service nova] Lock "1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:43:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b8086499-53da-454f-b5da-1ae7d0a76c1f req-7eb55ff6-c462-43fd-bb5a-b95f95db9170 service nova] Lock "1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:43:53 user nova-compute[74348]: DEBUG nova.compute.manager [req-b8086499-53da-454f-b5da-1ae7d0a76c1f req-7eb55ff6-c462-43fd-bb5a-b95f95db9170 service nova] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] No waiting events found dispatching network-vif-plugged-a79d46c5-8157-4754-9670-ddc05eeb22c3 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:43:53 user nova-compute[74348]: WARNING nova.compute.manager [req-b8086499-53da-454f-b5da-1ae7d0a76c1f req-7eb55ff6-c462-43fd-bb5a-b95f95db9170 service nova] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Received unexpected event network-vif-plugged-a79d46c5-8157-4754-9670-ddc05eeb22c3 for instance with vm_state active and task_state None.
Nov 22 08:43:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:43:55 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:43:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:44:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:44:08 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:44:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:44:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:44:11 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:44:12 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:44:12 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:44:12 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Rebuilding the list of instances to heal {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 08:44:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:44:12 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:44:12 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 08:44:12 user nova-compute[74348]: DEBUG nova.objects.instance [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lazy-loading 'info_cache' on Instance uuid 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:44:12 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Updating instance_info_cache with network_info: [{"id": "a79d46c5-8157-4754-9670-ddc05eeb22c3", "address": "fa:16:3e:28:06:cb", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa79d46c5-81", "ovs_interfaceid": "a79d46c5-8157-4754-9670-ddc05eeb22c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:44:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:44:13 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 08:44:13 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:44:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:44:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:44:16 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:44:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:44:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:44:21 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:44:21 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:44:22 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:44:22 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:44:23 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:44:24 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:44:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:44:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:44:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:44:24 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:44:24 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:44:24 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:44:25 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:44:25 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:44:25 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=9013MB free_disk=24.881141662597656GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:44:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:44:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:44:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:44:25 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:44:25 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:44:25 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:44:25 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Refreshing inventories for resource provider 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 22 08:44:25 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Updating ProviderTree inventory for provider 52690f6a-773f-4e8d-be85-d278b6522975 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 22 08:44:25 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Updating inventory in ProviderTree for provider 52690f6a-773f-4e8d-be85-d278b6522975 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 22 08:44:25 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Refreshing aggregate associations for resource provider 52690f6a-773f-4e8d-be85-d278b6522975, aggregates: None {{(pid=74348) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 22 08:44:25 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Refreshing trait associations for resource provider 52690f6a-773f-4e8d-be85-d278b6522975, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=74348) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 22 08:44:25 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:44:25 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:44:25 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:44:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.548s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:44:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:44:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:44:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:44:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:44:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:44:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:44:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:44:36 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:44:36 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Cleaning up deleted instances {{(pid=74348) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 22 08:44:36 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] There are 0 instances to clean {{(pid=74348) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 22 08:44:37 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:44:37 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74348) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 22 08:44:39 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:44:44 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:44:44 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:44:44 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:44:44 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:44:44 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:44:44 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:44:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:44:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:44:59 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:45:04 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:45:09 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:45:13 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:45:13 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:45:13 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Rebuilding the list of instances to heal {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 08:45:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:45:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:45:13 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 08:45:13 user nova-compute[74348]: DEBUG nova.objects.instance [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lazy-loading 'info_cache' on Instance uuid 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:45:14 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Updating instance_info_cache with network_info: [{"id": "a79d46c5-8157-4754-9670-ddc05eeb22c3", "address": "fa:16:3e:28:06:cb", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa79d46c5-81", "ovs_interfaceid": "a79d46c5-8157-4754-9670-ddc05eeb22c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:45:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:45:14 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 08:45:14 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:45:14 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:45:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:45:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:45:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:45:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:45:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:45:14 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:45:17 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:45:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:45:22 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:45:23 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:45:23 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:45:23 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:45:24 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:45:24 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:45:24 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:45:24 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:45:24 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:45:24 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:45:24 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:45:26 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:45:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:45:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:45:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:45:26 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:45:26 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:45:27 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:45:27 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:45:27 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=9042MB free_disk=24.88058090209961GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:45:27 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:45:27 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:45:27 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:45:27 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:45:27 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:45:27 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:45:27 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:45:27 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:45:27 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:45:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:45:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:45:33 user nova-compute[74348]: DEBUG nova.compute.manager [req-7a5576a4-fcf8-4dfb-b17e-f99ce9b48cc7 req-ad1fa2d7-2617-4216-95fb-47ceaac6e4c5 service nova] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Received event network-changed-a79d46c5-8157-4754-9670-ddc05eeb22c3 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:45:33 user nova-compute[74348]: DEBUG nova.compute.manager [req-7a5576a4-fcf8-4dfb-b17e-f99ce9b48cc7 req-ad1fa2d7-2617-4216-95fb-47ceaac6e4c5 service nova] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Refreshing instance network info cache due to event network-changed-a79d46c5-8157-4754-9670-ddc05eeb22c3. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:45:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-7a5576a4-fcf8-4dfb-b17e-f99ce9b48cc7 req-ad1fa2d7-2617-4216-95fb-47ceaac6e4c5 service nova] Acquiring lock "refresh_cache-1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:45:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-7a5576a4-fcf8-4dfb-b17e-f99ce9b48cc7 req-ad1fa2d7-2617-4216-95fb-47ceaac6e4c5 service nova] Acquired lock "refresh_cache-1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:45:33 user nova-compute[74348]: DEBUG nova.network.neutron [req-7a5576a4-fcf8-4dfb-b17e-f99ce9b48cc7 req-ad1fa2d7-2617-4216-95fb-47ceaac6e4c5 service nova] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Refreshing network info cache for port a79d46c5-8157-4754-9670-ddc05eeb22c3 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:45:33 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:45:33 user nova-compute[74348]: DEBUG nova.network.neutron [req-7a5576a4-fcf8-4dfb-b17e-f99ce9b48cc7 req-ad1fa2d7-2617-4216-95fb-47ceaac6e4c5 service nova] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Updated VIF entry in instance network info cache for port a79d46c5-8157-4754-9670-ddc05eeb22c3. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:45:33 user nova-compute[74348]: DEBUG nova.network.neutron [req-7a5576a4-fcf8-4dfb-b17e-f99ce9b48cc7 req-ad1fa2d7-2617-4216-95fb-47ceaac6e4c5 service nova] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Updating instance_info_cache with network_info: [{"id": "a79d46c5-8157-4754-9670-ddc05eeb22c3", "address": "fa:16:3e:28:06:cb", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa79d46c5-81", "ovs_interfaceid": "a79d46c5-8157-4754-9670-ddc05eeb22c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:45:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-7a5576a4-fcf8-4dfb-b17e-f99ce9b48cc7 req-ad1fa2d7-2617-4216-95fb-47ceaac6e4c5 service nova] Releasing lock "refresh_cache-1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:45:34 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:45:35 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:45:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "500e2717-d77c-4e1a-98d3-47c9326fdd0f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:45:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "500e2717-d77c-4e1a-98d3-47c9326fdd0f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:45:39 user nova-compute[74348]: DEBUG nova.compute.manager [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 08:45:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:45:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:45:39 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 08:45:39 user nova-compute[74348]: INFO nova.compute.claims [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Claim successful on node user
Nov 22 08:45:39 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:45:39 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:45:39 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:45:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.270s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:45:39 user nova-compute[74348]: DEBUG nova.compute.manager [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 08:45:39 user nova-compute[74348]: DEBUG nova.compute.manager [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 08:45:39 user nova-compute[74348]: DEBUG nova.network.neutron [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 08:45:39 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 08:45:39 user nova-compute[74348]: DEBUG nova.compute.manager [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 08:45:40 user nova-compute[74348]: DEBUG nova.policy [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b510235916f547b8b0f5c3c150fe9dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a81615aef8948718005d104403e260e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 08:45:40 user nova-compute[74348]: INFO nova.virt.block_device [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Booting with volume 85eb66d5-8b81-483d-ba7c-eae5ddfe6574 at /dev/vda
Nov 22 08:45:40 user nova-compute[74348]: DEBUG os_brick.utils [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:45:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:45:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:45:40 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4751c657-ef55-41ed-9d23-3a742c7445d9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:45:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:45:40 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:45:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:45:40 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3cfb78-c078-4374-b3e8-a4b2e1e881d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:45:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:45:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:45:40 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d6bf99-7483-450a-a711-396e12f38ab6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:45:40 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5763791a-e2bd-4249-9b83-db532425fb00]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:45:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:45:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:45:40 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 08:45:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:45:40 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:45:40 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 08:45:40 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[417af4c5-3014-4e7d-a658-bc52a6b4c310]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:45:40 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 08:45:40 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 08:45:40 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 08:45:40 user nova-compute[74348]: DEBUG os_brick.utils [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:45:40 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Updating existing volume attachment record: 31cf3d79-5579-4189-99d8-5b152e1d4d88 {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 08:45:41 user nova-compute[74348]: DEBUG nova.network.neutron [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Successfully created port: 92d5f230-38cf-4dd3-a8d7-2d0781af30e0 {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 08:45:41 user nova-compute[74348]: DEBUG nova.network.neutron [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Successfully updated port: 92d5f230-38cf-4dd3-a8d7-2d0781af30e0 {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 08:45:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "refresh_cache-500e2717-d77c-4e1a-98d3-47c9326fdd0f" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:45:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquired lock "refresh_cache-500e2717-d77c-4e1a-98d3-47c9326fdd0f" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:45:41 user nova-compute[74348]: DEBUG nova.network.neutron [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:45:41 user nova-compute[74348]: DEBUG nova.compute.manager [req-afd7331d-b133-4551-ba60-f3da7ff074d2 req-2a3b52c3-67ae-4b5f-849c-9249788f0598 service nova] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Received event network-changed-92d5f230-38cf-4dd3-a8d7-2d0781af30e0 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:45:41 user nova-compute[74348]: DEBUG nova.compute.manager [req-afd7331d-b133-4551-ba60-f3da7ff074d2 req-2a3b52c3-67ae-4b5f-849c-9249788f0598 service nova] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Refreshing instance network info cache due to event network-changed-92d5f230-38cf-4dd3-a8d7-2d0781af30e0. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:45:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-afd7331d-b133-4551-ba60-f3da7ff074d2 req-2a3b52c3-67ae-4b5f-849c-9249788f0598 service nova] Acquiring lock "refresh_cache-500e2717-d77c-4e1a-98d3-47c9326fdd0f" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:45:41 user nova-compute[74348]: DEBUG nova.network.neutron [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 08:45:41 user nova-compute[74348]: DEBUG nova.network.neutron [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Updating instance_info_cache with network_info: [{"id": "92d5f230-38cf-4dd3-a8d7-2d0781af30e0", "address": "fa:16:3e:f7:03:55", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d5f230-38", "ovs_interfaceid": "92d5f230-38cf-4dd3-a8d7-2d0781af30e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:45:42 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Releasing lock "refresh_cache-500e2717-d77c-4e1a-98d3-47c9326fdd0f" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:45:42 user nova-compute[74348]: DEBUG nova.compute.manager [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Instance network_info: |[{"id": "92d5f230-38cf-4dd3-a8d7-2d0781af30e0", "address": "fa:16:3e:f7:03:55", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d5f230-38", "ovs_interfaceid": "92d5f230-38cf-4dd3-a8d7-2d0781af30e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 08:45:42 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-afd7331d-b133-4551-ba60-f3da7ff074d2 req-2a3b52c3-67ae-4b5f-849c-9249788f0598 service nova] Acquired lock "refresh_cache-500e2717-d77c-4e1a-98d3-47c9326fdd0f" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:45:42 user nova-compute[74348]: DEBUG nova.network.neutron [req-afd7331d-b133-4551-ba60-f3da7ff074d2 req-2a3b52c3-67ae-4b5f-849c-9249788f0598 service nova] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Refreshing network info cache for port 92d5f230-38cf-4dd3-a8d7-2d0781af30e0 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:45:42 user nova-compute[74348]: DEBUG nova.network.neutron [req-afd7331d-b133-4551-ba60-f3da7ff074d2 req-2a3b52c3-67ae-4b5f-849c-9249788f0598 service nova] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Updated VIF entry in instance network info cache for port 92d5f230-38cf-4dd3-a8d7-2d0781af30e0. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:45:42 user nova-compute[74348]: DEBUG nova.network.neutron [req-afd7331d-b133-4551-ba60-f3da7ff074d2 req-2a3b52c3-67ae-4b5f-849c-9249788f0598 service nova] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Updating instance_info_cache with network_info: [{"id": "92d5f230-38cf-4dd3-a8d7-2d0781af30e0", "address": "fa:16:3e:f7:03:55", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d5f230-38", "ovs_interfaceid": "92d5f230-38cf-4dd3-a8d7-2d0781af30e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:45:42 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-afd7331d-b133-4551-ba60-f3da7ff074d2 req-2a3b52c3-67ae-4b5f-849c-9249788f0598 service nova] Releasing lock "refresh_cache-500e2717-d77c-4e1a-98d3-47c9326fdd0f" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:45:44 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG nova.compute.manager [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 08:45:46 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Creating image(s)
Nov 22 08:45:46 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Did not create local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Ensure instance console log exists: /opt/stack/data/nova/instances/500e2717-d77c-4e1a-98d3-47c9326fdd0f/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Start _get_guest_xml network_info=[{"id": "92d5f230-38cf-4dd3-a8d7-2d0781af30e0", "address": "fa:16:3e:f7:03:55", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d5f230-38", "ovs_interfaceid": "92d5f230-38cf-4dd3-a8d7-2d0781af30e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LwKrJqeM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '500e2717-d77c-4e1a-98d3-47c9326fdd0f', 'attached_at': '', 'detached_at': '', 'volume_id': '85eb66d5-8b81-483d-ba7c-eae5ddfe6574', 'serial': '85eb66d5-8b81-483d-ba7c-eae5ddfe6574'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '31cf3d79-5579-4189-99d8-5b152e1d4d88', 'volume_type': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 08:45:46 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:45:46 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:45:46 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LwKrJqeM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:45:46 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:45:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:45:46 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:45:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:45:46 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 08:45:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574 -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e883fe-d812-418d-851b-3ccadcce4378]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 08:45:46 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574 -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bb8beb-dc5d-428d-9900-0e27810f0e57]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574] added
Nov 22 08:45:46 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b28f35-ca6e-4c1c-bae3-7acf04de01f7]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[20fc2699-d0e7-4e4b-b20a-445eeaee78fa]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LwKrJqeM {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LwKrJqeM" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a527c6-9d0f-484a-848d-6befdfb39376]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LwKrJqeM'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ec2aca-8913-4451-8a20-66165ebd520b]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d9506d-b46a-41da-b819-8b64d4896f38]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 (non-flash)
Nov 22 08:45:46 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 (non-flash)
Nov 22 08:45:46 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574 -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc7ef55-d2cf-4ee9-a2b3-eb9f2add21a2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574, portal: 172.16.0.220,3260]
Nov 22 08:45:46 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574, portal: 172.16.0.220,3260] successful.
Nov 22 08:45:46 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[020505ac-d640-4506-a888-3bc07c32027d]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9d5afb-ccd9-4fbc-90ba-7fdcbce9be05]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 (non-flash)
Nov 22 08:45:46 user nova-compute[74348]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574 (non-flash)
Nov 22 08:45:46 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 (non-flash)
Nov 22 08:45:46 user nova-compute[74348]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574 (non-flash)
Nov 22 08:45:46 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] HCTL ('34', '-', '-', 0) found on session 63 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e36d21a-1bec-4d18-ab87-3da18e8c2357]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:45:46 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: None {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:45:47 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:45:47 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LwKrJqeM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 08:45:47 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:45:47 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23436333739633264', 'path': '/dev/sdc'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:45:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436333739633264', 'path': '/dev/sdc'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 08:45:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-67076410',display_name='tempest-TestVolumeBootPattern-server-67076410',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-67076410',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5q5hQzMSuk+sNGJnDRmtWK/6BKD87prla8huISA+ZthbmLQtye643HeDBlLY9Mo3uF5oVpKXrTj1o4wta3IDeKU9ciPV2epUfA3DB6baSC2/EpV7k8Mbb5IhAko6F/ug==',key_name='tempest-TestVolumeBootPattern-944686512',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a81615aef8948718005d104403e260e',ramdisk_id='',reservation_id='r-hnieme5q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1316917970',owner_user_name='tempest-TestVolumeBootPattern-1316917970-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:45:40Z,user_data=None,user_id='b510235916f547b8b0f5c3c150fe9dac',uuid=500e2717-d77c-4e1a-98d3-47c9326fdd0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92d5f230-38cf-4dd3-a8d7-2d0781af30e0", "address": "fa:16:3e:f7:03:55", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d5f230-38", "ovs_interfaceid": "92d5f230-38cf-4dd3-a8d7-2d0781af30e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 08:45:47 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Converting VIF {"id": "92d5f230-38cf-4dd3-a8d7-2d0781af30e0", "address": "fa:16:3e:f7:03:55", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d5f230-38", "ovs_interfaceid": "92d5f230-38cf-4dd3-a8d7-2d0781af30e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:45:47 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:03:55,bridge_name='br-int',has_traffic_filtering=True,id=92d5f230-38cf-4dd3-a8d7-2d0781af30e0,network=Network(aed76530-d78f-4747-ba48-e5a0eed6ef6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92d5f230-38') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:45:47 user nova-compute[74348]: DEBUG nova.objects.instance [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lazy-loading 'pci_devices' on Instance uuid 500e2717-d77c-4e1a-98d3-47c9326fdd0f {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:45:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] End _get_guest_xml xml=<domain type="kvm">
Nov 22 08:45:47 user nova-compute[74348]:   <uuid>500e2717-d77c-4e1a-98d3-47c9326fdd0f</uuid>
Nov 22 08:45:47 user nova-compute[74348]:   <name>instance-00000034</name>
Nov 22 08:45:47 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 08:45:47 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 08:45:47 user nova-compute[74348]:   <metadata>
Nov 22 08:45:47 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 08:45:47 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 08:45:47 user nova-compute[74348]:       <nova:name>tempest-TestVolumeBootPattern-server-67076410</nova:name>
Nov 22 08:45:47 user nova-compute[74348]:       <nova:creationTime>2023-11-22 08:45:46</nova:creationTime>
Nov 22 08:45:47 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 08:45:47 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 08:45:47 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 08:45:47 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 08:45:47 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 08:45:47 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 08:45:47 user nova-compute[74348]:       </nova:flavor>
Nov 22 08:45:47 user nova-compute[74348]:       <nova:owner>
Nov 22 08:45:47 user nova-compute[74348]:         <nova:user uuid="b510235916f547b8b0f5c3c150fe9dac">tempest-TestVolumeBootPattern-1316917970-project-member</nova:user>
Nov 22 08:45:47 user nova-compute[74348]:         <nova:project uuid="1a81615aef8948718005d104403e260e">tempest-TestVolumeBootPattern-1316917970</nova:project>
Nov 22 08:45:47 user nova-compute[74348]:       </nova:owner>
Nov 22 08:45:47 user nova-compute[74348]:       <nova:ports>
Nov 22 08:45:47 user nova-compute[74348]:         <nova:port uuid="92d5f230-38cf-4dd3-a8d7-2d0781af30e0">
Nov 22 08:45:47 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 22 08:45:47 user nova-compute[74348]:         </nova:port>
Nov 22 08:45:47 user nova-compute[74348]:       </nova:ports>
Nov 22 08:45:47 user nova-compute[74348]:     </nova:instance>
Nov 22 08:45:47 user nova-compute[74348]:   </metadata>
Nov 22 08:45:47 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 08:45:47 user nova-compute[74348]:     <system>
Nov 22 08:45:47 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 08:45:47 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 08:45:47 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 08:45:47 user nova-compute[74348]:       <entry name="serial">500e2717-d77c-4e1a-98d3-47c9326fdd0f</entry>
Nov 22 08:45:47 user nova-compute[74348]:       <entry name="uuid">500e2717-d77c-4e1a-98d3-47c9326fdd0f</entry>
Nov 22 08:45:47 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 08:45:47 user nova-compute[74348]:     </system>
Nov 22 08:45:47 user nova-compute[74348]:   </sysinfo>
Nov 22 08:45:47 user nova-compute[74348]:   <os>
Nov 22 08:45:47 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 08:45:47 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 08:45:47 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 08:45:47 user nova-compute[74348]:   </os>
Nov 22 08:45:47 user nova-compute[74348]:   <features>
Nov 22 08:45:47 user nova-compute[74348]:     <acpi/>
Nov 22 08:45:47 user nova-compute[74348]:     <apic/>
Nov 22 08:45:47 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 08:45:47 user nova-compute[74348]:   </features>
Nov 22 08:45:47 user nova-compute[74348]:   <clock offset="utc">
Nov 22 08:45:47 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 08:45:47 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 08:45:47 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 08:45:47 user nova-compute[74348]:   </clock>
Nov 22 08:45:47 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 08:45:47 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 08:45:47 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 08:45:47 user nova-compute[74348]:   </cpu>
Nov 22 08:45:47 user nova-compute[74348]:   <devices>
Nov 22 08:45:47 user nova-compute[74348]:     <disk type="block" device="disk">
Nov 22 08:45:47 user nova-compute[74348]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:45:47 user nova-compute[74348]:       <source dev="/dev/sdc"/>
Nov 22 08:45:47 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 08:45:47 user nova-compute[74348]:       <serial>85eb66d5-8b81-483d-ba7c-eae5ddfe6574</serial>
Nov 22 08:45:47 user nova-compute[74348]:     </disk>
Nov 22 08:45:47 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 08:45:47 user nova-compute[74348]:       <mac address="fa:16:3e:f7:03:55"/>
Nov 22 08:45:47 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:45:47 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 08:45:47 user nova-compute[74348]:       <target dev="tap92d5f230-38"/>
Nov 22 08:45:47 user nova-compute[74348]:     </interface>
Nov 22 08:45:47 user nova-compute[74348]:     <serial type="pty">
Nov 22 08:45:47 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/500e2717-d77c-4e1a-98d3-47c9326fdd0f/console.log" append="off"/>
Nov 22 08:45:47 user nova-compute[74348]:     </serial>
Nov 22 08:45:47 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 08:45:47 user nova-compute[74348]:     <video>
Nov 22 08:45:47 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:45:47 user nova-compute[74348]:     </video>
Nov 22 08:45:47 user nova-compute[74348]:     <rng model="virtio">
Nov 22 08:45:47 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 08:45:47 user nova-compute[74348]:     </rng>
Nov 22 08:45:47 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 08:45:47 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 08:45:47 user nova-compute[74348]:       <stats period="10"/>
Nov 22 08:45:47 user nova-compute[74348]:     </memballoon>
Nov 22 08:45:47 user nova-compute[74348]:   </devices>
Nov 22 08:45:47 user nova-compute[74348]: </domain>
Nov 22 08:45:47 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 08:45:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-67076410',display_name='tempest-TestVolumeBootPattern-server-67076410',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-67076410',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5q5hQzMSuk+sNGJnDRmtWK/6BKD87prla8huISA+ZthbmLQtye643HeDBlLY9Mo3uF5oVpKXrTj1o4wta3IDeKU9ciPV2epUfA3DB6baSC2/EpV7k8Mbb5IhAko6F/ug==',key_name='tempest-TestVolumeBootPattern-944686512',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a81615aef8948718005d104403e260e',ramdisk_id='',reservation_id='r-hnieme5q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1316917970',owner_user_name='tempest-TestVolumeBootPattern-1316917970-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:45:40Z,user_data=None,user_id='b510235916f547b8b0f5c3c150fe9dac',uuid=500e2717-d77c-4e1a-98d3-47c9326fdd0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92d5f230-38cf-4dd3-a8d7-2d0781af30e0", "address": "fa:16:3e:f7:03:55", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d5f230-38", "ovs_interfaceid": "92d5f230-38cf-4dd3-a8d7-2d0781af30e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 08:45:47 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Converting VIF {"id": "92d5f230-38cf-4dd3-a8d7-2d0781af30e0", "address": "fa:16:3e:f7:03:55", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d5f230-38", "ovs_interfaceid": "92d5f230-38cf-4dd3-a8d7-2d0781af30e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:45:47 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:03:55,bridge_name='br-int',has_traffic_filtering=True,id=92d5f230-38cf-4dd3-a8d7-2d0781af30e0,network=Network(aed76530-d78f-4747-ba48-e5a0eed6ef6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92d5f230-38') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:45:47 user nova-compute[74348]: DEBUG os_vif [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:03:55,bridge_name='br-int',has_traffic_filtering=True,id=92d5f230-38cf-4dd3-a8d7-2d0781af30e0,network=Network(aed76530-d78f-4747-ba48-e5a0eed6ef6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92d5f230-38') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 08:45:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:45:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:45:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 08:45:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:45:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '68f479c8-714f-533f-9d57-1a0e1c5102d9', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:45:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:45:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:45:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:45:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap92d5f230-38, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:45:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap92d5f230-38, col_values=(('qos', UUID('b174eb91-b257-4695-9eaa-aad0823f7a6a')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:45:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap92d5f230-38, col_values=(('external_ids', {'iface-id': '92d5f230-38cf-4dd3-a8d7-2d0781af30e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:03:55', 'vm-uuid': '500e2717-d77c-4e1a-98d3-47c9326fdd0f'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:45:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:45:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:45:47 user nova-compute[74348]: INFO os_vif [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:03:55,bridge_name='br-int',has_traffic_filtering=True,id=92d5f230-38cf-4dd3-a8d7-2d0781af30e0,network=Network(aed76530-d78f-4747-ba48-e5a0eed6ef6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92d5f230-38')
Nov 22 08:45:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:45:47 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] No VIF found with MAC fa:16:3e:f7:03:55, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:45:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:45:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:45:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:45:49 user nova-compute[74348]: DEBUG nova.compute.manager [req-96e7d9c5-799c-4cf7-ac5a-b6c23f6a6861 req-34ebaac4-e6cc-42c6-94c4-4e6454998c31 service nova] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Received event network-vif-plugged-92d5f230-38cf-4dd3-a8d7-2d0781af30e0 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:45:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-96e7d9c5-799c-4cf7-ac5a-b6c23f6a6861 req-34ebaac4-e6cc-42c6-94c4-4e6454998c31 service nova] Acquiring lock "500e2717-d77c-4e1a-98d3-47c9326fdd0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:45:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-96e7d9c5-799c-4cf7-ac5a-b6c23f6a6861 req-34ebaac4-e6cc-42c6-94c4-4e6454998c31 service nova] Lock "500e2717-d77c-4e1a-98d3-47c9326fdd0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:45:49 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-96e7d9c5-799c-4cf7-ac5a-b6c23f6a6861 req-34ebaac4-e6cc-42c6-94c4-4e6454998c31 service nova] Lock "500e2717-d77c-4e1a-98d3-47c9326fdd0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:45:49 user nova-compute[74348]: DEBUG nova.compute.manager [req-96e7d9c5-799c-4cf7-ac5a-b6c23f6a6861 req-34ebaac4-e6cc-42c6-94c4-4e6454998c31 service nova] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] No waiting events found dispatching network-vif-plugged-92d5f230-38cf-4dd3-a8d7-2d0781af30e0 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:45:49 user nova-compute[74348]: WARNING nova.compute.manager [req-96e7d9c5-799c-4cf7-ac5a-b6c23f6a6861 req-34ebaac4-e6cc-42c6-94c4-4e6454998c31 service nova] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Received unexpected event network-vif-plugged-92d5f230-38cf-4dd3-a8d7-2d0781af30e0 for instance with vm_state building and task_state spawning.
Nov 22 08:45:49 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:45:50 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:45:50 user nova-compute[74348]: DEBUG nova.compute.manager [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 08:45:50 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 08:45:50 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Instance spawned successfully.
Nov 22 08:45:50 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 08:45:50 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:45:50 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:45:50 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:45:50 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:45:50 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:45:50 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:45:51 user nova-compute[74348]: INFO nova.compute.manager [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Took 4.89 seconds to spawn the instance on the hypervisor.
Nov 22 08:45:51 user nova-compute[74348]: DEBUG nova.compute.manager [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:45:51 user nova-compute[74348]: DEBUG nova.compute.manager [req-18610464-d97d-4b91-b941-13d9095afcff req-767af10e-4296-47e3-96b9-fbc39608c8bd service nova] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Received event network-vif-plugged-92d5f230-38cf-4dd3-a8d7-2d0781af30e0 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:45:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-18610464-d97d-4b91-b941-13d9095afcff req-767af10e-4296-47e3-96b9-fbc39608c8bd service nova] Acquiring lock "500e2717-d77c-4e1a-98d3-47c9326fdd0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:45:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-18610464-d97d-4b91-b941-13d9095afcff req-767af10e-4296-47e3-96b9-fbc39608c8bd service nova] Lock "500e2717-d77c-4e1a-98d3-47c9326fdd0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:45:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-18610464-d97d-4b91-b941-13d9095afcff req-767af10e-4296-47e3-96b9-fbc39608c8bd service nova] Lock "500e2717-d77c-4e1a-98d3-47c9326fdd0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:45:51 user nova-compute[74348]: DEBUG nova.compute.manager [req-18610464-d97d-4b91-b941-13d9095afcff req-767af10e-4296-47e3-96b9-fbc39608c8bd service nova] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] No waiting events found dispatching network-vif-plugged-92d5f230-38cf-4dd3-a8d7-2d0781af30e0 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:45:51 user nova-compute[74348]: WARNING nova.compute.manager [req-18610464-d97d-4b91-b941-13d9095afcff req-767af10e-4296-47e3-96b9-fbc39608c8bd service nova] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Received unexpected event network-vif-plugged-92d5f230-38cf-4dd3-a8d7-2d0781af30e0 for instance with vm_state building and task_state spawning.
Nov 22 08:45:51 user nova-compute[74348]: INFO nova.compute.manager [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Took 11.52 seconds to build instance.
Nov 22 08:45:51 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-a646322e-acd6-4ed3-afc2-28a5271ffd56 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "500e2717-d77c-4e1a-98d3-47c9326fdd0f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.625s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:45:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:45:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:45:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:45:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:45:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:45:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:45:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:46:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:46:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:46:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:46:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:46:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:46:13 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:46:13 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:46:13 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Rebuilding the list of instances to heal {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 08:46:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:46:13 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:46:13 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 08:46:13 user nova-compute[74348]: DEBUG nova.objects.instance [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lazy-loading 'info_cache' on Instance uuid 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:46:14 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Updating instance_info_cache with network_info: [{"id": "a79d46c5-8157-4754-9670-ddc05eeb22c3", "address": "fa:16:3e:28:06:cb", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa79d46c5-81", "ovs_interfaceid": "a79d46c5-8157-4754-9670-ddc05eeb22c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:46:14 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:46:14 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 08:46:14 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:46:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:46:15 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:46:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:46:19 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:46:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:46:22 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:46:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:46:24 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:46:25 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:46:25 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:46:25 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:46:27 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:46:27 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:46:27 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:46:27 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:46:27 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:46:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:46:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:46:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:46:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:46:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:46:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:46:27 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:46:27 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:46:27 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:46:27 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:46:28 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=8913MB free_disk=24.87091827392578GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:46:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:46:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:46:28 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:46:28 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 500e2717-d77c-4e1a-98d3-47c9326fdd0f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:46:28 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:46:28 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:46:28 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:46:28 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:46:28 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:46:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.314s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:46:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:46:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:46:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:46:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:46:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:46:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:46:37 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:46:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:46:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:46:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:46:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:46:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:46:42 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:46:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:46:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:46:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:46:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:46:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:46:47 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:46:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:46:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:46:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:46:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:46:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:46:52 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:46:57 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:47:02 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:47:07 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:47:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:47:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:47:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:47:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:47:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:47:12 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:47:16 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:47:16 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:47:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-500e2717-d77c-4e1a-98d3-47c9326fdd0f" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:47:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-500e2717-d77c-4e1a-98d3-47c9326fdd0f" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:47:16 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 08:47:16 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Updating instance_info_cache with network_info: [{"id": "92d5f230-38cf-4dd3-a8d7-2d0781af30e0", "address": "fa:16:3e:f7:03:55", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d5f230-38", "ovs_interfaceid": "92d5f230-38cf-4dd3-a8d7-2d0781af30e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:47:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-500e2717-d77c-4e1a-98d3-47c9326fdd0f" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:47:16 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 08:47:16 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:47:16 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:47:17 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:47:20 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:47:22 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:47:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:47:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:47:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:47:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:47:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:47:22 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:47:24 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:47:26 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:47:27 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:47:27 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:47:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:47:28 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:47:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:47:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:47:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:47:28 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:47:28 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:47:28 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:47:28 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:47:28 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:47:28 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=8961MB free_disk=24.87033462524414GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:47:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:47:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:47:29 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:47:29 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 500e2717-d77c-4e1a-98d3-47c9326fdd0f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:47:29 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:47:29 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:47:29 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:47:29 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:47:29 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:47:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.194s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:47:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:47:31 user nova-compute[74348]: DEBUG nova.compute.manager [req-66039bb1-fd29-4856-aa7b-e876302c7736 req-9454bd04-390b-4543-8ea0-dfec07040414 service nova] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Received event network-changed-92d5f230-38cf-4dd3-a8d7-2d0781af30e0 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:47:31 user nova-compute[74348]: DEBUG nova.compute.manager [req-66039bb1-fd29-4856-aa7b-e876302c7736 req-9454bd04-390b-4543-8ea0-dfec07040414 service nova] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Refreshing instance network info cache due to event network-changed-92d5f230-38cf-4dd3-a8d7-2d0781af30e0. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:47:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-66039bb1-fd29-4856-aa7b-e876302c7736 req-9454bd04-390b-4543-8ea0-dfec07040414 service nova] Acquiring lock "refresh_cache-500e2717-d77c-4e1a-98d3-47c9326fdd0f" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:47:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-66039bb1-fd29-4856-aa7b-e876302c7736 req-9454bd04-390b-4543-8ea0-dfec07040414 service nova] Acquired lock "refresh_cache-500e2717-d77c-4e1a-98d3-47c9326fdd0f" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:47:31 user nova-compute[74348]: DEBUG nova.network.neutron [req-66039bb1-fd29-4856-aa7b-e876302c7736 req-9454bd04-390b-4543-8ea0-dfec07040414 service nova] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Refreshing network info cache for port 92d5f230-38cf-4dd3-a8d7-2d0781af30e0 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:47:31 user nova-compute[74348]: DEBUG nova.network.neutron [req-66039bb1-fd29-4856-aa7b-e876302c7736 req-9454bd04-390b-4543-8ea0-dfec07040414 service nova] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Updated VIF entry in instance network info cache for port 92d5f230-38cf-4dd3-a8d7-2d0781af30e0. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:47:31 user nova-compute[74348]: DEBUG nova.network.neutron [req-66039bb1-fd29-4856-aa7b-e876302c7736 req-9454bd04-390b-4543-8ea0-dfec07040414 service nova] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Updating instance_info_cache with network_info: [{"id": "92d5f230-38cf-4dd3-a8d7-2d0781af30e0", "address": "fa:16:3e:f7:03:55", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d5f230-38", "ovs_interfaceid": "92d5f230-38cf-4dd3-a8d7-2d0781af30e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:47:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-66039bb1-fd29-4856-aa7b-e876302c7736 req-9454bd04-390b-4543-8ea0-dfec07040414 service nova] Releasing lock "refresh_cache-500e2717-d77c-4e1a-98d3-47c9326fdd0f" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:47:32 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "500e2717-d77c-4e1a-98d3-47c9326fdd0f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "500e2717-d77c-4e1a-98d3-47c9326fdd0f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "500e2717-d77c-4e1a-98d3-47c9326fdd0f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "500e2717-d77c-4e1a-98d3-47c9326fdd0f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "500e2717-d77c-4e1a-98d3-47c9326fdd0f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:47:33 user nova-compute[74348]: INFO nova.compute.manager [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Terminating instance
Nov 22 08:47:33 user nova-compute[74348]: DEBUG nova.compute.manager [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG nova.compute.manager [req-f5cf41f6-03f4-48e6-aa99-bb3810aab7dd req-9ed66b67-419c-4b61-aa63-7c1a29fecc5d service nova] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Received event network-changed-92d5f230-38cf-4dd3-a8d7-2d0781af30e0 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG nova.compute.manager [req-f5cf41f6-03f4-48e6-aa99-bb3810aab7dd req-9ed66b67-419c-4b61-aa63-7c1a29fecc5d service nova] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Refreshing instance network info cache due to event network-changed-92d5f230-38cf-4dd3-a8d7-2d0781af30e0. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f5cf41f6-03f4-48e6-aa99-bb3810aab7dd req-9ed66b67-419c-4b61-aa63-7c1a29fecc5d service nova] Acquiring lock "refresh_cache-500e2717-d77c-4e1a-98d3-47c9326fdd0f" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f5cf41f6-03f4-48e6-aa99-bb3810aab7dd req-9ed66b67-419c-4b61-aa63-7c1a29fecc5d service nova] Acquired lock "refresh_cache-500e2717-d77c-4e1a-98d3-47c9326fdd0f" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG nova.network.neutron [req-f5cf41f6-03f4-48e6-aa99-bb3810aab7dd req-9ed66b67-419c-4b61-aa63-7c1a29fecc5d service nova] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Refreshing network info cache for port 92d5f230-38cf-4dd3-a8d7-2d0781af30e0 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:47:33 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Instance destroyed successfully.
Nov 22 08:47:33 user nova-compute[74348]: DEBUG nova.objects.instance [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lazy-loading 'resources' on Instance uuid 500e2717-d77c-4e1a-98d3-47c9326fdd0f {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-67076410',display_name='tempest-TestVolumeBootPattern-server-67076410',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-67076410',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5q5hQzMSuk+sNGJnDRmtWK/6BKD87prla8huISA+ZthbmLQtye643HeDBlLY9Mo3uF5oVpKXrTj1o4wta3IDeKU9ciPV2epUfA3DB6baSC2/EpV7k8Mbb5IhAko6F/ug==',key_name='tempest-TestVolumeBootPattern-944686512',keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:45:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1a81615aef8948718005d104403e260e',ramdisk_id='',reservation_id='r-hnieme5q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1316917970',owner_user_name='tempest-TestVolumeBootPattern-1316917970-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T08:45:51Z,user_data=None,user_id='b510235916f547b8b0f5c3c150fe9dac',uuid=500e2717-d77c-4e1a-98d3-47c9326fdd0f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92d5f230-38cf-4dd3-a8d7-2d0781af30e0", "address": "fa:16:3e:f7:03:55", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d5f230-38", "ovs_interfaceid": "92d5f230-38cf-4dd3-a8d7-2d0781af30e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Converting VIF {"id": "92d5f230-38cf-4dd3-a8d7-2d0781af30e0", "address": "fa:16:3e:f7:03:55", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d5f230-38", "ovs_interfaceid": "92d5f230-38cf-4dd3-a8d7-2d0781af30e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:03:55,bridge_name='br-int',has_traffic_filtering=True,id=92d5f230-38cf-4dd3-a8d7-2d0781af30e0,network=Network(aed76530-d78f-4747-ba48-e5a0eed6ef6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92d5f230-38') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG os_vif [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:03:55,bridge_name='br-int',has_traffic_filtering=True,id=92d5f230-38cf-4dd3-a8d7-2d0781af30e0,network=Network(aed76530-d78f-4747-ba48-e5a0eed6ef6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92d5f230-38') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap92d5f230-38, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b174eb91-b257-4695-9eaa-aad0823f7a6a) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:47:33 user nova-compute[74348]: INFO os_vif [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:03:55,bridge_name='br-int',has_traffic_filtering=True,id=92d5f230-38cf-4dd3-a8d7-2d0781af30e0,network=Network(aed76530-d78f-4747-ba48-e5a0eed6ef6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92d5f230-38')
Nov 22 08:47:33 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LwKrJqeM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:47:33 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:47:33 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e533be1a-054c-4da7-a903-d7fb9f6bcfda]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 08:47:33 user nova-compute[74348]: No targets found.
Nov 22 08:47:33 user nova-compute[74348]: iSNS:
Nov 22 08:47:33 user nova-compute[74348]: No targets found.
Nov 22 08:47:33 user nova-compute[74348]: STATIC:
Nov 22 08:47:33 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3
Nov 22 08:47:33 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:47:33 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:47:33 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574
Nov 22 08:47:33 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:47:33 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:47:33 user nova-compute[74348]: FIRMWARE:
Nov 22 08:47:33 user nova-compute[74348]: No targets found.
Nov 22 08:47:33 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 08:47:33 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 08:47:33 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e89865-6f35-4a2f-aa19-f0b968d15414]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9af82f0-4282-4da7-8f07-c80ac4fe6f35]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 (non-flash)
Nov 22 08:47:33 user nova-compute[74348]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574 (non-flash)
Nov 22 08:47:33 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 (non-flash)
Nov 22 08:47:33 user nova-compute[74348]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574 (non-flash)
Nov 22 08:47:33 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f222832bd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574'): ({'sdc'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Removing single pathed devices sdc {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[183fde9f-6535-435a-a8fa-e5f943e1a529]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG nova.network.neutron [req-f5cf41f6-03f4-48e6-aa99-bb3810aab7dd req-9ed66b67-419c-4b61-aa63-7c1a29fecc5d service nova] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Updated VIF entry in instance network info cache for port 92d5f230-38cf-4dd3-a8d7-2d0781af30e0. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG nova.network.neutron [req-f5cf41f6-03f4-48e6-aa99-bb3810aab7dd req-9ed66b67-419c-4b61-aa63-7c1a29fecc5d service nova] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Updating instance_info_cache with network_info: [{"id": "92d5f230-38cf-4dd3-a8d7-2d0781af30e0", "address": "fa:16:3e:f7:03:55", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d5f230-38", "ovs_interfaceid": "92d5f230-38cf-4dd3-a8d7-2d0781af30e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc07d60-7d09-420e-bc93-238a5cabdd17]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Flushing IO for device /dev/sdc {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f5cf41f6-03f4-48e6-aa99-bb3810aab7dd req-9ed66b67-419c-4b61-aa63-7c1a29fecc5d service nova] Releasing lock "refresh_cache-500e2717-d77c-4e1a-98d3-47c9326fdd0f" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG nova.compute.manager [req-f5cf41f6-03f4-48e6-aa99-bb3810aab7dd req-9ed66b67-419c-4b61-aa63-7c1a29fecc5d service nova] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Received event network-vif-unplugged-92d5f230-38cf-4dd3-a8d7-2d0781af30e0 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f5cf41f6-03f4-48e6-aa99-bb3810aab7dd req-9ed66b67-419c-4b61-aa63-7c1a29fecc5d service nova] Acquiring lock "500e2717-d77c-4e1a-98d3-47c9326fdd0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f5cf41f6-03f4-48e6-aa99-bb3810aab7dd req-9ed66b67-419c-4b61-aa63-7c1a29fecc5d service nova] Lock "500e2717-d77c-4e1a-98d3-47c9326fdd0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-f5cf41f6-03f4-48e6-aa99-bb3810aab7dd req-9ed66b67-419c-4b61-aa63-7c1a29fecc5d service nova] Lock "500e2717-d77c-4e1a-98d3-47c9326fdd0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG nova.compute.manager [req-f5cf41f6-03f4-48e6-aa99-bb3810aab7dd req-9ed66b67-419c-4b61-aa63-7c1a29fecc5d service nova] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] No waiting events found dispatching network-vif-unplugged-92d5f230-38cf-4dd3-a8d7-2d0781af30e0 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG nova.compute.manager [req-f5cf41f6-03f4-48e6-aa99-bb3810aab7dd req-9ed66b67-419c-4b61-aa63-7c1a29fecc5d service nova] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Received event network-vif-unplugged-92d5f230-38cf-4dd3-a8d7-2d0781af30e0 for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2826e881-5349-425b-b420-f8b0c6420575]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 08:47:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:47:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.074s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:47:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff02462-20ae-49a7-8336-c38ac872259e]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:47:34 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 08:47:34 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] SCSI volumes sdc have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 08:47:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 08:47:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:47:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:47:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7a0e01-83be-4921-a9bf-5f16f3ebf332]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:47:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:47:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574 -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:47:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:47:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed516de0-7636-4233-96ce-f88bb015bb26]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:47:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574, portal: 172.16.0.220,3260]
Nov 22 08:47:34 user nova-compute[74348]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574, portal: 172.16.0.220,3260] successful.
Nov 22 08:47:34 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:47:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574 -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:47:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85eb66d5-8b81-483d-ba7c-eae5ddfe6574 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:47:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9442a1-5a7f-49b6-accd-b1a7ff3aacb5]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:47:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:47:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:47:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] <== disconnect_volume: return (343ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:47:34 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 08:47:34 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Deleting instance files /opt/stack/data/nova/instances/500e2717-d77c-4e1a-98d3-47c9326fdd0f_del
Nov 22 08:47:34 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Deletion of /opt/stack/data/nova/instances/500e2717-d77c-4e1a-98d3-47c9326fdd0f_del complete
Nov 22 08:47:34 user nova-compute[74348]: INFO nova.compute.manager [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 22 08:47:34 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 08:47:34 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 08:47:34 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 08:47:34 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:47:34 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Took 0.41 seconds to deallocate network for instance.
Nov 22 08:47:35 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:47:35 user nova-compute[74348]: DEBUG nova.compute.manager [req-7a46fbc8-41d5-4b77-9f9e-4b744c6876a1 req-eb936dee-7484-45a8-8961-a8d032ae9d16 service nova] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Received event network-vif-plugged-92d5f230-38cf-4dd3-a8d7-2d0781af30e0 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:47:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-7a46fbc8-41d5-4b77-9f9e-4b744c6876a1 req-eb936dee-7484-45a8-8961-a8d032ae9d16 service nova] Acquiring lock "500e2717-d77c-4e1a-98d3-47c9326fdd0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:47:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-7a46fbc8-41d5-4b77-9f9e-4b744c6876a1 req-eb936dee-7484-45a8-8961-a8d032ae9d16 service nova] Lock "500e2717-d77c-4e1a-98d3-47c9326fdd0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:47:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-7a46fbc8-41d5-4b77-9f9e-4b744c6876a1 req-eb936dee-7484-45a8-8961-a8d032ae9d16 service nova] Lock "500e2717-d77c-4e1a-98d3-47c9326fdd0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:47:35 user nova-compute[74348]: DEBUG nova.compute.manager [req-7a46fbc8-41d5-4b77-9f9e-4b744c6876a1 req-eb936dee-7484-45a8-8961-a8d032ae9d16 service nova] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] No waiting events found dispatching network-vif-plugged-92d5f230-38cf-4dd3-a8d7-2d0781af30e0 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:47:35 user nova-compute[74348]: WARNING nova.compute.manager [req-7a46fbc8-41d5-4b77-9f9e-4b744c6876a1 req-eb936dee-7484-45a8-8961-a8d032ae9d16 service nova] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Received unexpected event network-vif-plugged-92d5f230-38cf-4dd3-a8d7-2d0781af30e0 for instance with vm_state active and task_state deleting.
Nov 22 08:47:35 user nova-compute[74348]: DEBUG nova.compute.manager [req-7a46fbc8-41d5-4b77-9f9e-4b744c6876a1 req-eb936dee-7484-45a8-8961-a8d032ae9d16 service nova] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Received event network-vif-deleted-92d5f230-38cf-4dd3-a8d7-2d0781af30e0 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:47:35 user nova-compute[74348]: INFO nova.compute.manager [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 500e2717-d77c-4e1a-98d3-47c9326fdd0f] Took 0.88 seconds to detach 1 volumes for instance.
Nov 22 08:47:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:47:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:47:35 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:47:35 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:47:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.146s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:47:35 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Deleted allocations for instance 500e2717-d77c-4e1a-98d3-47c9326fdd0f
Nov 22 08:47:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-03bf5f74-9b98-4f71-9123-58405b2aaa67 tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "500e2717-d77c-4e1a-98d3-47c9326fdd0f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.878s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:47:38 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:47:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:47:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:47:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:47:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:47:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:47:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:47:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:47:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:47:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:47:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:48:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:48:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:48:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:48:17 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:48:17 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:48:17 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Rebuilding the list of instances to heal {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 08:48:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:48:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:48:17 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 08:48:17 user nova-compute[74348]: DEBUG nova.objects.instance [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lazy-loading 'info_cache' on Instance uuid 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:48:18 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Updating instance_info_cache with network_info: [{"id": "a79d46c5-8157-4754-9670-ddc05eeb22c3", "address": "fa:16:3e:28:06:cb", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa79d46c5-81", "ovs_interfaceid": "a79d46c5-8157-4754-9670-ddc05eeb22c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:48:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:48:18 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 08:48:18 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:48:18 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:48:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:48:22 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:48:23 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:48:23 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:48:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:48:26 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:48:27 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:48:28 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:48:28 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:48:28 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:48:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:48:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:48:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:48:28 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:48:28 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:48:29 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:48:29 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:48:29 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:48:29 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=9035MB free_disk=24.869400024414062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:48:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:48:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:48:29 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:48:29 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:48:29 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:48:29 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:48:29 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:48:29 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:48:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:48:30 user nova-compute[74348]: DEBUG nova.compute.manager [req-9e721192-aac9-4d95-b06e-cd9027998eac req-a0a16ddc-551f-4e76-88b9-cfd47c8cc314 service nova] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Received event network-changed-a79d46c5-8157-4754-9670-ddc05eeb22c3 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:48:30 user nova-compute[74348]: DEBUG nova.compute.manager [req-9e721192-aac9-4d95-b06e-cd9027998eac req-a0a16ddc-551f-4e76-88b9-cfd47c8cc314 service nova] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Refreshing instance network info cache due to event network-changed-a79d46c5-8157-4754-9670-ddc05eeb22c3. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:48:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9e721192-aac9-4d95-b06e-cd9027998eac req-a0a16ddc-551f-4e76-88b9-cfd47c8cc314 service nova] Acquiring lock "refresh_cache-1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:48:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9e721192-aac9-4d95-b06e-cd9027998eac req-a0a16ddc-551f-4e76-88b9-cfd47c8cc314 service nova] Acquired lock "refresh_cache-1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:48:30 user nova-compute[74348]: DEBUG nova.network.neutron [req-9e721192-aac9-4d95-b06e-cd9027998eac req-a0a16ddc-551f-4e76-88b9-cfd47c8cc314 service nova] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Refreshing network info cache for port a79d46c5-8157-4754-9670-ddc05eeb22c3 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:48:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:48:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:48:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:48:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:48:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:48:30 user nova-compute[74348]: INFO nova.compute.manager [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Terminating instance
Nov 22 08:48:30 user nova-compute[74348]: DEBUG nova.compute.manager [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 08:48:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:48:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:48:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:48:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:48:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:48:30 user nova-compute[74348]: DEBUG nova.compute.manager [req-30267e00-55f5-4b2d-8406-b1a62f0bc843 req-599b128e-4993-4abc-a606-5ba507461e86 service nova] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Received event network-vif-unplugged-a79d46c5-8157-4754-9670-ddc05eeb22c3 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:48:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-30267e00-55f5-4b2d-8406-b1a62f0bc843 req-599b128e-4993-4abc-a606-5ba507461e86 service nova] Acquiring lock "1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:48:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-30267e00-55f5-4b2d-8406-b1a62f0bc843 req-599b128e-4993-4abc-a606-5ba507461e86 service nova] Lock "1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:48:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-30267e00-55f5-4b2d-8406-b1a62f0bc843 req-599b128e-4993-4abc-a606-5ba507461e86 service nova] Lock "1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:48:30 user nova-compute[74348]: DEBUG nova.compute.manager [req-30267e00-55f5-4b2d-8406-b1a62f0bc843 req-599b128e-4993-4abc-a606-5ba507461e86 service nova] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] No waiting events found dispatching network-vif-unplugged-a79d46c5-8157-4754-9670-ddc05eeb22c3 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:48:30 user nova-compute[74348]: DEBUG nova.compute.manager [req-30267e00-55f5-4b2d-8406-b1a62f0bc843 req-599b128e-4993-4abc-a606-5ba507461e86 service nova] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Received event network-vif-unplugged-a79d46c5-8157-4754-9670-ddc05eeb22c3 for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 08:48:30 user nova-compute[74348]: DEBUG nova.network.neutron [req-9e721192-aac9-4d95-b06e-cd9027998eac req-a0a16ddc-551f-4e76-88b9-cfd47c8cc314 service nova] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Updated VIF entry in instance network info cache for port a79d46c5-8157-4754-9670-ddc05eeb22c3. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:48:30 user nova-compute[74348]: DEBUG nova.network.neutron [req-9e721192-aac9-4d95-b06e-cd9027998eac req-a0a16ddc-551f-4e76-88b9-cfd47c8cc314 service nova] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Updating instance_info_cache with network_info: [{"id": "a79d46c5-8157-4754-9670-ddc05eeb22c3", "address": "fa:16:3e:28:06:cb", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa79d46c5-81", "ovs_interfaceid": "a79d46c5-8157-4754-9670-ddc05eeb22c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:48:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-9e721192-aac9-4d95-b06e-cd9027998eac req-a0a16ddc-551f-4e76-88b9-cfd47c8cc314 service nova] Releasing lock "refresh_cache-1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:48:31 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Instance destroyed successfully.
Nov 22 08:48:31 user nova-compute[74348]: DEBUG nova.objects.instance [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lazy-loading 'resources' on Instance uuid 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:43:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1976686305',display_name='tempest-TestVolumeBootPattern-server-1976686305',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1976686305',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5q5hQzMSuk+sNGJnDRmtWK/6BKD87prla8huISA+ZthbmLQtye643HeDBlLY9Mo3uF5oVpKXrTj1o4wta3IDeKU9ciPV2epUfA3DB6baSC2/EpV7k8Mbb5IhAko6F/ug==',key_name='tempest-TestVolumeBootPattern-944686512',keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:43:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1a81615aef8948718005d104403e260e',ramdisk_id='',reservation_id='r-7echdp9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1316917970',owner_user_name='tempest-TestVolumeBootPattern-1316917970-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T08:43:53Z,user_data=None,user_id='b510235916f547b8b0f5c3c150fe9dac',uuid=1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a79d46c5-8157-4754-9670-ddc05eeb22c3", "address": "fa:16:3e:28:06:cb", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa79d46c5-81", "ovs_interfaceid": "a79d46c5-8157-4754-9670-ddc05eeb22c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Converting VIF {"id": "a79d46c5-8157-4754-9670-ddc05eeb22c3", "address": "fa:16:3e:28:06:cb", "network": {"id": "aed76530-d78f-4747-ba48-e5a0eed6ef6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1920449423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a81615aef8948718005d104403e260e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa79d46c5-81", "ovs_interfaceid": "a79d46c5-8157-4754-9670-ddc05eeb22c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:06:cb,bridge_name='br-int',has_traffic_filtering=True,id=a79d46c5-8157-4754-9670-ddc05eeb22c3,network=Network(aed76530-d78f-4747-ba48-e5a0eed6ef6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa79d46c5-81') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG os_vif [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:06:cb,bridge_name='br-int',has_traffic_filtering=True,id=a79d46c5-8157-4754-9670-ddc05eeb22c3,network=Network(aed76530-d78f-4747-ba48-e5a0eed6ef6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa79d46c5-81') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa79d46c5-81, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e3736404-e825-4920-a006-e2907094a930) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:48:31 user nova-compute[74348]: INFO os_vif [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:06:cb,bridge_name='br-int',has_traffic_filtering=True,id=a79d46c5-8157-4754-9670-ddc05eeb22c3,network=Network(aed76530-d78f-4747-ba48-e5a0eed6ef6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa79d46c5-81')
Nov 22 08:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjmMCGTz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:48:31 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:48:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[05268cb7-f4e5-400f-a9ee-876d211c156b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 08:48:31 user nova-compute[74348]: No targets found.
Nov 22 08:48:31 user nova-compute[74348]: iSNS:
Nov 22 08:48:31 user nova-compute[74348]: No targets found.
Nov 22 08:48:31 user nova-compute[74348]: STATIC:
Nov 22 08:48:31 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3
Nov 22 08:48:31 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:48:31 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:48:31 user nova-compute[74348]: FIRMWARE:
Nov 22 08:48:31 user nova-compute[74348]: No targets found.
Nov 22 08:48:31 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 08:48:31 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 08:48:31 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e8fa0b-93f8-43be-a8b1-2f4044510482]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff301621-90ba-41fd-8f93-5cc15f85e094]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 (non-flash)
Nov 22 08:48:31 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 (non-flash)
Nov 22 08:48:31 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f224c691ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3'): ({'sdb'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Removing single pathed devices sdb {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b1eb61-4558-403f-810f-72dd8d0d882e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebd7955-dfde-4d6f-a035-dc36601a23a2]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Flushing IO for device /dev/sdb {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cf07bb-3b29-43d4-a05d-27975c670080]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[02801b25-f21b-45e3-9059-eb818dfe9eda]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] SCSI volumes sdb have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c23816-f14d-4f84-b808-85dbebb02e7d]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aab0e47-b7f7-4d0c-90d0-30e9f964e8bb]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3, portal: 172.16.0.220,3260]
Nov 22 08:48:31 user nova-compute[74348]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3, portal: 172.16.0.220,3260] successful.
Nov 22 08:48:31 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ef4422-cdac-49d6-a0ae-a737355ef4c3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdafdc04-3f45-4729-aa14-23b980f4c0d1]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] <== disconnect_volume: return (334ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 08:48:31 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Deleting instance files /opt/stack/data/nova/instances/1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b_del
Nov 22 08:48:31 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Deletion of /opt/stack/data/nova/instances/1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b_del complete
Nov 22 08:48:31 user nova-compute[74348]: INFO nova.compute.manager [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 22 08:48:31 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 08:48:31 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 08:48:32 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:48:32 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Took 0.42 seconds to deallocate network for instance.
Nov 22 08:48:32 user nova-compute[74348]: DEBUG nova.compute.manager [req-a3d7622d-9a45-43bf-97b3-47ebaf05b625 req-6f8966fe-1340-47f1-b5c8-f1772335d50f service nova] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Received event network-vif-deleted-a79d46c5-8157-4754-9670-ddc05eeb22c3 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:48:32 user nova-compute[74348]: DEBUG nova.compute.manager [req-b6ad03db-21a7-4732-a644-583b97c3c5b2 req-7010ad55-89e8-46e6-befc-daedc24d604d service nova] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Received event network-vif-plugged-a79d46c5-8157-4754-9670-ddc05eeb22c3 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:48:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b6ad03db-21a7-4732-a644-583b97c3c5b2 req-7010ad55-89e8-46e6-befc-daedc24d604d service nova] Acquiring lock "1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:48:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b6ad03db-21a7-4732-a644-583b97c3c5b2 req-7010ad55-89e8-46e6-befc-daedc24d604d service nova] Lock "1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:48:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-b6ad03db-21a7-4732-a644-583b97c3c5b2 req-7010ad55-89e8-46e6-befc-daedc24d604d service nova] Lock "1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:48:32 user nova-compute[74348]: DEBUG nova.compute.manager [req-b6ad03db-21a7-4732-a644-583b97c3c5b2 req-7010ad55-89e8-46e6-befc-daedc24d604d service nova] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] No waiting events found dispatching network-vif-plugged-a79d46c5-8157-4754-9670-ddc05eeb22c3 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:48:32 user nova-compute[74348]: WARNING nova.compute.manager [req-b6ad03db-21a7-4732-a644-583b97c3c5b2 req-7010ad55-89e8-46e6-befc-daedc24d604d service nova] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Received unexpected event network-vif-plugged-a79d46c5-8157-4754-9670-ddc05eeb22c3 for instance with vm_state active and task_state deleting.
Nov 22 08:48:32 user nova-compute[74348]: INFO nova.compute.manager [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] [instance: 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b] Took 0.74 seconds to detach 1 volumes for instance.
Nov 22 08:48:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:48:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:48:33 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:48:33 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:48:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.119s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:48:33 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Deleted allocations for instance 1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b
Nov 22 08:48:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-e5d028c8-66b7-496b-b841-61f11033f4cc tempest-TestVolumeBootPattern-1316917970 tempest-TestVolumeBootPattern-1316917970-project-member] Lock "1ab1bca1-cbc2-4de2-abc1-bf3b9626f27b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.676s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:48:36 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:48:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:48:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:48:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:48:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:48:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:48:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:48:46 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:48:51 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:48:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:49:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:49:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:49:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:49:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:49:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:49:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:49:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:49:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:49:13 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:49:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:49:17 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:49:19 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:49:19 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:49:19 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Rebuilding the list of instances to heal {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 08:49:19 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Didn't find any instances for network info cache update. {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 08:49:19 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:49:21 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:49:22 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:49:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:49:25 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:49:26 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:49:27 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:49:28 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:49:28 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:49:30 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:49:30 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:49:30 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:49:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:49:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:49:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:49:30 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:49:30 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:49:30 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:49:30 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=9167MB free_disk=24.8681640625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:49:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:49:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:49:30 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:49:30 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:49:30 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Refreshing inventories for resource provider 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 22 08:49:31 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Updating ProviderTree inventory for provider 52690f6a-773f-4e8d-be85-d278b6522975 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 22 08:49:31 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Updating inventory in ProviderTree for provider 52690f6a-773f-4e8d-be85-d278b6522975 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 22 08:49:31 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Refreshing aggregate associations for resource provider 52690f6a-773f-4e8d-be85-d278b6522975, aggregates: None {{(pid=74348) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 22 08:49:31 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Refreshing trait associations for resource provider 52690f6a-773f-4e8d-be85-d278b6522975, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=74348) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 22 08:49:31 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:49:31 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:49:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:49:31 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:49:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.260s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:49:31 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:49:36 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:49:39 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:49:41 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:49:43 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:49:43 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Cleaning up deleted instances {{(pid=74348) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 22 08:49:43 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] There are 0 instances to clean {{(pid=74348) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 22 08:49:46 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:49:48 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:49:48 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74348) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 22 08:49:51 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:49:56 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:49:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:50:00 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:50:00 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:50:01 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:50:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:50:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:50:06 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:50:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:50:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:50:11 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:50:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Acquiring lock "94a78a45-c802-4df9-aa62-86209a7d833a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:50:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "94a78a45-c802-4df9-aa62-86209a7d833a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:50:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:50:15 user nova-compute[74348]: DEBUG nova.compute.manager [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Starting instance... {{(pid=74348) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 08:50:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:50:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:50:15 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74348) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 08:50:15 user nova-compute[74348]: INFO nova.compute.claims [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Claim successful on node user
Nov 22 08:50:15 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:50:15 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:50:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.242s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:50:15 user nova-compute[74348]: DEBUG nova.compute.manager [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Start building networks asynchronously for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 08:50:15 user nova-compute[74348]: DEBUG nova.compute.manager [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Allocating IP information in the background. {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 08:50:15 user nova-compute[74348]: DEBUG nova.network.neutron [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] allocate_for_instance() {{(pid=74348) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 08:50:15 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 08:50:15 user nova-compute[74348]: DEBUG nova.compute.manager [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Start building block device mappings for instance. {{(pid=74348) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 08:50:15 user nova-compute[74348]: DEBUG nova.compute.manager [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Start spawning the instance on the hypervisor. {{(pid=74348) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 08:50:15 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Creating instance directory {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 08:50:15 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Creating image(s)
Nov 22 08:50:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Acquiring lock "/opt/stack/data/nova/instances/94a78a45-c802-4df9-aa62-86209a7d833a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:50:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "/opt/stack/data/nova/instances/94a78a45-c802-4df9-aa62-86209a7d833a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:50:15 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "/opt/stack/data/nova/instances/94a78a45-c802-4df9-aa62-86209a7d833a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:50:15 user nova-compute[74348]: DEBUG nova.policy [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fafb3a3776c243c59cce7c5ecba11172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b921bea0c3c49afa681bb8860438aa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74348) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 08:50:15 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:50:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.231s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:50:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Acquiring lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:50:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:50:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:50:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.194s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:50:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/94a78a45-c802-4df9-aa62-86209a7d833a/disk 1073741824 {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:50:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263,backing_fmt=raw /opt/stack/data/nova/instances/94a78a45-c802-4df9-aa62-86209a7d833a/disk 1073741824" returned: 0 in 0.058s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:50:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "98e1a2fcccec982a0896b68bf8d9d2efe3433263" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:50:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:50:16 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:50:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98e1a2fcccec982a0896b68bf8d9d2efe3433263 --force-share --output=json" returned: 0 in 0.207s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:50:16 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Checking if we can resize image /opt/stack/data/nova/instances/94a78a45-c802-4df9-aa62-86209a7d833a/disk. size=1073741824 {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 08:50:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a78a45-c802-4df9-aa62-86209a7d833a/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:50:16 user nova-compute[74348]: DEBUG nova.network.neutron [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Successfully created port: 92a9e823-5e7d-4c34-922b-130f1f35aa27 {{(pid=74348) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 08:50:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a78a45-c802-4df9-aa62-86209a7d833a/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:50:16 user nova-compute[74348]: DEBUG nova.virt.disk.api [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Cannot resize image /opt/stack/data/nova/instances/94a78a45-c802-4df9-aa62-86209a7d833a/disk to a smaller size. {{(pid=74348) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 08:50:16 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Created local disks {{(pid=74348) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 08:50:16 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Ensure instance console log exists: /opt/stack/data/nova/instances/94a78a45-c802-4df9-aa62-86209a7d833a/console.log {{(pid=74348) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 08:50:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:50:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:50:16 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:50:17 user nova-compute[74348]: DEBUG nova.network.neutron [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Successfully updated port: 92a9e823-5e7d-4c34-922b-130f1f35aa27 {{(pid=74348) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 08:50:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Acquiring lock "refresh_cache-94a78a45-c802-4df9-aa62-86209a7d833a" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:50:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Acquired lock "refresh_cache-94a78a45-c802-4df9-aa62-86209a7d833a" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:50:17 user nova-compute[74348]: DEBUG nova.network.neutron [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Building network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 08:50:17 user nova-compute[74348]: DEBUG nova.compute.manager [req-e709d303-5e48-4454-80fa-3133a4bfed0f req-c252f1a2-828a-4b39-8192-55e033060f73 service nova] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Received event network-changed-92a9e823-5e7d-4c34-922b-130f1f35aa27 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:50:17 user nova-compute[74348]: DEBUG nova.compute.manager [req-e709d303-5e48-4454-80fa-3133a4bfed0f req-c252f1a2-828a-4b39-8192-55e033060f73 service nova] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Refreshing instance network info cache due to event network-changed-92a9e823-5e7d-4c34-922b-130f1f35aa27. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:50:17 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e709d303-5e48-4454-80fa-3133a4bfed0f req-c252f1a2-828a-4b39-8192-55e033060f73 service nova] Acquiring lock "refresh_cache-94a78a45-c802-4df9-aa62-86209a7d833a" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:50:17 user nova-compute[74348]: DEBUG nova.network.neutron [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Instance cache missing network info. {{(pid=74348) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 08:50:17 user nova-compute[74348]: DEBUG nova.network.neutron [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Updating instance_info_cache with network_info: [{"id": "92a9e823-5e7d-4c34-922b-130f1f35aa27", "address": "fa:16:3e:6a:be:ae", "network": {"id": "8b432d85-b70b-4445-a161-89a54b510566", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1533482890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b921bea0c3c49afa681bb8860438aa6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a9e823-5e", "ovs_interfaceid": "92a9e823-5e7d-4c34-922b-130f1f35aa27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Releasing lock "refresh_cache-94a78a45-c802-4df9-aa62-86209a7d833a" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG nova.compute.manager [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Instance network_info: |[{"id": "92a9e823-5e7d-4c34-922b-130f1f35aa27", "address": "fa:16:3e:6a:be:ae", "network": {"id": "8b432d85-b70b-4445-a161-89a54b510566", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1533482890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b921bea0c3c49afa681bb8860438aa6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a9e823-5e", "ovs_interfaceid": "92a9e823-5e7d-4c34-922b-130f1f35aa27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74348) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e709d303-5e48-4454-80fa-3133a4bfed0f req-c252f1a2-828a-4b39-8192-55e033060f73 service nova] Acquired lock "refresh_cache-94a78a45-c802-4df9-aa62-86209a7d833a" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG nova.network.neutron [req-e709d303-5e48-4454-80fa-3133a4bfed0f req-c252f1a2-828a-4b39-8192-55e033060f73 service nova] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Refreshing network info cache for port 92a9e823-5e7d-4c34-922b-130f1f35aa27 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Start _get_guest_xml network_info=[{"id": "92a9e823-5e7d-4c34-922b-130f1f35aa27", "address": "fa:16:3e:6a:be:ae", "network": {"id": "8b432d85-b70b-4445-a161-89a54b510566", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1533482890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b921bea0c3c49afa681bb8860438aa6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a9e823-5e", "ovs_interfaceid": "92a9e823-5e7d-4c34-922b-130f1f35aa27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '7abe07a9-4f70-41a1-a0fc-c06f9c8dd109'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 08:50:18 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:50:18 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:50:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] CPU controller missing on host. {{(pid=74348) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.host [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] CPU controller found on host. {{(pid=74348) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74348) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T07:48:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T07:48:52Z,direct_url=<?>,disk_format='qcow2',id=7abe07a9-4f70-41a1-a0fc-c06f9c8dd109,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='648389b0c2f64438bdce146d4d816370',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T07:48:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Flavor limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Image limits 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Flavor pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Image pref 0:0:0 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Got 1 possible topologies {{(pid=74348) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG nova.virt.hardware [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74348) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:50:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-447732319',display_name='tempest-SnapshotDataIntegrityTests-server-447732319',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-447732319',id=53,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHynwjZFNG8iUYPQ7MmbyqTwyFWeTKUqN+TiVeO6DCdftqIpcih05uwRW1byAbda9FNE0JS2yhy7RVcMkYyD6dRKdYKT+s3Ha47LlRTSmL5OlUevnwOkjVCQvHz1gZiApQ==',key_name='tempest-keypair-738017072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b921bea0c3c49afa681bb8860438aa6',ramdisk_id='',reservation_id='r-mmi4d0ka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-426804247',owner_user_name='tempest-SnapshotDataIntegrityTests-426804247-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:50:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fafb3a3776c243c59cce7c5ecba11172',uuid=94a78a45-c802-4df9-aa62-86209a7d833a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92a9e823-5e7d-4c34-922b-130f1f35aa27", "address": "fa:16:3e:6a:be:ae", "network": {"id": "8b432d85-b70b-4445-a161-89a54b510566", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1533482890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b921bea0c3c49afa681bb8860438aa6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a9e823-5e", "ovs_interfaceid": "92a9e823-5e7d-4c34-922b-130f1f35aa27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74348) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Converting VIF {"id": "92a9e823-5e7d-4c34-922b-130f1f35aa27", "address": "fa:16:3e:6a:be:ae", "network": {"id": "8b432d85-b70b-4445-a161-89a54b510566", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1533482890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b921bea0c3c49afa681bb8860438aa6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a9e823-5e", "ovs_interfaceid": "92a9e823-5e7d-4c34-922b-130f1f35aa27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:be:ae,bridge_name='br-int',has_traffic_filtering=True,id=92a9e823-5e7d-4c34-922b-130f1f35aa27,network=Network(8b432d85-b70b-4445-a161-89a54b510566),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92a9e823-5e') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG nova.objects.instance [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lazy-loading 'pci_devices' on Instance uuid 94a78a45-c802-4df9-aa62-86209a7d833a {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] End _get_guest_xml xml=<domain type="kvm">
Nov 22 08:50:18 user nova-compute[74348]:   <uuid>94a78a45-c802-4df9-aa62-86209a7d833a</uuid>
Nov 22 08:50:18 user nova-compute[74348]:   <name>instance-00000035</name>
Nov 22 08:50:18 user nova-compute[74348]:   <memory>524288</memory>
Nov 22 08:50:18 user nova-compute[74348]:   <vcpu>1</vcpu>
Nov 22 08:50:18 user nova-compute[74348]:   <metadata>
Nov 22 08:50:18 user nova-compute[74348]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 08:50:18 user nova-compute[74348]:       <nova:package version="0.0.0"/>
Nov 22 08:50:18 user nova-compute[74348]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-447732319</nova:name>
Nov 22 08:50:18 user nova-compute[74348]:       <nova:creationTime>2023-11-22 08:50:18</nova:creationTime>
Nov 22 08:50:18 user nova-compute[74348]:       <nova:flavor name="m1.tiny">
Nov 22 08:50:18 user nova-compute[74348]:         <nova:memory>512</nova:memory>
Nov 22 08:50:18 user nova-compute[74348]:         <nova:disk>1</nova:disk>
Nov 22 08:50:18 user nova-compute[74348]:         <nova:swap>0</nova:swap>
Nov 22 08:50:18 user nova-compute[74348]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 08:50:18 user nova-compute[74348]:         <nova:vcpus>1</nova:vcpus>
Nov 22 08:50:18 user nova-compute[74348]:       </nova:flavor>
Nov 22 08:50:18 user nova-compute[74348]:       <nova:owner>
Nov 22 08:50:18 user nova-compute[74348]:         <nova:user uuid="fafb3a3776c243c59cce7c5ecba11172">tempest-SnapshotDataIntegrityTests-426804247-project-member</nova:user>
Nov 22 08:50:18 user nova-compute[74348]:         <nova:project uuid="9b921bea0c3c49afa681bb8860438aa6">tempest-SnapshotDataIntegrityTests-426804247</nova:project>
Nov 22 08:50:18 user nova-compute[74348]:       </nova:owner>
Nov 22 08:50:18 user nova-compute[74348]:       <nova:root type="image" uuid="7abe07a9-4f70-41a1-a0fc-c06f9c8dd109"/>
Nov 22 08:50:18 user nova-compute[74348]:       <nova:ports>
Nov 22 08:50:18 user nova-compute[74348]:         <nova:port uuid="92a9e823-5e7d-4c34-922b-130f1f35aa27">
Nov 22 08:50:18 user nova-compute[74348]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 22 08:50:18 user nova-compute[74348]:         </nova:port>
Nov 22 08:50:18 user nova-compute[74348]:       </nova:ports>
Nov 22 08:50:18 user nova-compute[74348]:     </nova:instance>
Nov 22 08:50:18 user nova-compute[74348]:   </metadata>
Nov 22 08:50:18 user nova-compute[74348]:   <sysinfo type="smbios">
Nov 22 08:50:18 user nova-compute[74348]:     <system>
Nov 22 08:50:18 user nova-compute[74348]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 08:50:18 user nova-compute[74348]:       <entry name="product">OpenStack Nova</entry>
Nov 22 08:50:18 user nova-compute[74348]:       <entry name="version">0.0.0</entry>
Nov 22 08:50:18 user nova-compute[74348]:       <entry name="serial">94a78a45-c802-4df9-aa62-86209a7d833a</entry>
Nov 22 08:50:18 user nova-compute[74348]:       <entry name="uuid">94a78a45-c802-4df9-aa62-86209a7d833a</entry>
Nov 22 08:50:18 user nova-compute[74348]:       <entry name="family">Virtual Machine</entry>
Nov 22 08:50:18 user nova-compute[74348]:     </system>
Nov 22 08:50:18 user nova-compute[74348]:   </sysinfo>
Nov 22 08:50:18 user nova-compute[74348]:   <os>
Nov 22 08:50:18 user nova-compute[74348]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 08:50:18 user nova-compute[74348]:     <boot dev="hd"/>
Nov 22 08:50:18 user nova-compute[74348]:     <smbios mode="sysinfo"/>
Nov 22 08:50:18 user nova-compute[74348]:   </os>
Nov 22 08:50:18 user nova-compute[74348]:   <features>
Nov 22 08:50:18 user nova-compute[74348]:     <acpi/>
Nov 22 08:50:18 user nova-compute[74348]:     <apic/>
Nov 22 08:50:18 user nova-compute[74348]:     <vmcoreinfo/>
Nov 22 08:50:18 user nova-compute[74348]:   </features>
Nov 22 08:50:18 user nova-compute[74348]:   <clock offset="utc">
Nov 22 08:50:18 user nova-compute[74348]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 08:50:18 user nova-compute[74348]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 08:50:18 user nova-compute[74348]:     <timer name="hpet" present="no"/>
Nov 22 08:50:18 user nova-compute[74348]:   </clock>
Nov 22 08:50:18 user nova-compute[74348]:   <cpu mode="custom" match="exact">
Nov 22 08:50:18 user nova-compute[74348]:     <model>Nehalem</model>
Nov 22 08:50:18 user nova-compute[74348]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 08:50:18 user nova-compute[74348]:   </cpu>
Nov 22 08:50:18 user nova-compute[74348]:   <devices>
Nov 22 08:50:18 user nova-compute[74348]:     <disk type="file" device="disk">
Nov 22 08:50:18 user nova-compute[74348]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 08:50:18 user nova-compute[74348]:       <source file="/opt/stack/data/nova/instances/94a78a45-c802-4df9-aa62-86209a7d833a/disk"/>
Nov 22 08:50:18 user nova-compute[74348]:       <target dev="vda" bus="virtio"/>
Nov 22 08:50:18 user nova-compute[74348]:     </disk>
Nov 22 08:50:18 user nova-compute[74348]:     <interface type="ethernet">
Nov 22 08:50:18 user nova-compute[74348]:       <mac address="fa:16:3e:6a:be:ae"/>
Nov 22 08:50:18 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:50:18 user nova-compute[74348]:       <mtu size="1442"/>
Nov 22 08:50:18 user nova-compute[74348]:       <target dev="tap92a9e823-5e"/>
Nov 22 08:50:18 user nova-compute[74348]:     </interface>
Nov 22 08:50:18 user nova-compute[74348]:     <serial type="pty">
Nov 22 08:50:18 user nova-compute[74348]:       <log file="/opt/stack/data/nova/instances/94a78a45-c802-4df9-aa62-86209a7d833a/console.log" append="off"/>
Nov 22 08:50:18 user nova-compute[74348]:     </serial>
Nov 22 08:50:18 user nova-compute[74348]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 08:50:18 user nova-compute[74348]:     <video>
Nov 22 08:50:18 user nova-compute[74348]:       <model type="virtio"/>
Nov 22 08:50:18 user nova-compute[74348]:     </video>
Nov 22 08:50:18 user nova-compute[74348]:     <rng model="virtio">
Nov 22 08:50:18 user nova-compute[74348]:       <backend model="random">/dev/urandom</backend>
Nov 22 08:50:18 user nova-compute[74348]:     </rng>
Nov 22 08:50:18 user nova-compute[74348]:     <controller type="usb" index="0" model="none"/>
Nov 22 08:50:18 user nova-compute[74348]:     <memballoon model="virtio">
Nov 22 08:50:18 user nova-compute[74348]:       <stats period="10"/>
Nov 22 08:50:18 user nova-compute[74348]:     </memballoon>
Nov 22 08:50:18 user nova-compute[74348]:   </devices>
Nov 22 08:50:18 user nova-compute[74348]: </domain>
Nov 22 08:50:18 user nova-compute[74348]:  {{(pid=74348) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:50:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-447732319',display_name='tempest-SnapshotDataIntegrityTests-server-447732319',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-447732319',id=53,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHynwjZFNG8iUYPQ7MmbyqTwyFWeTKUqN+TiVeO6DCdftqIpcih05uwRW1byAbda9FNE0JS2yhy7RVcMkYyD6dRKdYKT+s3Ha47LlRTSmL5OlUevnwOkjVCQvHz1gZiApQ==',key_name='tempest-keypair-738017072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b921bea0c3c49afa681bb8860438aa6',ramdisk_id='',reservation_id='r-mmi4d0ka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-426804247',owner_user_name='tempest-SnapshotDataIntegrityTests-426804247-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T08:50:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fafb3a3776c243c59cce7c5ecba11172',uuid=94a78a45-c802-4df9-aa62-86209a7d833a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92a9e823-5e7d-4c34-922b-130f1f35aa27", "address": "fa:16:3e:6a:be:ae", "network": {"id": "8b432d85-b70b-4445-a161-89a54b510566", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1533482890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b921bea0c3c49afa681bb8860438aa6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a9e823-5e", "ovs_interfaceid": "92a9e823-5e7d-4c34-922b-130f1f35aa27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Converting VIF {"id": "92a9e823-5e7d-4c34-922b-130f1f35aa27", "address": "fa:16:3e:6a:be:ae", "network": {"id": "8b432d85-b70b-4445-a161-89a54b510566", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1533482890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b921bea0c3c49afa681bb8860438aa6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a9e823-5e", "ovs_interfaceid": "92a9e823-5e7d-4c34-922b-130f1f35aa27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:be:ae,bridge_name='br-int',has_traffic_filtering=True,id=92a9e823-5e7d-4c34-922b-130f1f35aa27,network=Network(8b432d85-b70b-4445-a161-89a54b510566),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92a9e823-5e') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG os_vif [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:be:ae,bridge_name='br-int',has_traffic_filtering=True,id=92a9e823-5e7d-4c34-922b-130f1f35aa27,network=Network(8b432d85-b70b-4445-a161-89a54b510566),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92a9e823-5e') {{(pid=74348) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '64093bb4-75b3-5f93-90ff-a3bbce132750', '_type': 'linux-noop'}}, row=False) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap92a9e823-5e, may_exist=True, interface_attrs={}) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap92a9e823-5e, col_values=(('qos', UUID('42164c3f-6d75-4fb8-8a71-b48cf3a970d7')),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap92a9e823-5e, col_values=(('external_ids', {'iface-id': '92a9e823-5e7d-4c34-922b-130f1f35aa27', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:be:ae', 'vm-uuid': '94a78a45-c802-4df9-aa62-86209a7d833a'}),), if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:50:18 user nova-compute[74348]: INFO os_vif [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:be:ae,bridge_name='br-int',has_traffic_filtering=True,id=92a9e823-5e7d-4c34-922b-130f1f35aa27,network=Network(8b432d85-b70b-4445-a161-89a54b510566),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92a9e823-5e')
Nov 22 08:50:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] No VIF found with MAC fa:16:3e:6a:be:ae, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG nova.network.neutron [req-e709d303-5e48-4454-80fa-3133a4bfed0f req-c252f1a2-828a-4b39-8192-55e033060f73 service nova] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Updated VIF entry in instance network info cache for port 92a9e823-5e7d-4c34-922b-130f1f35aa27. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG nova.network.neutron [req-e709d303-5e48-4454-80fa-3133a4bfed0f req-c252f1a2-828a-4b39-8192-55e033060f73 service nova] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Updating instance_info_cache with network_info: [{"id": "92a9e823-5e7d-4c34-922b-130f1f35aa27", "address": "fa:16:3e:6a:be:ae", "network": {"id": "8b432d85-b70b-4445-a161-89a54b510566", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1533482890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b921bea0c3c49afa681bb8860438aa6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a9e823-5e", "ovs_interfaceid": "92a9e823-5e7d-4c34-922b-130f1f35aa27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:50:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e709d303-5e48-4454-80fa-3133a4bfed0f req-c252f1a2-828a-4b39-8192-55e033060f73 service nova] Releasing lock "refresh_cache-94a78a45-c802-4df9-aa62-86209a7d833a" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:50:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:50:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:50:19 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:50:20 user nova-compute[74348]: DEBUG nova.compute.manager [req-00c32a57-807b-4262-ade9-8e692b370169 req-3884c836-076d-4261-b6d9-48980133d8f7 service nova] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Received event network-vif-plugged-92a9e823-5e7d-4c34-922b-130f1f35aa27 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:50:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-00c32a57-807b-4262-ade9-8e692b370169 req-3884c836-076d-4261-b6d9-48980133d8f7 service nova] Acquiring lock "94a78a45-c802-4df9-aa62-86209a7d833a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:50:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-00c32a57-807b-4262-ade9-8e692b370169 req-3884c836-076d-4261-b6d9-48980133d8f7 service nova] Lock "94a78a45-c802-4df9-aa62-86209a7d833a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:50:20 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-00c32a57-807b-4262-ade9-8e692b370169 req-3884c836-076d-4261-b6d9-48980133d8f7 service nova] Lock "94a78a45-c802-4df9-aa62-86209a7d833a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:50:20 user nova-compute[74348]: DEBUG nova.compute.manager [req-00c32a57-807b-4262-ade9-8e692b370169 req-3884c836-076d-4261-b6d9-48980133d8f7 service nova] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] No waiting events found dispatching network-vif-plugged-92a9e823-5e7d-4c34-922b-130f1f35aa27 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:50:20 user nova-compute[74348]: WARNING nova.compute.manager [req-00c32a57-807b-4262-ade9-8e692b370169 req-3884c836-076d-4261-b6d9-48980133d8f7 service nova] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Received unexpected event network-vif-plugged-92a9e823-5e7d-4c34-922b-130f1f35aa27 for instance with vm_state building and task_state spawning.
Nov 22 08:50:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:50:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:50:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:50:21 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:50:21 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:50:21 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Rebuilding the list of instances to heal {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 08:50:21 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Skipping network cache update for instance because it is Building. {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 22 08:50:21 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Didn't find any instances for network info cache update. {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 08:50:21 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:50:22 user nova-compute[74348]: DEBUG nova.compute.manager [req-e2b4e885-b94b-41d6-8489-c50cdba71921 req-9947ebe6-10e3-4ef5-aeea-115b77d1bc53 service nova] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Received event network-vif-plugged-92a9e823-5e7d-4c34-922b-130f1f35aa27 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:50:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e2b4e885-b94b-41d6-8489-c50cdba71921 req-9947ebe6-10e3-4ef5-aeea-115b77d1bc53 service nova] Acquiring lock "94a78a45-c802-4df9-aa62-86209a7d833a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:50:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e2b4e885-b94b-41d6-8489-c50cdba71921 req-9947ebe6-10e3-4ef5-aeea-115b77d1bc53 service nova] Lock "94a78a45-c802-4df9-aa62-86209a7d833a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:50:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-e2b4e885-b94b-41d6-8489-c50cdba71921 req-9947ebe6-10e3-4ef5-aeea-115b77d1bc53 service nova] Lock "94a78a45-c802-4df9-aa62-86209a7d833a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:50:22 user nova-compute[74348]: DEBUG nova.compute.manager [req-e2b4e885-b94b-41d6-8489-c50cdba71921 req-9947ebe6-10e3-4ef5-aeea-115b77d1bc53 service nova] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] No waiting events found dispatching network-vif-plugged-92a9e823-5e7d-4c34-922b-130f1f35aa27 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:50:22 user nova-compute[74348]: WARNING nova.compute.manager [req-e2b4e885-b94b-41d6-8489-c50cdba71921 req-9947ebe6-10e3-4ef5-aeea-115b77d1bc53 service nova] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Received unexpected event network-vif-plugged-92a9e823-5e7d-4c34-922b-130f1f35aa27 for instance with vm_state building and task_state spawning.
Nov 22 08:50:22 user nova-compute[74348]: DEBUG nova.compute.manager [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Instance event wait completed in 0 seconds for  {{(pid=74348) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 08:50:22 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Guest created on hypervisor {{(pid=74348) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 08:50:22 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Instance spawned successfully.
Nov 22 08:50:22 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 08:50:22 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Found default for hw_cdrom_bus of ide {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:50:22 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Found default for hw_disk_bus of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:50:22 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Found default for hw_input_bus of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:50:22 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Found default for hw_pointer_model of None {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:50:22 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Found default for hw_video_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:50:22 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Found default for hw_vif_model of virtio {{(pid=74348) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 08:50:22 user nova-compute[74348]: INFO nova.compute.manager [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Took 6.72 seconds to spawn the instance on the hypervisor.
Nov 22 08:50:22 user nova-compute[74348]: DEBUG nova.compute.manager [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Checking state {{(pid=74348) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 08:50:22 user nova-compute[74348]: INFO nova.compute.manager [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Took 7.48 seconds to build instance.
Nov 22 08:50:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-263777ce-4407-4be1-8288-38eedb5518b7 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "94a78a45-c802-4df9-aa62-86209a7d833a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.600s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:50:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:50:24 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:50:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:50:26 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:50:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:50:28 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:50:29 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:50:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:50:30 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:50:30 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:50:30 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:50:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:50:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:50:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:50:30 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:50:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a78a45-c802-4df9-aa62-86209a7d833a/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:50:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a78a45-c802-4df9-aa62-86209a7d833a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:50:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a78a45-c802-4df9-aa62-86209a7d833a/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:50:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a78a45-c802-4df9-aa62-86209a7d833a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:50:31 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:50:31 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:50:31 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=8848MB free_disk=24.85226058959961GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:50:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:50:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:50:31 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 94a78a45-c802-4df9-aa62-86209a7d833a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:50:31 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:50:31 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:50:31 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:50:31 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:50:31 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:50:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.235s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:50:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:50:35 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:50:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:50:40 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:50:40 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:50:41 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._sync_power_states {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:50:41 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Triggering sync for uuid 94a78a45-c802-4df9-aa62-86209a7d833a {{(pid=74348) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 08:50:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "94a78a45-c802-4df9-aa62-86209a7d833a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:50:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "94a78a45-c802-4df9-aa62-86209a7d833a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:50:41 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "94a78a45-c802-4df9-aa62-86209a7d833a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:50:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:50:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:50:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:50:50 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:50:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:50:55 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:50:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:51:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:51:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:51:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:51:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:51:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:51:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:51:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:51:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:51:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:51:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:51:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:51:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:51:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:51:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:51:20 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:51:21 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:51:22 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:51:22 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:51:22 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Rebuilding the list of instances to heal {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 08:51:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-94a78a45-c802-4df9-aa62-86209a7d833a" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:51:22 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-94a78a45-c802-4df9-aa62-86209a7d833a" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:51:22 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 08:51:22 user nova-compute[74348]: DEBUG nova.objects.instance [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lazy-loading 'info_cache' on Instance uuid 94a78a45-c802-4df9-aa62-86209a7d833a {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:51:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:51:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:51:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:51:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:51:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:51:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:51:23 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Updating instance_info_cache with network_info: [{"id": "92a9e823-5e7d-4c34-922b-130f1f35aa27", "address": "fa:16:3e:6a:be:ae", "network": {"id": "8b432d85-b70b-4445-a161-89a54b510566", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1533482890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b921bea0c3c49afa681bb8860438aa6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a9e823-5e", "ovs_interfaceid": "92a9e823-5e7d-4c34-922b-130f1f35aa27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:51:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-94a78a45-c802-4df9-aa62-86209a7d833a" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:51:23 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 08:51:26 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:51:26 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:51:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:51:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:51:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:51:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:51:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:51:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:51:29 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:51:29 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:51:31 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:51:31 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:51:31 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:51:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:51:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:51:31 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:51:31 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:51:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a78a45-c802-4df9-aa62-86209a7d833a/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:51:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a78a45-c802-4df9-aa62-86209a7d833a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:51:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a78a45-c802-4df9-aa62-86209a7d833a/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:51:31 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a78a45-c802-4df9-aa62-86209a7d833a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:51:32 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:51:32 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:51:32 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=9028MB free_disk=24.822830200195312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:51:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:51:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:51:32 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 94a78a45-c802-4df9-aa62-86209a7d833a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:51:32 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:51:32 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:51:32 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:51:32 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:51:32 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:51:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.327s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:51:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:51:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:51:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:51:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:51:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:51:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:51:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:51:42 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:51:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:51:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:51:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:51:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:51:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:51:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:51:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:51:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:51:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:51:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:51:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:51:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:51:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:51:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:51:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:51:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:51:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:51:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:51:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:51:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:51:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:51:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:51:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:51:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:52:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:52:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:52:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:52:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:52:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:52:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:52:06 user nova-compute[74348]: DEBUG nova.compute.manager [req-cacdbea1-355a-4d61-bbe6-d0161b427824 req-90df6ecd-e049-49ae-b247-02c560920ec9 service nova] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Received event network-changed-92a9e823-5e7d-4c34-922b-130f1f35aa27 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:52:06 user nova-compute[74348]: DEBUG nova.compute.manager [req-cacdbea1-355a-4d61-bbe6-d0161b427824 req-90df6ecd-e049-49ae-b247-02c560920ec9 service nova] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Refreshing instance network info cache due to event network-changed-92a9e823-5e7d-4c34-922b-130f1f35aa27. {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 08:52:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-cacdbea1-355a-4d61-bbe6-d0161b427824 req-90df6ecd-e049-49ae-b247-02c560920ec9 service nova] Acquiring lock "refresh_cache-94a78a45-c802-4df9-aa62-86209a7d833a" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:52:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-cacdbea1-355a-4d61-bbe6-d0161b427824 req-90df6ecd-e049-49ae-b247-02c560920ec9 service nova] Acquired lock "refresh_cache-94a78a45-c802-4df9-aa62-86209a7d833a" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:52:06 user nova-compute[74348]: DEBUG nova.network.neutron [req-cacdbea1-355a-4d61-bbe6-d0161b427824 req-90df6ecd-e049-49ae-b247-02c560920ec9 service nova] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Refreshing network info cache for port 92a9e823-5e7d-4c34-922b-130f1f35aa27 {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 08:52:06 user nova-compute[74348]: DEBUG nova.network.neutron [req-cacdbea1-355a-4d61-bbe6-d0161b427824 req-90df6ecd-e049-49ae-b247-02c560920ec9 service nova] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Updated VIF entry in instance network info cache for port 92a9e823-5e7d-4c34-922b-130f1f35aa27. {{(pid=74348) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 08:52:06 user nova-compute[74348]: DEBUG nova.network.neutron [req-cacdbea1-355a-4d61-bbe6-d0161b427824 req-90df6ecd-e049-49ae-b247-02c560920ec9 service nova] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Updating instance_info_cache with network_info: [{"id": "92a9e823-5e7d-4c34-922b-130f1f35aa27", "address": "fa:16:3e:6a:be:ae", "network": {"id": "8b432d85-b70b-4445-a161-89a54b510566", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1533482890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b921bea0c3c49afa681bb8860438aa6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a9e823-5e", "ovs_interfaceid": "92a9e823-5e7d-4c34-922b-130f1f35aa27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:52:06 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-cacdbea1-355a-4d61-bbe6-d0161b427824 req-90df6ecd-e049-49ae-b247-02c560920ec9 service nova] Releasing lock "refresh_cache-94a78a45-c802-4df9-aa62-86209a7d833a" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:52:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:52:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:52:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:52:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:52:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:52:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:52:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:52:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Acquiring lock "94a78a45-c802-4df9-aa62-86209a7d833a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:52:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "94a78a45-c802-4df9-aa62-86209a7d833a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:52:10 user nova-compute[74348]: DEBUG nova.objects.instance [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lazy-loading 'flavor' on Instance uuid 94a78a45-c802-4df9-aa62-86209a7d833a {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:52:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "94a78a45-c802-4df9-aa62-86209a7d833a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:52:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Acquiring lock "94a78a45-c802-4df9-aa62-86209a7d833a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:52:10 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "94a78a45-c802-4df9-aa62-86209a7d833a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:52:10 user nova-compute[74348]: INFO nova.compute.manager [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Attaching volume 3e6674cc-3c19-4876-a692-ca66f5ef47a9 to /dev/vdb
Nov 22 08:52:10 user nova-compute[74348]: DEBUG os_brick.utils [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:52:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:52:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:52:10 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3019c85c-f7c6-40ca-9535-c311edb369e9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:52:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:52:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:52:10 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea70766-ae16-4703-95d1-2a26aca8fe28]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:52:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:52:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:52:10 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f389d6e-4bf1-4be6-81a9-0f47c8fed14f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:52:10 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ce2a02-2e60-40d9-a713-fb04d49f553f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:52:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:52:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:52:10 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 08:52:10 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:52:11 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:52:11 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 08:52:11 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[548a0522-b2ce-4dc1-9d79-6d4443de9b2d]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:52:11 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 08:52:11 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 08:52:11 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 08:52:11 user nova-compute[74348]: DEBUG os_brick.utils [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:52:11 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Updating existing volume attachment record: 27cea2cc-e6ee-4e34-b2fb-5965bb6c3bcc {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 08:52:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:52:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KCslUVde', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:52:16 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:52:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:52:16 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:52:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:52:16 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 08:52:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9 -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0157c888-341f-4db6-9675-a65be714e3dc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 08:52:16 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a72a11-94b4-4b6c-ae6f-637fc699190e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9] added
Nov 22 08:52:16 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fa179f-4624-48e6-9559-5f27d59fe72c]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b32cc5d-82d8-448c-b623-8cc7d3bf0b93]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KCslUVde {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KCslUVde" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1c64e7-3526-4e4b-8688-6c95126d0f9e]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KCslUVde'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc8f9b2-54e6-4690-a290-dbe4eb6bf63e]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c436a64-7299-4f62-a45e-387700f264a6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 22 08:52:16 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 22 08:52:16 user nova-compute[74348]:  {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:52:16 user nova-compute[74348]: WARNING os_brick.initiator.connectors.iscsi [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 22 08:52:16 user nova-compute[74348]: 
Nov 22 08:52:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9 -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1928df6f-f031-4b58-99c8-5dfd2ece048c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9, portal: 172.16.0.220,3260]
Nov 22 08:52:16 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9, portal: 172.16.0.220,3260] successful.
Nov 22 08:52:16 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52a34d5-c6a1-46c3-8e62-6f972dbdc946]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d967045-de5b-48a5-b7a5-2cf8d7423c1d]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9 (non-flash)
Nov 22 08:52:16 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9 (non-flash)
Nov 22 08:52:16 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.240s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b29ecf-6e5e-449c-bbd2-b52c64bc7e7e]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:52:16 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: None {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:52:17 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:52:17 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KCslUVde', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 08:52:17 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.270s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:52:17 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] <== connect_volume: return (1272ms) {'type': 'block', 'scsi_wwn': '23335313433383937', 'path': '/dev/sdb'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:52:17 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335313433383937', 'path': '/dev/sdb'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 08:52:17 user nova-compute[74348]: DEBUG nova.objects.instance [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lazy-loading 'flavor' on Instance uuid 94a78a45-c802-4df9-aa62-86209a7d833a {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:52:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 08:52:18 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:52:18 user nova-compute[74348]:   <source dev="/dev/sdb"/>
Nov 22 08:52:18 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:52:18 user nova-compute[74348]:   <serial>3e6674cc-3c19-4876-a692-ca66f5ef47a9</serial>
Nov 22 08:52:18 user nova-compute[74348]: </disk>
Nov 22 08:52:18 user nova-compute[74348]:  {{(pid=74348) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 08:52:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:52:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:52:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:52:18 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] No VIF found with MAC fa:16:3e:6a:be:ae, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:52:18 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-0decce1b-e903-4e59-9974-b450f13a1e19 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "94a78a45-c802-4df9-aa62-86209a7d833a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.722s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:52:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:52:20 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:52:22 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:52:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:52:23 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:52:23 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:52:23 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Rebuilding the list of instances to heal {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 08:52:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-94a78a45-c802-4df9-aa62-86209a7d833a" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:52:23 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-94a78a45-c802-4df9-aa62-86209a7d833a" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:52:23 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 08:52:23 user nova-compute[74348]: DEBUG nova.objects.instance [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lazy-loading 'info_cache' on Instance uuid 94a78a45-c802-4df9-aa62-86209a7d833a {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:52:24 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Updating instance_info_cache with network_info: [{"id": "92a9e823-5e7d-4c34-922b-130f1f35aa27", "address": "fa:16:3e:6a:be:ae", "network": {"id": "8b432d85-b70b-4445-a161-89a54b510566", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1533482890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b921bea0c3c49afa681bb8860438aa6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a9e823-5e", "ovs_interfaceid": "92a9e823-5e7d-4c34-922b-130f1f35aa27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:52:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-94a78a45-c802-4df9-aa62-86209a7d833a" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:52:24 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 08:52:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:52:27 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:52:27 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:52:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:52:29 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:52:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:52:30 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:52:31 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:52:31 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:52:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-761c2c25-a55a-4075-9bf3-2b4887a21761 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Acquiring lock "94a78a45-c802-4df9-aa62-86209a7d833a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:52:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-761c2c25-a55a-4075-9bf3-2b4887a21761 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "94a78a45-c802-4df9-aa62-86209a7d833a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:52:32 user nova-compute[74348]: INFO nova.compute.manager [None req-761c2c25-a55a-4075-9bf3-2b4887a21761 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Detaching volume 3e6674cc-3c19-4876-a692-ca66f5ef47a9
Nov 22 08:52:32 user nova-compute[74348]: INFO nova.virt.block_device [None req-761c2c25-a55a-4075-9bf3-2b4887a21761 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Attempting to driver detach volume 3e6674cc-3c19-4876-a692-ca66f5ef47a9 from mountpoint /dev/vdb
Nov 22 08:52:32 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-761c2c25-a55a-4075-9bf3-2b4887a21761 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Attempting to detach device vdb from instance 94a78a45-c802-4df9-aa62-86209a7d833a from the persistent domain config. {{(pid=74348) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 08:52:32 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-761c2c25-a55a-4075-9bf3-2b4887a21761 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:52:32 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:52:32 user nova-compute[74348]:   <source dev="/dev/sdb"/>
Nov 22 08:52:32 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:52:32 user nova-compute[74348]:   <serial>3e6674cc-3c19-4876-a692-ca66f5ef47a9</serial>
Nov 22 08:52:32 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 08:52:32 user nova-compute[74348]: </disk>
Nov 22 08:52:32 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:52:32 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-761c2c25-a55a-4075-9bf3-2b4887a21761 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Successfully detached device vdb from instance 94a78a45-c802-4df9-aa62-86209a7d833a from the persistent domain config.
Nov 22 08:52:32 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-761c2c25-a55a-4075-9bf3-2b4887a21761 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 94a78a45-c802-4df9-aa62-86209a7d833a from the live domain config. {{(pid=74348) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 08:52:32 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-761c2c25-a55a-4075-9bf3-2b4887a21761 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:52:32 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:52:32 user nova-compute[74348]:   <source dev="/dev/sdb"/>
Nov 22 08:52:32 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:52:32 user nova-compute[74348]:   <serial>3e6674cc-3c19-4876-a692-ca66f5ef47a9</serial>
Nov 22 08:52:32 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 08:52:32 user nova-compute[74348]: </disk>
Nov 22 08:52:32 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:52:32 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:52:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:52:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:52:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:52:32 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:52:32 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-761c2c25-a55a-4075-9bf3-2b4887a21761 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 94a78a45-c802-4df9-aa62-86209a7d833a {{(pid=74348) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 08:52:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a78a45-c802-4df9-aa62-86209a7d833a/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:52:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a78a45-c802-4df9-aa62-86209a7d833a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:52:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a78a45-c802-4df9-aa62-86209a7d833a/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:52:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a78a45-c802-4df9-aa62-86209a7d833a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:52:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:52:33 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:52:33 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:52:33 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=9033MB free_disk=24.821521759033203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:52:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:52:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:52:33 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 94a78a45-c802-4df9-aa62-86209a7d833a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:52:33 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:52:33 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:52:33 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:52:33 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:52:33 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:52:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:52:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:52:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:52:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:52:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:52:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:52:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:52:40 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:52:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:52:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:52:52 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-761c2c25-a55a-4075-9bf3-2b4887a21761 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 94a78a45-c802-4df9-aa62-86209a7d833a is timed out.
Nov 22 08:52:52 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-761c2c25-a55a-4075-9bf3-2b4887a21761 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Successfully detached device vdb from instance 94a78a45-c802-4df9-aa62-86209a7d833a from the live domain config.
Nov 22 08:52:52 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-761c2c25-a55a-4075-9bf3-2b4887a21761 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 08:52:52 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c2c25-a55a-4075-9bf3-2b4887a21761 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KCslUVde', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:52:52 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-761c2c25-a55a-4075-9bf3-2b4887a21761 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:52:52 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-761c2c25-a55a-4075-9bf3-2b4887a21761 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:52:52 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-761c2c25-a55a-4075-9bf3-2b4887a21761 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:52:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:52:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:52:52 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6560158-9d49-47cc-a635-01a92ce8cea4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:52:52 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c2c25-a55a-4075-9bf3-2b4887a21761 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 08:52:52 user nova-compute[74348]: No targets found.
Nov 22 08:52:52 user nova-compute[74348]: iSNS:
Nov 22 08:52:52 user nova-compute[74348]: No targets found.
Nov 22 08:52:52 user nova-compute[74348]: STATIC:
Nov 22 08:52:52 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9
Nov 22 08:52:52 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:52:52 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:52:52 user nova-compute[74348]: FIRMWARE:
Nov 22 08:52:52 user nova-compute[74348]: No targets found.
Nov 22 08:52:52 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:52:52 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c2c25-a55a-4075-9bf3-2b4887a21761 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 08:52:52 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 08:52:52 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 08:52:52 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c2c25-a55a-4075-9bf3-2b4887a21761 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 08:52:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:52:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:52:52 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9dda05-b80c-4160-b269-a5ad5187c053]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:52:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:52:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:52:52 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f83e66-6540-4b63-baf9-3b70580fa393]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:52:52 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c2c25-a55a-4075-9bf3-2b4887a21761 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9 (non-flash)
Nov 22 08:52:52 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:52:52 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c2c25-a55a-4075-9bf3-2b4887a21761 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9 (non-flash)
Nov 22 08:52:52 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:52:52 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c2c25-a55a-4075-9bf3-2b4887a21761 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f22285bfeb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9'): ({'sdb'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 08:52:52 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-761c2c25-a55a-4075-9bf3-2b4887a21761 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Removing single pathed devices sdb {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 08:52:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:52:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:52:52 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5d67a8-d640-4dad-9665-b03038084ba0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:52:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:52:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:52:52 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d659810c-8129-4f89-9769-d2fa34efc18c]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:52:52 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-761c2c25-a55a-4075-9bf3-2b4887a21761 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Flushing IO for device /dev/sdb {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 08:52:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:52:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:52:52 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1d8a32-dfb0-43da-bdad-fdb786035e53]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:52:52 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-761c2c25-a55a-4075-9bf3-2b4887a21761 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 08:52:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:52:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:52:52 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1398f28-acfd-4e45-ad04-cc021ac1941d]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:52:52 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-761c2c25-a55a-4075-9bf3-2b4887a21761 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 08:52:52 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-761c2c25-a55a-4075-9bf3-2b4887a21761 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] SCSI volumes sdb have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 08:52:52 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c2c25-a55a-4075-9bf3-2b4887a21761 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 08:52:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:52:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:52:52 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c38447-8f2d-4a3c-a89f-4ad6ee21cb56]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:52:52 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c2c25-a55a-4075-9bf3-2b4887a21761 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:52:52 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9 -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:52:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:52:53 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2761b8-dbb1-4fb4-abc7-74133c9abdd7]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:52:53 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c2c25-a55a-4075-9bf3-2b4887a21761 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9, portal: 172.16.0.220,3260]
Nov 22 08:52:53 user nova-compute[74348]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9, portal: 172.16.0.220,3260] successful.
Nov 22 08:52:53 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:52:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9 -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:52:53 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6674cc-3c19-4876-a692-ca66f5ef47a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:52:53 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb33196-2ba2-4ec4-814d-977efab16e0d]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:52:53 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c2c25-a55a-4075-9bf3-2b4887a21761 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:52:53 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-761c2c25-a55a-4075-9bf3-2b4887a21761 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:52:53 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c2c25-a55a-4075-9bf3-2b4887a21761 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] <== disconnect_volume: return (286ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:52:53 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-761c2c25-a55a-4075-9bf3-2b4887a21761 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 08:52:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:52:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:52:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:52:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:52:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:52:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:52:53 user nova-compute[74348]: DEBUG nova.objects.instance [None req-761c2c25-a55a-4075-9bf3-2b4887a21761 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lazy-loading 'flavor' on Instance uuid 94a78a45-c802-4df9-aa62-86209a7d833a {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:52:53 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-761c2c25-a55a-4075-9bf3-2b4887a21761 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "94a78a45-c802-4df9-aa62-86209a7d833a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.608s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:52:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:52:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:52:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:52:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:52:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:52:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:53:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:53:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:53:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:53:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:53:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:53:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:53:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:53:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:53:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:53:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:53:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:53:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:53:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:53:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:53:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:53:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:53:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:53:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:53:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:53:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:53:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:53:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:53:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:53:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:53:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:53:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:53:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:53:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:53:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:53:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:53:23 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:53:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Acquiring lock "94a78a45-c802-4df9-aa62-86209a7d833a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:53:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "94a78a45-c802-4df9-aa62-86209a7d833a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:53:24 user nova-compute[74348]: DEBUG nova.objects.instance [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lazy-loading 'flavor' on Instance uuid 94a78a45-c802-4df9-aa62-86209a7d833a {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:53:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "94a78a45-c802-4df9-aa62-86209a7d833a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:53:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Acquiring lock "94a78a45-c802-4df9-aa62-86209a7d833a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:53:24 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "94a78a45-c802-4df9-aa62-86209a7d833a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:53:24 user nova-compute[74348]: INFO nova.compute.manager [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Attaching volume da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c to /dev/vdb
Nov 22 08:53:24 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:53:24 user nova-compute[74348]: DEBUG os_brick.utils [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:53:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:53:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:53:24 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c630573-c302-4ba4-90d3-612a5c5d188f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:53:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:53:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:53:24 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ca9736-5475-432b-9c13-f8a28371e5b2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:53:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:53:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:53:24 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7baa1b9d-2eb2-465f-970d-42779cad50d7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:53:24 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd419dbf-9afa-4a5d-8a94-512387b323e4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:53:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:53:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:53:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 08:53:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:53:24 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:53:24 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 08:53:24 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57bfe7c-0a27-4cdf-8edd-0dcd10599f12]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:53:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 08:53:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 08:53:24 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 08:53:24 user nova-compute[74348]: DEBUG os_brick.utils [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:53:24 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Updating existing volume attachment record: 6bde8935-27a0-4ef4-a9d6-d406aa8ce886 {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 08:53:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:53:25 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:53:25 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:53:25 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Rebuilding the list of instances to heal {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 08:53:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-94a78a45-c802-4df9-aa62-86209a7d833a" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:53:25 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-94a78a45-c802-4df9-aa62-86209a7d833a" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:53:25 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 08:53:25 user nova-compute[74348]: DEBUG nova.objects.instance [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lazy-loading 'info_cache' on Instance uuid 94a78a45-c802-4df9-aa62-86209a7d833a {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:53:26 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Updating instance_info_cache with network_info: [{"id": "92a9e823-5e7d-4c34-922b-130f1f35aa27", "address": "fa:16:3e:6a:be:ae", "network": {"id": "8b432d85-b70b-4445-a161-89a54b510566", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1533482890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b921bea0c3c49afa681bb8860438aa6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a9e823-5e", "ovs_interfaceid": "92a9e823-5e7d-4c34-922b-130f1f35aa27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:53:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-94a78a45-c802-4df9-aa62-86209a7d833a" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:53:26 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 08:53:27 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:53:28 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:53:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KpGuLFBj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:53:30 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:53:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:53:30 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:53:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:53:30 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 08:53:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05742b9-d722-44d5-8c51-557709ed1f7d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 08:53:30 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[171c316a-4ccc-4d26-b17b-2b2e924535b3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c] added
Nov 22 08:53:30 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d259f5ae-0aad-4b5d-8df1-7d78b3d5d890]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c742e8a7-2fcd-4344-b261-2c6d15494c64]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KpGuLFBj {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KpGuLFBj" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f105fa1-5336-47a7-bff5-07a155c1fb06]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KpGuLFBj'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01bac47-a541-4f3a-81a6-33174b1b9be9]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb654e16-4733-406c-bb2d-3e879e1410d4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 22 08:53:30 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 22 08:53:30 user nova-compute[74348]:  {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:53:30 user nova-compute[74348]: WARNING os_brick.initiator.connectors.iscsi [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 22 08:53:30 user nova-compute[74348]: 
Nov 22 08:53:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc97f98-27e9-495f-8ee2-6d5b151654a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c, portal: 172.16.0.220,3260]
Nov 22 08:53:30 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c, portal: 172.16.0.220,3260] successful.
Nov 22 08:53:30 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d584a94-359f-4f2d-ac8c-413c4a9736d5]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1578a232-3a9d-4a6c-96f7-ccefa2c9f389]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c (non-flash)
Nov 22 08:53:30 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c (non-flash)
Nov 22 08:53:30 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7482f199-7ca5-4992-a402-6efbfc393608]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:53:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KpGuLFBj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 08:53:31 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:53:31 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:53:31 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:53:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:53:31 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '26563663437343430', 'path': '/dev/sdb'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:53:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563663437343430', 'path': '/dev/sdb'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 08:53:31 user nova-compute[74348]: DEBUG nova.objects.instance [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lazy-loading 'flavor' on Instance uuid 94a78a45-c802-4df9-aa62-86209a7d833a {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:53:31 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 08:53:31 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:53:31 user nova-compute[74348]:   <source dev="/dev/sdb"/>
Nov 22 08:53:31 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:53:31 user nova-compute[74348]:   <serial>da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c</serial>
Nov 22 08:53:31 user nova-compute[74348]: </disk>
Nov 22 08:53:31 user nova-compute[74348]:  {{(pid=74348) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 08:53:32 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:53:32 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:53:32 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] No VIF found with MAC fa:16:3e:6a:be:ae, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:53:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-31544618-2f85-42f8-a80a-a2d0fac63e9e tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "94a78a45-c802-4df9-aa62-86209a7d833a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.743s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:53:32 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:53:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:53:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:53:32 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:53:32 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:53:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a78a45-c802-4df9-aa62-86209a7d833a/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:53:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a78a45-c802-4df9-aa62-86209a7d833a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:53:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a78a45-c802-4df9-aa62-86209a7d833a/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:53:32 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a78a45-c802-4df9-aa62-86209a7d833a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:53:32 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74348) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 08:53:33 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:53:33 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:53:33 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=9014MB free_disk=24.820598602294922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:53:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:53:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:53:33 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 94a78a45-c802-4df9-aa62-86209a7d833a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:53:33 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:53:33 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:53:33 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:53:33 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:53:33 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:53:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:53:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:53:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:53:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:53:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:53:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:53:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:53:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-5bc06648-2312-4e2b-b396-5ce297403c15 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Acquiring lock "94a78a45-c802-4df9-aa62-86209a7d833a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:53:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-5bc06648-2312-4e2b-b396-5ce297403c15 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "94a78a45-c802-4df9-aa62-86209a7d833a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:53:34 user nova-compute[74348]: INFO nova.compute.manager [None req-5bc06648-2312-4e2b-b396-5ce297403c15 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Detaching volume da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c
Nov 22 08:53:34 user nova-compute[74348]: INFO nova.virt.block_device [None req-5bc06648-2312-4e2b-b396-5ce297403c15 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Attempting to driver detach volume da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c from mountpoint /dev/vdb
Nov 22 08:53:34 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-5bc06648-2312-4e2b-b396-5ce297403c15 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Attempting to detach device vdb from instance 94a78a45-c802-4df9-aa62-86209a7d833a from the persistent domain config. {{(pid=74348) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 08:53:34 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-5bc06648-2312-4e2b-b396-5ce297403c15 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:53:34 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:53:34 user nova-compute[74348]:   <source dev="/dev/sdb"/>
Nov 22 08:53:34 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:53:34 user nova-compute[74348]:   <serial>da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c</serial>
Nov 22 08:53:34 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 08:53:34 user nova-compute[74348]: </disk>
Nov 22 08:53:34 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:53:34 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-5bc06648-2312-4e2b-b396-5ce297403c15 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Successfully detached device vdb from instance 94a78a45-c802-4df9-aa62-86209a7d833a from the persistent domain config.
Nov 22 08:53:34 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-5bc06648-2312-4e2b-b396-5ce297403c15 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 94a78a45-c802-4df9-aa62-86209a7d833a from the live domain config. {{(pid=74348) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 08:53:34 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-5bc06648-2312-4e2b-b396-5ce297403c15 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:53:34 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:53:34 user nova-compute[74348]:   <source dev="/dev/sdb"/>
Nov 22 08:53:34 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:53:34 user nova-compute[74348]:   <serial>da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c</serial>
Nov 22 08:53:34 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 08:53:34 user nova-compute[74348]: </disk>
Nov 22 08:53:34 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:53:35 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-5bc06648-2312-4e2b-b396-5ce297403c15 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 94a78a45-c802-4df9-aa62-86209a7d833a {{(pid=74348) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 08:53:35 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:53:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:53:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:53:45 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:53:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:53:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:53:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:53:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:53:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:53:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:53:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:53:55 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-5bc06648-2312-4e2b-b396-5ce297403c15 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 94a78a45-c802-4df9-aa62-86209a7d833a is timed out.
Nov 22 08:53:55 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-5bc06648-2312-4e2b-b396-5ce297403c15 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Successfully detached device vdb from instance 94a78a45-c802-4df9-aa62-86209a7d833a from the live domain config.
Nov 22 08:53:55 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bc06648-2312-4e2b-b396-5ce297403c15 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc06648-2312-4e2b-b396-5ce297403c15 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KpGuLFBj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:53:55 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-5bc06648-2312-4e2b-b396-5ce297403c15 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:53:55 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-5bc06648-2312-4e2b-b396-5ce297403c15 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-5bc06648-2312-4e2b-b396-5ce297403c15 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9f17da-b868-4c21-ac49-6e0e1a1feceb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc06648-2312-4e2b-b396-5ce297403c15 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 08:53:55 user nova-compute[74348]: No targets found.
Nov 22 08:53:55 user nova-compute[74348]: iSNS:
Nov 22 08:53:55 user nova-compute[74348]: No targets found.
Nov 22 08:53:55 user nova-compute[74348]: STATIC:
Nov 22 08:53:55 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c
Nov 22 08:53:55 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:53:55 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:53:55 user nova-compute[74348]: FIRMWARE:
Nov 22 08:53:55 user nova-compute[74348]: No targets found.
Nov 22 08:53:55 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc06648-2312-4e2b-b396-5ce297403c15 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 08:53:55 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 08:53:55 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc06648-2312-4e2b-b396-5ce297403c15 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e0799d-cb62-4a4e-b07a-579516e00438]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e7e0a9-1538-4135-8542-4d4c248b46ae]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc06648-2312-4e2b-b396-5ce297403c15 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c (non-flash)
Nov 22 08:53:55 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc06648-2312-4e2b-b396-5ce297403c15 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c (non-flash)
Nov 22 08:53:55 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc06648-2312-4e2b-b396-5ce297403c15 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f22285adab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c'): ({'sdb'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-5bc06648-2312-4e2b-b396-5ce297403c15 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Removing single pathed devices sdb {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d91f58f-735a-4095-9c82-81d39e7169db]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1bc855-3801-4b48-81af-d8bab373d9b7]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-5bc06648-2312-4e2b-b396-5ce297403c15 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Flushing IO for device /dev/sdb {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[90401503-62b1-45a8-bde4-b3b360a2791b]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-5bc06648-2312-4e2b-b396-5ce297403c15 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da81f60-077d-45b1-ba97-dc2e90cd0ca4]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-5bc06648-2312-4e2b-b396-5ce297403c15 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-5bc06648-2312-4e2b-b396-5ce297403c15 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] SCSI volumes sdb have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc06648-2312-4e2b-b396-5ce297403c15 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8fcde50-534c-466e-be67-edfcc53e7ae0]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc06648-2312-4e2b-b396-5ce297403c15 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[23dbd2ca-d618-4882-8bbb-3c0f3c5656d5]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc06648-2312-4e2b-b396-5ce297403c15 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c, portal: 172.16.0.220,3260]
Nov 22 08:53:55 user nova-compute[74348]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c, portal: 172.16.0.220,3260] successful.
Nov 22 08:53:55 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9e2a55-9c0f-4eeb-ab41-e7deff4ecc0c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc92767-7ebd-4166-9714-333fc4f56dea]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc06648-2312-4e2b-b396-5ce297403c15 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-5bc06648-2312-4e2b-b396-5ce297403c15 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc06648-2312-4e2b-b396-5ce297403c15 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] <== disconnect_volume: return (295ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:53:55 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bc06648-2312-4e2b-b396-5ce297403c15 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 08:53:56 user nova-compute[74348]: DEBUG nova.objects.instance [None req-5bc06648-2312-4e2b-b396-5ce297403c15 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lazy-loading 'flavor' on Instance uuid 94a78a45-c802-4df9-aa62-86209a7d833a {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:53:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-5bc06648-2312-4e2b-b396-5ce297403c15 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "94a78a45-c802-4df9-aa62-86209a7d833a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.792s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:53:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:53:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:53:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:53:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:53:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:53:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:54:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:54:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:54:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:54:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:54:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:54:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:54:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:54:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:54:17 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:54:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:54:22 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:54:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:54:25 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:54:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Acquiring lock "94a78a45-c802-4df9-aa62-86209a7d833a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:54:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "94a78a45-c802-4df9-aa62-86209a7d833a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:54:26 user nova-compute[74348]: DEBUG nova.objects.instance [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lazy-loading 'flavor' on Instance uuid 94a78a45-c802-4df9-aa62-86209a7d833a {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:54:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "94a78a45-c802-4df9-aa62-86209a7d833a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:54:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Acquiring lock "94a78a45-c802-4df9-aa62-86209a7d833a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:54:26 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "94a78a45-c802-4df9-aa62-86209a7d833a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:54:26 user nova-compute[74348]: INFO nova.compute.manager [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Attaching volume c1729316-8e83-4288-9b33-7342eb607f21 to /dev/vdb
Nov 22 08:54:26 user nova-compute[74348]: DEBUG os_brick.utils [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:54:26 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:54:26 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:54:26 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3247bc58-6e7b-4ab7-88e1-e1f2005dc51d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:54:26 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:54:26 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:54:26 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bf3a2a-9be0-4373-8bdb-b58def693ffe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:54:26 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:54:26 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:54:26 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2299df-5d9b-43d5-bf5c-315b0c145e8c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:54:26 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8c31db-7230-487d-8858-69f915e1b6b1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:54:26 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:54:26 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:54:26 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 08:54:26 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:54:26 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:54:26 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 08:54:26 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[642e8f94-dccd-43d2-9da5-5abd4003394b]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:54:26 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 08:54:26 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 08:54:26 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 08:54:26 user nova-compute[74348]: DEBUG os_brick.utils [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:54:26 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Updating existing volume attachment record: 8b00fa3e-1a45-4182-a1db-8ff137e9266c {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 08:54:27 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:54:27 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:54:27 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Rebuilding the list of instances to heal {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 08:54:27 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-94a78a45-c802-4df9-aa62-86209a7d833a" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:54:27 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-94a78a45-c802-4df9-aa62-86209a7d833a" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:54:27 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 08:54:27 user nova-compute[74348]: DEBUG nova.objects.instance [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lazy-loading 'info_cache' on Instance uuid 94a78a45-c802-4df9-aa62-86209a7d833a {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:54:28 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Updating instance_info_cache with network_info: [{"id": "92a9e823-5e7d-4c34-922b-130f1f35aa27", "address": "fa:16:3e:6a:be:ae", "network": {"id": "8b432d85-b70b-4445-a161-89a54b510566", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1533482890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b921bea0c3c49afa681bb8860438aa6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a9e823-5e", "ovs_interfaceid": "92a9e823-5e7d-4c34-922b-130f1f35aa27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:54:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-94a78a45-c802-4df9-aa62-86209a7d833a" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:54:28 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 08:54:28 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:54:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:54:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:54:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:54:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:54:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:54:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:54:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:54:30 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:54:30 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:54:32 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:54:32 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:54:32 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:54:33 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:54:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:54:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:54:33 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:54:33 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:54:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:54:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a78a45-c802-4df9-aa62-86209a7d833a/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:54:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a78a45-c802-4df9-aa62-86209a7d833a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:54:33 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a78a45-c802-4df9-aa62-86209a7d833a/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a78a45-c802-4df9-aa62-86209a7d833a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:54:34 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:54:34 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:54:34 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=9018MB free_disk=24.819782257080078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 94a78a45-c802-4df9-aa62-86209a7d833a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vQXSHoAj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:54:34 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:54:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:54:34 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:54:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:54:34 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 08:54:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21 -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Refreshing inventories for resource provider 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b8cfd4-a656-4ebf-b4d8-9a7537a33607]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 08:54:34 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21 -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5f5106-c7fd-4d09-b21c-9b1dd03e542f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21] added
Nov 22 08:54:34 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Updating ProviderTree inventory for provider 52690f6a-773f-4e8d-be85-d278b6522975 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Updating inventory in ProviderTree for provider 52690f6a-773f-4e8d-be85-d278b6522975 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Refreshing aggregate associations for resource provider 52690f6a-773f-4e8d-be85-d278b6522975, aggregates: None {{(pid=74348) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b410da5a-25d7-4756-a97a-72a79c2313c6]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e568481d-d550-4da9-8523-a4e3586655cb]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vQXSHoAj {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Refreshing trait associations for resource provider 52690f6a-773f-4e8d-be85-d278b6522975, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=74348) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vQXSHoAj" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[323d2dcb-85b8-4868-9e83-c2cd8347c550]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vQXSHoAj'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5cb6cc7-e9af-405e-836e-c77d5360eee3]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[10069492-4a8e-49a5-ad4e-8cbb8cd1eb89]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 22 08:54:34 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 22 08:54:34 user nova-compute[74348]:  {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:54:34 user nova-compute[74348]: WARNING os_brick.initiator.connectors.iscsi [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 22 08:54:34 user nova-compute[74348]: 
Nov 22 08:54:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21 -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.297s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[365fc089-7295-439d-92f9-ee6956915b60]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21, portal: 172.16.0.220,3260]
Nov 22 08:54:34 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21, portal: 172.16.0.220,3260] successful.
Nov 22 08:54:34 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a46d47e-2b8e-440d-b658-d4778d96ae32]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1dc1988-b57e-4c29-84e5-d3daa4bbebf5]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21 (non-flash)
Nov 22 08:54:34 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21 (non-flash)
Nov 22 08:54:34 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c378faa8-30f9-4e91-8d09-4c79a9f24eac]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:54:34 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:54:35 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:54:35 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:54:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vQXSHoAj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 08:54:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:54:35 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23766643130666234', 'path': '/dev/sdb'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:54:35 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766643130666234', 'path': '/dev/sdb'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 08:54:35 user nova-compute[74348]: DEBUG nova.objects.instance [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lazy-loading 'flavor' on Instance uuid 94a78a45-c802-4df9-aa62-86209a7d833a {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:54:35 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 08:54:35 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:54:35 user nova-compute[74348]:   <source dev="/dev/sdb"/>
Nov 22 08:54:35 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:54:35 user nova-compute[74348]:   <serial>c1729316-8e83-4288-9b33-7342eb607f21</serial>
Nov 22 08:54:35 user nova-compute[74348]: </disk>
Nov 22 08:54:35 user nova-compute[74348]:  {{(pid=74348) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 08:54:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:54:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:54:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] No VIF found with MAC fa:16:3e:6a:be:ae, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:54:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-a128c70d-f0f2-412d-b96e-e3b97597c0d0 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "94a78a45-c802-4df9-aa62-86209a7d833a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.585s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:54:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d6f16d41-ba47-4f23-8c28-a3d9635ef983 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Acquiring lock "94a78a45-c802-4df9-aa62-86209a7d833a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:54:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d6f16d41-ba47-4f23-8c28-a3d9635ef983 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "94a78a45-c802-4df9-aa62-86209a7d833a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:54:38 user nova-compute[74348]: INFO nova.compute.manager [None req-d6f16d41-ba47-4f23-8c28-a3d9635ef983 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Detaching volume c1729316-8e83-4288-9b33-7342eb607f21
Nov 22 08:54:38 user nova-compute[74348]: INFO nova.virt.block_device [None req-d6f16d41-ba47-4f23-8c28-a3d9635ef983 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Attempting to driver detach volume c1729316-8e83-4288-9b33-7342eb607f21 from mountpoint /dev/vdb
Nov 22 08:54:38 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-d6f16d41-ba47-4f23-8c28-a3d9635ef983 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Attempting to detach device vdb from instance 94a78a45-c802-4df9-aa62-86209a7d833a from the persistent domain config. {{(pid=74348) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 08:54:38 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-d6f16d41-ba47-4f23-8c28-a3d9635ef983 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:54:38 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:54:38 user nova-compute[74348]:   <source dev="/dev/sdb"/>
Nov 22 08:54:38 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:54:38 user nova-compute[74348]:   <serial>c1729316-8e83-4288-9b33-7342eb607f21</serial>
Nov 22 08:54:38 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 08:54:38 user nova-compute[74348]: </disk>
Nov 22 08:54:38 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:54:38 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-d6f16d41-ba47-4f23-8c28-a3d9635ef983 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Successfully detached device vdb from instance 94a78a45-c802-4df9-aa62-86209a7d833a from the persistent domain config.
Nov 22 08:54:38 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-d6f16d41-ba47-4f23-8c28-a3d9635ef983 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 94a78a45-c802-4df9-aa62-86209a7d833a from the live domain config. {{(pid=74348) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 08:54:38 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-d6f16d41-ba47-4f23-8c28-a3d9635ef983 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:54:38 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:54:38 user nova-compute[74348]:   <source dev="/dev/sdb"/>
Nov 22 08:54:38 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:54:38 user nova-compute[74348]:   <serial>c1729316-8e83-4288-9b33-7342eb607f21</serial>
Nov 22 08:54:38 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 08:54:38 user nova-compute[74348]: </disk>
Nov 22 08:54:38 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:54:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:54:38 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-d6f16d41-ba47-4f23-8c28-a3d9635ef983 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 94a78a45-c802-4df9-aa62-86209a7d833a {{(pid=74348) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 08:54:40 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:54:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:54:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:54:52 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:54:52 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Cleaning up deleted instances {{(pid=74348) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 22 08:54:52 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] There are 0 instances to clean {{(pid=74348) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 22 08:54:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:54:55 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:54:55 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74348) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:54:58 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-d6f16d41-ba47-4f23-8c28-a3d9635ef983 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 94a78a45-c802-4df9-aa62-86209a7d833a is timed out.
Nov 22 08:54:58 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-d6f16d41-ba47-4f23-8c28-a3d9635ef983 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Successfully detached device vdb from instance 94a78a45-c802-4df9-aa62-86209a7d833a from the live domain config.
Nov 22 08:54:58 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6f16d41-ba47-4f23-8c28-a3d9635ef983 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f16d41-ba47-4f23-8c28-a3d9635ef983 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vQXSHoAj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:54:58 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-d6f16d41-ba47-4f23-8c28-a3d9635ef983 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:54:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-d6f16d41-ba47-4f23-8c28-a3d9635ef983 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-d6f16d41-ba47-4f23-8c28-a3d9635ef983 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff2a81f-4c8f-4732-be59-4716c32aeaa5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f16d41-ba47-4f23-8c28-a3d9635ef983 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 08:54:58 user nova-compute[74348]: No targets found.
Nov 22 08:54:58 user nova-compute[74348]: iSNS:
Nov 22 08:54:58 user nova-compute[74348]: No targets found.
Nov 22 08:54:58 user nova-compute[74348]: STATIC:
Nov 22 08:54:58 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21
Nov 22 08:54:58 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:54:58 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:54:58 user nova-compute[74348]: FIRMWARE:
Nov 22 08:54:58 user nova-compute[74348]: No targets found.
Nov 22 08:54:58 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f16d41-ba47-4f23-8c28-a3d9635ef983 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 08:54:58 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 08:54:58 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f16d41-ba47-4f23-8c28-a3d9635ef983 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d6c448-9eeb-4479-b427-6fa924fd0b58]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba88dcf8-8e23-429c-bba8-06e7a36e807b]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21 (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f16d41-ba47-4f23-8c28-a3d9635ef983 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21 (non-flash)
Nov 22 08:54:58 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f16d41-ba47-4f23-8c28-a3d9635ef983 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21 (non-flash)
Nov 22 08:54:58 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f16d41-ba47-4f23-8c28-a3d9635ef983 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f224c710310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21'): ({'sdb'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-d6f16d41-ba47-4f23-8c28-a3d9635ef983 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Removing single pathed devices sdb {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cec76c1-563d-4fa6-8789-4f26b4a25900]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[068b7b5a-796a-4760-85a1-cf6394132275]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-d6f16d41-ba47-4f23-8c28-a3d9635ef983 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Flushing IO for device /dev/sdb {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cec46a-8ba1-4dda-a216-2e76b6264e5e]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-d6f16d41-ba47-4f23-8c28-a3d9635ef983 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0566994-9474-40bf-8c41-80be17d9a0b1]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-d6f16d41-ba47-4f23-8c28-a3d9635ef983 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-d6f16d41-ba47-4f23-8c28-a3d9635ef983 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] SCSI volumes sdb have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f16d41-ba47-4f23-8c28-a3d9635ef983 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba87654-7a47-465d-9e68-ad97ecfbafd3]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f16d41-ba47-4f23-8c28-a3d9635ef983 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21 -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d6ad5f-7eda-4fd1-a4e1-1b115dc76d01]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f16d41-ba47-4f23-8c28-a3d9635ef983 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21, portal: 172.16.0.220,3260]
Nov 22 08:54:58 user nova-compute[74348]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21, portal: 172.16.0.220,3260] successful.
Nov 22 08:54:58 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21 -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1729316-8e83-4288-9b33-7342eb607f21 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[60be986d-8b86-4460-a36f-9b77cdf7b7c8]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f16d41-ba47-4f23-8c28-a3d9635ef983 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-d6f16d41-ba47-4f23-8c28-a3d9635ef983 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f16d41-ba47-4f23-8c28-a3d9635ef983 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] <== disconnect_volume: return (271ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:54:58 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6f16d41-ba47-4f23-8c28-a3d9635ef983 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 08:54:59 user nova-compute[74348]: DEBUG nova.objects.instance [None req-d6f16d41-ba47-4f23-8c28-a3d9635ef983 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lazy-loading 'flavor' on Instance uuid 94a78a45-c802-4df9-aa62-86209a7d833a {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:54:59 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d6f16d41-ba47-4f23-8c28-a3d9635ef983 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "94a78a45-c802-4df9-aa62-86209a7d833a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.881s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:55:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:55:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:55:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:55:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:55:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:55:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:55:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:55:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:55:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:55:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:55:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:55:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:55:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:55:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:55:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:55:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:55:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:55:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:55:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:55:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:55:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:55:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:55:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:55:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:55:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:55:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:55:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:55:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:55:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:55:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:55:24 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:55:25 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:55:28 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:55:28 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:55:28 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Rebuilding the list of instances to heal {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 08:55:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-94a78a45-c802-4df9-aa62-86209a7d833a" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:55:28 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-94a78a45-c802-4df9-aa62-86209a7d833a" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:55:28 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 08:55:28 user nova-compute[74348]: DEBUG nova.objects.instance [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lazy-loading 'info_cache' on Instance uuid 94a78a45-c802-4df9-aa62-86209a7d833a {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:55:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:55:29 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Updating instance_info_cache with network_info: [{"id": "92a9e823-5e7d-4c34-922b-130f1f35aa27", "address": "fa:16:3e:6a:be:ae", "network": {"id": "8b432d85-b70b-4445-a161-89a54b510566", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1533482890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b921bea0c3c49afa681bb8860438aa6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a9e823-5e", "ovs_interfaceid": "92a9e823-5e7d-4c34-922b-130f1f35aa27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:55:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-94a78a45-c802-4df9-aa62-86209a7d833a" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:55:29 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 08:55:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:55:30 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:55:30 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:55:30 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:55:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Acquiring lock "94a78a45-c802-4df9-aa62-86209a7d833a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:55:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "94a78a45-c802-4df9-aa62-86209a7d833a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:55:30 user nova-compute[74348]: DEBUG nova.objects.instance [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lazy-loading 'flavor' on Instance uuid 94a78a45-c802-4df9-aa62-86209a7d833a {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:55:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "94a78a45-c802-4df9-aa62-86209a7d833a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:55:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Acquiring lock "94a78a45-c802-4df9-aa62-86209a7d833a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:55:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "94a78a45-c802-4df9-aa62-86209a7d833a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:55:30 user nova-compute[74348]: INFO nova.compute.manager [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Attaching volume a1dd60d2-a84f-4c26-9094-5e04c215c8ee to /dev/vdb
Nov 22 08:55:30 user nova-compute[74348]: DEBUG os_brick.utils [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:55:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:55:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:55:30 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f6c964-4eb1-4a79-94fb-f64b2b6e2687]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:20d770a46b46\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:55:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:55:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:55:30 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e2f3d6-cadb-4c8b-be12-caebc9c7da80]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:55:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:55:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:55:30 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c096761a-00c9-41ee-80c6-d22c0b8546a5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:55:30 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1923adf5-83ab-4f12-905d-8a14a0d92312]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:55:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Running cmd (subprocess): nvme version {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:55:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] 'nvme version' failed. Not Retrying. {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:55:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] nvme not present on system {{(pid=74348) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 08:55:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:55:30 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 08:55:30 user nova-compute[74348]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 08:55:30 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6409f1-9f76-432c-95fa-fb0ea4100dcf]: (4, '') {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:55:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74348) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 08:55:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 08:55:30 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.lightos [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] LIGHTOS: no hostnqn found. {{(pid=74348) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 08:55:30 user nova-compute[74348]: DEBUG os_brick.utils [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:20d770a46b46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:55:30 user nova-compute[74348]: DEBUG nova.virt.block_device [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Updating existing volume attachment record: 92da9faa-14fa-4567-b5c3-9226d154b38b {{(pid=74348) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 08:55:32 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:55:32 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:55:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:55:34 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:55:34 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:55:34 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a78a45-c802-4df9-aa62-86209a7d833a/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a78a45-c802-4df9-aa62-86209a7d833a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a78a45-c802-4df9-aa62-86209a7d833a/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:55:34 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a78a45-c802-4df9-aa62-86209a7d833a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:55:35 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:55:35 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:55:35 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:55:35 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=9026MB free_disk=24.81877899169922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:55:35 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 94a78a45-c802-4df9-aa62-86209a7d833a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:55:35 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:55:35 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:55:35 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:55:35 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:55:35 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:55:35 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Calling os-brick to attach iSCSI Volume {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tRwXJGWk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:55:36 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:55:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:55:36 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:55:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:55:36 user nova-compute[74348]: INFO os_brick.initiator.connectors.iscsi [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 08:55:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee -p 172.16.0.220:3260 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[972ac66d-742f-4e8f-8182-85bce88505c5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 08:55:36 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee -p 172.16.0.220:3260 --interface default --op new {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1a3e47-3438-48b0-a938-b2f09700935a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee] added\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee] added
Nov 22 08:55:36 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0de509-194f-4242-9602-0f03aa009ad4]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba76116e-19ed-46cf-9a4d-f431e5701511]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tRwXJGWk {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tRwXJGWk" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a05401-d233-4498-bd78-dc3e7b72318e]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tRwXJGWk'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1874560e-5513-468a-a1bd-51bbe0164ff8]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[09347a8c-5457-4317-9a5b-5601cf468945]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 22 08:55:36 user nova-compute[74348]:  {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 22 08:55:36 user nova-compute[74348]:  {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:55:36 user nova-compute[74348]: WARNING os_brick.initiator.connectors.iscsi [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 22 08:55:36 user nova-compute[74348]: 
Nov 22 08:55:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee -p 172.16.0.220:3260 --login {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d607417-f05e-4f88-9da2-45c6f844620f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee, portal: 172.16.0.220,3260]
Nov 22 08:55:36 user nova-compute[74348]: Login to [iface: default, target: iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee, portal: 172.16.0.220,3260] successful.
Nov 22 08:55:36 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c370f928-a5e4-4713-b4af-41e5a89199c8]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e747fc11-95c5-4808-a972-e3575bd41588]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee (non-flash)
Nov 22 08:55:36 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee (non-flash)
Nov 22 08:55:36 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Connected to 172.16.0.220:3260 {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=74348) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74348) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 08:55:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:55:37 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:55:37 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53dd46b-e8d7-4472-8f36-8dd81127c04e]: (4, ('- - 0', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:55:37 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: None {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:55:38 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74348) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 08:55:38 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tRwXJGWk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74348) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 08:55:38 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:55:38 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23937343563323266', 'path': '/dev/sdb'} {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:55:38 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937343563323266', 'path': '/dev/sdb'} {{(pid=74348) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 08:55:38 user nova-compute[74348]: DEBUG nova.objects.instance [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lazy-loading 'flavor' on Instance uuid 94a78a45-c802-4df9-aa62-86209a7d833a {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:55:38 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 08:55:38 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:55:38 user nova-compute[74348]:   <source dev="/dev/sdb"/>
Nov 22 08:55:38 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:55:38 user nova-compute[74348]:   <serial>a1dd60d2-a84f-4c26-9094-5e04c215c8ee</serial>
Nov 22 08:55:38 user nova-compute[74348]: </disk>
Nov 22 08:55:38 user nova-compute[74348]:  {{(pid=74348) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 08:55:38 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] No BDM found with device name vda, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:55:38 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74348) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 08:55:38 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] No VIF found with MAC fa:16:3e:6a:be:ae, not building metadata {{(pid=74348) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 08:55:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-d8b4b3ce-6e73-4887-bac4-fdc5bf8149d6 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "94a78a45-c802-4df9-aa62-86209a7d833a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.812s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:55:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:55:40 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:55:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-71a4dd3d-45c9-4e7c-8bdb-e91948f40afa tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Acquiring lock "94a78a45-c802-4df9-aa62-86209a7d833a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:55:40 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-71a4dd3d-45c9-4e7c-8bdb-e91948f40afa tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "94a78a45-c802-4df9-aa62-86209a7d833a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:55:40 user nova-compute[74348]: INFO nova.compute.manager [None req-71a4dd3d-45c9-4e7c-8bdb-e91948f40afa tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Detaching volume a1dd60d2-a84f-4c26-9094-5e04c215c8ee
Nov 22 08:55:41 user nova-compute[74348]: INFO nova.virt.block_device [None req-71a4dd3d-45c9-4e7c-8bdb-e91948f40afa tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Attempting to driver detach volume a1dd60d2-a84f-4c26-9094-5e04c215c8ee from mountpoint /dev/vdb
Nov 22 08:55:41 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-71a4dd3d-45c9-4e7c-8bdb-e91948f40afa tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Attempting to detach device vdb from instance 94a78a45-c802-4df9-aa62-86209a7d833a from the persistent domain config. {{(pid=74348) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 08:55:41 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-71a4dd3d-45c9-4e7c-8bdb-e91948f40afa tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:55:41 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:55:41 user nova-compute[74348]:   <source dev="/dev/sdb"/>
Nov 22 08:55:41 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:55:41 user nova-compute[74348]:   <serial>a1dd60d2-a84f-4c26-9094-5e04c215c8ee</serial>
Nov 22 08:55:41 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 08:55:41 user nova-compute[74348]: </disk>
Nov 22 08:55:41 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:55:41 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-71a4dd3d-45c9-4e7c-8bdb-e91948f40afa tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Successfully detached device vdb from instance 94a78a45-c802-4df9-aa62-86209a7d833a from the persistent domain config.
Nov 22 08:55:41 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-71a4dd3d-45c9-4e7c-8bdb-e91948f40afa tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 94a78a45-c802-4df9-aa62-86209a7d833a from the live domain config. {{(pid=74348) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 08:55:41 user nova-compute[74348]: DEBUG nova.virt.libvirt.guest [None req-71a4dd3d-45c9-4e7c-8bdb-e91948f40afa tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 08:55:41 user nova-compute[74348]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 08:55:41 user nova-compute[74348]:   <source dev="/dev/sdb"/>
Nov 22 08:55:41 user nova-compute[74348]:   <target dev="vdb" bus="virtio"/>
Nov 22 08:55:41 user nova-compute[74348]:   <serial>a1dd60d2-a84f-4c26-9094-5e04c215c8ee</serial>
Nov 22 08:55:41 user nova-compute[74348]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 08:55:41 user nova-compute[74348]: </disk>
Nov 22 08:55:41 user nova-compute[74348]:  {{(pid=74348) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 08:55:41 user nova-compute[74348]: DEBUG nova.virt.libvirt.driver [None req-71a4dd3d-45c9-4e7c-8bdb-e91948f40afa tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 94a78a45-c802-4df9-aa62-86209a7d833a {{(pid=74348) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 08:55:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:55:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:55:47 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:55:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:55:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:55:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:55:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:55:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:55:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:55:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:55:58 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:56:01 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-71a4dd3d-45c9-4e7c-8bdb-e91948f40afa tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 94a78a45-c802-4df9-aa62-86209a7d833a is timed out.
Nov 22 08:56:01 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-71a4dd3d-45c9-4e7c-8bdb-e91948f40afa tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Successfully detached device vdb from instance 94a78a45-c802-4df9-aa62-86209a7d833a from the live domain config.
Nov 22 08:56:01 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71a4dd3d-45c9-4e7c-8bdb-e91948f40afa tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] calling os-brick to detach iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a4dd3d-45c9-4e7c-8bdb-e91948f40afa tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f224c2f1e10>, {'target_iqn': 'iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tRwXJGWk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 08:56:01 user nova-compute[74348]: WARNING os_brick.initiator.connectors.base [None req-71a4dd3d-45c9-4e7c-8bdb-e91948f40afa tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 08:56:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-71a4dd3d-45c9-4e7c-8bdb-e91948f40afa tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-71a4dd3d-45c9-4e7c-8bdb-e91948f40afa tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf33a64-cb61-43a0-a303-d07c81337516]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a4dd3d-45c9-4e7c-8bdb-e91948f40afa tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 08:56:01 user nova-compute[74348]: No targets found.
Nov 22 08:56:01 user nova-compute[74348]: iSNS:
Nov 22 08:56:01 user nova-compute[74348]: No targets found.
Nov 22 08:56:01 user nova-compute[74348]: STATIC:
Nov 22 08:56:01 user nova-compute[74348]: Target: iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee
Nov 22 08:56:01 user nova-compute[74348]:         Portal: 172.16.0.220:3260,-1
Nov 22 08:56:01 user nova-compute[74348]:                 Iface Name: default
Nov 22 08:56:01 user nova-compute[74348]: FIRMWARE:
Nov 22 08:56:01 user nova-compute[74348]: No targets found.
Nov 22 08:56:01 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a4dd3d-45c9-4e7c-8bdb-e91948f40afa tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 08:56:01 user nova-compute[74348]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 08:56:01 user nova-compute[74348]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74348) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a4dd3d-45c9-4e7c-8bdb-e91948f40afa tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee', 0)] {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[54524e58-6a31-42f2-a61a-e08e5e20d677]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca103d3a-4250-44c6-92fd-1c83160507e1]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee (non-flash)\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a4dd3d-45c9-4e7c-8bdb-e91948f40afa tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee (non-flash)
Nov 22 08:56:01 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a4dd3d-45c9-4e7c-8bdb-e91948f40afa tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee (non-flash)
Nov 22 08:56:01 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a4dd3d-45c9-4e7c-8bdb-e91948f40afa tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f22282e8940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee'): ({'sdb'}, set())}) {{(pid=74348) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-71a4dd3d-45c9-4e7c-8bdb-e91948f40afa tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Removing single pathed devices sdb {{(pid=74348) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[866b96f3-5187-4589-925b-b7c53e09b757]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49b5344-60c0-4d84-9c00-4cac5ef24b6a]: (4, ('ok\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-71a4dd3d-45c9-4e7c-8bdb-e91948f40afa tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Flushing IO for device /dev/sdb {{(pid=74348) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3f585d-7cd5-44c9-abc4-f643fb2aa656]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-71a4dd3d-45c9-4e7c-8bdb-e91948f40afa tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74348) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ec884f-29cb-40fb-8386-33ebe9502e83]: (4, ('1', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-71a4dd3d-45c9-4e7c-8bdb-e91948f40afa tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG os_brick.initiator.linuxscsi [None req-71a4dd3d-45c9-4e7c-8bdb-e91948f40afa tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] SCSI volumes sdb have been removed. {{(pid=74348) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a4dd3d-45c9-4e7c-8bdb-e91948f40afa tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee')] {{(pid=74348) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86a3d9a-601f-49e0-a65b-0504d5fed59e]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a4dd3d-45c9-4e7c-8bdb-e91948f40afa tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee -p 172.16.0.220:3260 --logout {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3150fe43-d2d9-4300-89af-f31e2278c24c]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a4dd3d-45c9-4e7c-8bdb-e91948f40afa tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee, portal: 172.16.0.220,3260]
Nov 22 08:56:01 user nova-compute[74348]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee, portal: 172.16.0.220,3260] successful.
Nov 22 08:56:01 user nova-compute[74348]:  stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee -p 172.16.0.220:3260 --op delete {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1dd60d2-a84f-4c26-9094-5e04c215c8ee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85159) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6f2c59-e994-4ad2-9713-eaa634193832]: (4, ('', '')) {{(pid=85159) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a4dd3d-45c9-4e7c-8bdb-e91948f40afa tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74348) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.base [None req-71a4dd3d-45c9-4e7c-8bdb-e91948f40afa tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a4dd3d-45c9-4e7c-8bdb-e91948f40afa tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] <== disconnect_volume: return (305ms) None {{(pid=74348) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 08:56:01 user nova-compute[74348]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71a4dd3d-45c9-4e7c-8bdb-e91948f40afa tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Disconnected iSCSI Volume {{(pid=74348) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 08:56:02 user nova-compute[74348]: DEBUG nova.objects.instance [None req-71a4dd3d-45c9-4e7c-8bdb-e91948f40afa tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lazy-loading 'flavor' on Instance uuid 94a78a45-c802-4df9-aa62-86209a7d833a {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:56:02 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-71a4dd3d-45c9-4e7c-8bdb-e91948f40afa tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "94a78a45-c802-4df9-aa62-86209a7d833a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.614s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:56:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:56:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:56:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:56:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:56:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:56:03 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:56:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:56:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:56:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:56:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:56:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:56:08 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:56:13 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:56:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:56:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:56:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:56:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:56:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:56:18 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:56:23 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:56:25 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:56:25 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:56:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:56:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:56:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:56:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:56:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:56:28 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:56:29 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:56:29 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:56:29 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Rebuilding the list of instances to heal {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 08:56:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "refresh_cache-94a78a45-c802-4df9-aa62-86209a7d833a" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 08:56:29 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquired lock "refresh_cache-94a78a45-c802-4df9-aa62-86209a7d833a" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 08:56:29 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Forcefully refreshing network info cache for instance {{(pid=74348) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 08:56:29 user nova-compute[74348]: DEBUG nova.objects.instance [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lazy-loading 'info_cache' on Instance uuid 94a78a45-c802-4df9-aa62-86209a7d833a {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:56:30 user nova-compute[74348]: DEBUG nova.network.neutron [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Updating instance_info_cache with network_info: [{"id": "92a9e823-5e7d-4c34-922b-130f1f35aa27", "address": "fa:16:3e:6a:be:ae", "network": {"id": "8b432d85-b70b-4445-a161-89a54b510566", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1533482890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b921bea0c3c49afa681bb8860438aa6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a9e823-5e", "ovs_interfaceid": "92a9e823-5e7d-4c34-922b-130f1f35aa27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:56:30 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Releasing lock "refresh_cache-94a78a45-c802-4df9-aa62-86209a7d833a" {{(pid=74348) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 08:56:30 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Updated the network info_cache for instance {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 08:56:30 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:56:30 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:56:32 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:56:33 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:56:34 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:56:34 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:56:34 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:56:36 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:56:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:56:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:56:36 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:56:36 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:56:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a78a45-c802-4df9-aa62-86209a7d833a/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:56:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a78a45-c802-4df9-aa62-86209a7d833a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:56:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a78a45-c802-4df9-aa62-86209a7d833a/disk --force-share --output=json {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 08:56:36 user nova-compute[74348]: DEBUG oslo_concurrency.processutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a78a45-c802-4df9-aa62-86209a7d833a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74348) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 08:56:37 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:56:37 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:56:37 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=9006MB free_disk=24.81789779663086GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:56:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:56:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:56:37 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Instance 94a78a45-c802-4df9-aa62-86209a7d833a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74348) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 08:56:37 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:56:37 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:56:37 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:56:37 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:56:37 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:56:37 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.344s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:56:38 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:56:43 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:56:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:56:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:56:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74348) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 08:56:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:56:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74348) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 08:56:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:56:53 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:56:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-163d341e-8784-4d3f-95e8-830ebde38358 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Acquiring lock "94a78a45-c802-4df9-aa62-86209a7d833a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:56:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-163d341e-8784-4d3f-95e8-830ebde38358 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "94a78a45-c802-4df9-aa62-86209a7d833a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:56:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-163d341e-8784-4d3f-95e8-830ebde38358 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Acquiring lock "94a78a45-c802-4df9-aa62-86209a7d833a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:56:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-163d341e-8784-4d3f-95e8-830ebde38358 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "94a78a45-c802-4df9-aa62-86209a7d833a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:56:54 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-163d341e-8784-4d3f-95e8-830ebde38358 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "94a78a45-c802-4df9-aa62-86209a7d833a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:56:54 user nova-compute[74348]: INFO nova.compute.manager [None req-163d341e-8784-4d3f-95e8-830ebde38358 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Terminating instance
Nov 22 08:56:54 user nova-compute[74348]: DEBUG nova.compute.manager [None req-163d341e-8784-4d3f-95e8-830ebde38358 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Start destroying the instance on the hypervisor. {{(pid=74348) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 08:56:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:56:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:56:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:56:54 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:56:55 user nova-compute[74348]: DEBUG nova.compute.manager [req-309b70bd-b5d9-4b01-bc68-5f096692e5d0 req-97060789-1263-4cd8-9ab1-1957e3bb810e service nova] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Received event network-vif-unplugged-92a9e823-5e7d-4c34-922b-130f1f35aa27 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:56:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-309b70bd-b5d9-4b01-bc68-5f096692e5d0 req-97060789-1263-4cd8-9ab1-1957e3bb810e service nova] Acquiring lock "94a78a45-c802-4df9-aa62-86209a7d833a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:56:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-309b70bd-b5d9-4b01-bc68-5f096692e5d0 req-97060789-1263-4cd8-9ab1-1957e3bb810e service nova] Lock "94a78a45-c802-4df9-aa62-86209a7d833a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:56:55 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-309b70bd-b5d9-4b01-bc68-5f096692e5d0 req-97060789-1263-4cd8-9ab1-1957e3bb810e service nova] Lock "94a78a45-c802-4df9-aa62-86209a7d833a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:56:55 user nova-compute[74348]: DEBUG nova.compute.manager [req-309b70bd-b5d9-4b01-bc68-5f096692e5d0 req-97060789-1263-4cd8-9ab1-1957e3bb810e service nova] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] No waiting events found dispatching network-vif-unplugged-92a9e823-5e7d-4c34-922b-130f1f35aa27 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:56:55 user nova-compute[74348]: DEBUG nova.compute.manager [req-309b70bd-b5d9-4b01-bc68-5f096692e5d0 req-97060789-1263-4cd8-9ab1-1957e3bb810e service nova] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Received event network-vif-unplugged-92a9e823-5e7d-4c34-922b-130f1f35aa27 for instance with task_state deleting. {{(pid=74348) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 08:56:55 user nova-compute[74348]: INFO nova.virt.libvirt.driver [-] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Instance destroyed successfully.
Nov 22 08:56:55 user nova-compute[74348]: DEBUG nova.objects.instance [None req-163d341e-8784-4d3f-95e8-830ebde38358 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lazy-loading 'resources' on Instance uuid 94a78a45-c802-4df9-aa62-86209a7d833a {{(pid=74348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 08:56:55 user nova-compute[74348]: DEBUG nova.virt.libvirt.vif [None req-163d341e-8784-4d3f-95e8-830ebde38358 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T08:50:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-447732319',display_name='tempest-SnapshotDataIntegrityTests-server-447732319',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-447732319',id=53,image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHynwjZFNG8iUYPQ7MmbyqTwyFWeTKUqN+TiVeO6DCdftqIpcih05uwRW1byAbda9FNE0JS2yhy7RVcMkYyD6dRKdYKT+s3Ha47LlRTSmL5OlUevnwOkjVCQvHz1gZiApQ==',key_name='tempest-keypair-738017072',keypairs=<?>,launch_index=0,launched_at=2023-11-22T08:50:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b921bea0c3c49afa681bb8860438aa6',ramdisk_id='',reservation_id='r-mmi4d0ka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7abe07a9-4f70-41a1-a0fc-c06f9c8dd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-426804247',owner_user_name='tempest-SnapshotDataIntegrityTests-426804247-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T08:50:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fafb3a3776c243c59cce7c5ecba11172',uuid=94a78a45-c802-4df9-aa62-86209a7d833a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92a9e823-5e7d-4c34-922b-130f1f35aa27", "address": "fa:16:3e:6a:be:ae", "network": {"id": "8b432d85-b70b-4445-a161-89a54b510566", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1533482890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b921bea0c3c49afa681bb8860438aa6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a9e823-5e", "ovs_interfaceid": "92a9e823-5e7d-4c34-922b-130f1f35aa27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 08:56:55 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-163d341e-8784-4d3f-95e8-830ebde38358 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Converting VIF {"id": "92a9e823-5e7d-4c34-922b-130f1f35aa27", "address": "fa:16:3e:6a:be:ae", "network": {"id": "8b432d85-b70b-4445-a161-89a54b510566", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1533482890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b921bea0c3c49afa681bb8860438aa6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a9e823-5e", "ovs_interfaceid": "92a9e823-5e7d-4c34-922b-130f1f35aa27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 08:56:55 user nova-compute[74348]: DEBUG nova.network.os_vif_util [None req-163d341e-8784-4d3f-95e8-830ebde38358 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:be:ae,bridge_name='br-int',has_traffic_filtering=True,id=92a9e823-5e7d-4c34-922b-130f1f35aa27,network=Network(8b432d85-b70b-4445-a161-89a54b510566),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92a9e823-5e') {{(pid=74348) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 08:56:55 user nova-compute[74348]: DEBUG os_vif [None req-163d341e-8784-4d3f-95e8-830ebde38358 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:be:ae,bridge_name='br-int',has_traffic_filtering=True,id=92a9e823-5e7d-4c34-922b-130f1f35aa27,network=Network(8b432d85-b70b-4445-a161-89a54b510566),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92a9e823-5e') {{(pid=74348) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 08:56:55 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:56:55 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:56:55 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap92a9e823-5e, bridge=br-int, if_exists=True) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:56:55 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:56:55 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:56:55 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=42164c3f-6d75-4fb8-8a71-b48cf3a970d7) {{(pid=74348) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 08:56:55 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:56:55 user nova-compute[74348]: INFO os_vif [None req-163d341e-8784-4d3f-95e8-830ebde38358 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:be:ae,bridge_name='br-int',has_traffic_filtering=True,id=92a9e823-5e7d-4c34-922b-130f1f35aa27,network=Network(8b432d85-b70b-4445-a161-89a54b510566),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92a9e823-5e')
Nov 22 08:56:55 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-163d341e-8784-4d3f-95e8-830ebde38358 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Deleting instance files /opt/stack/data/nova/instances/94a78a45-c802-4df9-aa62-86209a7d833a_del
Nov 22 08:56:55 user nova-compute[74348]: INFO nova.virt.libvirt.driver [None req-163d341e-8784-4d3f-95e8-830ebde38358 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Deletion of /opt/stack/data/nova/instances/94a78a45-c802-4df9-aa62-86209a7d833a_del complete
Nov 22 08:56:55 user nova-compute[74348]: INFO nova.compute.manager [None req-163d341e-8784-4d3f-95e8-830ebde38358 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 22 08:56:55 user nova-compute[74348]: DEBUG oslo.service.loopingcall [None req-163d341e-8784-4d3f-95e8-830ebde38358 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74348) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 08:56:55 user nova-compute[74348]: DEBUG nova.compute.manager [-] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Deallocating network for instance {{(pid=74348) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 08:56:55 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] deallocate_for_instance() {{(pid=74348) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 08:56:56 user nova-compute[74348]: DEBUG nova.network.neutron [-] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Updating instance_info_cache with network_info: [] {{(pid=74348) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 08:56:56 user nova-compute[74348]: INFO nova.compute.manager [-] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Took 0.81 seconds to deallocate network for instance.
Nov 22 08:56:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-163d341e-8784-4d3f-95e8-830ebde38358 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:56:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-163d341e-8784-4d3f-95e8-830ebde38358 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:56:56 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-163d341e-8784-4d3f-95e8-830ebde38358 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:56:56 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-163d341e-8784-4d3f-95e8-830ebde38358 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:56:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-163d341e-8784-4d3f-95e8-830ebde38358 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.120s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:56:56 user nova-compute[74348]: INFO nova.scheduler.client.report [None req-163d341e-8784-4d3f-95e8-830ebde38358 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Deleted allocations for instance 94a78a45-c802-4df9-aa62-86209a7d833a
Nov 22 08:56:56 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-163d341e-8784-4d3f-95e8-830ebde38358 tempest-SnapshotDataIntegrityTests-426804247 tempest-SnapshotDataIntegrityTests-426804247-project-member] Lock "94a78a45-c802-4df9-aa62-86209a7d833a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.046s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:56:57 user nova-compute[74348]: DEBUG nova.compute.manager [req-7196ddd5-6312-444f-abf2-cbf4d535a432 req-5347f008-f469-4675-a987-3244afe7d5e2 service nova] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Received event network-vif-plugged-92a9e823-5e7d-4c34-922b-130f1f35aa27 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:56:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-7196ddd5-6312-444f-abf2-cbf4d535a432 req-5347f008-f469-4675-a987-3244afe7d5e2 service nova] Acquiring lock "94a78a45-c802-4df9-aa62-86209a7d833a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:56:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-7196ddd5-6312-444f-abf2-cbf4d535a432 req-5347f008-f469-4675-a987-3244afe7d5e2 service nova] Lock "94a78a45-c802-4df9-aa62-86209a7d833a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:56:57 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [req-7196ddd5-6312-444f-abf2-cbf4d535a432 req-5347f008-f469-4675-a987-3244afe7d5e2 service nova] Lock "94a78a45-c802-4df9-aa62-86209a7d833a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:56:57 user nova-compute[74348]: DEBUG nova.compute.manager [req-7196ddd5-6312-444f-abf2-cbf4d535a432 req-5347f008-f469-4675-a987-3244afe7d5e2 service nova] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] No waiting events found dispatching network-vif-plugged-92a9e823-5e7d-4c34-922b-130f1f35aa27 {{(pid=74348) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 08:56:57 user nova-compute[74348]: WARNING nova.compute.manager [req-7196ddd5-6312-444f-abf2-cbf4d535a432 req-5347f008-f469-4675-a987-3244afe7d5e2 service nova] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Received unexpected event network-vif-plugged-92a9e823-5e7d-4c34-922b-130f1f35aa27 for instance with vm_state deleted and task_state None.
Nov 22 08:56:57 user nova-compute[74348]: DEBUG nova.compute.manager [req-7196ddd5-6312-444f-abf2-cbf4d535a432 req-5347f008-f469-4675-a987-3244afe7d5e2 service nova] [instance: 94a78a45-c802-4df9-aa62-86209a7d833a] Received event network-vif-deleted-92a9e823-5e7d-4c34-922b-130f1f35aa27 {{(pid=74348) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 08:57:00 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:57:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:57:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:57:15 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:57:20 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:57:25 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:57:26 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:57:27 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:57:29 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:57:29 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Starting heal instance info cache {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 08:57:29 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Rebuilding the list of instances to heal {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 08:57:29 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Didn't find any instances for network info cache update. {{(pid=74348) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 08:57:30 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:57:30 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:57:32 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:57:33 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:57:35 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:57:35 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:57:36 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:57:36 user nova-compute[74348]: DEBUG nova.compute.manager [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74348) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 08:57:38 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:57:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:57:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:57:38 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:57:38 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Auditing locally available compute resources for user (node: user) {{(pid=74348) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 08:57:39 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:57:39 user nova-compute[74348]: WARNING nova.virt.libvirt.driver [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 08:57:39 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Hypervisor/Node resource view: name=user free_ram=9172MB free_disk=24.845081329345703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74348) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 08:57:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 08:57:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 08:57:39 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 08:57:39 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74348) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 08:57:39 user nova-compute[74348]: DEBUG nova.compute.provider_tree [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed in ProviderTree for provider: 52690f6a-773f-4e8d-be85-d278b6522975 {{(pid=74348) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 08:57:39 user nova-compute[74348]: DEBUG nova.scheduler.client.report [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Inventory has not changed for provider 52690f6a-773f-4e8d-be85-d278b6522975 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74348) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 08:57:39 user nova-compute[74348]: DEBUG nova.compute.resource_tracker [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Compute_service record updated for user:user {{(pid=74348) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 08:57:39 user nova-compute[74348]: DEBUG oslo_concurrency.lockutils [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.151s {{(pid=74348) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 08:57:40 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 08:57:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:57:45 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:57:48 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:57:49 user nova-compute[74348]: DEBUG oslo_service.periodic_task [None req-ea381281-4da9-44aa-bbfa-83dbead9ac3a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74348) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 08:57:50 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:57:51 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:57:55 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:58:00 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:58:05 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 08:58:10 user nova-compute[74348]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74348) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}